vix.ing · top · new · best · stats · spec

Revisiting "What Every Computer Scientist Should Know About Floating-point Arithmetic"

2020/12/04 by Lafage, Vincent
#FOS: Mathematics #G.1.0 #Numerical Analysis (math.NA)

paper · doi:10.48550/arxiv.2012.02492

Abstract

The differences between the sets in which ideal arithmetics takes place and the sets of floating point numbers are outlined. A set of classical problems in correct numerical evaluation is presented, to increase the awareness of newcomers to the field. A self-defense, prophylactic approach to numerical computation is advocated.

Related