Floating-point formats truncate recurring binary expansions when precision runs out, creating rounding errors instead of exact values.
Floating-point formats truncate recurring binary expansions when precision runs out, creating rounding errors instead of exact values.
More from this video
See all →In programming, 0.1 + 0.2 differs slightly from 0.3 because neither has an exact finite binary…
Adding three rounded representations of one-third can produce 0.99999999... instead of exactly 1.
Binary cannot represent many ordinary decimal fractions exactly. Decimal 0.1 becomes a recurring…
Tiny numerical errors become visible in currency, even when imperceptible in physical simulations…
For currency, use decimal arithmetic or store integer cents or pence, dividing by 100 only for…
Floating-point error is harmless when tolerance exceeds it, such as positioning a game object…
Floating-point numbers are binary scientific notation: significant digits are stored with an…
Floating point becomes less mysterious as significant figures and scientific notation translated…
Don't lose this one
A free account saves insights like this to your Boards, and Korva resurfaces them so you actually remember.