Floating point becomes less mysterious as significant figures and scientific notation translated from base 10 into base 2.
Floating point becomes less mysterious as significant figures and scientific notation translated from base 10 into base 2.
More from this video
See all →In programming, 0.1 + 0.2 differs slightly from 0.3 because neither has an exact finite binary…
Adding three rounded representations of one-third can produce 0.99999999... instead of exactly 1.
Binary cannot represent many ordinary decimal fractions exactly. Decimal 0.1 becomes a recurring…
Tiny numerical errors become visible in currency, even when imperceptible in physical simulations…
For currency, use decimal arithmetic or store integer cents or pence, dividing by 100 only for…
Floating-point formats truncate recurring binary expansions when precision runs out, creating…
Floating-point error is harmless when tolerance exceeds it, such as positioning a game object…
Floating-point numbers are binary scientific notation: significant digits are stored with an…
Don't lose this one
A free account saves insights like this to your Boards, and Korva resurfaces them so you actually remember.