Comment by CraigJPerry
1 day ago
The award for "most fun integer" in 32 bit float is 16777217 (and 9007199254740992 for 64bit).
It's sometimes fun to have these kinds of edge cases up your sleeve when testing things.
1 day ago
The award for "most fun integer" in 32 bit float is 16777217 (and 9007199254740992 for 64bit).
It's sometimes fun to have these kinds of edge cases up your sleeve when testing things.
For 64-bit, 9007199254740991 is also known as `Number.MAX_SAFE_INTEGER` in JavaScript. Note that this value is not even; the next integer, ..0992 is still safe to represent by its own, but it can't be distinguished from a definitely unsafe integer ..0993 rounded to ..0992.
You mean ±9,007,199,254,740,993.0 for 64-bit floats. :-)
For other curious readers, these are one beyond the largest integer values that can be represented accurately. In other words, the next representable value away from zero after ±16,777,216.0 is ±16,777,218.0 in 32 bits -- the value ±16,777,217.0 cannot be represented, and will be rounded somewhat hand-wavingly (usually towards zero).
Precision rounding is one of those things that people often overlook.