Power of two operation gives incorrect result

Issue #764 invalid
Remo created an issue

Windows 7 64 bit I came across into incorrect result when trying calculate power of two with exponent 64 that's get me to examine with excel to see if it gave the same result. With surprise I found out it's completely incorrect starting with exponent 50 so on. The same result I get with windows 7 64 bit calculator.

Comments (1)

  1. Pol Welter

    Speedcrunch is right, and Excel is wrong.

    Excel uses double precision floating point, which cannot represent these numbers exactly. It basically rounds any results to ~16 significant digits.

  2. Log in to comment