Uploaded image for project: 'ZK Spreadsheet'
  1. ZK Spreadsheet
  2. ZSS-691

Support calculation in Excel's double precision

XMLWordPrintable

    • Icon: New Feature New Feature
    • Resolution: Done
    • Icon: Normal Normal
    • 3.5.0
    • 3.5.0 RC
    • None
    • None

      Excel handle double in different way.
      1. Input number would be cut to only 15 significant digits (while IEEE754 used in double can represent 17 digits)
      2. temporary number calculation result in formula is rounded(not cut) into 15 precision.

      The following calculation will results in 5.820766091346741E-11 in IEEE754 calculation but it is expected to be zero.

      =-732870.32 - -207279.38 - -4737.63 - -4737.89 - -516115.42

            henrichen henrichen
            henrichen henrichen
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved: