Uploaded image for project: 'ZK Spreadsheet'
  1. ZK Spreadsheet
  2. ZSS-691

Support calculation in Excel's double precision

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Normal
    • Resolution: Done
    • Affects Version/s: 3.5.0 RC
    • Fix Version/s: 3.5.0
    • Component/s: None
    • Labels:
      None

      Description

      Excel handle double in different way.
      1. Input number would be cut to only 15 significant digits (while IEEE754 used in double can represent 17 digits)
      2. temporary number calculation result in formula is rounded(not cut) into 15 precision.

      The following calculation will results in 5.820766091346741E-11 in IEEE754 calculation but it is expected to be zero.

      =-732870.32 - -207279.38 - -4737.63 - -4737.89 - -516115.42

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              henrichen henrichen
              Reporter:
              henrichen henrichen
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: