Uploaded image for project: 'ZK Spreadsheet'
  1. ZK Spreadsheet
  2. ZSS-691

Support calculation in Excel's double precision

    XMLWordPrintable

Details

    • New Feature
    • Resolution: Done
    • Normal
    • 3.5.0
    • 3.5.0 RC
    • None
    • None

    Description

      Excel handle double in different way.
      1. Input number would be cut to only 15 significant digits (while IEEE754 used in double can represent 17 digits)
      2. temporary number calculation result in formula is rounded(not cut) into 15 precision.

      The following calculation will results in 5.820766091346741E-11 in IEEE754 calculation but it is expected to be zero.

      =-732870.32 - -207279.38 - -4737.63 - -4737.89 - -516115.42

      Attachments

        Issue Links

          Activity

            People

              henrichen henrichen
              henrichen henrichen
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: