Uploaded image for project: 'ZK Spreadsheet'
  1. ZK Spreadsheet
  2. ZSS-691

Support calculation in Excel's double precision

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Normal
    • Resolution: Done
    • Affects Version/s: 3.5.0 RC
    • Fix Version/s: 3.5.0
    • Component/s: None
    • Labels:
      None

      Description

      Excel handle double in different way.
      1. Input number would be cut to only 15 significant digits (while IEEE754 used in double can represent 17 digits)
      2. temporary number calculation result in formula is rounded(not cut) into 15 precision.

      The following calculation will results in 5.820766091346741E-11 in IEEE754 calculation but it is expected to be zero.

      =-732870.32 - -207279.38 - -4737.63 - -4737.89 - -516115.42

        Activity

        Show
        henrichen henrichen added a comment - 3.5 https://github.com/zkoss/zkspreadsheet/commit/62deec2198874ecf74ad50d097282fdb808d9441 http://gitlab.potix.com:3000/zpoi/commit/d7ba7b180b49c4648476565aaf92f76a38833c3c https://github.com/zkoss/zsscml/commit/b7321b5aa03d773452f412d92b8e2bd3fe0d9852
        Hide
        henrichen henrichen added a comment -

        Done.

        Show
        henrichen henrichen added a comment - Done.

          People

          • Assignee:
            henrichen henrichen
            Reporter:
            henrichen henrichen
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: