Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-4614

calShowPartitions() precision loss for huge narrow decimal

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 5.6.1, 5.5.1
    • Fix Version/s: 6.1.1
    • Component/s: PrimProc
    • Labels:
      None
    • Sprint:
      2021-5, 2021-6, 2021-7, 2021-8

      Description

      DROP TABLE IF EXISTS t1;
      CREATE TABLE t1 (a DECIMAL(17,1)) ENGINE=ColumnStore;
      INSERT INTO t1 VALUES (-8999999999999999.9);
      SELECT * FROM t1 WHERE a=0;
      SELECT calShowPartitions('t1','a');
      

      +--------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | calShowPartitions('t1','a')                                                                                                                                  |
      +--------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | Part#     Min                           Max                           Status
        0.0.1     -9000000000000000.0           -9000000000000000.0           Enabled |
      +--------------------------------------------------------------------------------------------------------------------------------------------------------------+
      

      Notice, the Min and Max values are wrong.

      This happens because the underlying printing code uses double representation.

      It should be fixed to use native representation.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              dleeyh Daniel Lee
              Reporter:
              bar Alexander Barkov
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Git Integration