Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-22995

float datatye behave strange even with defined precision of 3

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open (View Workflow)
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 10.4.8
    • Fix Version/s: None
    • Environment:
      Linux 5.2.13 SMP PREEMPT Fri Sep 6 17:52:33 UTC 2019 x86_64 GNU/Linux
      Server version: 10.4.8-MariaDB OIS-net on Arch Linux
      Protocol version: 10
      mysql Ver 15.1 Distrib 10.4.8-MariaDB, for Linux (x86_64) using readline 5.1

      Description

      hi
      i'm using floating point operations with the understanding of https://en.wikipedia.org/wiki/Floating-point_arithmetic and IEEE 754. i'm aware of precision problem, the 6 significant digits. i there for was testing the behavior of mariadb with less than five and last digit is a 0. hence all digits behind are defined.
      please have a glimp @SimpleFloatTest.sql. on my implementation integers and anything with #.25 work fine. 0.025 or 0.23 or 0.24 fail to select.

      the result is fancy. everything is stored correctly. if i extend precision the question rises if the last digit will be rounded or not (sprintf ("%e"). mariadb does rounding, perl does not, have to check compiler. but currently there is no precision question, if the result showed by SimpleFloatTest.sql appear on every installation.

        Attachments

          Activity

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            SwissGeorge Juerg Oehler
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:

                Git Integration