Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-22995

float datatye behave strange even with defined precision of 3

    XMLWordPrintable

Details

    • Bug
    • Status: Open (View Workflow)
    • Major
    • Resolution: Unresolved
    • 10.4.8
    • None
    • Linux 5.2.13 SMP PREEMPT Fri Sep 6 17:52:33 UTC 2019 x86_64 GNU/Linux
      Server version: 10.4.8-MariaDB OIS-net on Arch Linux
      Protocol version: 10
      mysql Ver 15.1 Distrib 10.4.8-MariaDB, for Linux (x86_64) using readline 5.1

    Description

      hi
      i'm using floating point operations with the understanding of https://en.wikipedia.org/wiki/Floating-point_arithmetic and IEEE 754. i'm aware of precision problem, the 6 significant digits. i there for was testing the behavior of mariadb with less than five and last digit is a 0. hence all digits behind are defined.
      please have a glimp @SimpleFloatTest.sql. on my implementation integers and anything with #.25 work fine. 0.025 or 0.23 or 0.24 fail to select.

      the result is fancy. everything is stored correctly. if i extend precision the question rises if the last digit will be rounded or not (sprintf ("%e"). mariadb does rounding, perl does not, have to check compiler. but currently there is no precision question, if the result showed by SimpleFloatTest.sql appear on every installation.

      Attachments

        1. SimpleFloatTest.sql
          1 kB
          Juerg Oehler
        2. SimpleFloatTest2.sql
          2 kB
          Juerg Oehler

        Activity

          People

            Unassigned Unassigned
            SwissGeorge Juerg Oehler
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.