Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-19308

Use bloom filters when employing range rowid / primary key filters

Details

    • Task
    • Status: Open (View Workflow)
    • Major
    • Resolution: Unresolved
    • None
    • Optimizer
    • None

    Description

      The current implementation of the optimization based on usage of in-memory rowid/pk filters built for selective range conditions directly stores rowids / primary keys of the filters in sorted arrays. These arrays are used only for an non-inclusion checks Using bloom filters for such checks will save a lot memory for each rowid / primary key because with bloom filters only 10 bits will be allocated for each rowid / primary key belonging to the filter set.

      Inherit Rowid_filter_container to implement https://en.wikipedia.org/wiki/Bloom_filter

      Attachments

        Issue Links

          includes

          Task - A task that needs to be done. MDEV-18477 Rowid filters: Implement FNV-1a hash function

          • Major - Major loss of function.
          • Stalled

          Activity

            Ascending order - Click to sort in descending order
            igor Igor Babaev (Inactive) created issue -
            igor Igor Babaev (Inactive) made changes -
            Field Original Value New Value
            Summary Use bloom filters when employing range rowid / primary key filters. Use bloom filters when employing range rowid / primary key filters
            ralf.gebhardt Ralf Gebhardt made changes -
            NRE Projects RM_105_CANDIDATE
            ralf.gebhardt Ralf Gebhardt made changes -
            NRE Projects RM_105_CANDIDATE RM_105_CANDIDATE RM_105_OPTIMIZER
            igor Igor Babaev (Inactive) made changes -
            Assignee Igor Babaev [ igor ] Galina Shalygina [ shagalla ]
            shagalla Galina Shalygina (Inactive) made changes -
            igor Igor Babaev (Inactive) made changes -
            Assignee Galina Shalygina [ shagalla ] Igor Babaev [ igor ]
            ralf.gebhardt Ralf Gebhardt made changes -
            Fix Version/s 10.5 [ 23123 ]
            sergei.krivonos Sergei Krivonos (Inactive) made changes -
            Description The current implementation of the optimization based on usage of in-memory rowid/pk filters built for selective range conditions directly stores rowids / primary keys of the filters in sorted arrays. These arrays are used only for an non-inclusion checks Using bloom filters for such checks will save a lot memory for each rowid / primary key because with bloom filters only 10 bits will be allocated for each rowid / primary key belonging to the filter set. The current implementation of the optimization based on usage of in-memory rowid/pk filters built for selective range conditions directly stores rowids / primary keys of the filters in sorted arrays. These arrays are used only for an non-inclusion checks Using bloom filters for such checks will save a lot memory for each rowid / primary key because with bloom filters only 10 bits will be allocated for each rowid / primary key belonging to the filter set.

            Inherit Rowid_filter_container to implement https://en.wikipedia.org/wiki/Bloom_filter

            serg Sergei Golubchik made changes -
            Workflow MariaDB v3 [ 96288 ] MariaDB v4 [ 131071 ]
            monty Michael Widenius made changes -
            Assignee Igor Babaev [ igor ]

            People

              Unassigned Unassigned
              igor Igor Babaev (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.