Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-33409

Index Condition Pushdown for k-ANN graph searches

    XMLWordPrintable

Details

    Description

      After the implementation of MDEV-33408:

      Modify the basic graph search algorithm to support index condition pushdown. That is, only add nodes to the candidate result set that pass the WHERE clause.

      This will allow queries of the form:

      SELECT *
      		 
      FROM table
      		 
      WHERE cond(table.column) == true
      		 
      ORDER BY VEC_DISTANCE(table.emb, target_vec)
      		 
      LIMIT 10

      to take advantage of the index.

      This will have the following edge cases:

      • What if none of the neighbors of the upper layer pass the where clause?
      • What if none of the neighbors in the search pass the where clause, but if we had only considered nodes that did pass (nodes that were never explored in this search), we would have found a valid result set.

      Attachments

        Issue Links

          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33406 basic optimizer support for k-NN searches

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MDEV-32887 vector search

          • Critical - Crashes, loss of data, severe memory leak.
          • Stalled

          Task - A task that needs to be done. MDEV-35032 streaming mode for mhnsw search

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33412 cost-based optimizer choice for k-NN indexes

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-34774 Vector queries crash in subquery or wrong results with WHERE

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              serg Sergei Golubchik
              serg Sergei Golubchik
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.