Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-32887

vector search

Details

    • Epic
    • Status: Stalled (View Workflow)
    • Critical
    • Resolution: Unresolved
    • N/A
    • Server
    • vector search

    Description

      A common operation for multi-dimensional vectors is to find k nearest vectors to the given one.
      This task is about implementing indexes that allow to do it fast.

      • ideally they'll be engine independent
      • indexes should be update-able
      • in this task we'll only do Euclidean distance
      • we'll benchmark it on real multi-million-rows data sets
      • what algorithm, exactly, to use is still unclear

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. MDEV-32886 VEC_FromText() and VEC_ToText() functions

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33404 Engine-independent indexes: subtable method

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Task - A task that needs to be done. MDEV-33405 Engine-independent indexes: low-level API method

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33406 basic optimizer support for k-NN searches

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33407 Parser support for vector indexes

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33408 HNSW for k-ANN vector searches

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33410 VECTOR data type

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33411 OPTIMIZE for graph indexes

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-33413 cache k-ANN graph in memory

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Task - A task that needs to be done. MDEV-33414 benchmark vector indexes

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Task - A task that needs to be done. MDEV-33415 graph index search: heuristical edge choice

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33417 VEC_DISTANCE_COSINE() function

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-33419 graph index insert: consider more neighbors

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MDEV-34436 DDL: per-index attributes

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Task - A task that needs to be done. MDEV-34698 mhnsw: support AVX-512 instructions

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-34699 mhnsw: support aarch64 SIMD instructions

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Task - A task that needs to be done. MDEV-34804 mhnsw: compiler-independent choice of CPU-specific optimizations

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MDEV-34805 provide various information about vector indexes

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Task - A task that needs to be done. MDEV-34806 mhnsw: use start_bulk_insert to estmate min_rows

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Task - A task that needs to be done. MDEV-34811 handlerton refactoring

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-35196 XA support for mhnsw indexes

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MDEV-35264 Improve InnoDB concurrent insert into vector index performance

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MDEV-35283 support nullable indexed vector columns

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MDEV-35314 multi-part vector indexes

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MDEV-35315 vector indexes in partitioned tables

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MDEV-35316 more than one vector index per table

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-35418 Better support for multiple duplicates vectors in the index

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MDEV-35629 Hybrid Search (Text + Vector) w/ Simple Re-Ranking

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Task - A task that needs to be done. MDEV-36184 mhnsw: support powerpc64 SIMD instructions

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-32885 VEC_DISTANCE() function

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33409 Index Condition Pushdown for k-ANN graph searches

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33412 cost-based optimizer choice for k-NN indexes

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-33416 graph index: use smaller floating point numbers

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-33418 graph index insert: stronger selection of neighbors

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-34862 Fix ALTER TABLE to work with high-level indexes

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-35327 Add VEC_DISTANCE_MANHATTAN (L1) distance function on Vector

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MDEV-35831 MYSQL_TYPE_VECTOR

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MDEV-35841 replicate MySQL 9.0 Vector to MariaDB

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MDEV-36100 Generate embeddings automatically on INSERT

          • Major - Major loss of function.
          • Open
          links to

          Web Link early gdoc

          Activity

            People

              serg Sergei Golubchik
              serg Sergei Golubchik
              Votes:
              2 Vote for this issue
              Watchers:
              19 Start watching this issue

              Dates

                Created:
                Updated:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.