Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-33414

benchmark vector indexes

    XMLWordPrintable

Details

    • Task
    • Status: In Progress (View Workflow)
    • Critical
    • Resolution: Unresolved
    • 11.6
    • None
    • None

    Description

      Use some real-life million-size dataset

      Benchmark goals:

      • Index creation time
      • Index update time
      • Index lookup for 1, 10, 100, 1000 entries for the same "query" vector repeated N times.
        • This tests speed of graph lookup with hopefully most data in cache.
      • Index lookup for million different query vectors (top 1, 10, 100, 1000) results, no repetition.
        • This tests speed of graph lookup when data may not all fit in cache.
      • Compute average recall of the algorithm for such queries.

      Compare to papers using the same algorithm.

      Attachments

        Issue Links

          blocks

          Task - A task that needs to be done. MDEV-33413 cache k-ANN graph in memory

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-33415 graph index search: heuristical edge choice

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-33416 graph index: use smaller floating point numbers

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-33418 graph index insert: stronger selection of neighbors

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-33419 graph index insert: consider more neighbors

          • Major - Major loss of function.
          • Open
          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33406 basic optimizer support for k-NN searches

          • Critical - Crashes, loss of data, severe memory leak.
          • In Testing

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33407 Parser support for vector indexes

          • Critical - Crashes, loss of data, severe memory leak.
          • In Testing

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33408 HNSW for k-ANN vector searches

          • Critical - Crashes, loss of data, severe memory leak.
          • In Progress
          relates to

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33404 Engine-independent indexes: subtable method

          • Critical - Crashes, loss of data, severe memory leak.
          • Stalled

          Task - A task that needs to be done. MDEV-33405 Engine-independent indexes: low-level API method

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MDEV-32887 k-ANN indexes for vectors

          • Major - Major loss of function.
          • Stalled

          Activity

            People

              cvicentiu Vicențiu Ciorbaru
              serg Sergei Golubchik
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.