Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-33414

benchmark vector indexes

Details

    Description

      Use some real-life million-size dataset

      Benchmark goals:

      • Index creation time
      • Index update time
      • Index lookup for 1, 10, 100, 1000 entries for the same "query" vector repeated N times.
        • This tests speed of graph lookup with hopefully most data in cache.
      • Index lookup for million different query vectors (top 1, 10, 100, 1000) results, no repetition.
        • This tests speed of graph lookup when data may not all fit in cache.
      • Compute average recall of the algorithm for such queries.

      Compare to papers using the same algorithm.

      Attachments

        Issue Links

          blocks

          Task - A task that needs to be done. MDEV-33413 cache k-ANN graph in memory

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Task - A task that needs to be done. MDEV-33415 graph index search: heuristical edge choice

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-33416 graph index: use smaller floating point numbers

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-33418 graph index insert: stronger selection of neighbors

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-33419 graph index insert: consider more neighbors

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open
          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33406 basic optimizer support for k-NN searches

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33407 Parser support for vector indexes

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33408 HNSW for k-ANN vector searches

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is part of

          New Feature - A new feature of the product, which has yet to be developed. MDEV-34939 vector search in 11.7

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          New Feature - A new feature of the product, which has yet to be developed. MDEV-33404 Engine-independent indexes: subtable method

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Task - A task that needs to be done. MDEV-33405 Engine-independent indexes: low-level API method

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. MDEV-32887 vector search

          • Critical - Crashes, loss of data, severe memory leak.
          • Stalled

          Activity

            Transition Time In Source Status Execution Times
            JiraAutomate made transition -
            In Progress Stalled
            		47d 3h 24m 1
            Sergei Golubchik made transition -
            Stalled In Progress
            		8m 57s 1
            Sergei Golubchik made transition -
            In Progress Needs Feedback
            		25d 5h 4m 1
            Sergei Golubchik made transition -
            Needs Feedback Open
            		6s 1
            Sergei Golubchik made transition -
            Open In Progress
            		90d 1h 13m 2
            Sergei Golubchik made transition -
            In Progress In Testing
            		4s 1
            Sergei Golubchik made transition -
            In Testing Closed
            		114d 16h 17m 1

            People

              serg Sergei Golubchik
              serg Sergei Golubchik
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.