Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-4917

Certain Extent Map operations doesn't scale well.

    XMLWordPrintable

Details

    • 2021-14, 2021-15, 2021-16, 2021-17

    Description

      There is a major deficiency in parts of EM code that makes the operations slower. We need to profile and introduce lookup structures to speed up read/write ops in EM. ExtentMap::getDbRootHWMInfo() must be overloaded to serve multiple oids at a time. ExtentMap::setLocalHWM is called multiple times compacting journal into EM on MCS shutdown(save_brm presumably). setLocalHWM is utterly slow that forces systemd to kill save_brm on timeout.

      Attachments

        Issue Links

          includes

          New Feature - A new feature of the product, which has yet to be developed. MCOL-5089 Merge RBTree-based Extent Map with EM Index to remove scaleability slow-downs -develop5

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MCOL-5090 Up-merge EMIndex + RBTree-based EM into develop-6

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MCOL-5091 Up-merge RBTree-based EM into develop

          • Major - Major loss of function.
          • Closed
          is part of

          Task - A task that needs to be done. MCOL-5313 Re-test new Exttent Map implementation

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MCOL-4988 Table lock remained after DML failure due to cluster was in readonly mode

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Activity

            People

              drrtuy Roman
              drrtuy Roman
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.