Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-3242

Improve load/save in BRM structs

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Closed (View Workflow)
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4.0
    • Component/s: writeengine
    • Labels:
      None
    • Sprint:
      2019-06

      Description

      Hacking up the BRM structs to make them use IDBDataFile consistently, I noticed that the EM, VBBM, and VSS are still using my v 0.1 prototype code for loading and saving. That code, written like 12 years ago, loads and saves elements one by one. That won't scale, and it'll cause noticeable pauses across the system while it does that. This is another one of those things I had to fix at Tune (saving a 600MB extent map ~50 bytes at a time = pain).

      This task is for making them save consecutive groups of elements at a time. Much much quicker.

      One other thing I noticed is that it's taking a full snapshot of all of the structs on commit. That's expensive, esp with the current impl, and it doesn't need to do that.

        Attachments

          Activity

            People

            Assignee:
            dleeyh Daniel Lee
            Reporter:
            pleblanc Patrick LeBlanc (Inactive)
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.