Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-5950

Improve finalization of the disk-based aggregation generations

    XMLWordPrintable

Details

    • New Feature
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • None
    • 23.10.4
    • PrimProc
    • None

    Description

      Currently, during the finalization process, in order to merge data from one generation to another, the hash map of one generation is iterated. After that, the corresponding row in the other generation is searched and the aggregated data are merged. This algorithm is quite complex and inefficient in terms of memory usage and disk operations. It can be simplified by iterating not by the hash map, but by the rows in the vector of RGDatas. This would require slightly more memory to duplicate the row hashes in an RowStorage (+8 bytes per row). However, it should speed up the process and reduce peak memory consumption.

      Attachments

        Issue Links

          Activity

            People

              alexey.antipovsky Aleksei Antipovskii
              alexey.antipovsky Aleksei Antipovskii
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 5d
                  5d
                  Remaining:
                  Remaining Estimate - 0d
                  0d
                  Logged:
                  Time Spent - 5d
                  5d

                  Git Integration

                    Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.