Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-5950

Improve finalization of the disk-based aggregation generations

    XMLWordPrintable

Details

    • New Feature
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • None
    • 23.10.4
    • PrimProc
    • None

    Description

      Currently, during the finalization process, in order to merge data from one generation to another, the hash map of one generation is iterated. After that, the corresponding row in the other generation is searched and the aggregated data are merged. This algorithm is quite complex and inefficient in terms of memory usage and disk operations. It can be simplified by iterating not by the hash map, but by the rows in the vector of RGDatas. This would require slightly more memory to duplicate the row hashes in an RowStorage (+8 bytes per row). However, it should speed up the process and reduce peak memory consumption.

      Attachments

        Activity

          People

            alexey.antipovsky Aleksei Antipovskii
            alexey.antipovsky Aleksei Antipovskii
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.