Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-5477

Improve Disk Join Step to handle corner cases for large data

    XMLWordPrintable

Details

    • New Feature
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • None
    • 23.10.0
    • None
    • 2023-8

    Description

      By the current design of DJS it tries to distribute rows to buckets based on a hashing result for each row, when the bucket exceed the memory limit defined in session variables it tries to redistribute the current bucket into the small buckets again using a hash with different seed, in case all rows a the same in the bucket we cannot distribute them into different buckets as designed, we go into endless recursion trying to do this. The current task is to handle this corner cases by updating the approach of bucket selection algorithm and bucket distribution algorithm.

      Attachments

        Activity

          People

            denis0x0D Denis Khalikov
            denis0x0D Denis Khalikov
            Roman Roman
            Kirill Perov Kirill Perov (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.