Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-5429

GROUP_CONCAT execution allocates enourmous amount of RAM for its result RGDatas

Details

    • 2023-4, 2023-5, 2023-6

    Description

      There is MDB client variable group_concat_max_len that controls the max length of GROUP_CONCAT output field. The variable default value differs by distros and can be either 1MB or 3 MB.
      The value of this field sets the outcome RG column width here in buildAggregateColumn().
      There are multiple places where code makes a new RowGroup and the corresponding RGData using 3MB as its column width and if a user sets the value to a higher value this causes PP to crash.
      The suggested solution is to convert GROUP_CONCAT into a StringStore only column and avoid using group_concat_max_len value as a column width.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MCOL-5385 GROUP_CONCAT execution doesn't count RAM used to store data properly crashing PrimProc runtime

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Activity

            Ascending order - Click to sort in descending order
            drrtuy Roman created issue -
            drrtuy Roman made changes -
            Field Original Value New Value
            alexey.vorovich alexey vorovich (Inactive) made changes -
            Fix Version/s 23.02 [ 28209 ]
            toddstoffel Todd Stoffel (Inactive) made changes -
            Sprint 10.4.0-1 [ 254 ] 2022-24 [ 698 ]
            toddstoffel Todd Stoffel (Inactive) made changes -
            Rank Ranked higher
            toddstoffel Todd Stoffel (Inactive) made changes -
            Sprint 2023-4 [ 698 ] 2023-4, 2023-5 [ 698, 702 ]
            toddstoffel Todd Stoffel (Inactive) made changes -
            Sprint 2023-4, 2023-5 [ 698, 702 ] 2023-4, 2023-5, 2023-6 [ 698, 702, 706 ]
            tntnatbry Gagan Goel (Inactive) made changes -
            Assignee Leonid Fedorov [ JIRAUSER48443 ] Gagan Goel [ tntnatbry ]
            tntnatbry Gagan Goel (Inactive) made changes -
            Status Open [ 1 ] Confirmed [ 10101 ]
            tntnatbry Gagan Goel (Inactive) made changes -
            Status Confirmed [ 10101 ] In Progress [ 3 ]
            tntnatbry Gagan Goel (Inactive) made changes -
            Assigned for Review Roman [ drrtuy ]
            Assigned for Testing Daniel Lee [ dleeyh ]
            tntnatbry Gagan Goel (Inactive) made changes -
            Fix Version/s 23.02.3 [ 28901 ]
            Fix Version/s 23.02 [ 28209 ]
            tntnatbry Gagan Goel (Inactive) made changes -
            Status In Progress [ 3 ] In Review [ 10002 ]
            tntnatbry Gagan Goel (Inactive) made changes -
            Status In Review [ 10002 ] In Testing [ 10301 ]
            tntnatbry Gagan Goel (Inactive) added a comment -

            Fix for this issue is tested in the related ticket MCOL-5385. Marking this ticket as fixed.

            tntnatbry Gagan Goel (Inactive) added a comment - Fix for this issue is tested in the related ticket MCOL-5385 . Marking this ticket as fixed.
            tntnatbry Gagan Goel (Inactive) made changes -
            Resolution Fixed [ 1 ]
            Status In Testing [ 10301 ] Closed [ 6 ]

            People

              tntnatbry Gagan Goel (Inactive)
              drrtuy Roman
              Roman Roman
              Daniel Lee Daniel Lee (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.