[MCOL-5852] GROUP_CONCAT in query uses enormous amount of RAM causing OOM to kill PrimProc - Jira

Type: Bug
Status: In Progress (View Workflow)
Priority: Blocker
Resolution: Unresolved
Affects Version/s: 23.10.2
Fix Version/s: 23.10.4
Component/s: ExeMgr, PrimProc
Labels:
- performance
Environment:

Hide
NAME="Rocky Linux"
VERSION="9.3 (Blue Onyx)"
ID="rocky"
ID_LIKE="rhel centos fedora"
VERSION_ID="9.3"
PLATFORM_ID="platform:el9"
PRETTY_NAME="Rocky Linux 9.3 (Blue Onyx)"
ANSI_COLOR="0;32"
LOGO="fedora-logo-icon"
CPE_NAME="cpe:/o:rocky:rocky:9::baseos"
HOME_URL="https://rockylinux.org/"
BUG_REPORT_URL="https://bugs.rockylinux.org/"
SUPPORT_END="2032-05-31"
ROCKY_SUPPORT_PRODUCT="Rocky-Linux-9"
ROCKY_SUPPORT_PRODUCT_VERSION="9.3"
REDHAT_SUPPORT_PRODUCT="Rocky Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="9.3"

Show
NAME="Rocky Linux" VERSION="9.3 (Blue Onyx)" ID="rocky" ID_LIKE="rhel centos fedora" VERSION_ID="9.3" PLATFORM_ID="platform:el9" PRETTY_NAME="Rocky Linux 9.3 (Blue Onyx)" ANSI_COLOR="0;32" LOGO="fedora-logo-icon" CPE_NAME="cpe:/o:rocky:rocky:9::baseos" HOME_URL=" https://rockylinux.org/ " BUG_REPORT_URL=" https://bugs.rockylinux.org/ " SUPPORT_END="2032-05-31" ROCKY_SUPPORT_PRODUCT="Rocky-Linux-9" ROCKY_SUPPORT_PRODUCT_VERSION="9.3" REDHAT_SUPPORT_PRODUCT="Rocky Linux" REDHAT_SUPPORT_PRODUCT_VERSION="9.3"

When a query has the `GROUP_CONCAT` keyword, it executes for a short while, and dies off with the below error:

ERROR 1815 (HY000): Internal error: InetStreamSocket::readToMagic: Remote is closed

This is due to `OOM` killing the `PrimProc` service.

Parameter values of note, we have:

mcsSetConfig HashJoin TotalUmMemory 50%  --previous value 25%, same issue.

mcsSetConfig HashJoin AllowDiskBasedJoin N --previous value Y, same issue.

relates to

MCOL-5921 Disk based GROUP_CONCAT()

There are no comments yet on this issue.

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.

MariaDB ColumnStore