[MCOL-901] group_concat() consumes a great amount of memory Created: 2017-08-31 Updated: 2020-08-25 Resolved: 2019-03-11 |
|
| Status: | Closed |
| Project: | MariaDB ColumnStore |
| Component/s: | ExeMgr |
| Affects Version/s: | 1.0.11 |
| Fix Version/s: | 1.2.3 |
| Type: | Bug | Priority: | Major |
| Reporter: | Daniel Lee (Inactive) | Assignee: | Daniel Lee (Inactive) |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Sprint: | 2019-01, 2019-02, 2019-03 |
| Description |
|
Build tested: 1.0.11-1, 1.0.9-1 Using a VM that's configured with 60 GB memory. I did the following test: 1) create a 1gb dbt3 database 2) execute query 1500000 rows in set, 1 warning (4 min 13.48 sec) 3) Check cal trace
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Desc Mode Table TableOID ReferencedColumns PIO LIO PBE Elapsed Rows 4) getcalstat -----------------------------------------------------------+
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ExeMgr's memory utilization was peaked at 40gb. Although group_concat() is known to use more memory, but using 40gb memory to process two columns totaling 44mg of data seems to be excessive. I also did the same test on 1.0.9-1 and it showed the same behavior. |
| Comments |
| Comment by Roman [ 2019-02-01 ] |
|
Please review. |
| Comment by Daniel Lee (Inactive) [ 2019-02-08 ] |
|
Build verified: 1.2.3-1 from buildbot nightly Build verified: 1.2.3-1 from buildbot nightly server commit: Executed the same test on a VM with 48gb of memory. It used a max of 9%, or 4.32gb of memory. That's about 90% less memory used. |
| Comment by David Hill (Inactive) [ 2019-02-22 ] |
|
Issue reported by a customer that had a beta version of 1.2.3 |
| Comment by Roman [ 2019-03-04 ] |
|
Please review |
| Comment by Daniel Lee (Inactive) [ 2019-03-11 ] |
|
The ticket was closed. According to the programmer, the ticket was reopened by mistake. Closed it. |