[MCOL-1507] ExeMgr over using memory causing swap and system restarts to occur Created: 2018-06-26  Updated: 2020-08-25  Resolved: 2018-11-05

Status: Closed
Project: MariaDB ColumnStore
Component/s: ExeMgr
Affects Version/s: 1.1.5
Fix Version/s: 1.1.7

Type: Bug Priority: Major
Reporter: David Hill (Inactive) Assignee: Andrew Hutchings (Inactive)
Resolution: Duplicate Votes: 2
Labels: None
Environment:

1um 2pm system


Issue Links:
Duplicate
duplicates MCOL-1750 Thread stack memory leak in ThreadPool Closed
Sprint: 2018-13, 2018-14, 2018-15, 2018-16, 2018-17, 2018-18, 2018-19, 2018-20

 Description   

Customer reporting that ExeMgr is going way over its TotalUmMemory seeing of 50% to the point that its hitting swap space and a system restart is occurring..

Issue maybe related to how ExeMgr handles ByteStream

err: Jun 25 17:47:24 usfit-sctst2 ServerMonitor[5993]: 24.937868 |0|0|0| C 09 CAL0000: Swap Space usage over Major threashold, perform OAM command restartSystem

debug :

Jun 25 17:32:29 usfit-sctst2 ServerMonitor[5993]: 29.593575 |0|0|0| I 09 CAL0000: Local Memory above Critical Memory threshold with a percentage of 90 ; Swap 0
Jun 25 17:32:29 usfit-sctst2 ServerMonitor[5993]: 29.607779 |0|0|0| I 09 CAL0000: Local-Memory usage at percentage of 90 , Alarm set: 7
Jun 25 17:32:29 usfit-sctst2 ServerMonitor[5993]: 29.662047 |0|0|0| I 09 CAL0000: Memory Usage for Process: python : Memory Used 4503 : % Used 1
Jun 25 17:32:29 usfit-sctst2 ServerMonitor[5993]: 29.662136 |0|0|0| I 09 CAL0000: Memory Usage for Process: systemd-journald : Memory Used 10211 : % Used 1
Jun 25 17:32:29 usfit-sctst2 ServerMonitor[5993]: 29.662193 |0|0|0| I 09 CAL0000: Memory Usage for Process: mysqld : Memory Used 21652 : % Used 1
Jun 25 17:32:29 usfit-sctst2 ServerMonitor[5993]: 29.662248 |0|0|0| I 09 CAL0000: Memory Usage for Process: dsm_om_connsvcd : Memory Used 37009 : % Used 1
Jun 25 17:32:29 usfit-sctst2 ServerMonitor[5993]: 29.662302 |0|0|0| I 09 CAL0000: Memory Usage for Process: ExeMgr : Memory Used 17289954 : % Used 88



 Comments   
Comment by Andrew Hutchings (Inactive) [ 2018-06-26 ]

Issue is ByteStream for the output is growing to fulfil the entire result set and doesn't shrink again until the end of the query.

Comment by Andrew Hutchings (Inactive) [ 2018-11-05 ]

Duplicate of MCOL-1750

Generated at Thu Feb 08 02:29:17 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.