[MXS-4154] MaxScale Memory Leak in Container Created: 2022-06-03  Updated: 2022-10-25  Resolved: 2022-06-09

Status: Closed
Project: MariaDB MaxScale
Component/s: N/A
Affects Version/s: 6.2.3
Fix Version/s: N/A

Type: Bug Priority: Major
Reporter: Juan Assignee: Unassigned
Resolution: Not a Bug Votes: 0
Labels: containers, leak
Environment:

CentOS 7.7 Docker Container


Attachments: File cs0400579-20220531-maxscale-info-sanitized.out     File cs0400579-nc4103-cmdb-maxscale-1-20220602-jemalloc-heap-1.svg     File cs0400579-nc4103-cmdb-maxscale-1-20220602-jemalloc-heap-2.svg    
Issue Links:
Relates
relates to MXS-4368 Detect if maxscale is running inside ... Closed

 Description   

Customer has uncontrolled memory growth eventually leading to MaxScale exceeding its memory allocation and crashing.

Problem is not reproducible outside customer's lab & production container environments. Customer is also unable to reproduce the problem in virtualization or bare metal environments. Customer states problem happens in "idle" state, where "idle" means between 55 and 250qps

Successive efforts have ruled out MXS-4100 (non-zero connection_keepalive) and made an effort to minimize memory consumption by limiting write q high water mark as well as query classifier cache size. None of these changes have made a difference.

Customer was shown how to run traces with jemalloc, added that to the container, and saw no change. two svg reports from different heap trace sessions attached.



 Comments   
Comment by markus makela [ 2022-06-03 ]

Note to self: Jira image preview doesn't show the full SVG and you have to download them to actually view it or click the fullscreen button.

Generated at Thu Feb 08 04:26:35 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.