package versions:
3 or 4 servers have a similar memory leak profile to the memory-month-g1 image attached. Variables and settings attached are from the g1 server. The dates that an increase in memory usage occurs is the same on all server. The 4th server, memory-month-repl1 is only used as read only and has significantly lower traffic and lower memory usage overall.
The restart at the beginning of the graph was an upgrade from an upgrade from 5.5.32. Looking at the year graphs it appears there was a leak there too that I hadn't noticed before.
Client has another regional database on 5.5.37-MariaDB-1~precise-log (non-galera) with similar structured databases and code usage. If this non-galera instance has a leak is much slower.
top - 09:14:36 up 172 days, 7:56, 2 users, load average: 0.07, 0.02, 0.00
Tasks: 128 total, 1 running, 127 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 7970076k total, 7873132k used, 96944k free, 126140k buffers
Swap: 1073144k total, 6408k used, 1066736k free, 2927628k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
7637 mysql 20 0 12.7g 5.5g 1.3g S 0 72.0 505:21.12 mysqld
13405 syslog 20 0 254m 4540 1040 S 0 0.1 3:04.63 rsyslogd
25822 openquer 20 0 17292 1428 1072 R 0 0.0 0:00.03 top
1 root 20 0 24356 1556 696 S 0 0.0 0:00.56 init
I've restarted repl with no query cache and lower usage settings as it was overallocated.
There is a UAT environment with this that I can test out patches with.
Would trying the patch from MDEV-4974
made changes -
2014-06-07 18:24
Field
Original Value
New Value
Assignee
Nirbhay Choubey
[ nirbhay_c
]
made changes -
2014-06-13 15:06
Workflow
defaullt
[ 41801
]
MariaDB v2
[ 44753
]
made changes -
2014-09-06 05:05
Affects Version/s
5.5.39-galera
[ 16302
]
made changes -
2017-02-25 21:34
Assignee
Nirbhay Choubey
[ nirbhay_c
]
made changes -
2017-09-25 12:42
Fix Version/s
5.5-galera
[ 21900
]
made changes -
2020-06-02 06:21
Fix Version/s
5.5-galera
[ 21900
]
made changes -
2020-06-02 06:23
Component/s
Galera
[ 10124
]
Fix Version/s
N/A
[ 14700
]
Resolution
Won't Fix
[ 2
]
Status
Stalled
[ 10000
]
Closed
[ 6
]
made changes -
2021-12-06 21:40
Workflow
MariaDB v3
[ 64774
]
MariaDB v4
[ 147931
]
{"report":{"fcp":1676,"ttfb":309.9000005722046,"pageVisibility":"visible","entityId":38001,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"b3475a0f-7e1e-4e25-a0f1-17f4864ec620","navigationType":0,"readyForUser":1814.7000007629395,"redirectCount":0,"resourceLoadedEnd":1894.3000001907349,"resourceLoadedStart":318.30000019073486,"resourceTiming":[{"duration":746.9000005722046,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":318.30000019073486,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":318.30000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1065.2000007629395,"responseStart":0,"secureConnectionStart":0},{"duration":747.1000003814697,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":318.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":318.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1065.6000003814697,"responseStart":0,"secureConnectionStart":0},{"duration":758.3999996185303,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":318.70000076293945,"connectEnd":318.70000076293945,"connectStart":318.70000076293945,"domainLookupEnd":318.70000076293945,"domainLookupStart":318.70000076293945,"fetchStart":318.70000076293945,"redirectEnd":0,"redirectStart":0,"requestStart":318.70000076293945,"responseEnd":1077.1000003814697,"responseStart":1077.1000003814697,"secureConnectionStart":318.70000076293945},{"duration":833.4000005722046,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":319,"connectEnd":319,"connectStart":319,"domainLookupEnd":319,"domainLookupStart":319,"fetchStart":319,"redirectEnd":0,"redirectStart":0,"requestStart":319,"responseEnd":1152.4000005722046,"responseStart":1152.4000005722046,"secureConnectionStart":319},{"duration":842.8999996185303,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":319.20000076293945,"connectEnd":319.20000076293945,"connectStart":319.20000076293945,"domainLookupEnd":319.20000076293945,"domainLookupStart":319.20000076293945,"fetchStart":319.20000076293945,"redirectEnd":0,"redirectStart":0,"requestStart":319.20000076293945,"responseEnd":1162.1000003814697,"responseStart":1162.1000003814697,"secureConnectionStart":319.20000076293945},{"duration":843.0999994277954,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":319.4000005722046,"connectEnd":319.4000005722046,"connectStart":319.4000005722046,"domainLookupEnd":319.4000005722046,"domainLookupStart":319.4000005722046,"fetchStart":319.4000005722046,"redirectEnd":0,"redirectStart":0,"requestStart":319.4000005722046,"responseEnd":1162.5,"responseStart":1162.5,"secureConnectionStart":319.4000005722046},{"duration":843.3999996185303,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":319.6000003814697,"connectEnd":319.6000003814697,"connectStart":319.6000003814697,"domainLookupEnd":319.6000003814697,"domainLookupStart":319.6000003814697,"fetchStart":319.6000003814697,"redirectEnd":0,"redirectStart":0,"requestStart":319.6000003814697,"responseEnd":1163,"responseStart":1163,"secureConnectionStart":319.6000003814697},{"duration":971.9000005722046,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":319.80000019073486,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":319.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1291.7000007629395,"responseStart":0,"secureConnectionStart":0},{"duration":843.5,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":319.9000005722046,"connectEnd":319.9000005722046,"connectStart":319.9000005722046,"domainLookupEnd":319.9000005722046,"domainLookupStart":319.9000005722046,"fetchStart":319.9000005722046,"redirectEnd":0,"redirectStart":0,"requestStart":319.9000005722046,"responseEnd":1163.4000005722046,"responseStart":1163.3000001907349,"secureConnectionStart":319.9000005722046},{"duration":972.1000003814697,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":320,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":320,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1292.1000003814697,"responseStart":0,"secureConnectionStart":0},{"duration":843.7999992370605,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":320.20000076293945,"connectEnd":320.20000076293945,"connectStart":320.20000076293945,"domainLookupEnd":320.20000076293945,"domainLookupStart":320.20000076293945,"fetchStart":320.20000076293945,"redirectEnd":0,"redirectStart":0,"requestStart":320.20000076293945,"responseEnd":1164,"responseStart":1164,"secureConnectionStart":320.20000076293945},{"duration":1164.3000001907349,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":321.1000003814697,"connectEnd":321.1000003814697,"connectStart":321.1000003814697,"domainLookupEnd":321.1000003814697,"domainLookupStart":321.1000003814697,"fetchStart":321.1000003814697,"redirectEnd":0,"redirectStart":0,"requestStart":321.1000003814697,"responseEnd":1485.4000005722046,"responseStart":1485.4000005722046,"secureConnectionStart":321.1000003814697},{"duration":1165.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":321.1000003814697,"connectEnd":321.1000003814697,"connectStart":321.1000003814697,"domainLookupEnd":321.1000003814697,"domainLookupStart":321.1000003814697,"fetchStart":321.1000003814697,"redirectEnd":0,"redirectStart":0,"requestStart":321.1000003814697,"responseEnd":1486.6000003814697,"responseStart":1486.6000003814697,"secureConnectionStart":321.1000003814697},{"duration":51,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":1316.3000001907349,"connectEnd":1316.3000001907349,"connectStart":1316.3000001907349,"domainLookupEnd":1316.3000001907349,"domainLookupStart":1316.3000001907349,"fetchStart":1316.3000001907349,"redirectEnd":0,"redirectStart":0,"requestStart":1316.3000001907349,"responseEnd":1367.3000001907349,"responseStart":1367.3000001907349,"secureConnectionStart":1316.3000001907349},{"duration":251.89999961853027,"initiatorType":"link","name":"https://jira.mariadb.org/s/d5715adaadd168a9002b108b2b039b50-CDN/lu2cib/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/css/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":1371.7000007629395,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":1371.7000007629395,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1623.6000003814697,"responseStart":0,"secureConnectionStart":0},{"duration":521.3999996185303,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/e65b778d185daf5aee24936755b43da6/_/download/contextbatch/js/browser-metrics-plugin.contrib,-_super,-project.issue.navigator,-jira.view.issue,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":1372.9000005722046,"connectEnd":1372.9000005722046,"connectStart":1372.9000005722046,"domainLookupEnd":1372.9000005722046,"domainLookupStart":1372.9000005722046,"fetchStart":1372.9000005722046,"redirectEnd":0,"redirectStart":0,"requestStart":1372.9000005722046,"responseEnd":1894.3000001907349,"responseStart":1894.3000001907349,"secureConnectionStart":1372.9000005722046},{"duration":537.5999994277954,"initiatorType":"script","name":"https://jira.mariadb.org/s/097ae97cb8fbec7d6ea4bbb1f26955b9-CDN/lu2cib/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/js/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":1373.4000005722046,"connectEnd":1373.4000005722046,"connectStart":1373.4000005722046,"domainLookupEnd":1373.4000005722046,"domainLookupStart":1373.4000005722046,"fetchStart":1373.4000005722046,"redirectEnd":0,"redirectStart":0,"requestStart":1373.4000005722046,"responseEnd":1911,"responseStart":1911,"secureConnectionStart":1373.4000005722046}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":99,"responseStart":310,"responseEnd":314,"domLoading":316,"domInteractive":1897,"domContentLoadedEventStart":1897,"domContentLoadedEventEnd":1967,"domComplete":2229,"loadEventStart":2229,"loadEventEnd":2230,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1855.2000007629395},{"name":"bigPipe.sidebar-id.end","time":1856.1000003814697},{"name":"bigPipe.activity-panel-pipe-id.start","time":1856.2000007629395},{"name":"bigPipe.activity-panel-pipe-id.end","time":1861.1000003814697},{"name":"activityTabFullyLoaded","time":2000}],"measures":[],"correlationId":"19ce3e3b51755b","effectiveType":"4g","downlink":9.2,"rtt":0,"serverDuration":151,"dbReadsTimeInMs":30,"dbConnsTimeInMs":40,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Bug
Major
MDEV-6300-leaks-track.sql.gz pushed to private ftp as the the output from the psergey-mdev4974-xpl1.diff patch inMDEV-4974.graphing showed small increase of memory usage over a day on a test server. I'm not 100 I've captured this.
Happy to try other patches and test stuff out.