I want to confirm if this is the expected behaviour on tmpfs/ramdisk filesystem
While benchmarking sysbench oltp_update_index lua for a 150 sec run I see drop in tps consistently after 80 sec . This is happening both in intel x86 as well as ARM platform but hurting ARM a little more as good as 10%,
Setup : In memory filesystem( datadir is kept in tmpfs filesystem) and bufferpool is 50gb, innodb_flush_log_at_trx_commit =0,and logfile size is 2 gb ,bufferpool instance is 30
Test : 20 tables with 100000 records in each table. Run for 64 threads with sysbench oltp_update_index.lua (update tests)
Time : 150 sec
Few observation :
1) I don’t see the issue in pure I/O operations ie The bufferpool size is kept default and datadir is in ssd’s instead of tmpfs.
2) The tps as expected is heavily dropped in pure I/O so the issues seems to have masked.
3) Flushing seems to be slow when we do in memory test and not able to cope up with read speed in tmpfs.
4) In pure I/O read/write test I see innodb_flush_sync =0 is not recommended as the TPS is almost 40% compared to async operations.
017-11-24 9:40:34 76 [Note] Detected table cache mutex contention at instance 1: 20% waits. Additional table cache instance activated. Number of instances after activation: 2.
[ 10s ] thds: 64 tps: 138157.88 qps: 138157.88 (r/w/o: 0.00/138157.88/0.00) lat (ms,95%): 1.14 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 64 tps: 164025.68 qps: 164025.68 (r/w/o: 0.00/164025.68/0.00) lat (ms,95%): 0.94 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 64 tps: 164611.23 qps: 164611.23 (r/w/o: 0.00/164611.23/0.00) lat (ms,95%): 0.94 err/s: 0.00 reconn/s: 0.00
[ 40s ] thds: 64 tps: 164317.42 qps: 164317.42 (r/w/o: 0.00/164317.42/0.00) lat (ms,95%): 0.94 err/s: 0.00 reconn/s: 0.00
[ 50s ] thds: 64 tps: 164128.75 qps: 164128.85 (r/w/o: 0.00/164128.85/0.00) lat (ms,95%): 0.94 err/s: 0.00 reconn/s: 0.00
[ 60s ] thds: 64 tps: 164028.19 qps: 164028.19 (r/w/o: 0.00/164028.19/0.00) lat (ms,95%): 0.94 err/s: 0.00 reconn/s: 0.00
[ 70s ] thds: 64 tps: 148203.75 qps: 148203.65 (r/w/o: 0.00/148203.65/0.00) lat (ms,95%): 1.23 err/s: 0.00 reconn/s: 0.00
[ 80s ] thds: 64 tps: 113156.11 qps: 113156.11 (r/w/o: 0.00/113156.11/0.00) lat (ms,95%): 1.58 err/s: 0.00 reconn/s: 0.00
[ 90s ] thds: 64 tps: 118685.99 qps: 118685.99 (r/w/o: 0.00/118685.99/0.00) lat (ms,95%): 1.52 err/s: 0.00 reconn/s: 0.00
[ 100s ] thds: 64 tps: 118142.32 qps: 118142.32 (r/w/o: 0.00/118142.32/0.00) lat (ms,95%): 1.55 err/s: 0.00 reconn/s: 0.00
[ 110s ] thds: 64 tps: 122747.22 qps: 122747.22 (r/w/o: 0.00/122747.22/0.00) lat (ms,95%): 1.50 err/s: 0.00 reconn/s: 0.00
[ 120s ] thds: 64 tps: 112475.31 qps: 112475.31 (r/w/o: 0.00/112475.31/0.00) lat (ms,95%): 1.58 err/s: 0.00 reconn/s: 0.00
[ 130s ] thds: 64 tps: 112336.17 qps: 112336.17 (r/w/o: 0.00/112336.17/0.00) lat (ms,95%): 1.58 err/s: 0.00 reconn/s: 0.00
[ 140s ] thds: 64 tps: 121541.22 qps: 121541.22 (r/w/o: 0.00/121541.22/0.00) lat (ms,95%): 1.50 err/s: 0.00 reconn/s: 0.00
[ 150s ] thds: 64 tps: 116951.59 qps: 116951.59 (r/w/o: 0.00/116951.59/0.00) lat (ms,95%): 1.55 err/s: 0.00 reconn/s: 0.00
I modified the cnf files to use the below two parameter
innodb_flush_sync=0
innodb_io_capacity =8000
[ 10s ] thds: 64 tps: 139392.95 qps: 139392.95 (r/w/o: 0.00/139392.95/0.00) lat (ms,95%): 1.08 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 64 tps: 163050.96 qps: 163050.96 (r/w/o: 0.00/163050.96/0.00) lat (ms,95%): 0.90 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 64 tps: 162052.53 qps: 162052.53 (r/w/o: 0.00/162052.53/0.00) lat (ms,95%): 0.90 err/s: 0.00 reconn/s: 0.00
[ 40s ] thds: 64 tps: 162532.91 qps: 162532.91 (r/w/o: 0.00/162532.91/0.00) lat (ms,95%): 0.92 err/s: 0.00 reconn/s: 0.00
[ 50s ] thds: 64 tps: 163324.90 qps: 163324.90 (r/w/o: 0.00/163324.90/0.00) lat (ms,95%): 0.90 err/s: 0.00 reconn/s: 0.00
[ 60s ] thds: 64 tps: 164528.45 qps: 164528.65 (r/w/o: 0.00/164528.65/0.00) lat (ms,95%): 0.89 err/s: 0.00 reconn/s: 0.00
[ 70s ] thds: 64 tps: 164178.11 qps: 164177.91 (r/w/o: 0.00/164177.91/0.00) lat (ms,95%): 0.89 err/s: 0.00 reconn/s: 0.00
[ 80s ] thds: 64 tps: 162853.44 qps: 162853.44 (r/w/o: 0.00/162853.44/0.00) lat (ms,95%): 0.90 err/s: 0.00 reconn/s: 0.00
[ 90s ] thds: 64 tps: 163859.76 qps: 163859.76 (r/w/o: 0.00/163859.76/0.00) lat (ms,95%): 0.89 err/s: 0.00 reconn/s: 0.00
[ 100s ] thds: 64 tps: 163382.50 qps: 163382.50 (r/w/o: 0.00/163382.50/0.00) lat (ms,95%): 0.89 err/s: 0.00 reconn/s: 0.00
[ 110s ] thds: 64 tps: 164321.72 qps: 164321.82 (r/w/o: 0.00/164321.82/0.00) lat (ms,95%): 0.87 err/s: 0.00 reconn/s: 0.00
[ 120s ] thds: 64 tps: 163324.30 qps: 163324.20 (r/w/o: 0.00/163324.20/0.00) lat (ms,95%): 0.90 err/s: 0.00 reconn/s: 0.00
[ 130s ] thds: 64 tps: 164130.22 qps: 164130.22 (r/w/o: 0.00/164130.22/0.00) lat (ms,95%): 0.89 err/s: 0.00 reconn/s: 0.00
[ 140s ] thds: 64 tps: 163013.68 qps: 163013.68 (r/w/o: 0.00/163013.68/0.00) lat (ms,95%): 0.90 err/s: 0.00 reconn/s: 0.00
[ 150s ] thds: 64 tps: 155699.33 qps: 155699.33 (r/w/o: 0.00/155699.33/0.00) lat (ms,95%): 1.08 err/s: 0.00 reconn/s: 0.00
- blocks
-
MDEV-14442
Optimization for ARM64 platform.
-
-
Open
Transition |
Time In Source Status |
Execution Times |
Open |
|
Closed |
|
1382d 3h 45m
|
1
|
{"report":{"fcp":991.9000005722046,"ttfb":221.70000076293945,"pageVisibility":"visible","entityId":64651,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"1e622336-8319-44fc-b539-c404b3f166fe","navigationType":0,"readyForUser":1075.1000003814697,"redirectCount":0,"resourceLoadedEnd":1122.5,"resourceLoadedStart":236.80000019073486,"resourceTiming":[{"duration":167.19999980926514,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":236.80000019073486,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":236.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":404,"responseStart":0,"secureConnectionStart":0},{"duration":167.30000019073486,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/2bf333562ca6724060a9d5f1535471f6/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":237.10000038146973,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":237.10000038146973,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":404.4000005722046,"responseStart":0,"secureConnectionStart":0},{"duration":200.80000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":237.30000019073486,"connectEnd":237.30000019073486,"connectStart":237.30000019073486,"domainLookupEnd":237.30000019073486,"domainLookupStart":237.30000019073486,"fetchStart":237.30000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":237.30000019073486,"responseEnd":438.1000003814697,"responseStart":438.1000003814697,"secureConnectionStart":237.30000019073486},{"duration":293.1000003814697,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/2bf333562ca6724060a9d5f1535471f6/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":237.5,"connectEnd":237.5,"connectStart":237.5,"domainLookupEnd":237.5,"domainLookupStart":237.5,"fetchStart":237.5,"redirectEnd":0,"redirectStart":0,"requestStart":237.5,"responseEnd":530.6000003814697,"responseStart":530.6000003814697,"secureConnectionStart":237.5},{"duration":297,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":237.70000076293945,"connectEnd":237.70000076293945,"connectStart":237.70000076293945,"domainLookupEnd":237.70000076293945,"domainLookupStart":237.70000076293945,"fetchStart":237.70000076293945,"redirectEnd":0,"redirectStart":0,"requestStart":237.70000076293945,"responseEnd":534.7000007629395,"responseStart":534.7000007629395,"secureConnectionStart":237.70000076293945},{"duration":297.3999996185303,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":237.9000005722046,"connectEnd":237.9000005722046,"connectStart":237.9000005722046,"domainLookupEnd":237.9000005722046,"domainLookupStart":237.9000005722046,"fetchStart":237.9000005722046,"redirectEnd":0,"redirectStart":0,"requestStart":237.9000005722046,"responseEnd":535.3000001907349,"responseStart":535.3000001907349,"secureConnectionStart":237.9000005722046},{"duration":297.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":238.10000038146973,"connectEnd":238.10000038146973,"connectStart":238.10000038146973,"domainLookupEnd":238.10000038146973,"domainLookupStart":238.10000038146973,"fetchStart":238.10000038146973,"redirectEnd":0,"redirectStart":0,"requestStart":238.10000038146973,"responseEnd":535.6000003814697,"responseStart":535.6000003814697,"secureConnectionStart":238.10000038146973},{"duration":345.69999980926514,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":238.30000019073486,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":238.30000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":584,"responseStart":0,"secureConnectionStart":0},{"duration":297.6000003814697,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":238.5,"connectEnd":238.5,"connectStart":238.5,"domainLookupEnd":238.5,"domainLookupStart":238.5,"fetchStart":238.5,"redirectEnd":0,"redirectStart":0,"requestStart":238.5,"responseEnd":536.1000003814697,"responseStart":536.1000003814697,"secureConnectionStart":238.5},{"duration":345.6000003814697,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":238.60000038146973,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":238.60000038146973,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":584.2000007629395,"responseStart":0,"secureConnectionStart":0},{"duration":298.0999994277954,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":238.70000076293945,"connectEnd":238.70000076293945,"connectStart":238.70000076293945,"domainLookupEnd":238.70000076293945,"domainLookupStart":238.70000076293945,"fetchStart":238.70000076293945,"redirectEnd":0,"redirectStart":0,"requestStart":238.70000076293945,"responseEnd":536.8000001907349,"responseStart":536.8000001907349,"secureConnectionStart":238.70000076293945},{"duration":471.79999923706055,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":239.70000076293945,"connectEnd":239.70000076293945,"connectStart":239.70000076293945,"domainLookupEnd":239.70000076293945,"domainLookupStart":239.70000076293945,"fetchStart":239.70000076293945,"redirectEnd":0,"redirectStart":0,"requestStart":239.70000076293945,"responseEnd":711.5,"responseStart":711.5,"secureConnectionStart":239.70000076293945},{"duration":879.9000005722046,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":239.80000019073486,"connectEnd":239.80000019073486,"connectStart":239.80000019073486,"domainLookupEnd":239.80000019073486,"domainLookupStart":239.80000019073486,"fetchStart":239.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":239.80000019073486,"responseEnd":1119.7000007629395,"responseStart":1119.7000007629395,"secureConnectionStart":239.80000019073486},{"duration":105.09999942779541,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":606.9000005722046,"connectEnd":606.9000005722046,"connectStart":606.9000005722046,"domainLookupEnd":606.9000005722046,"domainLookupStart":606.9000005722046,"fetchStart":606.9000005722046,"redirectEnd":0,"redirectStart":0,"requestStart":606.9000005722046,"responseEnd":712,"responseStart":712,"secureConnectionStart":606.9000005722046},{"duration":214.0999994277954,"initiatorType":"link","name":"https://jira.mariadb.org/s/d5715adaadd168a9002b108b2b039b50-CDN/lu2cib/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/css/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":906.4000005722046,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":906.4000005722046,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1120.5,"responseStart":0,"secureConnectionStart":0},{"duration":215.39999961853027,"initiatorType":"link","name":"https://jira.mariadb.org/s/50bc9be5bfead1a25e72c1a9338c94f6-CDN/lu2cib/820016/12ta74/e108c7645258ccb43280ed3404e3e949/_/download/contextbatch/css/com.atlassian.jira.plugins.jira-development-integration-plugin:0,-_super,-jira.view.issue,-jira.global,-jira.general,-jira.browse.project,-project.issue.navigator,-atl.general/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":907.1000003814697,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":907.1000003814697,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1122.5,"responseStart":0,"secureConnectionStart":0}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":65,"responseStart":221,"responseEnd":225,"domLoading":234,"domInteractive":1141,"domContentLoadedEventStart":1141,"domContentLoadedEventEnd":1190,"domComplete":1729,"loadEventStart":1729,"loadEventEnd":1729,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1123.3000001907349},{"name":"bigPipe.sidebar-id.end","time":1124.2000007629395},{"name":"bigPipe.activity-panel-pipe-id.start","time":1124.3000001907349},{"name":"bigPipe.activity-panel-pipe-id.end","time":1125.2000007629395},{"name":"activityTabFullyLoaded","time":1202.8000001907349}],"measures":[],"correlationId":"6f65d17a18550","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":103,"dbReadsTimeInMs":15,"dbConnsTimeInMs":23,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}