The sample MTR calls
|
./mysql-test-run.pl --mysqld=--innodb_random_read_ahead=ON innodb.create-index
|
./mysql-test-run.pl --mysqld=--innodb_flush_sync=0 innodb.create-index
|
end up in
|
Logging: ./mysql-test-run.pl --mysqld=--innodb_flush_sync=0 innodb.create-index
|
vardir: /home/mleich/Server_bin/10.5_asan_Og/mysql-test/var
|
Checking leftover processes...
|
Removing old var directory...
|
- WARNING: Using the 'mysql-test/var' symlink
|
Creating var directory '/home/mleich/Server_bin/10.5_asan_Og/mysql-test/var'...
|
Checking supported features...
|
MariaDB Version 10.5.7-MariaDB-debug
|
- SSL connections supported
|
- binaries are debug compiled
|
- binaries built with wsrep patch
|
Collecting tests...
|
Installing system database...
|
|
and than happens nothing extra == The process does not finish.
|
origin/10.5 440d4b282dd4992d64abdd6289859598db7e5f75 2020-11-02
|
|
origin/10.2 97f3207cf3d1a119fe3d6a56b204e5bf30cec109 2020-11-03 (10.2.35)
|
origin/10.3 2391582ec3f87378581fc5a55266b3d7c6c823d6 2020-11-03 (10.3.26)
|
origin/10.4 5739c7702d83e83ecff5cdd84e0fab899101f9f5 2020-11-03 (10.4.17)
|
have no problem with --innodb_flush_sync=0 or innodb_random_read_ahead=ON
|
|
IMHO the server process should either
|
a) not freeze if meeting these two settings during bootstrap (my preference)
|
... ignore them or fix whatever ...
|
or
|
b) print an error message telling that these settings are not supported during
|
bootstrap and abort.
|
In case b) is picked and both options are important than some adjustment of MTR
|
could be made.
|
{"report":{"fcp":1427.7000000476837,"ttfb":344,"pageVisibility":"visible","entityId":93451,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"7a17070e-c28d-4944-a487-51bd7a9b29e7","navigationType":0,"readyForUser":1554.0999999046326,"redirectCount":0,"resourceLoadedEnd":1106.5999999046326,"resourceLoadedStart":349.7999999523163,"resourceTiming":[{"duration":49.10000014305115,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":349.7999999523163,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":349.7999999523163,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":398.90000009536743,"responseStart":0,"secureConnectionStart":0},{"duration":50,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":350.2000000476837,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":350.2000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":400.2000000476837,"responseStart":0,"secureConnectionStart":0},{"duration":299.19999980926514,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":350.40000009536743,"connectEnd":350.40000009536743,"connectStart":350.40000009536743,"domainLookupEnd":350.40000009536743,"domainLookupStart":350.40000009536743,"fetchStart":350.40000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":414,"responseEnd":649.5999999046326,"responseStart":466.5,"secureConnectionStart":350.40000009536743},{"duration":616.5999999046326,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":350.5,"connectEnd":350.5,"connectStart":350.5,"domainLookupEnd":350.5,"domainLookupStart":350.5,"fetchStart":350.5,"redirectEnd":0,"redirectStart":0,"requestStart":420.09999990463257,"responseEnd":967.0999999046326,"responseStart":641.7999999523163,"secureConnectionStart":350.5},{"duration":262.2000000476837,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":350.7999999523163,"connectEnd":350.7999999523163,"connectStart":350.7999999523163,"domainLookupEnd":350.7999999523163,"domainLookupStart":350.7999999523163,"fetchStart":350.7999999523163,"redirectEnd":0,"redirectStart":0,"requestStart":420.2000000476837,"responseEnd":613,"responseStart":611.5,"secureConnectionStart":350.7999999523163},{"duration":260.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":350.90000009536743,"connectEnd":350.90000009536743,"connectStart":350.90000009536743,"domainLookupEnd":350.90000009536743,"domainLookupStart":350.90000009536743,"fetchStart":350.90000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":420.2999999523163,"responseEnd":611.4000000953674,"responseStart":610.5,"secureConnectionStart":350.90000009536743},{"duration":90,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":351.09999990463257,"connectEnd":428.90000009536743,"connectStart":428.90000009536743,"domainLookupEnd":428.90000009536743,"domainLookupStart":428.90000009536743,"fetchStart":351.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":429.40000009536743,"responseEnd":441.09999990463257,"responseStart":440,"secureConnectionStart":428.90000009536743},{"duration":68.70000004768372,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":351.2000000476837,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":351.2000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":419.90000009536743,"responseStart":0,"secureConnectionStart":0},{"duration":96.09999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":351.40000009536743,"connectEnd":351.40000009536743,"connectStart":351.40000009536743,"domainLookupEnd":351.40000009536743,"domainLookupStart":351.40000009536743,"fetchStart":351.40000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":435,"responseEnd":447.5,"responseStart":446.5,"secureConnectionStart":351.40000009536743},{"duration":81.79999995231628,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":351.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":351.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":433.2999999523163,"responseStart":0,"secureConnectionStart":0},{"duration":99.29999995231628,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":351.7000000476837,"connectEnd":351.7000000476837,"connectStart":351.7000000476837,"domainLookupEnd":351.7000000476837,"domainLookupStart":351.7000000476837,"fetchStart":351.7000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":436,"responseEnd":451,"responseStart":447.7999999523163,"secureConnectionStart":351.7000000476837},{"duration":735.0999999046326,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":369.7000000476837,"connectEnd":369.7000000476837,"connectStart":369.7000000476837,"domainLookupEnd":369.7000000476837,"domainLookupStart":369.7000000476837,"fetchStart":369.7000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":527.4000000953674,"responseEnd":1104.7999999523163,"responseStart":1091.5999999046326,"secureConnectionStart":369.7000000476837},{"duration":733.1999998092651,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":373.40000009536743,"connectEnd":373.40000009536743,"connectStart":373.40000009536743,"domainLookupEnd":373.40000009536743,"domainLookupStart":373.40000009536743,"fetchStart":373.40000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":558.2999999523163,"responseEnd":1106.5999999046326,"responseStart":1096.0999999046326,"secureConnectionStart":373.40000009536743},{"duration":175.20000004768372,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":879.7000000476837,"connectEnd":879.7000000476837,"connectStart":879.7000000476837,"domainLookupEnd":879.7000000476837,"domainLookupStart":879.7000000476837,"fetchStart":879.7000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":964.7000000476837,"responseEnd":1054.9000000953674,"responseStart":1051,"secureConnectionStart":879.7000000476837}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":190,"responseStart":344,"responseEnd":372,"domLoading":348,"domInteractive":1660,"domContentLoadedEventStart":1660,"domContentLoadedEventEnd":1720,"domComplete":3215,"loadEventStart":3215,"loadEventEnd":3215,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1629.5},{"name":"bigPipe.sidebar-id.end","time":1630.2000000476837},{"name":"bigPipe.activity-panel-pipe-id.start","time":1630.4000000953674},{"name":"bigPipe.activity-panel-pipe-id.end","time":1631.5},{"name":"activityTabFullyLoaded","time":1735.4000000953674}],"measures":[],"correlationId":"caeb9a88fdb85a","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":92,"dbReadsTimeInMs":14,"dbConnsTimeInMs":22,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Bug
Major
mleich, the stated 10.5 revision does not include the fix of
MDEV-24101. Without that fix, I confirm that./mysql-test-run.pl --mysqld=--innodb_random_read_ahead=ON innodb.create-indexwill hang on bootstrap. I changed this report to cover innodb_flush_sync=OFF only, because innodb_random_read_ahead=ON was already covered by
MDEV-24101.I confirm the hang with innodb_flush_sync=0 with the latest 10.5. During the early development of
MDEV-23855, I did test the performance with innodb_flush_sync=OFF, and it did work back then. This must have been broken later.Curiously, for the following invocation, the parameter appears to be ignored for some reason:
./mtr --mysqld=--skip-innodb-flush-sync innodb.create-indexThis might be the reason why I failed to catch this regression later.
I think that a proper fix is to let the page cleaner thread handle the checkpoint flushing also in the innodb_flush_sync=OFF case, and limit the write rate to innodb_io_capacity_max pages per second.
With the default innodb_flush_sync=ON setting, we would attempt to write out up to innodb_io_capacity_max pages that were modified before the target checkpoint LSN, and then perform a checkpoint, and keep looping until the target has been met. With this bug fixed, innodb_flush_sync=OFF would do the same, except that we may pause between the batches so that the rate of innodb_io_capacity_max pages per second will not be exceeded.