The sample MTR calls
|
./mysql-test-run.pl --mysqld=--innodb_random_read_ahead=ON innodb.create-index
|
./mysql-test-run.pl --mysqld=--innodb_flush_sync=0 innodb.create-index
|
end up in
|
Logging: ./mysql-test-run.pl --mysqld=--innodb_flush_sync=0 innodb.create-index
|
vardir: /home/mleich/Server_bin/10.5_asan_Og/mysql-test/var
|
Checking leftover processes...
|
Removing old var directory...
|
- WARNING: Using the 'mysql-test/var' symlink
|
Creating var directory '/home/mleich/Server_bin/10.5_asan_Og/mysql-test/var'...
|
Checking supported features...
|
MariaDB Version 10.5.7-MariaDB-debug
|
- SSL connections supported
|
- binaries are debug compiled
|
- binaries built with wsrep patch
|
Collecting tests...
|
Installing system database...
|
|
and than happens nothing extra == The process does not finish.
|
origin/10.5 440d4b282dd4992d64abdd6289859598db7e5f75 2020-11-02
|
|
origin/10.2 97f3207cf3d1a119fe3d6a56b204e5bf30cec109 2020-11-03 (10.2.35)
|
origin/10.3 2391582ec3f87378581fc5a55266b3d7c6c823d6 2020-11-03 (10.3.26)
|
origin/10.4 5739c7702d83e83ecff5cdd84e0fab899101f9f5 2020-11-03 (10.4.17)
|
have no problem with --innodb_flush_sync=0 or innodb_random_read_ahead=ON
|
|
IMHO the server process should either
|
a) not freeze if meeting these two settings during bootstrap (my preference)
|
... ignore them or fix whatever ...
|
or
|
b) print an error message telling that these settings are not supported during
|
bootstrap and abort.
|
In case b) is picked and both options are important than some adjustment of MTR
|
could be made.
|
{"report":{"fcp":1623.0999999046326,"ttfb":596.7999997138977,"pageVisibility":"visible","entityId":93451,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"9a8bc34b-a171-42d2-8340-acb4343b3829","navigationType":0,"readyForUser":1704.6999998092651,"redirectCount":0,"resourceLoadedEnd":1337.2999997138977,"resourceLoadedStart":612.3999996185303,"resourceTiming":[{"duration":256,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":612.3999996185303,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":612.3999996185303,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":868.3999996185303,"responseStart":0,"secureConnectionStart":0},{"duration":259.30000019073486,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":612.6999998092651,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":612.6999998092651,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":872,"responseStart":0,"secureConnectionStart":0},{"duration":496.8999996185303,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":613,"connectEnd":613,"connectStart":613,"domainLookupEnd":613,"domainLookupStart":613,"fetchStart":613,"redirectEnd":0,"redirectStart":0,"requestStart":873.5999999046326,"responseEnd":1109.8999996185303,"responseStart":891.2999997138977,"secureConnectionStart":613},{"duration":703.1000003814697,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":613.8999996185303,"connectEnd":613.8999996185303,"connectStart":613.8999996185303,"domainLookupEnd":613.8999996185303,"domainLookupStart":613.8999996185303,"fetchStart":613.8999996185303,"redirectEnd":0,"redirectStart":0,"requestStart":874.2999997138977,"responseEnd":1317,"responseStart":895.6999998092651,"secureConnectionStart":613.8999996185303},{"duration":284.40000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":614.0999999046326,"connectEnd":614.0999999046326,"connectStart":614.0999999046326,"domainLookupEnd":614.0999999046326,"domainLookupStart":614.0999999046326,"fetchStart":614.0999999046326,"redirectEnd":0,"redirectStart":0,"requestStart":876.0999999046326,"responseEnd":898.5,"responseStart":897.2999997138977,"secureConnectionStart":614.0999999046326},{"duration":282.30000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":614.2999997138977,"connectEnd":614.2999997138977,"connectStart":614.2999997138977,"domainLookupEnd":614.2999997138977,"domainLookupStart":614.2999997138977,"fetchStart":614.2999997138977,"redirectEnd":0,"redirectStart":0,"requestStart":875.5,"responseEnd":896.5999999046326,"responseStart":894.8999996185303,"secureConnectionStart":614.2999997138977},{"duration":291.80000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":614.3999996185303,"connectEnd":614.3999996185303,"connectStart":614.3999996185303,"domainLookupEnd":614.3999996185303,"domainLookupStart":614.3999996185303,"fetchStart":614.3999996185303,"redirectEnd":0,"redirectStart":0,"requestStart":877.3999996185303,"responseEnd":906.1999998092651,"responseStart":902.1999998092651,"secureConnectionStart":614.3999996185303},{"duration":286,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":614.5999999046326,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":614.5999999046326,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":900.5999999046326,"responseStart":0,"secureConnectionStart":0},{"duration":332.7000002861023,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":614.7999997138977,"connectEnd":614.7999997138977,"connectStart":614.7999997138977,"domainLookupEnd":614.7999997138977,"domainLookupStart":614.7999997138977,"fetchStart":614.7999997138977,"redirectEnd":0,"redirectStart":0,"requestStart":905.1999998092651,"responseEnd":947.5,"responseStart":945.6999998092651,"secureConnectionStart":614.7999997138977},{"duration":286.2000002861023,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":614.8999996185303,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":614.8999996185303,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":901.0999999046326,"responseStart":0,"secureConnectionStart":0},{"duration":332.7999997138977,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":615,"connectEnd":615,"connectStart":615,"domainLookupEnd":615,"domainLookupStart":615,"fetchStart":615,"redirectEnd":0,"redirectStart":0,"requestStart":905.5,"responseEnd":947.7999997138977,"responseStart":946.1999998092651,"secureConnectionStart":615},{"duration":675.7000002861023,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":656.2999997138977,"connectEnd":656.2999997138977,"connectStart":656.2999997138977,"domainLookupEnd":656.2999997138977,"domainLookupStart":656.2999997138977,"fetchStart":656.2999997138977,"redirectEnd":0,"redirectStart":0,"requestStart":1077.7999997138977,"responseEnd":1332,"responseStart":1329.7999997138977,"secureConnectionStart":656.2999997138977},{"duration":680.9000000953674,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":656.3999996185303,"connectEnd":656.3999996185303,"connectStart":656.3999996185303,"domainLookupEnd":656.3999996185303,"domainLookupStart":656.3999996185303,"fetchStart":656.3999996185303,"redirectEnd":0,"redirectStart":0,"requestStart":1294.1999998092651,"responseEnd":1337.2999997138977,"responseStart":1334.3999996185303,"secureConnectionStart":656.3999996185303},{"duration":190,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":1256.3999996185303,"connectEnd":1256.3999996185303,"connectStart":1256.3999996185303,"domainLookupEnd":1256.3999996185303,"domainLookupStart":1256.3999996185303,"fetchStart":1256.3999996185303,"redirectEnd":0,"redirectStart":0,"requestStart":1413.0999999046326,"responseEnd":1446.3999996185303,"responseStart":1445.7999997138977,"secureConnectionStart":1256.3999996185303}],"fetchStart":0,"domainLookupStart":372,"domainLookupEnd":382,"connectStart":382,"connectEnd":403,"secureConnectionStart":391,"requestStart":403,"responseStart":597,"responseEnd":656,"domLoading":602,"domInteractive":1779,"domContentLoadedEventStart":1779,"domContentLoadedEventEnd":1824,"domComplete":2947,"loadEventStart":2947,"loadEventEnd":2947,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1756.2999997138977},{"name":"bigPipe.sidebar-id.end","time":1757.0999999046326},{"name":"bigPipe.activity-panel-pipe-id.start","time":1757.1999998092651},{"name":"bigPipe.activity-panel-pipe-id.end","time":1758.2999997138977},{"name":"activityTabFullyLoaded","time":1839.5999999046326}],"measures":[],"correlationId":"9da47890f60667","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":96,"dbReadsTimeInMs":13,"dbConnsTimeInMs":22,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Bug
Major
mleich, the stated 10.5 revision does not include the fix of
MDEV-24101. Without that fix, I confirm that./mysql-test-run.pl --mysqld=--innodb_random_read_ahead=ON innodb.create-indexwill hang on bootstrap. I changed this report to cover innodb_flush_sync=OFF only, because innodb_random_read_ahead=ON was already covered by
MDEV-24101.I confirm the hang with innodb_flush_sync=0 with the latest 10.5. During the early development of
MDEV-23855, I did test the performance with innodb_flush_sync=OFF, and it did work back then. This must have been broken later.Curiously, for the following invocation, the parameter appears to be ignored for some reason:
./mtr --mysqld=--skip-innodb-flush-sync innodb.create-indexThis might be the reason why I failed to catch this regression later.
I think that a proper fix is to let the page cleaner thread handle the checkpoint flushing also in the innodb_flush_sync=OFF case, and limit the write rate to innodb_io_capacity_max pages per second.
With the default innodb_flush_sync=ON setting, we would attempt to write out up to innodb_io_capacity_max pages that were modified before the target checkpoint LSN, and then perform a checkpoint, and keep looping until the target has been met. With this bug fixed, innodb_flush_sync=OFF would do the same, except that we may pause between the batches so that the rate of innodb_io_capacity_max pages per second will not be exceeded.