Type:
Bug
Priority:
Major
Resolution:
Fixed
Affects Version/s:
10.6 , 10.7(EOL) , 10.8(EOL) , 10.9(EOL) , 10.10(EOL) , 10.11 , 11.0(EOL) , 11.1(EOL)
While repeatedly running the test innodb.alter_copy to test MDEV-29911 , I reproduced an assertion failure in fil_validate() . To make it more likely, apply this patch:
diff --git a/storage/innobase/fil/fil0fil.cc b/storage/innobase/fil/fil0fil.cc
index 365bb11c38f..a00709dab01 100644
--- a/storage/innobase/fil/fil0fil.cc
+++ b/storage/innobase/fil/fil0fil.cc
@@ -200,6 +200,8 @@ fil_system_t fil_system;
extern uint srv_fil_crypt_rotate_key_age;
#ifdef UNIV_DEBUG
+#define fil_validate_skip fil_validate
+#if 0
/** Try fil_validate() every this many times */
# define FIL_VALIDATE_SKIP 17
@@ -218,6 +220,7 @@ fil_validate_skip(void)
check in debug builds. */
return (fil_validate_count++ % FIL_VALIDATE_SKIP) || fil_validate();
}
+#endif
#endif /* UNIV_DEBUG */
/** Look up a tablespace.
I reproduced two rr replay traces that would be fixed by the following:
@@ -1140,8 +1144,10 @@ fil_space_t *recv_sys_t::recover_deferred(const recv_sys_t::map::iterator &p,
uint32_t(file_size / fil_space_t::physical_size(flags));
if (n_pages > size)
{
+ mysql_mutex_lock(&fil_system.mutex);
space->size= node->size= n_pages;
space->set_committed_size();
+ mysql_mutex_unlock(&fil_system.mutex);
goto size_set;
}
}
But, there is more to it. I think that it is best to continuously hold fil_system.mutex around the deferred tablespace creation, or in general, around the creation of a tablespace and adding the first (only) data file to it. With these fixes, the test innodb.alter_copy is stable in the 10.8 branch also after applying the MDEV-29911 changes.
I suspect that these changes should also fix the ut_a(fil_system.n_open == n_open) assertion failures in fil_validate() that have been observed starting with 10.6, occasionally when running the test innodb.table_definition_cache_debug .
blocks
MDEV-29911
InnoDB recovery and mariadb-backup --prepare fail to report detailed progress
Closed
{"report":{"fcp":846,"ttfb":182.5,"pageVisibility":"visible","entityId":121194,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":1,"journeyId":"5d9df479-e89c-4936-8270-376bc46fdb28","navigationType":0,"readyForUser":924.0999999940395,"redirectCount":0,"resourceLoadedEnd":1149.7999999970198,"resourceLoadedStart":206.5,"resourceTiming":[{"duration":183,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bv2/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":206.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":206.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":389.5,"responseStart":0,"secureConnectionStart":0},{"duration":183.09999999403954,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bv2/820016/12ta74/2380add21a9a1006587582385952de73/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":206.79999999701977,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":206.79999999701977,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":389.8999999910593,"responseStart":0,"secureConnectionStart":0},{"duration":191.70000000298023,"initiatorType":"script","name":"https://jira.mariadb.org/s/e9b27a47da5fb0f74a35acd57e9847fb-CDN/lu2bv2/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":206.8999999910593,"connectEnd":206.8999999910593,"connectStart":206.8999999910593,"domainLookupEnd":206.8999999910593,"domainLookupStart":206.8999999910593,"fetchStart":206.8999999910593,"redirectEnd":0,"redirectStart":0,"requestStart":206.8999999910593,"responseEnd":398.59999999403954,"responseStart":398.59999999403954,"secureConnectionStart":206.8999999910593},{"duration":231.20000000298023,"initiatorType":"script","name":"https://jira.mariadb.org/s/c32eb0da7ad9831253f8397e6cc26afd-CDN/lu2bv2/820016/12ta74/2380add21a9a1006587582385952de73/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":207.09999999403954,"connectEnd":207.09999999403954,"connectStart":207.09999999403954,"domainLookupEnd":207.09999999403954,"domainLookupStart":207.09999999403954,"fetchStart":207.09999999403954,"redirectEnd":0,"redirectStart":0,"requestStart":207.09999999403954,"responseEnd":438.29999999701977,"responseStart":438.29999999701977,"secureConnectionStart":207.09999999403954},{"duration":234.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/bc0bcb146314416123c992714ee00ff7-CDN/lu2bv2/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":207.29999999701977,"connectEnd":207.29999999701977,"connectStart":207.29999999701977,"domainLookupEnd":207.29999999701977,"domainLookupStart":207.29999999701977,"fetchStart":207.29999999701977,"redirectEnd":0,"redirectStart":0,"requestStart":207.29999999701977,"responseEnd":441.79999999701977,"responseStart":441.79999999701977,"secureConnectionStart":207.29999999701977},{"duration":235,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":207.59999999403954,"connectEnd":207.59999999403954,"connectStart":207.59999999403954,"domainLookupEnd":207.59999999403954,"domainLookupStart":207.59999999403954,"fetchStart":207.59999999403954,"redirectEnd":0,"redirectStart":0,"requestStart":207.59999999403954,"responseEnd":442.59999999403954,"responseStart":442.59999999403954,"secureConnectionStart":207.59999999403954},{"duration":328.90000000596046,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bv2/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":207.79999999701977,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":207.79999999701977,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":536.7000000029802,"responseStart":0,"secureConnectionStart":0},{"duration":235.29999999701977,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":207.79999999701977,"connectEnd":207.79999999701977,"connectStart":207.79999999701977,"domainLookupEnd":207.79999999701977,"domainLookupStart":207.79999999701977,"fetchStart":207.79999999701977,"redirectEnd":0,"redirectStart":0,"requestStart":207.79999999701977,"responseEnd":443.09999999403954,"responseStart":443.09999999403954,"secureConnectionStart":207.79999999701977},{"duration":235.79999999701977,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":208,"connectEnd":208,"connectStart":208,"domainLookupEnd":208,"domainLookupStart":208,"fetchStart":208,"redirectEnd":0,"redirectStart":0,"requestStart":208,"responseEnd":443.79999999701977,"responseStart":443.79999999701977,"secureConnectionStart":208},{"duration":328.69999998807907,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bv2/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":208.20000000298023,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":208.20000000298023,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":536.8999999910593,"responseStart":0,"secureConnectionStart":0},{"duration":235.90000000596046,"initiatorType":"script","name":"https://jira.mariadb.org/s/719848dd97ebe0663199f49a3936487a-CDN/lu2bv2/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":208.3999999910593,"connectEnd":208.3999999910593,"connectStart":208.3999999910593,"domainLookupEnd":208.3999999910593,"domainLookupStart":208.3999999910593,"fetchStart":208.3999999910593,"redirectEnd":0,"redirectStart":0,"requestStart":208.3999999910593,"responseEnd":444.29999999701977,"responseStart":444.29999999701977,"secureConnectionStart":208.3999999910593},{"duration":424.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":209.20000000298023,"connectEnd":209.20000000298023,"connectStart":209.20000000298023,"domainLookupEnd":209.20000000298023,"domainLookupStart":209.20000000298023,"fetchStart":209.20000000298023,"redirectEnd":0,"redirectStart":0,"requestStart":209.20000000298023,"responseEnd":633.7000000029802,"responseStart":633.7000000029802,"secureConnectionStart":209.20000000298023},{"duration":927.4000000059605,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":209.29999999701977,"connectEnd":209.29999999701977,"connectStart":209.29999999701977,"domainLookupEnd":209.29999999701977,"domainLookupStart":209.29999999701977,"fetchStart":209.29999999701977,"redirectEnd":0,"redirectStart":0,"requestStart":209.29999999701977,"responseEnd":1136.7000000029802,"responseStart":1136.7000000029802,"secureConnectionStart":209.29999999701977},{"duration":131.29999999701977,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":562.7000000029802,"connectEnd":562.7000000029802,"connectStart":562.7000000029802,"domainLookupEnd":562.7000000029802,"domainLookupStart":562.7000000029802,"fetchStart":562.7000000029802,"redirectEnd":0,"redirectStart":0,"requestStart":562.7000000029802,"responseEnd":694,"responseStart":694,"secureConnectionStart":562.7000000029802},{"duration":347.70000000298023,"initiatorType":"link","name":"https://jira.mariadb.org/s/d5715adaadd168a9002b108b2b039b50-CDN/lu2bv2/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/css/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":802,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":802,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1149.7000000029802,"responseStart":0,"secureConnectionStart":0},{"duration":347.29999999701977,"initiatorType":"link","name":"https://jira.mariadb.org/s/50bc9be5bfead1a25e72c1a9338c94f6-CDN/lu2bv2/820016/12ta74/e108c7645258ccb43280ed3404e3e949/_/download/contextbatch/css/com.atlassian.jira.plugins.jira-development-integration-plugin:0,-_super,-jira.view.issue,-jira.global,-jira.general,-jira.browse.project,-project.issue.navigator,-atl.general/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":802.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":802.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1149.7999999970198,"responseStart":0,"secureConnectionStart":0},{"duration":335.59999999403954,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/e65b778d185daf5aee24936755b43da6/_/download/contextbatch/js/browser-metrics-plugin.contrib,-_super,-project.issue.navigator,-jira.view.issue,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":803.2999999970198,"connectEnd":803.2999999970198,"connectStart":803.2999999970198,"domainLookupEnd":803.2999999970198,"domainLookupStart":803.2999999970198,"fetchStart":803.2999999970198,"redirectEnd":0,"redirectStart":0,"requestStart":803.2999999970198,"responseEnd":1138.8999999910593,"responseStart":1138.8999999910593,"secureConnectionStart":803.2999999970198},{"duration":341.30000001192093,"initiatorType":"script","name":"https://jira.mariadb.org/s/630dda803a823fdd5771c4338338e018-CDN/lu2bv2/820016/12ta74/e108c7645258ccb43280ed3404e3e949/_/download/contextbatch/js/com.atlassian.jira.plugins.jira-development-integration-plugin:0,-_super,-jira.view.issue,-jira.global,-jira.general,-jira.browse.project,-project.issue.navigator,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":803.8999999910593,"connectEnd":803.8999999910593,"connectStart":803.8999999910593,"domainLookupEnd":803.8999999910593,"domainLookupStart":803.8999999910593,"fetchStart":803.8999999910593,"redirectEnd":0,"redirectStart":0,"requestStart":803.8999999910593,"responseEnd":1145.2000000029802,"responseStart":1145.2000000029802,"secureConnectionStart":803.8999999910593},{"duration":340.09999999403954,"initiatorType":"script","name":"https://jira.mariadb.org/s/53a43b6764f587426c7bb9a150184c00-CDN/lu2bv2/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/js/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":803.7000000029802,"connectEnd":803.7000000029802,"connectStart":803.7000000029802,"domainLookupEnd":803.7000000029802,"domainLookupStart":803.7000000029802,"fetchStart":803.7000000029802,"redirectEnd":0,"redirectStart":0,"requestStart":803.7000000029802,"responseEnd":1143.7999999970198,"responseStart":1143.7999999970198,"secureConnectionStart":803.7000000029802},{"duration":362.30000001192093,"initiatorType":"script","name":"https://www.google-analytics.com/analytics.js","startTime":840.3999999910593,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":840.3999999910593,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1202.7000000029802,"responseStart":0,"secureConnectionStart":0}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":22,"responseStart":182,"responseEnd":184,"domLoading":204,"domInteractive":1159,"domContentLoadedEventStart":1159,"domContentLoadedEventEnd":1197,"domComplete":2713,"loadEventStart":2713,"loadEventEnd":2715,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1139},{"name":"bigPipe.sidebar-id.end","time":1139.8999999910593},{"name":"bigPipe.activity-panel-pipe-id.start","time":1140},{"name":"bigPipe.activity-panel-pipe-id.end","time":1142.2999999970198},{"name":"activityTabFullyLoaded","time":1206.2000000029802}],"measures":[],"correlationId":"9d1ffb29b85b90","effectiveType":"4g","downlink":9.5,"rtt":0,"serverDuration":97,"dbReadsTimeInMs":12,"dbConnsTimeInMs":20,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}