Type:
Bug
Priority:
Major
Resolution:
Fixed
Affects Version/s:
N/A
Two examples follow. I have a few more if needed.
Case 1
bb-10.6-monty-innodb 790a52644c
2021-05-11 19:04:37 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=54303,54303
2021-05-11 19:04:41 0 [Note] InnoDB: Starting final batch to recover 2264 pages from redo log.
2021-05-11 19:04:44 0 [ERROR] InnoDB: Cannot replay rename of tablespace 81 from './test/tt6.ibd' to './test/table75_innodb_int_autoinc.ibd' because the target file exists
2021-05-11 19:04:44 0 [ERROR] InnoDB: Plugin initialization aborted at srv0start.cc[1473] with error Data structure corruption
In the case above, the test was running concurrent DDL in 4 threads and was sigkilled in the process. The last executed statements in each thread, according to the general log, were
28 Query DROP TABLE `table53_innodb_int_autoinc`, `table76_innodb_int_autoinc`, vv2
30 Query ALTER TABLE `table89_innodb_int_autoinc` DROP KEY `ncol4`, ADD KEY IF NOT EXISTS n ( `ncol4` ) COMMENT 'pad'
31 Query UNLOCK TABLES
29 Query RENAME TABLE `t15` TO tt6
The logs, datadirs and rr profiles are available.
Case 2
bb-10.6-monty-innodb 790a52644c
2021-05-11 17:59:28 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=54303,54303
2021-05-11 17:59:29 0 [Note] InnoDB: Starting final batch to recover 456 pages from redo log.
2021-05-11 17:59:30 0 [ERROR] InnoDB: Cannot replay rename of tablespace 13 from './test/tt11.ibd' to './test/t5_innodb.ibd' because the target file exists
2021-05-11 17:59:30 0 [ERROR] InnoDB: Plugin initialization aborted at srv0start.cc[1473] with error Data structure corruption
In the case above, the test was running various DDL in a single thread in PS protocol, got sigkilled upon running a query, and failed with the error above upon recovery.
The logs and the data directories are available. Unfortunately, in PS protocol the last statement may be missing from the general log.
rr profiles are also available, but the profile before crash seems to be broken somehow.
So, this case is better than the previous one in the sense that there was only one thread involved, but worse in everything else.
I think I've seen similar failures on previous releases without atomic DDL, so it's possibly not anything new, but I would expect it to be gone with atomic DDL. Strangely, I didn't see them in previous tests on atomic DDL, but now they have suddenly appeared in bulk.
Transition
Time In Source Status
Execution Times
Open
In Progress
7h 21m
1
In Progress
Closed
9h 34m
1
{"report":{"fcp":807.8999998569489,"ttfb":163.79999995231628,"pageVisibility":"visible","entityId":99568,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":1,"journeyId":"60b164b2-51cf-428b-9d24-fa3c0ca20dc5","navigationType":0,"readyForUser":888.2999999523163,"redirectCount":0,"resourceLoadedEnd":930.6999998092651,"resourceLoadedStart":169.79999995231628,"resourceTiming":[{"duration":135.70000004768372,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":169.79999995231628,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":169.79999995231628,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":305.5,"responseStart":0,"secureConnectionStart":0},{"duration":135.69999980926514,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":170,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":170,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":305.69999980926514,"responseStart":0,"secureConnectionStart":0},{"duration":144.60000014305115,"initiatorType":"script","name":"https://jira.mariadb.org/s/fbf975c0cce4b1abf04784eeae9ba1f4-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":170.19999980926514,"connectEnd":170.19999980926514,"connectStart":170.19999980926514,"domainLookupEnd":170.19999980926514,"domainLookupStart":170.19999980926514,"fetchStart":170.19999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":170.19999980926514,"responseEnd":314.7999999523163,"responseStart":314.7999999523163,"secureConnectionStart":170.19999980926514},{"duration":259.40000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/099b33461394b8015fc36c0a4b96e19f-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":170.39999985694885,"connectEnd":170.39999985694885,"connectStart":170.39999985694885,"domainLookupEnd":170.39999985694885,"domainLookupStart":170.39999985694885,"fetchStart":170.39999985694885,"redirectEnd":0,"redirectStart":0,"requestStart":170.39999985694885,"responseEnd":429.7999999523163,"responseStart":429.7999999523163,"secureConnectionStart":170.39999985694885},{"duration":263.39999985694885,"initiatorType":"script","name":"https://jira.mariadb.org/s/94c15bff32baef80f4096a08aceae8bc-CDN/lu2bu7/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":170.5,"connectEnd":170.5,"connectStart":170.5,"domainLookupEnd":170.5,"domainLookupStart":170.5,"fetchStart":170.5,"redirectEnd":0,"redirectStart":0,"requestStart":170.5,"responseEnd":433.89999985694885,"responseStart":433.89999985694885,"secureConnectionStart":170.5},{"duration":263.7999999523163,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":170.59999990463257,"connectEnd":170.59999990463257,"connectStart":170.59999990463257,"domainLookupEnd":170.59999990463257,"domainLookupStart":170.59999990463257,"fetchStart":170.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":170.59999990463257,"responseEnd":434.39999985694885,"responseStart":434.39999985694885,"secureConnectionStart":170.59999990463257},{"duration":264.10000014305115,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":170.69999980926514,"connectEnd":170.69999980926514,"connectStart":170.69999980926514,"domainLookupEnd":170.69999980926514,"domainLookupStart":170.69999980926514,"fetchStart":170.69999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":170.69999980926514,"responseEnd":434.7999999523163,"responseStart":434.7999999523163,"secureConnectionStart":170.69999980926514},{"duration":264.59999990463257,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bu7/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":170.79999995231628,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":170.79999995231628,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":435.39999985694885,"responseStart":0,"secureConnectionStart":0},{"duration":264.40000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":170.89999985694885,"connectEnd":170.89999985694885,"connectStart":170.89999985694885,"domainLookupEnd":170.89999985694885,"domainLookupStart":170.89999985694885,"fetchStart":170.89999985694885,"redirectEnd":0,"redirectStart":0,"requestStart":170.89999985694885,"responseEnd":435.2999999523163,"responseStart":435.2999999523163,"secureConnectionStart":170.89999985694885},{"duration":264.59999990463257,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":171,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":171,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":435.59999990463257,"responseStart":0,"secureConnectionStart":0},{"duration":264.7000000476837,"initiatorType":"script","name":"https://jira.mariadb.org/s/3339d87fa2538a859872f2df449bf8d0-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":171.09999990463257,"connectEnd":171.09999990463257,"connectStart":171.09999990463257,"domainLookupEnd":171.09999990463257,"domainLookupStart":171.09999990463257,"fetchStart":171.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":171.09999990463257,"responseEnd":435.7999999523163,"responseStart":435.7999999523163,"secureConnectionStart":171.09999990463257},{"duration":358.2000000476837,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":172.09999990463257,"connectEnd":172.09999990463257,"connectStart":172.09999990463257,"domainLookupEnd":172.09999990463257,"domainLookupStart":172.09999990463257,"fetchStart":172.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":172.09999990463257,"responseEnd":530.2999999523163,"responseStart":530.2999999523163,"secureConnectionStart":172.09999990463257},{"duration":630.7000000476837,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":172.09999990463257,"connectEnd":172.09999990463257,"connectStart":172.09999990463257,"domainLookupEnd":172.09999990463257,"domainLookupStart":172.09999990463257,"fetchStart":172.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":172.09999990463257,"responseEnd":802.7999999523163,"responseStart":802.7999999523163,"secureConnectionStart":172.09999990463257},{"duration":60.700000047683716,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":470.89999985694885,"connectEnd":470.89999985694885,"connectStart":470.89999985694885,"domainLookupEnd":470.89999985694885,"domainLookupStart":470.89999985694885,"fetchStart":470.89999985694885,"redirectEnd":0,"redirectStart":0,"requestStart":470.89999985694885,"responseEnd":531.5999999046326,"responseStart":531.5999999046326,"secureConnectionStart":470.89999985694885},{"duration":206.39999985694885,"initiatorType":"link","name":"https://jira.mariadb.org/s/d5715adaadd168a9002b108b2b039b50-CDN/lu2bu7/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/css/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":724.2999999523163,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":724.2999999523163,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":930.6999998092651,"responseStart":0,"secureConnectionStart":0}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":18,"responseStart":164,"responseEnd":167,"domLoading":168,"domInteractive":944,"domContentLoadedEventStart":944,"domContentLoadedEventEnd":994,"domComplete":1112,"loadEventStart":1112,"loadEventEnd":1113,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":923},{"name":"bigPipe.sidebar-id.end","time":923.7999999523163},{"name":"bigPipe.activity-panel-pipe-id.start","time":923.8999998569489},{"name":"bigPipe.activity-panel-pipe-id.end","time":924.8999998569489},{"name":"activityTabFullyLoaded","time":1006.0999999046326}],"measures":[],"correlationId":"f8986b02a1b5b3","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":86,"dbReadsTimeInMs":19,"dbConnsTimeInMs":26,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}