Backup fails for different tables (usually small, not always the same, and sometimes it completes successfully), with messages like these:
...
2019-12-20 2:50:05 140619606296320 [Note] InnoDB: Log sequence number at the start 1919250543 and the end 1933193007 do not match
[01] mariabackup: Database page corruption detected at page 5, retrying...
2019-12-20 2:50:05 140619606296320 [Note] InnoDB: Log sequence number at the start 1919250543 and the end 1933193007 do not match
2019-12-20 2:50:05 140619606296320 [Note] InnoDB: Log sequence number at the start 1919250543 and the end 1933193007 do not match
2019-12-20 2:50:06 140619606296320 [Note] InnoDB: Log sequence number at the start 1919250543 and the end 1933193007 do not match
2019-12-20 2:50:06 140619606296320 [Note] InnoDB: Log sequence number at the start 1919250543 and the end 1933193007 do not match
2019-12-20 2:50:06 140619606296320 [Note] InnoDB: Log sequence number at the start 1919250543 and the end 1933193007 do not match
2019-12-20 2:50:06 140619606296320 [Note] InnoDB: Log sequence number at the start 1919250543 and the end 1933193007 do not match
2019-12-20 2:50:06 140619606296320 [Note] InnoDB: Log sequence number at the start 1919250543 and the end 1933193007 do not match
2019-12-20 2:50:06 140619606296320 [Note] InnoDB: Log sequence number at the start 1919250543 and the end 1933193007 do not match
2019-12-20 2:50:06 140619606296320 [Note] InnoDB: Log sequence number at the start 1919250543 and the end 1933193007 do not match
[01] mariabackup: Error: failed to read page after 10 retries. File ./db/table.ibd seems to be corrupted.
[01] mariabackup: Error: xtrabackup_copy_datafile() failed.
[01] mariabackup: Error: failed to copy datafile.
The table can be read and rebuilt, and next time backup does not fail on this same table.
innochecksum gives something like these for affected tables:
openxs@ao756:/tmp$ ~/dbs/maria10.2/bin/innochecksum -v -i -S /tmp/tt.ibd
Variables (--variable-name=value)
and boolean options {FALSE|TRUE} Value (after reading options)
--------------------------------- ----------------------------------------
verbose TRUE
count FALSE
start-page 0
end-page 0
page 0
strict-check crc32
no-check FALSE
allow-mismatches 0
write crc32
page-type-summary TRUE
page-type-dump (No default value)
per-page-details TRUE
log (No default value)
leaf FALSE
merge 0
page 0 page 1 page 2 page 3 index id=15027 page 3 leaf 0 n_recs 3 data_bytes 66
page 4 index id=15028 page 4 leaf 1 n_recs 13 data_bytes 307
page 5 index id=15027 page 5 leaf 1 n_recs 2 data_bytes 52
97
page 6 index id=15027 page 6 leaf 1 n_recs 6 data_bytes 13714
page 7 index id=15027 page 7 leaf 1 n_recs 5 data_bytes 9779
Fail: page::8 invalid
Exceeded the maximum allowed checksum mismatch count::1 current::0
So it's not only mariabackup code that considers the table problematic.
relates to
MDEV-22929
MariaBackup option to report and/or continue when corruption is encountered
Closed
made changes -
2020-02-10 09:04
Field
Original Value
New Value
Fix Version/s
10.2
[ 14601
]
made changes -
2020-02-10 09:04
Assignee
Vladislav Lesin
[ vlad.lesin
]
made changes -
2020-04-08 09:36
Link
This issue relates to TODO-2290
[ TODO-2290
]
made changes -
2021-04-02 11:05
Description
Backup fails for different tables (usually small, not always the same, and sometimes it completes successfully), with messages like these:
openxs@ao756 :/tmp$ ~/dbs/maria10.2/bin/innochecksum -v -i -S /tmp/tt.ibd
Backup fails for different tables (usually small, not always the same, and sometimes it completes successfully), with messages like these:
openxs@ao756 :/tmp$ ~/dbs/maria10.2/bin/innochecksum -v -i -S /tmp/tt.ibd
made changes -
2021-04-02 13:40
Assignee
Vladislav Lesin
[ vlad.lesin
]
Marko Mäkelä
[ marko
]
made changes -
2021-05-17 23:33
Fix Version/s
N/A
[ 14700
]
Fix Version/s
10.2
[ 14601
]
Resolution
Incomplete
[ 4
]
Status
Open
[ 1
]
Closed
[ 6
]
made changes -
2021-12-06 21:50
Workflow
MariaDB v3
[ 103769
]
MariaDB v4
[ 157300
]
{"report":{"fcp":1182.0999999046326,"ttfb":344.2999999523163,"pageVisibility":"visible","entityId":83054,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"291a2c44-f9ae-4412-92e4-033e8d3f519e","navigationType":0,"readyForUser":1261.1999999284744,"redirectCount":0,"resourceLoadedEnd":1319.3999999761581,"resourceLoadedStart":350.6999999284744,"resourceTiming":[{"duration":259.3000000715256,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":350.6999999284744,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":350.6999999284744,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":610,"responseStart":0,"secureConnectionStart":0},{"duration":259.59999990463257,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":351,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":351,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":610.5999999046326,"responseStart":0,"secureConnectionStart":0},{"duration":330.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/fbf975c0cce4b1abf04784eeae9ba1f4-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":351.1999999284744,"connectEnd":351.1999999284744,"connectStart":351.1999999284744,"domainLookupEnd":351.1999999284744,"domainLookupStart":351.1999999284744,"fetchStart":351.1999999284744,"redirectEnd":0,"redirectStart":0,"requestStart":351.1999999284744,"responseEnd":681.6999999284744,"responseStart":681.6999999284744,"secureConnectionStart":351.1999999284744},{"duration":403.60000002384186,"initiatorType":"script","name":"https://jira.mariadb.org/s/099b33461394b8015fc36c0a4b96e19f-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":351.2999999523163,"connectEnd":351.2999999523163,"connectStart":351.2999999523163,"domainLookupEnd":351.2999999523163,"domainLookupStart":351.2999999523163,"fetchStart":351.2999999523163,"redirectEnd":0,"redirectStart":0,"requestStart":351.2999999523163,"responseEnd":754.8999999761581,"responseStart":754.8999999761581,"secureConnectionStart":351.2999999523163},{"duration":407.39999997615814,"initiatorType":"script","name":"https://jira.mariadb.org/s/94c15bff32baef80f4096a08aceae8bc-CDN/lu2bu7/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":351.5,"connectEnd":351.5,"connectStart":351.5,"domainLookupEnd":351.5,"domainLookupStart":351.5,"fetchStart":351.5,"redirectEnd":0,"redirectStart":0,"requestStart":351.5,"responseEnd":758.8999999761581,"responseStart":758.8999999761581,"secureConnectionStart":351.5},{"duration":407.7000000476837,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":351.6999999284744,"connectEnd":351.6999999284744,"connectStart":351.6999999284744,"domainLookupEnd":351.6999999284744,"domainLookupStart":351.6999999284744,"fetchStart":351.6999999284744,"redirectEnd":0,"redirectStart":0,"requestStart":351.6999999284744,"responseEnd":759.3999999761581,"responseStart":759.3999999761581,"secureConnectionStart":351.6999999284744},{"duration":408.1999999284744,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":351.89999997615814,"connectEnd":351.89999997615814,"connectStart":351.89999997615814,"domainLookupEnd":351.89999997615814,"domainLookupStart":351.89999997615814,"fetchStart":351.89999997615814,"redirectEnd":0,"redirectStart":0,"requestStart":351.89999997615814,"responseEnd":760.0999999046326,"responseStart":760.0999999046326,"secureConnectionStart":351.89999997615814},{"duration":469.90000009536743,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bu7/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":352.09999990463257,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":352.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":822,"responseStart":0,"secureConnectionStart":0},{"duration":408.39999997615814,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":352.1999999284744,"connectEnd":352.1999999284744,"connectStart":352.1999999284744,"domainLookupEnd":352.1999999284744,"domainLookupStart":352.1999999284744,"fetchStart":352.1999999284744,"redirectEnd":0,"redirectStart":0,"requestStart":352.1999999284744,"responseEnd":760.5999999046326,"responseStart":760.5999999046326,"secureConnectionStart":352.1999999284744},{"duration":469.7999999523163,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":352.2999999523163,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":352.2999999523163,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":822.0999999046326,"responseStart":0,"secureConnectionStart":0},{"duration":409.39999997615814,"initiatorType":"script","name":"https://jira.mariadb.org/s/3339d87fa2538a859872f2df449bf8d0-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":352.5,"connectEnd":352.5,"connectStart":352.5,"domainLookupEnd":352.5,"domainLookupStart":352.5,"fetchStart":352.5,"redirectEnd":0,"redirectStart":0,"requestStart":352.5,"responseEnd":761.8999999761581,"responseStart":761.8999999761581,"secureConnectionStart":352.5},{"duration":586.1000000238419,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":353.39999997615814,"connectEnd":353.39999997615814,"connectStart":353.39999997615814,"domainLookupEnd":353.39999997615814,"domainLookupStart":353.39999997615814,"fetchStart":353.39999997615814,"redirectEnd":0,"redirectStart":0,"requestStart":353.39999997615814,"responseEnd":939.5,"responseStart":939.5,"secureConnectionStart":353.39999997615814},{"duration":764.3000000715256,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":357.59999990463257,"connectEnd":357.59999990463257,"connectStart":357.59999990463257,"domainLookupEnd":357.59999990463257,"domainLookupStart":357.59999990463257,"fetchStart":357.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":357.59999990463257,"responseEnd":1121.8999999761581,"responseStart":1121.8999999761581,"secureConnectionStart":357.59999990463257},{"duration":107.90000009536743,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":833.5999999046326,"connectEnd":833.5999999046326,"connectStart":833.5999999046326,"domainLookupEnd":833.5999999046326,"domainLookupStart":833.5999999046326,"fetchStart":833.5999999046326,"redirectEnd":0,"redirectStart":0,"requestStart":833.5999999046326,"responseEnd":941.5,"responseStart":941.5,"secureConnectionStart":833.5999999046326},{"duration":52.200000047683716,"initiatorType":"link","name":"https://jira.mariadb.org/s/d5715adaadd168a9002b108b2b039b50-CDN/lu2bu7/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/css/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":1088.2999999523163,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":1088.2999999523163,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1140.5,"responseStart":0,"secureConnectionStart":0},{"duration":222.20000004768372,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/e65b778d185daf5aee24936755b43da6/_/download/contextbatch/js/browser-metrics-plugin.contrib,-_super,-project.issue.navigator,-jira.view.issue,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":1089.1999999284744,"connectEnd":1089.1999999284744,"connectStart":1089.1999999284744,"domainLookupEnd":1089.1999999284744,"domainLookupStart":1089.1999999284744,"fetchStart":1089.1999999284744,"redirectEnd":0,"redirectStart":0,"requestStart":1089.1999999284744,"responseEnd":1311.3999999761581,"responseStart":1311.3999999761581,"secureConnectionStart":1089.1999999284744},{"duration":229.80000007152557,"initiatorType":"script","name":"https://jira.mariadb.org/s/f51ef5507eea4c158f257c66c93b2a3f-CDN/lu2bu7/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/js/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":1089.5999999046326,"connectEnd":1089.5999999046326,"connectStart":1089.5999999046326,"domainLookupEnd":1089.5999999046326,"domainLookupStart":1089.5999999046326,"fetchStart":1089.5999999046326,"redirectEnd":0,"redirectStart":0,"requestStart":1089.5999999046326,"responseEnd":1319.3999999761581,"responseStart":1319.3999999761581,"secureConnectionStart":1089.5999999046326},{"duration":207.60000002384186,"initiatorType":"script","name":"https://www.google-analytics.com/analytics.js","startTime":1176.0999999046326,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":1176.0999999046326,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1383.6999999284744,"responseStart":0,"secureConnectionStart":0}],"fetchStart":1,"domainLookupStart":1,"domainLookupEnd":1,"connectStart":1,"connectEnd":1,"requestStart":144,"responseStart":345,"responseEnd":352,"domLoading":348,"domInteractive":1328,"domContentLoadedEventStart":1328,"domContentLoadedEventEnd":1380,"domComplete":1600,"loadEventStart":1600,"loadEventEnd":1600,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1297.5999999046326},{"name":"bigPipe.sidebar-id.end","time":1298.5},{"name":"bigPipe.activity-panel-pipe-id.start","time":1298.5999999046326},{"name":"bigPipe.activity-panel-pipe-id.end","time":1301.5},{"name":"activityTabFullyLoaded","time":1402.5999999046326}],"measures":[],"correlationId":"1a655f34dba859","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":135,"dbReadsTimeInMs":25,"dbConnsTimeInMs":35,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Bug
Major
MDEV-22929 MariaBackup option to report and/or continue when corruption is encountered
Could this have been addressed by
MDEV-22929?