Type:
Bug
Priority:
Critical
Resolution:
Fixed
Affects Version/s:
10.5 , 10.6 , 10.7(EOL) , 10.8(EOL) , 10.9(EOL) , 10.10(EOL) , 10.11 , 11.0(EOL) , 11.1(EOL) , 11.2(EOL)
origin/preview-11.2-preview 79f9e94195dc8a007debd27ec4e8d2c15f094a97 2023-06-13T17:23:05+10:00
Scenario:
1. Start source server, generate some initial data
2. Several sessions run concurrent SQL
3. During 2. is ongoing
mariabackup --backup data from source server to some other location
mariabackup --prepare on that other location
This fails with
# 2023-06-13T20:43:22 [73003] | [rr 136876 18773]2023-06-13 20:41:29 0 [Note] InnoDB: Last binlog file './mysql-bin.000001', position 11543118
# 2023-06-13T20:43:22 [73003] | [rr 136876 18786]2023-06-13 20:41:29 0 [ERROR] InnoDB: Space id and page no stored in the page, read in are [page id: space=50528773, page number=1165950976], should be [page id: space=3, page number=0]
# 2023-06-13T20:43:22 [73003] | [rr 136876 18810][00] 2023-06-13 20:41:29 Last binlog file ./mysql-bin.000001, position 11543118
# 2023-06-13T20:43:22 [73003] | [rr 136876 18849]2023-06-13 20:41:29 0 [ERROR] InnoDB: Database page corruption on disk or a failed read of file './undo001' page [page id: space=1, page number=4]. You may have to recover from a backup.
pluto:/data/results/1686674959/TBR-1929--TBR-1928$ _RR_TRACE_DIR=./1_clone/rr/ rr replay --mark-stdio
RQG
====
# git clone https://github.com/mleich1/rqg --branch <pick the right branch> RQG
#
# GIT_SHOW: HEAD -> master, origin/master, origin/HEAD a8c8cd1021480e64ef979d326a2543c577d1068a 2023-06-09T18:22:34+02:00
# rqg.pl : Version 4.2.1 (2022-12)
#
# $RQG_HOME/rqg.pl \
# --grammar=conf/engines/many_indexes.yy \
# --gendata=conf/engines/many_indexes.zz \
# --max_gd_duration=900 \
# --reporters=Mariabackup_linux \
# --mysqld=--loose-innodb-log-file-size=200M \
# --mysqld=--loose-innodb_lock_schedule_algorithm=fcfs \
# --mysqld=--loose-idle_write_transaction_timeout=0 \
# --mysqld=--loose-idle_transaction_timeout=0 \
# --mysqld=--loose-idle_readonly_transaction_timeout=0 \
# --mysqld=--connect_timeout=60 \
# --mysqld=--interactive_timeout=28800 \
# --mysqld=--slave_net_timeout=60 \
# --mysqld=--net_read_timeout=30 \
# --mysqld=--net_write_timeout=60 \
# --mysqld=--loose-table_lock_wait_timeout=50 \
# --mysqld=--wait_timeout=28800 \
# --no_mask \
# --queries=10000000 \
# --seed=random \
# --reporters=None \
# --reporters=ErrorLog \
# --reporters=Deadlock \
# --validators=None \
# --mysqld=--log_output=none \
# --mysqld=--log_bin_trust_function_creators=1 \
# --mysqld=--loose-debug_assert_on_not_freed_memory=0 \
# --engine=InnoDB \
# --restart_timeout=240 \
# --mysqld=--plugin-load-add=file_key_management.so \
# --mysqld=--loose-file-key-management-filename=$RQG_HOME/conf/mariadb/encryption_keys.txt \
# --mysqld=--plugin-load-add=provider_lzo.so \
# --mysqld=--plugin-load-add=provider_bzip2.so \
# --mysqld=--plugin-load-add=provider_lzma.so \
# --mysqld=--plugin-load-add=provider_snappy.so \
# --mysqld=--plugin-load-add=provider_lz4.so \
# --mysqld=--loose-innodb_compression_level=1 \
# --duration=300 \
# --mysqld=--loose-innodb_fatal_semaphore_wait_threshold=300 \
# --mysqld=--lock-wait-timeout=86400 \
# --mysqld=--innodb-lock-wait-timeout=50 \
# --mysqld=--loose-innodb_read_only_compressed=OFF \
# --mysqld=--innodb_stats_persistent=on \
# --mysqld=--innodb_adaptive_hash_index=on \
# --mysqld=--innodb_random_read_ahead=OFF \
# --mysqld=--log-bin \
# --mysqld=--sync-binlog=1 \
# --mysqld=--loose-innodb_evict_tables_on_commit_debug=off \
# --mysqld=--loose-max-statement-time=30 \
# --threads=9 \
# --mysqld=--innodb_use_native_aio=1 \
# --mysqld=--innodb_undo_log_truncate=ON \
# --mysqld=--innodb_rollback_on_timeout=OFF \
# --mysqld=--innodb_page_size=8K \
# --mysqld=--innodb-buffer-pool-size=256M \
# <local settings>
{"report":{"fcp":818.8999996185303,"ttfb":199.30000019073486,"pageVisibility":"visible","entityId":122825,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":1,"journeyId":"547c96dd-a8d8-4fba-a8cf-7eb46314b3d9","navigationType":0,"readyForUser":923.6999998092651,"redirectCount":0,"resourceLoadedEnd":1016.6999998092651,"resourceLoadedStart":214.19999980926514,"resourceTiming":[{"duration":120.40000057220459,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":214.19999980926514,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":214.19999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":334.6000003814697,"responseStart":0,"secureConnectionStart":0},{"duration":120.60000038146973,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/2bf333562ca6724060a9d5f1535471f6/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":214.39999961853027,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":214.39999961853027,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":335,"responseStart":0,"secureConnectionStart":0},{"duration":129.30000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":214.69999980926514,"connectEnd":214.69999980926514,"connectStart":214.69999980926514,"domainLookupEnd":214.69999980926514,"domainLookupStart":214.69999980926514,"fetchStart":214.69999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":214.69999980926514,"responseEnd":344,"responseStart":344,"secureConnectionStart":214.69999980926514},{"duration":240.30000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/2bf333562ca6724060a9d5f1535471f6/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":214.89999961853027,"connectEnd":214.89999961853027,"connectStart":214.89999961853027,"domainLookupEnd":214.89999961853027,"domainLookupStart":214.89999961853027,"fetchStart":214.89999961853027,"redirectEnd":0,"redirectStart":0,"requestStart":214.89999961853027,"responseEnd":455.19999980926514,"responseStart":455.19999980926514,"secureConnectionStart":214.89999961853027},{"duration":243.79999923706055,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":215.10000038146973,"connectEnd":215.10000038146973,"connectStart":215.10000038146973,"domainLookupEnd":215.10000038146973,"domainLookupStart":215.10000038146973,"fetchStart":215.10000038146973,"redirectEnd":0,"redirectStart":0,"requestStart":215.10000038146973,"responseEnd":458.8999996185303,"responseStart":458.8999996185303,"secureConnectionStart":215.10000038146973},{"duration":243.80000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":215.39999961853027,"connectEnd":215.39999961853027,"connectStart":215.39999961853027,"domainLookupEnd":215.39999961853027,"domainLookupStart":215.39999961853027,"fetchStart":215.39999961853027,"redirectEnd":0,"redirectStart":0,"requestStart":215.39999961853027,"responseEnd":459.19999980926514,"responseStart":459.19999980926514,"secureConnectionStart":215.39999961853027},{"duration":244.10000038146973,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":215.5,"connectEnd":215.5,"connectStart":215.5,"domainLookupEnd":215.5,"domainLookupStart":215.5,"fetchStart":215.5,"redirectEnd":0,"redirectStart":0,"requestStart":215.5,"responseEnd":459.6000003814697,"responseStart":459.6000003814697,"secureConnectionStart":215.5},{"duration":276.1000003814697,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":215.69999980926514,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":215.69999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":491.80000019073486,"responseStart":0,"secureConnectionStart":0},{"duration":244.20000076293945,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":215.89999961853027,"connectEnd":215.89999961853027,"connectStart":215.89999961853027,"domainLookupEnd":215.89999961853027,"domainLookupStart":215.89999961853027,"fetchStart":215.89999961853027,"redirectEnd":0,"redirectStart":0,"requestStart":215.89999961853027,"responseEnd":460.1000003814697,"responseStart":460.1000003814697,"secureConnectionStart":215.89999961853027},{"duration":276,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":216,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":216,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":492,"responseStart":0,"secureConnectionStart":0},{"duration":244.4000005722046,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":216.19999980926514,"connectEnd":216.19999980926514,"connectStart":216.19999980926514,"domainLookupEnd":216.19999980926514,"domainLookupStart":216.19999980926514,"fetchStart":216.19999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":216.19999980926514,"responseEnd":460.6000003814697,"responseStart":460.6000003814697,"secureConnectionStart":216.19999980926514},{"duration":438,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":217.10000038146973,"connectEnd":217.10000038146973,"connectStart":217.10000038146973,"domainLookupEnd":217.10000038146973,"domainLookupStart":217.10000038146973,"fetchStart":217.10000038146973,"redirectEnd":0,"redirectStart":0,"requestStart":217.10000038146973,"responseEnd":655.1000003814697,"responseStart":655,"secureConnectionStart":217.10000038146973},{"duration":799.5999994277954,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":217.10000038146973,"connectEnd":217.10000038146973,"connectStart":217.10000038146973,"domainLookupEnd":217.10000038146973,"domainLookupStart":217.10000038146973,"fetchStart":217.10000038146973,"redirectEnd":0,"redirectStart":0,"requestStart":217.10000038146973,"responseEnd":1016.6999998092651,"responseStart":1016.6999998092651,"secureConnectionStart":217.10000038146973},{"duration":249,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":531.8000001907349,"connectEnd":531.8000001907349,"connectStart":531.8000001907349,"domainLookupEnd":531.8000001907349,"domainLookupStart":531.8000001907349,"fetchStart":531.8000001907349,"redirectEnd":0,"redirectStart":0,"requestStart":531.8000001907349,"responseEnd":780.8000001907349,"responseStart":780.8000001907349,"secureConnectionStart":531.8000001907349}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":38,"responseStart":199,"responseEnd":204,"domLoading":211,"domInteractive":1036,"domContentLoadedEventStart":1036,"domContentLoadedEventEnd":1079,"domComplete":2141,"loadEventStart":2141,"loadEventEnd":2142,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1018.5},{"name":"bigPipe.sidebar-id.end","time":1019.3999996185303},{"name":"bigPipe.activity-panel-pipe-id.start","time":1019.5},{"name":"bigPipe.activity-panel-pipe-id.end","time":1021.8999996185303},{"name":"activityTabFullyLoaded","time":1087.3999996185303}],"measures":[],"correlationId":"7195e6c7bf510b","effectiveType":"4g","downlink":9.1,"rtt":0,"serverDuration":92,"dbReadsTimeInMs":12,"dbConnsTimeInMs":21,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}