Type:
Bug
Priority:
Blocker
Resolution:
Fixed
Affects Version/s:
N/A
origin/bb-10.6-MDEV-32068 a26c51a190030443063362eb3f21c510fcb3c734 2023-09-05T16:30:53+03:00
but observed on other trees in history too.
Scenario:
1. Start server, generate some initial data
2. Several sessions run concurrent a DDL/DML mix
3. Intentional crash, restart with success
4. Check the data
SELECT `col2` FROM `test`.`t3` FORCE INDEX (`Marvão_uidx1`) WHERE `col2` IS NULL OR `col2` IS NOT NULL harvests 1030: Got error 1 "Operation not permitted" from storage engine InnoDB.
The server error log contains for the time of the SELECT ... FORCE ...
[rr 3698310 16732]2023-09-05 7:42:03 6 [ERROR] Cannot find index Marvão_uidx1 in InnoDB index dictionary.
[rr 3698310 16736]2023-09-05 7:42:03 6 [ERROR] InnoDB indexes are inconsistent with what defined in .frm for table ./test/t3
[rr 3698310 16740]2023-09-05 7:42:03 6 [ERROR] InnoDB: Table test/t3 contains 2 indexes inside InnoDB, which is different from the number of indexes 3 defined in the .frm file. See https://mariadb.com/kb/en/innodb-troubleshooting/
The table t3 is ROW_FORMAT = Compact.
sdp:/data1/results/1693922571/TBR-1311--CATCH-0001$ _RR_TRACE_DIR=./1/rr rr replay --mark-stdio
sdp:/data1/results/1693922571/TBR-1311--CATCH-0001/1/fbackup/ contains a file backup
made after the crash before the restart attempt.
RQG
===
# git clone https://github.com/mleich1/rqg --branch <pick the right branch> RQG
#
# GIT_SHOW: HEAD -> master, origin/master, origin/HEAD d5889a108c00974367f47657cabe4804fe7df566 2023-09-04T13:53:19+02:00
# rqg.pl : Version 4.4.0 (2023-08)
#
# $RQG_HOME/rqg.pl \
# --gendata=conf/mariadb/table_stress.zz \
# --gendata_sql=conf/mariadb/table_stress.sql \
# --grammar=conf/mariadb/table_stress_innodb.yy \
# --reporters=CrashRecovery \
# --mysqld=--loose-innodb_lock_schedule_algorithm=fcfs \
# --mysqld=--loose-idle_write_transaction_timeout=0 \
# --mysqld=--loose-idle_transaction_timeout=0 \
# --mysqld=--loose-idle_readonly_transaction_timeout=0 \
# --mysqld=--connect_timeout=60 \
# --mysqld=--interactive_timeout=28800 \
# --mysqld=--slave_net_timeout=60 \
# --mysqld=--net_read_timeout=30 \
# --mysqld=--net_write_timeout=60 \
# --mysqld=--loose-table_lock_wait_timeout=50 \
# --mysqld=--wait_timeout=28800 \
# --no_mask \
# --queries=10000000 \
# --seed=random \
# --reporters=None \
# --reporters=ErrorLog \
# --reporters=Deadlock \
# --validators=None \
# --mysqld=--log_output=none \
# --mysqld=--log_bin_trust_function_creators=1 \
# --mysqld=--loose-debug_assert_on_not_freed_memory=0 \
# --engine=InnoDB \
# --restart_timeout=240 \
# --mysqld=--plugin-load-add=file_key_management.so \
# --mysqld=--loose-file-key-management-filename=$RQG_HOME/conf/mariadb/encryption_keys.txt \
# --mysqld=--plugin-load-add=provider_lzo.so \
# --mysqld=--plugin-load-add=provider_bzip2.so \
# --mysqld=--plugin-load-add=provider_lzma.so \
# --mysqld=--plugin-load-add=provider_snappy.so \
# --mysqld=--plugin-load-add=provider_lz4.so \
# --mysqld=--loose-innodb_compression_level=1 \
# --duration=300 \
# --mysqld=--loose-innodb_fatal_semaphore_wait_threshold=300 \
# --mysqld=--lock-wait-timeout=15 \
# --mysqld=--innodb-lock-wait-timeout=10 \
# --mysqld=--loose-innodb_fast_shutdown=0 \
# --mysqld=--sql_mode=STRICT_TRANS_TABLES,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION \
# --mysqld=--innodb_file_per_table=1 \
# --mysqld=--loose-innodb_read_only_compressed=OFF \
# --mysqld=--innodb_stats_persistent=on \
# --mysqld=--innodb_adaptive_hash_index=off \
# --mysqld=--innodb_sort_buffer_size=65536 \
# --mysqld=--innodb_random_read_ahead=OFF \
# --mysqld=--log-bin \
# --mysqld=--sync-binlog=1 \
# --mysqld=--loose-innodb_evict_tables_on_commit_debug=off \
# --mysqld=--loose-max-statement-time=30 \
# --threads=33 \
# --mysqld=--innodb-use-native-aio=0 \
# --mysqld=--loose-gdb \
# --mysqld=--loose-debug-gdb \
# --rr=Extended \
# --rr_options=--chaos --wait \
# --mysqld=--innodb_undo_log_truncate=OFF \
# --mysqld=--innodb_rollback_on_timeout=OFF \
# --mysqld=--innodb_page_size=16K \
# --mysqld=--innodb-buffer-pool-size=256M \
# <local settings>
{"report":{"fcp":919.3000000119209,"ttfb":291,"pageVisibility":"visible","entityId":124835,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"5368a72f-0d9d-4a95-95f2-1997206f45df","navigationType":0,"readyForUser":1014.1999999880791,"redirectCount":0,"resourceLoadedEnd":750,"resourceLoadedStart":301.30000001192093,"resourceTiming":[{"duration":102.39999997615814,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bv2/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":301.30000001192093,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":301.30000001192093,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":403.69999998807907,"responseStart":0,"secureConnectionStart":0},{"duration":102.40000000596046,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bv2/820016/12ta74/2380add21a9a1006587582385952de73/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":301.59999999403954,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":301.59999999403954,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":404,"responseStart":0,"secureConnectionStart":0},{"duration":124.2999999821186,"initiatorType":"script","name":"https://jira.mariadb.org/s/e9b27a47da5fb0f74a35acd57e9847fb-CDN/lu2bv2/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":301.90000000596046,"connectEnd":301.90000000596046,"connectStart":301.90000000596046,"domainLookupEnd":301.90000000596046,"domainLookupStart":301.90000000596046,"fetchStart":301.90000000596046,"redirectEnd":0,"redirectStart":0,"requestStart":301.90000000596046,"responseEnd":426.19999998807907,"responseStart":426.19999998807907,"secureConnectionStart":301.90000000596046},{"duration":184.2000000178814,"initiatorType":"script","name":"https://jira.mariadb.org/s/c32eb0da7ad9831253f8397e6cc26afd-CDN/lu2bv2/820016/12ta74/2380add21a9a1006587582385952de73/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":302.09999999403954,"connectEnd":302.09999999403954,"connectStart":302.09999999403954,"domainLookupEnd":302.09999999403954,"domainLookupStart":302.09999999403954,"fetchStart":302.09999999403954,"redirectEnd":0,"redirectStart":0,"requestStart":302.09999999403954,"responseEnd":486.30000001192093,"responseStart":486.30000001192093,"secureConnectionStart":302.09999999403954},{"duration":187.59999999403954,"initiatorType":"script","name":"https://jira.mariadb.org/s/bc0bcb146314416123c992714ee00ff7-CDN/lu2bv2/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":302.30000001192093,"connectEnd":302.30000001192093,"connectStart":302.30000001192093,"domainLookupEnd":302.30000001192093,"domainLookupStart":302.30000001192093,"fetchStart":302.30000001192093,"redirectEnd":0,"redirectStart":0,"requestStart":302.30000001192093,"responseEnd":489.90000000596046,"responseStart":489.90000000596046,"secureConnectionStart":302.30000001192093},{"duration":188.09999999403954,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":302.40000000596046,"connectEnd":302.40000000596046,"connectStart":302.40000000596046,"domainLookupEnd":302.40000000596046,"domainLookupStart":302.40000000596046,"fetchStart":302.40000000596046,"redirectEnd":0,"redirectStart":0,"requestStart":302.40000000596046,"responseEnd":490.5,"responseStart":490.5,"secureConnectionStart":302.40000000596046},{"duration":188.30000001192093,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":302.69999998807907,"connectEnd":302.69999998807907,"connectStart":302.69999998807907,"domainLookupEnd":302.69999998807907,"domainLookupStart":302.69999998807907,"fetchStart":302.69999998807907,"redirectEnd":0,"redirectStart":0,"requestStart":302.69999998807907,"responseEnd":491,"responseStart":491,"secureConnectionStart":302.69999998807907},{"duration":266.90000000596046,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bv2/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":302.90000000596046,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":302.90000000596046,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":569.8000000119209,"responseStart":0,"secureConnectionStart":0},{"duration":188.40000000596046,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":303.09999999403954,"connectEnd":303.09999999403954,"connectStart":303.09999999403954,"domainLookupEnd":303.09999999403954,"domainLookupStart":303.09999999403954,"fetchStart":303.09999999403954,"redirectEnd":0,"redirectStart":0,"requestStart":303.09999999403954,"responseEnd":491.5,"responseStart":491.5,"secureConnectionStart":303.09999999403954},{"duration":266.80000001192093,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bv2/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":303.19999998807907,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":303.19999998807907,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":570,"responseStart":0,"secureConnectionStart":0},{"duration":188.59999999403954,"initiatorType":"script","name":"https://jira.mariadb.org/s/719848dd97ebe0663199f49a3936487a-CDN/lu2bv2/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":303.40000000596046,"connectEnd":303.40000000596046,"connectStart":303.40000000596046,"domainLookupEnd":303.40000000596046,"domainLookupStart":303.40000000596046,"fetchStart":303.40000000596046,"redirectEnd":0,"redirectStart":0,"requestStart":303.40000000596046,"responseEnd":492,"responseStart":492,"secureConnectionStart":303.40000000596046},{"duration":333.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":309.09999999403954,"connectEnd":309.09999999403954,"connectStart":309.09999999403954,"domainLookupEnd":309.09999999403954,"domainLookupStart":309.09999999403954,"fetchStart":309.09999999403954,"redirectEnd":0,"redirectStart":0,"requestStart":309.09999999403954,"responseEnd":642.5999999940395,"responseStart":642.5999999940395,"secureConnectionStart":309.09999999403954},{"duration":440.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":309.5,"connectEnd":309.5,"connectStart":309.5,"domainLookupEnd":309.5,"domainLookupStart":309.5,"fetchStart":309.5,"redirectEnd":0,"redirectStart":0,"requestStart":309.5,"responseEnd":750,"responseStart":750,"secureConnectionStart":309.5},{"duration":67.30000001192093,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":581.6999999880791,"connectEnd":581.6999999880791,"connectStart":581.6999999880791,"domainLookupEnd":581.6999999880791,"domainLookupStart":581.6999999880791,"fetchStart":581.6999999880791,"redirectEnd":0,"redirectStart":0,"requestStart":581.6999999880791,"responseEnd":649,"responseStart":649,"secureConnectionStart":581.6999999880791}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":113,"responseStart":291,"responseEnd":309,"domLoading":299,"domInteractive":1082,"domContentLoadedEventStart":1082,"domContentLoadedEventEnd":1134,"domComplete":2433,"loadEventStart":2433,"loadEventEnd":2434,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1061.199999988079},{"name":"bigPipe.sidebar-id.end","time":1062.0999999940395},{"name":"bigPipe.activity-panel-pipe-id.start","time":1062.199999988079},{"name":"bigPipe.activity-panel-pipe-id.end","time":1067.5},{"name":"activityTabFullyLoaded","time":1141.9000000059605}],"measures":[],"correlationId":"cae5c4c6d010c5","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":104,"dbReadsTimeInMs":15,"dbConnsTimeInMs":25,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}