MariaDB 10.6.17 hits the following assertion failure:
...
|
2024-03-15 14:39:06 0x7fa9fc05e700 InnoDB: Assertion failure in file /home/buildbot/buildbot/build/storage/innobase/btr/btr0cur.cc line 4272
|
InnoDB: Failing assertion: err == DB_SUCCESS
|
InnoDB: We intentionally generate a memory trap.
|
InnoDB: Submit a detailed bug report to https://jira.mariadb.org/
|
InnoDB: If you get repeated assertion failures or crashes, even
|
InnoDB: immediately after the mariadbd startup, there may be
|
InnoDB: corruption in the InnoDB tablespace. Please refer to
|
InnoDB: https://mariadb.com/kb/en/library/innodb-recovery-modes/
|
InnoDB: about forcing recovery.
|
240315 14:39:06 [ERROR] mysqld got signal 6 ;
|
Sorry, we probably made a mistake, and this is a bug.
|
|
Your assistance in bug reporting will enable us to fix this for the next release.
|
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
|
|
We will try our best to scrape up some info that will hopefully help
|
diagnose the problem, but since we have already crashed,
|
something is definitely wrong and this may fail.
|
|
Server version: 10.6.17-MariaDB-log source revision: 15c75ad083a55e198ae78324f22970694b72f22b
|
key_buffer_size=134217728
|
read_buffer_size=131072
|
max_used_connections=0
|
max_threads=602
|
thread_count=9
|
It is possible that mysqld could use up to
|
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 1456870 K bytes of memory
|
Hope that's ok; if not, decrease some variables in the equation.
|
|
Thread pointer: 0x7f9c60000c58
|
Attempting backtrace. You can use the following information to find out
|
where mysqld died. If you see no messages after this, something went
|
terribly wrong...
|
stack_bottom = 0x7fa9fc05dd40 thread_stack 0x49000
|
mysys/stacktrace.c:216(my_print_stacktrace)[0x557db4e5354e]
|
sql/signal_handler.cc:238(handle_fatal_signal)[0x557db4824be7]
|
2024-03-15 14:39:07 0 [Note] WSREP: (bda9dd93-acb5, 'tcp://0.0.0.0:4567') turning message relay requesting off
|
/lib/x86_64-linux-gnu/libpthread.so.0(+0x13140)[0x7fa9fd44b140]
|
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0x141)[0x7fa9fcf83ce1]
|
/lib/x86_64-linux-gnu/libc.so.6(abort+0x123)[0x7fa9fcf6d537]
|
/opt/mysql/gc_adios_prod_3306/bin/mysqld(+0x6c4189)[0x557db44c4189]
|
btr/btr0cur.cc:4159(btr_cur_pessimistic_update(unsigned long, btr_cur_t*, unsigned short**, mem_block_info_t**, mem_block_info_t*, big_rec_t**, upd_t*, unsigned long, que_thr_t*, unsigned long, mtr_t*))[0x557db4ca6869]
|
row/row0upd.cc:2448(row_upd_clust_rec(unsigned long, upd_node_t*, dict_index_t*, unsigned short*, mem_block_info_t**, que_thr_t*, mtr_t*))[0x557db4c2e4f9]
|
row/row0upd.cc:2679(row_upd_clust_step(upd_node_t*, que_thr_t*))[0x557db4c3156a]
|
row/row0upd.cc:2781(row_upd_step(que_thr_t*))[0x557db4c32f60]
|
row/row0mysql.cc:1690(row_update_for_mysql(row_prebuilt_t*))[0x557db4c0dd31]
|
handler/ha_innodb.cc:8687(ha_innobase::update_row(unsigned char const*, unsigned char const*))[0x557db4b479e3]
|
sql/handler.cc:7719(handler::ha_update_row(unsigned char const*, unsigned char const*))[0x557db48342e2]
|
sql/log_event_server.cc:8569(Update_rows_log_event::do_exec_row(rpl_group_info*))[0x557db494bd6b]
|
sql/log_event_server.cc:5801(Rows_log_event::do_apply_event(rpl_group_info*))[0x557db493fe1d]
|
sql/log_event.h:1510(Log_event::apply_event(rpl_group_info*))[0x557db4b161d7]
|
sql/wsrep_high_priority_service.cc:129(apply_events(THD*, Relay_log_info*, wsrep::const_buffer const&, wsrep::mutable_buffer&))[0x557db4afda70]
|
sql/wsrep_high_priority_service.cc:598(Wsrep_applier_service::apply_write_set(wsrep::ws_meta const&, wsrep::const_buffer const&, wsrep::mutable_buffer&))[0x557db4afdb63]
|
src/server_state.cpp:333(apply_write_set(wsrep::server_state&, wsrep::high_priority_service&, wsrep::ws_handle const&, wsrep::ws_meta const&, wsrep::const_buffer const&))[0x557db4fb4a1f]
|
src/server_state.cpp:1131(wsrep::server_state::on_apply(wsrep::high_priority_service&, wsrep::ws_handle const&, wsrep::ws_meta const&, wsrep::const_buffer const&))[0x557db4fb5745]
|
src/wsrep_provider_v26.cpp:507((anonymous namespace)::apply_cb(void*, wsrep_ws_handle const*, unsigned int, wsrep_buf const*, wsrep_trx_meta const*, bool*))[0x557db4fc52a8]
|
src/trx_handle.cpp:396(galera::TrxHandleSlave::apply(void*, wsrep_cb_status (*)(void*, wsrep_ws_handle const*, unsigned int, wsrep_buf const*, wsrep_trx_meta const*, bool*), wsrep_trx_meta const&, bool&))[0x7fa9fc547d31]
|
src/replicator_smm.cpp:512(galera::ReplicatorSMM::apply_trx(void*, galera::TrxHandleSlave&))[0x7fa9fc555e4f]
|
src/replicator_str.cpp:1157(galera::ReplicatorSMM::process_IST_writeset(void*, boost::shared_ptr<galera::TrxHandleSlave> const&))[0x7fa9fc5687d6]
|
src/trx_handle.hpp:624(galera::TrxHandleSlave::exit_loop() const)[0x7fa9fc56967a]
|
src/replicator_smm.cpp:404(galera::ReplicatorSMM::async_recv(void*))[0x7fa9fc55ae7b]
|
src/wsrep_provider.cpp:266(galera_recv)[0x7fa9fc5365ba]
|
src/wsrep_provider_v26.cpp:859(wsrep::wsrep_provider_v26::run_applier(wsrep::high_priority_service*))[0x557db4fc59de]
|
sql/wsrep_thd.cc:59(wsrep_replication_process(THD*, void*))[0x557db4b17fc2]
|
sql/wsrep_mysqld.cc:3695(start_wsrep_THD(void*))[0x557db4b08e5d]
|
perfschema/pfs.cc:2204(pfs_spawn_thread)[0x557db4a9910c]
|
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7ea7)[0x7fa9fd43fea7]
|
/lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7fa9fd046a2f]
|
|
Trying to get some variables.
|
Some pointers may be invalid and cause the dump to abort.
|
Query (0x7fa98c97ae3b): update T set C1='...' where _ID=2810341728
|
|
Connection ID (thread ID): 6
|
Status: NOT_KILLED
|
...
|
while applying Galera write set. I can not find any known bug with similar stack trace that applies to 10.6.17, so decided to report a new one.
The datadir content is gone, as the node was added back to the customer via SST, so no core dump for further study is available.
{"report":{"fcp":956.5,"ttfb":249.69999999552965,"pageVisibility":"visible","entityId":128498,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"004b920a-4d58-43b7-9945-8b66a4f06acc","navigationType":0,"readyForUser":1046.5999999940395,"redirectCount":0,"resourceLoadedEnd":1079.8999999985099,"resourceLoadedStart":255.69999999552965,"resourceTiming":[{"duration":186.30000000447035,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bv2/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":255.69999999552965,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":255.69999999552965,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":442,"responseStart":0,"secureConnectionStart":0},{"duration":186.19999999552965,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bv2/820016/12ta74/2380add21a9a1006587582385952de73/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":256,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":256,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":442.19999999552965,"responseStart":0,"secureConnectionStart":0},{"duration":194.70000000298023,"initiatorType":"script","name":"https://jira.mariadb.org/s/e9b27a47da5fb0f74a35acd57e9847fb-CDN/lu2bv2/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":256.19999999552965,"connectEnd":256.19999999552965,"connectStart":256.19999999552965,"domainLookupEnd":256.19999999552965,"domainLookupStart":256.19999999552965,"fetchStart":256.19999999552965,"redirectEnd":0,"redirectStart":0,"requestStart":256.19999999552965,"responseEnd":450.8999999985099,"responseStart":450.8999999985099,"secureConnectionStart":256.19999999552965},{"duration":232.60000000149012,"initiatorType":"script","name":"https://jira.mariadb.org/s/c32eb0da7ad9831253f8397e6cc26afd-CDN/lu2bv2/820016/12ta74/2380add21a9a1006587582385952de73/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":256.29999999701977,"connectEnd":256.29999999701977,"connectStart":256.29999999701977,"domainLookupEnd":256.29999999701977,"domainLookupStart":256.29999999701977,"fetchStart":256.29999999701977,"redirectEnd":0,"redirectStart":0,"requestStart":256.29999999701977,"responseEnd":488.8999999985099,"responseStart":488.79999999701977,"secureConnectionStart":256.29999999701977},{"duration":235.89999999850988,"initiatorType":"script","name":"https://jira.mariadb.org/s/bc0bcb146314416123c992714ee00ff7-CDN/lu2bv2/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":256.5,"connectEnd":256.5,"connectStart":256.5,"domainLookupEnd":256.5,"domainLookupStart":256.5,"fetchStart":256.5,"redirectEnd":0,"redirectStart":0,"requestStart":256.5,"responseEnd":492.3999999985099,"responseStart":492.3999999985099,"secureConnectionStart":256.5},{"duration":236.89999999850988,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":256.69999999552965,"connectEnd":256.69999999552965,"connectStart":256.69999999552965,"domainLookupEnd":256.69999999552965,"domainLookupStart":256.69999999552965,"fetchStart":256.69999999552965,"redirectEnd":0,"redirectStart":0,"requestStart":256.69999999552965,"responseEnd":493.59999999403954,"responseStart":493.59999999403954,"secureConnectionStart":256.69999999552965},{"duration":237,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":257,"connectEnd":257,"connectStart":257,"domainLookupEnd":257,"domainLookupStart":257,"fetchStart":257,"redirectEnd":0,"redirectStart":0,"requestStart":257,"responseEnd":494,"responseStart":494,"secureConnectionStart":257},{"duration":332.8999999985099,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bv2/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":257.29999999701977,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":257.29999999701977,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":590.1999999955297,"responseStart":0,"secureConnectionStart":0},{"duration":237.60000000149012,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":257.3999999985099,"connectEnd":257.3999999985099,"connectStart":257.3999999985099,"domainLookupEnd":257.3999999985099,"domainLookupStart":257.3999999985099,"fetchStart":257.3999999985099,"redirectEnd":0,"redirectStart":0,"requestStart":257.3999999985099,"responseEnd":495,"responseStart":495,"secureConnectionStart":257.3999999985099},{"duration":332.6000000014901,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bv2/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":257.59999999403954,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":257.59999999403954,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":590.1999999955297,"responseStart":0,"secureConnectionStart":0},{"duration":237.89999999850988,"initiatorType":"script","name":"https://jira.mariadb.org/s/719848dd97ebe0663199f49a3936487a-CDN/lu2bv2/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":257.79999999701977,"connectEnd":257.79999999701977,"connectStart":257.79999999701977,"domainLookupEnd":257.79999999701977,"domainLookupStart":257.79999999701977,"fetchStart":257.79999999701977,"redirectEnd":0,"redirectStart":0,"requestStart":257.79999999701977,"responseEnd":495.69999999552965,"responseStart":495.69999999552965,"secureConnectionStart":257.79999999701977},{"duration":405.70000000298023,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":258.69999999552965,"connectEnd":258.69999999552965,"connectStart":258.69999999552965,"domainLookupEnd":258.69999999552965,"domainLookupStart":258.69999999552965,"fetchStart":258.69999999552965,"redirectEnd":0,"redirectStart":0,"requestStart":258.69999999552965,"responseEnd":664.3999999985099,"responseStart":664.3999999985099,"secureConnectionStart":258.69999999552965},{"duration":447.20000000298023,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":258.69999999552965,"connectEnd":258.69999999552965,"connectStart":258.69999999552965,"domainLookupEnd":258.69999999552965,"domainLookupStart":258.69999999552965,"fetchStart":258.69999999552965,"redirectEnd":0,"redirectStart":0,"requestStart":258.69999999552965,"responseEnd":705.8999999985099,"responseStart":705.8999999985099,"secureConnectionStart":258.69999999552965},{"duration":64.19999999552965,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":601.3999999985099,"connectEnd":601.3999999985099,"connectStart":601.3999999985099,"domainLookupEnd":601.3999999985099,"domainLookupStart":601.3999999985099,"fetchStart":601.3999999985099,"redirectEnd":0,"redirectStart":0,"requestStart":601.3999999985099,"responseEnd":665.5999999940395,"responseStart":665.5999999940395,"secureConnectionStart":601.3999999985099},{"duration":207.80000000447035,"initiatorType":"link","name":"https://jira.mariadb.org/s/d5715adaadd168a9002b108b2b039b50-CDN/lu2bv2/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/css/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":872.0999999940395,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":872.0999999940395,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1079.8999999985099,"responseStart":0,"secureConnectionStart":0}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":76,"responseStart":250,"responseEnd":252,"domLoading":253,"domInteractive":1107,"domContentLoadedEventStart":1107,"domContentLoadedEventEnd":1151,"domComplete":1942,"loadEventStart":1942,"loadEventEnd":1944,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1088.0999999940395},{"name":"bigPipe.sidebar-id.end","time":1088.6999999955297},{"name":"bigPipe.activity-panel-pipe-id.start","time":1088.8999999985099},{"name":"bigPipe.activity-panel-pipe-id.end","time":1091.2999999970198},{"name":"activityTabFullyLoaded","time":1159.6999999955297}],"measures":[],"correlationId":"67a57c9ec99990","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":99,"dbReadsTimeInMs":12,"dbConnsTimeInMs":20,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}