Hello,
tonight one of our MariaDB Server crashed out of nowhere. Searched the Reason for a few Hours now - but was not able to narrow the cause down! :-/
Maybe it's a Bug? Maybe you can tell me a bit more from those Errors?
OS: CentOS Linux release 7.3.1611 (Core)
Thank you
170301 0:40:01 [ERROR] mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.
Server version: 10.1.21-MariaDB
key_buffer_size=3221225472
read_buffer_size=6291456
max_used_connections=502
max_threads=602
thread_count=79
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 85762103 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
Thread pointer: 0x7f6e58b00a38
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
Definitely a bug. A server should never crash due to a query. Even one like FLUSH QUERY CACHE. No doing this SQL query will probably not affect any server behaviour at all.
The output from this may be useful too.
SHOW GLOBAL STATUS LIKE'Qcache%';
edit: server config provided
Daniel Black
added a comment - - edited Definitely a bug. A server should never crash due to a query. Even one like FLUSH QUERY CACHE. No doing this SQL query will probably not affect any server behaviour at all.
The output from this may be useful too.
SHOW GLOBAL STATUS LIKE 'Qcache%' ;
edit: server config provided
Hello,
during the weekend the crash happened 2 more times:
12.03.2017 08:00:11:
170312 8:00:02 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware.
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail.
Server version: 10.1.21-MariaDB
key_buffer_size=3221225472
read_buffer_size=6291456
max_used_connections=503
max_threads=602
thread_count=73
It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 85762103 K bytes of memory Hope that's ok; if not, decrease some variables in the equation.
Thread pointer: 0x7f56d1ef2c48
Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong...
Andreas Schnederle-Wagner
added a comment - Hello,
during the weekend the crash happened 2 more times:
12.03.2017 08:00:11:
170312 8:00:02 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware.
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail.
Server version: 10.1.21-MariaDB
key_buffer_size=3221225472
read_buffer_size=6291456
max_used_connections=503
max_threads=602
thread_count=73
It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 85762103 K bytes of memory Hope that's ok; if not, decrease some variables in the equation.
Thread pointer: 0x7f56d1ef2c48
Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong...
stack_bottom = 0x7f54ffc8ccf0 thread_stack 0x30000 /usr/libexec/mysqld(my_print_stacktrace+0x2e)[0x7f56cfbaf80e]
/usr/libexec/mysqld(handle_fatal_signal+0x305)[0x7f56cf6d6da5]
/lib64/libpthread.so.0(+0xf370)[0x7f56cecf3370]
/usr/libexec/mysqld(_ZN11Query_cache12move_by_typeEPPhPP17Query_cache_blockPmS3_+0x730)[0x7f56cf51c920]
/usr/libexec/mysqld(_ZN11Query_cache10pack_cacheEv+0x71)[0x7f56cf51cb21]
/usr/libexec/mysqld(_ZN11Query_cache4packEP3THDmj+0x4e)[0x7f56cf51ce0e]
/usr/libexec/mysqld(_Z20reload_acl_and_cacheP3THDyP10TABLE_LISTPi+0x690)[0x7f56cf63f970]
/usr/libexec/mysqld(_Z21mysql_execute_commandP3THD+0x1400)[0x7f56cf5526a0]
/usr/libexec/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x332)[0x7f56cf55a682]
/usr/libexec/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x243c)[0x7f56cf55d99c]
/usr/libexec/mysqld(_Z10do_commandP3THD+0x14a)[0x7f56cf55e1fa]
/usr/libexec/mysqld(_Z24do_handle_one_connectionP3THD+0x18a)[0x7f56cf62545a]
/usr/libexec/mysqld(handle_one_connection+0x40)[0x7f56cf625600]
/lib64/libpthread.so.0(+0x7dc5)[0x7f56cecebdc5]
/lib64/libc.so.6(clone+0x6d)[0x7f56cd56473d]
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (0x7f528c0008e0): FLUSH QUERY CACHE Connection ID (thread ID): 292308
Status: NOT_KILLED
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=off
Andreas Schnederle-Wagner
added a comment - 13.03.2017 03:10:01:
170313 3:10:01 [ERROR] mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.
Server version: 10.1.21-MariaDB
key_buffer_size=3221225472
read_buffer_size=6291456
max_used_connections=417
max_threads=602
thread_count=48
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 85762103 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
Thread pointer: 0x7f135263aea8
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0x7f118c344cf0 thread_stack 0x30000
/usr/libexec/mysqld(my_print_stacktrace+0x2e)[0x7f134e99880e]
/usr/libexec/mysqld(handle_fatal_signal+0x305)[0x7f134e4bfda5]
/lib64/libpthread.so.0(+0xf370)[0x7f134dadc370]
/usr/libexec/mysqld(_ZN11Query_cache12move_by_typeEPPhPP17Query_cache_blockPmS3_+0x730)[0x7f134e305920]
/usr/libexec/mysqld(_ZN11Query_cache10pack_cacheEv+0x71)[0x7f134e305b21]
/usr/libexec/mysqld(_ZN11Query_cache4packEP3THDmj+0x4e)[0x7f134e305e0e]
/usr/libexec/mysqld(_Z20reload_acl_and_cacheP3THDyP10TABLE_LISTPi+0x690)[0x7f134e428970]
/usr/libexec/mysqld(_Z21mysql_execute_commandP3THD+0x1400)[0x7f134e33b6a0]
/usr/libexec/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x332)[0x7f134e343682]
/usr/libexec/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x243c)[0x7f134e34699c]
/usr/libexec/mysqld(_Z10do_commandP3THD+0x14a)[0x7f134e3471fa]
/usr/libexec/mysqld(_Z24do_handle_one_connectionP3THD+0x18a)[0x7f134e40e45a]
/usr/libexec/mysqld(handle_one_connection+0x40)[0x7f134e40e600]
/lib64/libpthread.so.0(+0x7dc5)[0x7f134dad4dc5]
/lib64/libc.so.6(clone+0x6d)[0x7f134c34d73d]
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (0x7f0f2c00bd20): FLUSH QUERY CACHE
Connection ID (thread ID): 20616
Status: NOT_KILLED
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=off
MDEV-25365 has a test case for what appears to be an identical failure (although not a great test case, but better than nothing). So, while it's generally against common sense to close an older report as a duplicate of a new one, in this case we'll continue tracking this problem in MDEV-25365.
Elena Stepanova
added a comment - MDEV-25365 has a test case for what appears to be an identical failure (although not a great test case, but better than nothing). So, while it's generally against common sense to close an older report as a duplicate of a new one, in this case we'll continue tracking this problem in MDEV-25365 .
People
Unassigned
Andreas Schnederle-Wagner
Votes:
0Vote for this issue
Watchers:
5Start watching this issue
Dates
Created:
Updated:
Resolved:
Git Integration
Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.
{"report":{"fcp":1359.7000000476837,"ttfb":396.90000009536743,"pageVisibility":"visible","entityId":60387,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"e5aed077-059f-4e08-8cb1-791d017d88c6","navigationType":0,"readyForUser":1487.6000001430511,"redirectCount":0,"resourceLoadedEnd":1237.5,"resourceLoadedStart":402.2000000476837,"resourceTiming":[{"duration":406.10000014305115,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":402.2000000476837,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":402.2000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":808.3000001907349,"responseStart":0,"secureConnectionStart":0},{"duration":405.90000009536743,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":402.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":402.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":808.4000000953674,"responseStart":0,"secureConnectionStart":0},{"duration":561.7000000476837,"initiatorType":"script","name":"https://jira.mariadb.org/s/fbf975c0cce4b1abf04784eeae9ba1f4-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":402.60000014305115,"connectEnd":402.60000014305115,"connectStart":402.60000014305115,"domainLookupEnd":402.60000014305115,"domainLookupStart":402.60000014305115,"fetchStart":402.60000014305115,"redirectEnd":0,"redirectStart":0,"requestStart":809.9000000953674,"responseEnd":964.3000001907349,"responseStart":825.9000000953674,"secureConnectionStart":402.60000014305115},{"duration":669.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/099b33461394b8015fc36c0a4b96e19f-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":402.7000000476837,"connectEnd":402.7000000476837,"connectStart":402.7000000476837,"domainLookupEnd":402.7000000476837,"domainLookupStart":402.7000000476837,"fetchStart":402.7000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":811.4000000953674,"responseEnd":1072.2000000476837,"responseStart":858.8000001907349,"secureConnectionStart":402.7000000476837},{"duration":428.59999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/s/94c15bff32baef80f4096a08aceae8bc-CDN/lu2bu7/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":402.80000019073486,"connectEnd":402.80000019073486,"connectStart":402.80000019073486,"domainLookupEnd":402.80000019073486,"domainLookupStart":402.80000019073486,"fetchStart":402.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":811.9000000953674,"responseEnd":831.4000000953674,"responseStart":830.4000000953674,"secureConnectionStart":402.80000019073486},{"duration":429.30000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":403,"connectEnd":403,"connectStart":403,"domainLookupEnd":403,"domainLookupStart":403,"fetchStart":403,"redirectEnd":0,"redirectStart":0,"requestStart":812.5,"responseEnd":832.3000001907349,"responseStart":831.6000001430511,"secureConnectionStart":403},{"duration":440.10000014305115,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":403,"connectEnd":403,"connectStart":403,"domainLookupEnd":403,"domainLookupStart":403,"fetchStart":403,"redirectEnd":0,"redirectStart":0,"requestStart":813.5,"responseEnd":843.1000001430511,"responseStart":842,"secureConnectionStart":403},{"duration":409,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bu7/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":403.10000014305115,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":403.10000014305115,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":812.1000001430511,"responseStart":0,"secureConnectionStart":0},{"duration":442.7000000476837,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":403.2000000476837,"connectEnd":403.2000000476837,"connectStart":403.2000000476837,"domainLookupEnd":403.2000000476837,"domainLookupStart":403.2000000476837,"fetchStart":403.2000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":817.5,"responseEnd":845.9000000953674,"responseStart":844.3000001907349,"secureConnectionStart":403.2000000476837},{"duration":410.19999980926514,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":403.30000019073486,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":403.30000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":813.5,"responseStart":0,"secureConnectionStart":0},{"duration":451.7000000476837,"initiatorType":"script","name":"https://jira.mariadb.org/s/3339d87fa2538a859872f2df449bf8d0-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":403.40000009536743,"connectEnd":403.40000009536743,"connectStart":403.40000009536743,"domainLookupEnd":403.40000009536743,"domainLookupStart":403.40000009536743,"fetchStart":403.40000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":818.4000000953674,"responseEnd":855.1000001430511,"responseStart":844.8000001907349,"secureConnectionStart":403.40000009536743},{"duration":827.1000001430511,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":410.2000000476837,"connectEnd":410.2000000476837,"connectStart":410.2000000476837,"domainLookupEnd":410.2000000476837,"domainLookupStart":410.2000000476837,"fetchStart":410.2000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":1224.9000000953674,"responseEnd":1237.3000001907349,"responseStart":1235.9000000953674,"secureConnectionStart":410.2000000476837},{"duration":826.6999998092651,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":410.80000019073486,"connectEnd":410.80000019073486,"connectStart":410.80000019073486,"domainLookupEnd":410.80000019073486,"domainLookupStart":410.80000019073486,"fetchStart":410.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":1225.5,"responseEnd":1237.5,"responseStart":1236.7000000476837,"secureConnectionStart":410.80000019073486},{"duration":161.10000014305115,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":1096.7000000476837,"connectEnd":1096.7000000476837,"connectStart":1096.7000000476837,"domainLookupEnd":1096.7000000476837,"domainLookupStart":1096.7000000476837,"fetchStart":1096.7000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":1228.6000001430511,"responseEnd":1257.8000001907349,"responseStart":1257,"secureConnectionStart":1096.7000000476837},{"duration":168.5,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":1299.7000000476837,"connectEnd":1299.7000000476837,"connectStart":1299.7000000476837,"domainLookupEnd":1299.7000000476837,"domainLookupStart":1299.7000000476837,"fetchStart":1299.7000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":1439.6000001430511,"responseEnd":1468.2000000476837,"responseStart":1467.7000000476837,"secureConnectionStart":1299.7000000476837}],"fetchStart":1,"domainLookupStart":210,"domainLookupEnd":218,"connectStart":218,"connectEnd":239,"secureConnectionStart":227,"requestStart":239,"responseStart":397,"responseEnd":408,"domLoading":401,"domInteractive":1575,"domContentLoadedEventStart":1575,"domContentLoadedEventEnd":1637,"domComplete":2060,"loadEventStart":2060,"loadEventEnd":2061,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1536.2000000476837},{"name":"bigPipe.sidebar-id.end","time":1536.9000000953674},{"name":"bigPipe.activity-panel-pipe-id.start","time":1537.2000000476837},{"name":"bigPipe.activity-panel-pipe-id.end","time":1541.9000000953674},{"name":"activityTabFullyLoaded","time":1654.9000000953674}],"measures":[],"correlationId":"e5e4010687fe2e","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":84,"dbReadsTimeInMs":14,"dbConnsTimeInMs":21,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
added config file