Details
-
Bug
-
Status: Closed (View Workflow)
-
Major
-
Resolution: Duplicate
-
10.1.18
-
None
-
Ubuntu Server 16.04 64bit, SSD hard disk, 3 node Galera cluster
Description
We got the following signal 11. We run a 3 node galera cluster
161013 16:14:59 [ERROR] mysqld got signal 11 ;
|
This could be because you hit a bug. It is also possible that this binary
|
or one of the libraries it was linked against is corrupt, improperly built,
|
or misconfigured. This error can also be caused by malfunctioning hardware.
|
|
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
|
|
We will try our best to scrape up some info that will hopefully help
|
diagnose the problem, but since we have already crashed,
|
something is definitely wrong and this may fail.
|
|
Server version: 10.1.18-MariaDB-1~xenial
|
key_buffer_size=134217728
|
read_buffer_size=2097152
|
max_used_connections=210
|
max_threads=514
|
thread_count=191
|
It is possible that mysqld could use up to
|
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 3299624 K bytes of memory
|
Hope that's ok; if not, decrease some variables in the equation.
|
|
Thread pointer: 0x0x7f6fe7412008
|
Attempting backtrace. You can use the following information to find out
|
where mysqld died. If you see no messages after this, something went
|
terribly wrong...
|
stack_bottom = 0x7f714ea790d8 thread_stack 0x48400
|
/usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x561730dfa62e]
|
/usr/sbin/mysqld(handle_fatal_signal+0x2d5)[0x5617309493d5]
|
/lib/x86_64-linux-gnu/libpthread.so.0(+0x113d0)[0x7f714d1ea3d0]
|
/usr/sbin/mysqld(_ZN13MYSQL_BIN_LOG13mark_xid_doneEmb+0x8b)[0x5617309fe31b]
|
/usr/sbin/mysqld(binlog_background_thread+0x2f3)[0x5617309fe8f3]
|
/lib/x86_64-linux-gnu/libpthread.so.0(+0x76fa)[0x7f714d1e06fa]
|
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f714c88bb5d]
|
|
Trying to get some variables.
|
Some pointers may be invalid and cause the dump to abort.
|
Query (0x0):
|
Connection ID (thread ID): 3
|
Status: NOT_KILLED
|
|
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=off
|
|
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
|
information that should help you find out what is causing the crash.
|
____________________________________________________________________
Log entries immediately before this error are listed below, but are about 19 mins prior to the crash.
2016-10-13 14:43:59 140124334881536 [Warning] Aborted connection 428 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 14:44:09 140118458153728 [Warning] Aborted connection 430 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:34:00 7f714668bb00InnoDB: transactions deadlock detected, dumping detailed information.
|
2016-10-13 15:34:00 7f714668bb00
|
*** (1) TRANSACTION:
|
TRANSACTION 31187032, ACTIVE 0 sec starting index read
|
mysql tables in use 1, locked 1
|
LOCK WAIT 4 lock struct(s), heap size 1184, 2 row lock(s), undo log entries 3
|
MySQL thread id 590, OS thread handle 0x7f6fd9bf2b00, query id 3150943 10.1.0.7 root updating
|
UPDATE User SET FollowerCount = FollowerCount + 1 WHERE UserId=7042
|
*** (1) WAITING FOR THIS LOCK TO BE GRANTED:
|
RECORD LOCKS space id 570 page no 15 n bits 96 index `PRIMARY` of table `mm`.`User` trx table locks 2 total table locks 167 trx id 31187032 lock_mode X locks rec but not gap waiting lock hold time 0 wait time before grant 0
|
*** (2) TRANSACTION:
|
TRANSACTION 31184036, ACTIVE 5 sec starting index read
|
mysql tables in use 1, locked 1
|
5 lock struct(s), heap size 1184, 2 row lock(s), undo log entries 1
|
MySQL thread id 534, OS thread handle 0x7f714668bb00, query id 3149292 10.1.0.17 root updating
|
UPDATE User SET FriendCount = FriendCount - 1 WHERE (UserId=48780 OR UserId=7042) AND FriendCount > 0
|
*** (2) HOLDS THE LOCK(S):
|
RECORD LOCKS space id 570 page no 15 n bits 96 index `PRIMARY` of table `mm`.`User` trx table locks 2 total table locks 167 trx id 31184036 lock_mode X locks rec but not gap lock hold time 1 wait time before grant 1
|
*** (2) WAITING FOR THIS LOCK TO BE GRANTED:
|
RECORD LOCKS space id 570 page no 1353 n bits 104 index `PRIMARY` of table `mm`.`User` trx table locks 2 total table locks 167 trx id 31184036 lock_mode X locks rec but not gap waiting lock hold time 0 wait time before grant 0
|
*** WE ROLL BACK TRANSACTION (2)
|
2016-10-13 15:34:00 140124489300736 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction
|
2016-10-13 15:34:00 140124489300736 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction
|
2016-10-13 15:37:11 7f6fd83feb00InnoDB: transactions deadlock detected, dumping detailed information.
|
2016-10-13 15:37:11 7f6fd83feb00
|
*** (1) TRANSACTION:
|
TRANSACTION 31269941, ACTIVE 1 sec starting index read
|
mysql tables in use 1, locked 1
|
LOCK WAIT 4 lock struct(s), heap size 1184, 2 row lock(s), undo log entries 3
|
MySQL thread id 487, OS thread handle 0x7f71269f7b00, query id 3510118 10.1.0.17 root updating
|
UPDATE User SET FollowerCount = FollowerCount + 1 WHERE UserId=7042
|
*** (1) WAITING FOR THIS LOCK TO BE GRANTED:
|
RECORD LOCKS space id 570 page no 15 n bits 96 index `PRIMARY` of table `mm`.`User` trx table locks 2 total table locks 105 trx id 31269941 lock_mode X locks rec but not gap waiting lock hold time 0 wait time before grant 0
|
*** (2) TRANSACTION:
|
TRANSACTION 31265639, ACTIVE 8 sec starting index read
|
mysql tables in use 1, locked 1
|
6 lock struct(s), heap size 1184, 2 row lock(s), undo log entries 1
|
MySQL thread id 630, OS thread handle 0x7f6fd83feb00, query id 3501445 10.1.0.7 root updating
|
UPDATE User SET FriendCount = FriendCount - 1 WHERE (UserId=59316 OR UserId=7042) AND FriendCount > 0
|
*** (2) HOLDS THE LOCK(S):
|
RECORD LOCKS space id 570 page no 15 n bits 96 index `PRIMARY` of table `mm`.`User` trx table locks 2 total table locks 105 trx id 31265639 lock_mode X locks rec but not gap lock hold time 3 wait time before grant 3
|
*** (2) WAITING FOR THIS LOCK TO BE GRANTED:
|
RECORD LOCKS space id 570 page no 646 n bits 112 index `PRIMARY` of table `mm`.`User` trx table locks 2 total table locks 105 trx id 31265639 lock_mode X locks rec but not gap waiting lock hold time 0 wait time before grant 0
|
*** WE ROLL BACK TRANSACTION (2)
|
2016-10-13 15:37:11 140118346164992 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction
|
2016-10-13 15:37:11 140118346164992 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction
|
2016-10-13 15:37:12 7f7146769b00InnoDB: transactions deadlock detected, dumping detailed information.
|
2016-10-13 15:37:12 7f7146769b00
|
*** (1) TRANSACTION:
|
TRANSACTION 31269306, ACTIVE 2 sec starting index read
|
mysql tables in use 1, locked 1
|
LOCK WAIT 4 lock struct(s), heap size 1184, 2 row lock(s), undo log entries 3
|
MySQL thread id 550, OS thread handle 0x7f70b4ec0b00, query id 3507731 10.1.0.7 root updating
|
UPDATE User SET FollowerCount = FollowerCount + 1 WHERE UserId=7042
|
*** (1) WAITING FOR THIS LOCK TO BE GRANTED:
|
RECORD LOCKS space id 570 page no 15 n bits 96 index `PRIMARY` of table `mm`.`User` trx table locks 2 total table locks 131 trx id 31269306 lock_mode X locks rec but not gap waiting lock hold time 2 wait time before grant 0
|
*** (2) TRANSACTION:
|
TRANSACTION 31267821, ACTIVE 4 sec starting index read
|
mysql tables in use 1, locked 1
|
5 lock struct(s), heap size 1184, 2 row lock(s), undo log entries 1
|
MySQL thread id 480, OS thread handle 0x7f7146769b00, query id 3506114 10.1.0.17 root updating
|
UPDATE User SET FriendCount = FriendCount - 1 WHERE (UserId=59325 OR UserId=7042) AND FriendCount > 0
|
*** (2) HOLDS THE LOCK(S):
|
RECORD LOCKS space id 570 page no 15 n bits 96 index `PRIMARY` of table `mm`.`User` trx table locks 2 total table locks 131 trx id 31267821 lock_mode X locks rec but not gap lock hold time 3 wait time before grant 3
|
*** (2) WAITING FOR THIS LOCK TO BE GRANTED:
|
RECORD LOCKS space id 570 page no 646 n bits 112 index `PRIMARY` of table `mm`.`User` trx table locks 2 total table locks 131 trx id 31267821 lock_mode X locks rec but not gap waiting lock hold time 0 wait time before grant 0
|
*** WE ROLL BACK TRANSACTION (2)
|
2016-10-13 15:37:12 140124490210048 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction
|
2016-10-13 15:37:12 140124490210048 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction
|
2016-10-13 15:51:23 140124628146944 [Note] InnoDB: Online DDL : Start
|
2016-10-13 15:51:23 140124628146944 [Note] InnoDB: Online DDL : Start reading clustered index of the table and create temporary files
|
2016-10-13 15:51:23 140124628146944 [Note] InnoDB: Online DDL : End of reading clustered index of the table and create temporary files
|
2016-10-13 15:51:23 140124628146944 [Note] InnoDB: Online DDL : Completed
|
2016-10-13 15:56:43 140124331850496 [Warning] Aborted connection 454 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118863137536 [Warning] Aborted connection 465 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118863743744 [Warning] Aborted connection 458 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140122047523584 [Warning] Aborted connection 457 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140120772283136 [Warning] Aborted connection 455 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140124272102144 [Warning] Aborted connection 466 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118458759936 [Warning] Aborted connection 448 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118667569920 [Warning] Aborted connection 453 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140120773192448 [Warning] Aborted connection 442 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118668782336 [Warning] Aborted connection 444 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140124488997632 [Warning] Aborted connection 445 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118668176128 [Warning] Aborted connection 461 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118668479232 [Warning] Aborted connection 464 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118864046848 [Warning] Aborted connection 459 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140122046917376 [Warning] Aborted connection 451 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118459063040 [Warning] Aborted connection 447 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140120771373824 [Warning] Aborted connection 467 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140124575476480 [Warning] Aborted connection 439 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140124272708352 [Warning] Aborted connection 456 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118865865472 [Warning] Aborted connection 443 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140124271495936 [Warning] Aborted connection 463 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140124489603840 [Warning] Aborted connection 462 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140120771980032 [Warning] Aborted connection 460 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118669085440 [Warning] Aborted connection 440 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140124334275328 [Warning] Aborted connection 450 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118459366144 [Warning] Aborted connection 452 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118862531328 [Warning] Aborted connection 441 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140124333062912 [Warning] Aborted connection 449 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118667266816 [Warning] Aborted connection 432 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
2016-10-13 15:56:43 140118665448192 [Warning] Aborted connection 446 to db: 'mm' user: 'root' host: '10.1.0.17' (Got an error reading communication packets)
|
161013 16:14:59 [ERROR] mysqld got signal 11 ;
|
Attachments
Issue Links
- relates to
-
MDEV-9510 Segmentation fault in binlog thread causes crash
- Closed