2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: The InnoDB memory heap is disabled 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Memory barrier is not used 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Using Linux native AIO 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Using generic crc32 instructions 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Completed initialization of buffer pool 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Highest supported file format is Barracuda. 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: The log sequence numbers 225163710958 and 225163710958 in ibdata files do not match the log sequence number 225197365083 in the ib_logfiles! 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Database was not shutdown normally! 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Starting crash recovery. 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Reading tablespace information from the .ibd files... 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Restoring possible half-written data pages 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: from the doublewrite buffer... InnoDB: Last MySQL binlog file position 0 439685, file name ./OFF.000013 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: 128 rollback segment(s) are active. 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Waiting for purge to start 2016-02-08 10:01:23 140355300116352 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.26-76.0 started; log sequence number 225197365083 2016-02-08 10:01:24 140354821027584 [Note] InnoDB: Dumping buffer pool(s) not yet started Mon Feb 8 10:01:24 2016 PerconaFT recovery starting in env /var/lib/mysql/3306/ Mon Feb 8 10:01:24 2016 PerconaFT recovery scanning backward from 27523124 Mon Feb 8 10:01:24 2016 PerconaFT recovery bw_end_checkpoint at 27523124 timestamp 1454943632109466 xid 27523107 (bw_newer) Mon Feb 8 10:01:24 2016 PerconaFT recovery bw_begin_checkpoint at 27523107 timestamp 1454943632109261 (bw_between) Mon Feb 8 10:01:24 2016 PerconaFT recovery turning around at begin checkpoint 27523107 time 205 Mon Feb 8 10:01:24 2016 PerconaFT recovery starts scanning forward to 27523124 from 27523107 left 17 (fw_between) Mon Feb 8 10:01:24 2016 PerconaFT recovery closing 15 dictionaries Mon Feb 8 10:01:24 2016 PerconaFT recovery making a checkpoint Mon Feb 8 10:01:24 2016 PerconaFT recovery done 2016-02-08 10:01:24 140355300116352 [Note] CONNECT: Version 1.04.0005 December 11, 2015 2016-02-08 10:01:24 140355300116352 [Note] Plugin 'FEEDBACK' is disabled. 2016-02-08 10:01:24 140355300116352 [Note] Recovering after a crash using OFF 2016-02-08 10:01:24 140355300116352 [Note] Starting crash recovery... 2016-02-08 10:01:24 140355300116352 [Note] Crash recovery finished. 2016-02-08 10:01:24 140355300116352 [Note] Server socket created on IP: '192.168.123.4'. 2016-02-08 10:01:24 140355300116352 [Note] Server socket created on IP: '192.168.123.4'. 2016-02-08 10:01:24 140355300116352 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.1.11-MariaDB-log' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Source distribution 2016-02-17 16:25:10 140355224254208 [Note] /usr/sbin/mysqld: Normal shutdown 2016-02-17 16:25:10 140355224254208 [Note] Event Scheduler: Purging the queue. 9 events 2016-02-17 16:25:11 140354804242176 [Note] InnoDB: FTS optimize thread exiting. 2016-02-17 16:25:11 140355224254208 [Note] InnoDB: Starting shutdown... 2016-02-17 16:26:11 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:27:11 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:28:11 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:29:11 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:30:12 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:31:12 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:32:12 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:33:12 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:34:12 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:35:13 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:36:13 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:37:13 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:38:13 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:39:13 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:40:13 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:41:14 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:42:14 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:43:14 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-02-17 16:44:14 140355224254208 [Note] InnoDB: Waiting for 3 active transactions to finish 160217 16:45:08 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see http://kb.askmonty.org/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.1.11-MariaDB-log key_buffer_size=33554432 read_buffer_size=262144 max_used_connections=5 max_threads=1001 thread_count=0 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 805576 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x0x0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x0 thread_stack 0x40000 /usr/sbin/mysqld(my_print_stacktrace+0x20)[0x7fa7046df9d0] /usr/sbin/mysqld(handle_fatal_signal+0x347)[0x7fa70425f16f] /lib64/libpthread.so.0(+0xfa00)[0x7fa702340a00] /lib64/libpthread.so.0(pthread_cond_wait+0xbf)[0x7fa70233d2cf] /usr/sbin/mysqld(_Z11mysqld_mainiPPc+0xa3d)[0x7fa70408c88c] /usr/sbin/mysqld(main+0x9)[0x7fa70407f310] /lib64/libc.so.6(__libc_start_main+0xf5)[0x7fa700efa81c] /usr/sbin/mysqld(_start+0x29)[0x7fa70407f249] The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: The InnoDB memory heap is disabled 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: Memory barrier is not used 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: Using Linux native AIO 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: Using generic crc32 instructions 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: Completed initialization of buffer pool 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: Highest supported file format is Barracuda. 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: The log sequence numbers 225163710958 and 225163710958 in ibdata files do not match the log sequence number 225198051418 in the ib_logfiles! 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: Database was not shutdown normally! 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: Starting crash recovery. 2016-02-17 16:45:23 139635272918912 [Note] InnoDB: Reading tablespace information from the .ibd files... 2016-02-17 16:45:24 139635272918912 [Note] InnoDB: Restoring possible half-written data pages 2016-02-17 16:45:24 139635272918912 [Note] InnoDB: from the doublewrite buffer... InnoDB: Last MySQL binlog file position 0 310137, file name ./OFF.000014 2016-02-17 16:45:25 139635272918912 [Note] InnoDB: 128 rollback segment(s) are active. 2016-02-17 16:45:25 139635272918912 [Note] InnoDB: Waiting for purge to start 2016-02-17 16:45:25 139635272918912 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.26-76.0 started; log sequence number 225198051418 2016-02-17 16:45:25 139634793248512 [Note] InnoDB: Dumping buffer pool(s) not yet started 2016-02-17 16:45:25 139635272918912 [Note] CONNECT: Version 1.04.0005 December 11, 2015 2016-02-17 16:45:25 139635272918912 [Note] Plugin 'FEEDBACK' is disabled. 2016-02-17 16:45:26 139635272918912 [Note] Server socket created on IP: '192.168.123.4'. 2016-02-17 16:45:26 139635272918912 [Note] Server socket created on IP: '192.168.123.4'. 2016-02-17 16:45:26 139635272918912 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.1.11-MariaDB-log' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Source distribution 2016-02-17 16:46:23 139635272214272 [Note] /usr/sbin/mysqld: Normal shutdown 2016-02-17 16:46:23 139635272214272 [Note] Event Scheduler: Purging the queue. 9 events 2016-02-17 16:46:23 139634768082688 [Note] InnoDB: FTS optimize thread exiting. 2016-02-17 16:46:23 139635272214272 [Note] InnoDB: Starting shutdown... 2016-02-17 16:46:25 139635272214272 [Note] InnoDB: Shutdown completed; log sequence number 225198051540 2016-02-17 16:46:25 139635272214272 [Note] /usr/sbin/mysqld: Shutdown complete 2016-02-17 16:46:26 139867554072448 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-02-17 16:46:26 139867554072448 [Note] InnoDB: The InnoDB memory heap is disabled 2016-02-17 16:46:26 139867554072448 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-02-17 16:46:26 139867554072448 [Note] InnoDB: Memory barrier is not used 2016-02-17 16:46:26 139867554072448 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-02-17 16:46:26 139867554072448 [Note] InnoDB: Using Linux native AIO 2016-02-17 16:46:26 139867554072448 [Note] InnoDB: Using generic crc32 instructions 2016-02-17 16:46:26 139867554072448 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2016-02-17 16:46:26 139867554072448 [Note] InnoDB: Completed initialization of buffer pool 2016-02-17 16:46:26 139867554072448 [Note] InnoDB: Highest supported file format is Barracuda. 2016-02-17 16:46:26 139867554072448 [Note] InnoDB: 128 rollback segment(s) are active. 2016-02-17 16:46:26 139867554072448 [Note] InnoDB: Waiting for purge to start 2016-02-17 16:46:26 139867554072448 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.26-76.0 started; log sequence number 225198051540 2016-02-17 16:46:26 139867073804032 [Note] InnoDB: Dumping buffer pool(s) not yet started 2016-02-17 16:46:26 139867554072448 [Note] CONNECT: Version 1.04.0005 December 11, 2015 2016-02-17 16:46:26 139867554072448 [Note] Plugin 'FEEDBACK' is disabled. 2016-02-17 16:46:26 139867554072448 [Note] Server socket created on IP: '192.168.123.4'. 2016-02-17 16:46:26 139867554072448 [Note] Server socket created on IP: '192.168.123.4'. 2016-02-17 16:46:26 139867554072448 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.1.11-MariaDB-log' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Source distribution 2016-03-01 12:47:13 139867553343232 [Warning] GSSAPI plugin : default principal 'mariadb/ichigo.scent-team.com@SCENT-TEAM.COM' not found in keytab 2016-03-01 12:47:13 139867553343232 [ERROR] Plugin 'gssapi' init function returned error. 2016-03-01 12:51:17 139867478361856 [Note] /usr/sbin/mysqld: Normal shutdown 2016-03-01 12:51:17 139867478361856 [Note] Event Scheduler: Purging the queue. 9 events 2016-03-01 12:51:18 139867057018624 [Note] InnoDB: FTS optimize thread exiting. 2016-03-01 12:51:18 139867478361856 [Note] InnoDB: Starting shutdown... 2016-03-01 12:52:18 139867478361856 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-03-01 12:53:18 139867478361856 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-03-01 12:54:18 139867478361856 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-03-01 12:55:19 139867478361856 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-03-01 12:56:19 139867478361856 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-03-01 12:57:19 139867478361856 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-03-01 12:58:19 139867478361856 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-03-01 12:59:19 139867478361856 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-03-01 13:00:19 139867478361856 [Note] InnoDB: Waiting for 3 active transactions to finish 2016-03-01 13:01:20 139867478361856 [Note] InnoDB: Waiting for 3 active transactions to finish 160301 13:01:30 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see http://kb.askmonty.org/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.1.11-MariaDB-log key_buffer_size=33554432 read_buffer_size=262144 max_used_connections=6 max_threads=1001 thread_count=0 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 805576 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x0x0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x0 thread_stack 0x40000 /usr/sbin/mysqld(my_print_stacktrace+0x20)[0x7f35747ff9d0] /usr/sbin/mysqld(handle_fatal_signal+0x347)[0x7f357437f16f] /lib64/libpthread.so.0(+0xfcb0)[0x7f357245ccb0] /lib64/libpthread.so.0(pthread_cond_wait+0xbf)[0x7f357245944f] /usr/sbin/mysqld(_Z11mysqld_mainiPPc+0xa3d)[0x7f35741ac88c] /usr/sbin/mysqld(main+0x9)[0x7f357419f310] /lib64/libc.so.6(__libc_start_main+0xf0)[0x7f35710117c8] /usr/sbin/mysqld(_start+0x29)[0x7f357419f249] The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: The InnoDB memory heap is disabled 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: Memory barrier is not used 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: Using Linux native AIO 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: Using generic crc32 instructions 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: Completed initialization of buffer pool 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: Highest supported file format is Barracuda. 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: The log sequence numbers 225198051540 and 225198051540 in ibdata files do not match the log sequence number 225199859653 in the ib_logfiles! 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: Database was not shutdown normally! 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: Starting crash recovery. 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: Reading tablespace information from the .ibd files... 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: Restoring possible half-written data pages 2016-03-01 14:05:12 140291934361472 [Note] InnoDB: from the doublewrite buffer... InnoDB: Last MySQL binlog file position 0 310137, file name ./OFF.000014 2016-03-01 14:05:13 140291934361472 [Note] InnoDB: 128 rollback segment(s) are active. 2016-03-01 14:05:13 140291934361472 [Note] InnoDB: Waiting for purge to start 2016-03-01 14:05:13 140291934361472 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 225199859653 2016-03-01 14:05:13 140291436680960 [Note] InnoDB: Dumping buffer pool(s) not yet started 2016-03-01 14:05:13 140291934361472 [Note] CONNECT: Version 1.04.0005 January 24, 2016 2016-03-01 14:05:13 140291934361472 [Note] Plugin 'FEEDBACK' is disabled. 2016-03-01 14:05:13 140291934361472 [Warning] GSSAPI plugin : default principal 'mariadb/ichigo.scent-team.com@SCENT-TEAM.COM' not found in keytab 2016-03-01 14:05:13 140291934361472 [Note] Recovering after a crash using tc.log 2016-03-01 14:05:13 140291934361472 [Note] Starting crash recovery... 2016-03-01 14:05:13 140291934361472 [Note] Crash recovery finished. 2016-03-01 14:05:13 140291934361472 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-01 14:05:13 140291934361472 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-01 14:05:13 140291934361472 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.1.12-MariaDB' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Source distribution 2016-03-01 14:35:33 140291857725184 [Note] /usr/sbin/mysqld: Normal shutdown 2016-03-01 14:35:33 140291857725184 [Note] Event Scheduler: Purging the queue. 9 events 2016-03-01 14:35:33 140291415701248 [Note] InnoDB: FTS optimize thread exiting. 2016-03-01 14:35:33 140291857725184 [Note] InnoDB: Starting shutdown... 2016-03-01 14:35:35 140291857725184 [Note] InnoDB: Shutdown completed; log sequence number 225199859663 2016-03-01 14:35:35 140291857725184 [Note] /usr/sbin/mysqld: Shutdown complete 2016-03-01 14:35:35 140202163890048 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-03-01 14:35:35 140202163890048 [Note] InnoDB: The InnoDB memory heap is disabled 2016-03-01 14:35:35 140202163890048 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-03-01 14:35:35 140202163890048 [Note] InnoDB: Memory barrier is not used 2016-03-01 14:35:35 140202163890048 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-03-01 14:35:35 140202163890048 [Note] InnoDB: Using Linux native AIO 2016-03-01 14:35:35 140202163890048 [Note] InnoDB: Using generic crc32 instructions 2016-03-01 14:35:35 140202163890048 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2016-03-01 14:35:35 140202163890048 [Note] InnoDB: Completed initialization of buffer pool 2016-03-01 14:35:35 140202163890048 [Note] InnoDB: Highest supported file format is Barracuda. 2016-03-01 14:35:35 140202163890048 [Note] InnoDB: 128 rollback segment(s) are active. 2016-03-01 14:35:35 140202163890048 [Note] InnoDB: Waiting for purge to start 2016-03-01 14:35:35 140202163890048 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 225199859663 2016-03-01 14:35:35 140201666017024 [Note] InnoDB: Dumping buffer pool(s) not yet started 2016-03-01 14:35:36 140202163890048 [Note] CONNECT: Version 1.04.0005 January 24, 2016 2016-03-01 14:35:36 140202163890048 [Note] Plugin 'FEEDBACK' is disabled. 2016-03-01 14:35:36 140202163890048 [Warning] GSSAPI plugin : default principal 'mariadb/ichigo.scent-team.com@SCENT-TEAM.COM' not found in keytab 2016-03-01 14:35:36 140202163890048 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-01 14:35:36 140202163890048 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-01 14:35:36 140202163890048 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.1.12-MariaDB' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Source distribution 2016-03-01 14:37:48 140202162894592 [Note] /usr/sbin/mysqld: Normal shutdown 2016-03-01 14:37:48 140202162894592 [Note] Event Scheduler: Purging the queue. 9 events 2016-03-01 14:37:49 140201645037312 [Note] InnoDB: FTS optimize thread exiting. 2016-03-01 14:37:49 140202162894592 [Note] InnoDB: Starting shutdown... 2016-03-01 14:37:51 140202162894592 [Note] InnoDB: Shutdown completed; log sequence number 225199859673 2016-03-01 14:37:51 140202162894592 [Note] /usr/sbin/mysqld: Shutdown complete 2016-03-01 14:38:09 140197282867072 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-03-01 14:38:09 140197282867072 [Note] InnoDB: The InnoDB memory heap is disabled 2016-03-01 14:38:09 140197282867072 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-03-01 14:38:09 140197282867072 [Note] InnoDB: Memory barrier is not used 2016-03-01 14:38:09 140197282867072 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-03-01 14:38:09 140197282867072 [Note] InnoDB: Using Linux native AIO 2016-03-01 14:38:09 140197282867072 [Note] InnoDB: Using generic crc32 instructions 2016-03-01 14:38:09 140197282867072 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2016-03-01 14:38:09 140197282867072 [Note] InnoDB: Completed initialization of buffer pool 2016-03-01 14:38:09 140197282867072 [Note] InnoDB: Highest supported file format is Barracuda. 2016-03-01 14:38:09 140197282867072 [Note] InnoDB: 128 rollback segment(s) are active. 2016-03-01 14:38:09 140197282867072 [Note] InnoDB: Waiting for purge to start 2016-03-01 14:38:09 140197282867072 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 225199859673 2016-03-01 14:38:10 140196783847168 [Note] InnoDB: Dumping buffer pool(s) not yet started 2016-03-01 14:38:10 140197282867072 [Note] CONNECT: Version 1.04.0005 January 24, 2016 2016-03-01 14:38:10 140197282867072 [Note] Plugin 'FEEDBACK' is disabled. 2016-03-01 14:38:10 140197282867072 [Note] GSSAPI plugin : using principal name 'mariadb/ichigo.wilkesbarre.scent-team.local@wilkesbarre.scent-team.local' 2016-03-01 14:38:30 140197282867072 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-01 14:38:30 140197282867072 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-01 14:38:30 140197282867072 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.1.12-MariaDB' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Source distribution 160304 11:15:34 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see http://kb.askmonty.org/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.1.12-MariaDB key_buffer_size=33554432 read_buffer_size=262144 max_used_connections=5 max_threads=1001 thread_count=1 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 805576 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x0x7f81fc7ca008 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f823487edc8 thread_stack 0x40000 /usr/sbin/mysqld(my_print_stacktrace+0x20)[0x7f8239de26e0] /usr/sbin/mysqld(handle_fatal_signal+0x347)[0x7f8239961a0f] /lib64/libpthread.so.0(+0xfcb0)[0x7f8237a3ecb0] /usr/sbin/mysqld(+0x6a6e3f)[0x7f8239aa7e3f] /usr/lib64/mysql/plugin/ha_oqgraph.so(_ZN10ha_oqgraph5extraE17ha_extra_function+0x14)[0x7f82302beab4] /usr/sbin/mysqld(+0x3caa4d)[0x7f82397cba4d] /usr/sbin/mysqld(_Z11open_tablesP3THDRK14DDL_options_stPP10TABLE_LISTPjjP19Prelocking_strategy+0x23e)[0x7f82397cbed6] /usr/sbin/mysqld(_Z30open_normal_and_derived_tablesP3THDP10TABLE_LISTjj+0x5d)[0x7f82397cc3d8] /usr/sbin/mysqld(+0x457412)[0x7f8239858412] /usr/sbin/mysqld(_Z14get_all_tablesP3THDP10TABLE_LISTP4Item+0x586)[0x7f823986a8e3] /usr/sbin/mysqld(_Z24get_schema_tables_resultP4JOIN23enum_schema_table_state+0x289)[0x7f823986bb60] /usr/sbin/mysqld(_ZN4JOIN10exec_innerEv+0x4d8)[0x7f82398539cc] /usr/sbin/mysqld(_ZN4JOIN4execEv+0x63)[0x7f8239854dfd] /usr/sbin/mysqld(_Z12mysql_selectP3THDPPP4ItemP10TABLE_LISTjR4ListIS1_ES2_jP8st_orderSB_S2_SB_yP13select_resultP18st_select_lex_unitP13st_select_lex+0x89d)[0x7f8239852d08] /usr/sbin/mysqld(_Z13handle_selectP3THDP3LEXP13select_resultm+0x141)[0x7f8239852f4c] /usr/sbin/mysqld(+0x3fd30f)[0x7f82397fe30f] /usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x1054)[0x7f8239806505] /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x167)[0x7f823980c024] /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0xbe1)[0x7f823980d3cf] /usr/sbin/mysqld(_Z10do_commandP3THD+0x1b9)[0x7f823980f06c] /usr/sbin/mysqld(_Z26threadpool_process_requestP3THD+0x67)[0x7f823990a112] /usr/sbin/mysqld(+0x53ed55)[0x7f823993fd55] /usr/sbin/mysqld(+0x53f5d9)[0x7f82399405d9] /lib64/libpthread.so.0(+0x71df)[0x7f8237a361df] /lib64/libc.so.6(clone+0x6d)[0x7f82366b3a8d] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x7f82344d3020): is an invalid pointer Connection ID (thread ID): 400 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: The InnoDB memory heap is disabled 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Memory barrier is not used 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Using Linux native AIO 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Using generic crc32 instructions 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Completed initialization of buffer pool 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Highest supported file format is Barracuda. 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: The log sequence numbers 225199859673 and 225199859673 in ibdata files do not match the log sequence number 225201018972 in the ib_logfiles! 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Database was not shutdown normally! 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Starting crash recovery. 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Reading tablespace information from the .ibd files... 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Restoring possible half-written data pages 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: from the doublewrite buffer... InnoDB: Last MySQL binlog file position 0 310137, file name ./OFF.000014 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: 128 rollback segment(s) are active. 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Waiting for purge to start 2016-03-04 11:16:13 139707288668032 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 225201018972 2016-03-04 11:16:13 139706788452096 [Note] InnoDB: Dumping buffer pool(s) not yet started Fri Mar 4 11:16:14 2016 PerconaFT recovery starting in env /var/lib/mysql/3306/ Fri Mar 4 11:16:14 2016 PerconaFT recovery scanning backward from 28150268 Fri Mar 4 11:16:14 2016 PerconaFT recovery bw_end_checkpoint at 28150268 timestamp 1457108110431934 xid 28150251 (bw_newer) Fri Mar 4 11:16:14 2016 PerconaFT recovery bw_begin_checkpoint at 28150251 timestamp 1457108110431835 (bw_between) Fri Mar 4 11:16:14 2016 PerconaFT recovery turning around at begin checkpoint 28150251 time 99 Fri Mar 4 11:16:14 2016 PerconaFT recovery starts scanning forward to 28150268 from 28150251 left 17 (fw_between) Fri Mar 4 11:16:14 2016 PerconaFT recovery closing 15 dictionaries Fri Mar 4 11:16:14 2016 PerconaFT recovery making a checkpoint Fri Mar 4 11:16:14 2016 PerconaFT recovery done 2016-03-04 11:16:14 139707288668032 [Note] CONNECT: Version 1.04.0005 January 24, 2016 2016-03-04 11:16:14 139707288668032 [Note] Plugin 'FEEDBACK' is disabled. 2016-03-04 11:16:14 139707288668032 [Note] GSSAPI plugin : using principal name 'mariadb/ichigo.wilkesbarre.scent-team.local@wilkesbarre.scent-team.local' 2016-03-04 11:16:33 139707288668032 [Note] Recovering after a crash using tc.log 2016-03-04 11:16:33 139707288668032 [Note] Starting crash recovery... 2016-03-04 11:16:33 139707288668032 [Note] Crash recovery finished. 2016-03-04 11:16:33 139707288668032 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-04 11:16:33 139707288668032 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-04 11:16:33 139707288668032 [ERROR] mysqld: Table './mysql/user' is marked as crashed and should be repaired 2016-03-04 11:16:33 139707288668032 [Warning] Checking table: './mysql/user' 2016-03-04 11:16:33 139707288668032 [ERROR] mysql.user: 1 client is using or hasn't closed the table properly 2016-03-04 11:16:33 139707288668032 [ERROR] mysqld: Table './mysql/db' is marked as crashed and should be repaired 2016-03-04 11:16:33 139707288668032 [Warning] Checking table: './mysql/db' 2016-03-04 11:16:33 139707288668032 [ERROR] mysql.db: 1 client is using or hasn't closed the table properly 2016-03-04 11:16:33 139707288668032 [ERROR] mysqld: Table './mysql/roles_mapping' is marked as crashed and should be repaired 2016-03-04 11:16:33 139707288668032 [Warning] Checking table: './mysql/roles_mapping' 2016-03-04 11:16:33 139707288668032 [ERROR] mysql.roles_mapping: 1 client is using or hasn't closed the table properly 2016-03-04 11:16:33 139707288668032 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.1.12-MariaDB' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Source distribution 2016-03-04 11:48:21 139707287672576 [Note] /usr/sbin/mysqld: Normal shutdown 2016-03-04 11:48:21 139707287672576 [Note] Event Scheduler: Purging the queue. 9 events 2016-03-04 11:48:22 139706767472384 [Note] InnoDB: FTS optimize thread exiting. 2016-03-04 11:48:22 139707287672576 [Note] InnoDB: Starting shutdown... 2016-03-04 11:48:23 139707287672576 [Note] InnoDB: Shutdown completed; log sequence number 225201019670 2016-03-04 11:48:23 139707287672576 [Note] /usr/sbin/mysqld: Shutdown complete 2016-03-04 11:48:24 140347507742592 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-03-04 11:48:24 140347507742592 [Note] InnoDB: The InnoDB memory heap is disabled 2016-03-04 11:48:24 140347507742592 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-03-04 11:48:24 140347507742592 [Note] InnoDB: Memory barrier is not used 2016-03-04 11:48:24 140347507742592 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-03-04 11:48:24 140347507742592 [Note] InnoDB: Using Linux native AIO 2016-03-04 11:48:24 140347507742592 [Note] InnoDB: Using generic crc32 instructions 2016-03-04 11:48:24 140347507742592 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2016-03-04 11:48:24 140347507742592 [Note] InnoDB: Completed initialization of buffer pool 2016-03-04 11:48:24 140347507742592 [Note] InnoDB: Highest supported file format is Barracuda. 2016-03-04 11:48:24 140347507742592 [Note] InnoDB: 128 rollback segment(s) are active. 2016-03-04 11:48:24 140347507742592 [Note] InnoDB: Waiting for purge to start 2016-03-04 11:48:24 140347507742592 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 225201019670 2016-03-04 11:48:24 140347007039232 [Note] InnoDB: Dumping buffer pool(s) not yet started 2016-03-04 11:48:24 140347507742592 [Note] CONNECT: Version 1.04.0005 January 24, 2016 2016-03-04 11:48:24 140347507742592 [Note] Plugin 'FEEDBACK' is disabled. 2016-03-04 11:48:24 140347507742592 [Note] GSSAPI plugin : using principal name 'mariadb/ichigo.wilkesbarre.scent-team.local@wilkesbarre.scent-team.local' 2016-03-04 11:48:44 140347507742592 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-04 11:48:44 140347507742592 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-04 11:48:44 140347507742592 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.1.12-MariaDB' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Source distribution 2016-03-08 13:05:31 140346981861120 [Note] /usr/sbin/mysqld: Normal shutdown 2016-03-08 13:05:31 140346981861120 [Note] Event Scheduler: Purging the queue. 9 events 2016-03-08 13:05:33 140346990253824 [Note] InnoDB: FTS optimize thread exiting. 2016-03-08 13:05:33 140346981861120 [Note] InnoDB: Starting shutdown... 2016-03-08 13:06:33 140346981861120 [Note] InnoDB: Waiting for 2 active transactions to finish 2016-03-08 13:07:33 140346981861120 [Note] InnoDB: Waiting for 2 active transactions to finish 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: The InnoDB memory heap is disabled 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: Memory barrier is not used 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: Using Linux native AIO 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: Using generic crc32 instructions 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: Completed initialization of buffer pool 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: Highest supported file format is Barracuda. 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: The log sequence numbers 225201019670 and 225201019670 in ibdata files do not match the log sequence number 225202922898 in the ib_logfiles! 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: Database was not shutdown normally! 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: Starting crash recovery. 2016-03-08 13:09:25 140211052918656 [Note] InnoDB: Reading tablespace information from the .ibd files... 2016-03-08 13:09:27 140211052918656 [Note] InnoDB: Restoring possible half-written data pages 2016-03-08 13:09:27 140211052918656 [Note] InnoDB: from the doublewrite buffer... InnoDB: Last MySQL binlog file position 0 310137, file name ./OFF.000014 2016-03-08 13:09:28 140211052918656 [Note] InnoDB: 128 rollback segment(s) are active. 2016-03-08 13:09:28 140211052918656 [Note] InnoDB: Waiting for purge to start 2016-03-08 13:09:28 140211052918656 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 225202922898 2016-03-08 13:09:28 140210545358592 [Note] InnoDB: Dumping buffer pool(s) not yet started 2016-03-08 13:09:29 140211052918656 [Note] CONNECT: Version 1.04.0005 January 24, 2016 2016-03-08 13:09:29 140211052918656 [Note] Plugin 'FEEDBACK' is disabled. 2016-03-08 13:09:29 140211052918656 [Note] GSSAPI plugin : using principal name 'mariadb/ichigo.wilkesbarre.scent-team.local@wilkesbarre.scent-team.local' 2016-03-08 13:13:19 140211052918656 [Note] Recovering after a crash using tc.log 2016-03-08 13:13:19 140211052918656 [Note] Starting crash recovery... 2016-03-08 13:13:19 140211052918656 [Note] Crash recovery finished. 2016-03-08 13:13:20 140211052918656 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-08 13:13:20 140211052918656 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-08 13:13:23 140211052918656 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.1.12-MariaDB' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Source distribution 2016-03-08 13:37:15 140211052189440 [Note] /usr/sbin/mysqld: Normal shutdown 2016-03-08 13:37:15 140211052189440 [Note] Event Scheduler: Purging the queue. 9 events 2016-03-08 13:37:16 140210524378880 [Note] InnoDB: FTS optimize thread exiting. 2016-03-08 13:37:16 140211052189440 [Note] InnoDB: Starting shutdown... 2016-03-08 13:37:18 140211052189440 [Note] InnoDB: Shutdown completed; log sequence number 225202922908 2016-03-08 13:37:18 140211052189440 [Note] /usr/sbin/mysqld: Shutdown complete 2016-03-08 13:39:36 140703115888512 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-03-08 13:39:36 140703115888512 [Note] InnoDB: The InnoDB memory heap is disabled 2016-03-08 13:39:36 140703115888512 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-03-08 13:39:36 140703115888512 [Note] InnoDB: Memory barrier is not used 2016-03-08 13:39:36 140703115888512 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-03-08 13:39:36 140703115888512 [Note] InnoDB: Using Linux native AIO 2016-03-08 13:39:36 140703115888512 [Note] InnoDB: Using generic crc32 instructions 2016-03-08 13:39:36 140703115888512 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2016-03-08 13:39:36 140703115888512 [Note] InnoDB: Completed initialization of buffer pool 2016-03-08 13:39:36 140703115888512 [Note] InnoDB: Highest supported file format is Barracuda. 2016-03-08 13:39:38 140703115888512 [Note] InnoDB: 128 rollback segment(s) are active. 2016-03-08 13:39:38 140703115888512 [Note] InnoDB: Waiting for purge to start 2016-03-08 13:39:38 140703115888512 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 225202922908 2016-03-08 13:39:38 140702604322560 [Note] InnoDB: Dumping buffer pool(s) not yet started 2016-03-08 13:39:38 140703115888512 [Note] CONNECT: Version 1.04.0005 January 24, 2016 2016-03-08 13:39:38 140703115888512 [Note] Plugin 'FEEDBACK' is disabled. 2016-03-08 13:39:38 140703115888512 [Note] GSSAPI plugin : using principal name 'mariadb/ichigo.wilkesbarre.scent-team.local@wilkesbarre.scent-team.local' 2016-03-08 13:39:58 140703115888512 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-08 13:39:58 140703115888512 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-08 13:39:59 140703115888512 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.1.12-MariaDB' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Source distribution 2016-03-16 10:06:13 140703037396736 [Note] /usr/sbin/mysqld: Normal shutdown 2016-03-16 10:06:13 140703037396736 [Note] Event Scheduler: Purging the queue. 9 events 2016-03-16 10:06:13 140702587537152 [Note] InnoDB: FTS optimize thread exiting. 2016-03-16 10:06:13 140703037396736 [Note] InnoDB: Starting shutdown... 2016-03-16 10:07:13 140703037396736 [Note] InnoDB: Waiting for 1 active transactions to finish 2016-03-16 10:08:13 140703037396736 [Note] InnoDB: Waiting for 1 active transactions to finish 2016-03-16 10:09:14 140703037396736 [Note] InnoDB: Waiting for 1 active transactions to finish 2016-03-16 10:10:14 140703037396736 [Note] InnoDB: Waiting for 1 active transactions to finish 2016-03-16 10:11:14 140703037396736 [Note] InnoDB: Waiting for 1 active transactions to finish 2016-03-16 10:12:14 140703037396736 [Note] InnoDB: Waiting for 1 active transactions to finish 2016-03-16 10:13:14 140703037396736 [Note] InnoDB: Waiting for 1 active transactions to finish 2016-03-16 10:14:14 140703037396736 [Note] InnoDB: Waiting for 1 active transactions to finish 2016-03-16 10:15:15 140703037396736 [Note] InnoDB: Waiting for 1 active transactions to finish 160316 10:15:35 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see http://kb.askmonty.org/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.1.12-MariaDB key_buffer_size=33554432 read_buffer_size=262144 max_used_connections=4 max_threads=1001 thread_count=0 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 805576 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x0x0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x0 thread_stack 0x40000 /usr/sbin/mysqld(my_print_stacktrace+0x20)[0x55fcc96cd6e0] /usr/sbin/mysqld(handle_fatal_signal+0x347)[0x55fcc924ca0f] /lib64/libpthread.so.0(+0xfcb0)[0x7ff7fda34cb0] /lib64/libpthread.so.0(pthread_cond_wait+0xbf)[0x7ff7fda3144f] /usr/sbin/mysqld(_Z11mysqld_mainiPPc+0xa43)[0x55fcc9079aac] /usr/sbin/mysqld(main+0x9)[0x55fcc906c540] /lib64/libc.so.6(__libc_start_main+0xf0)[0x7ff7fc5e97c8] /usr/sbin/mysqld(_start+0x29)[0x55fcc906c479] The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: The InnoDB memory heap is disabled 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Memory barrier is not used 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Using Linux native AIO 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Using generic crc32 instructions 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Completed initialization of buffer pool 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Highest supported file format is Barracuda. 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: The log sequence numbers 225202922908 and 225202922908 in ibdata files do not match the log sequence number 225203203047 in the ib_logfiles! 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Database was not shutdown normally! 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Starting crash recovery. 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Reading tablespace information from the .ibd files... 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Restoring possible half-written data pages 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: from the doublewrite buffer... InnoDB: Last MySQL binlog file position 0 310137, file name ./OFF.000014 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: 128 rollback segment(s) are active. 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Waiting for purge to start 2016-03-16 10:15:50 139862944982912 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 225203203047 2016-03-16 10:15:51 139862447462144 [Note] InnoDB: Dumping buffer pool(s) not yet started 2016-03-16 10:15:51 139862944982912 [Note] CONNECT: Version 1.04.0005 January 24, 2016 2016-03-16 10:15:51 139862944982912 [Note] Plugin 'FEEDBACK' is disabled. 2016-03-16 10:15:51 139862944982912 [Note] GSSAPI plugin : using principal name 'mariadb/ichigo.wilkesbarre.scent-team.local@wilkesbarre.scent-team.local' 2016-03-16 10:16:11 139862944982912 [Note] Recovering after a crash using tc.log 2016-03-16 10:16:11 139862944982912 [Note] Starting crash recovery... 2016-03-16 10:16:11 139862944982912 [Note] Crash recovery finished. 2016-03-16 10:16:11 139862944982912 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-16 10:16:11 139862944982912 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-16 10:16:11 139862944982912 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.1.12-MariaDB' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Source distribution 2016-03-16 10:18:39 139862944519936 [Note] /usr/sbin/mysqld: Normal shutdown 2016-03-16 10:18:39 139862944519936 [Note] Event Scheduler: Purging the queue. 9 events 2016-03-16 10:18:39 139862426482432 [Note] InnoDB: FTS optimize thread exiting. 2016-03-16 10:18:39 139862944519936 [Note] InnoDB: Starting shutdown... 2016-03-16 10:18:41 139862944519936 [Note] InnoDB: Shutdown completed; log sequence number 225203203057 2016-03-16 10:18:41 139862944519936 [Note] /usr/sbin/mysqld: Shutdown complete 2016-03-16 10:18:41 139706426107776 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-03-16 10:18:41 139706426107776 [Note] InnoDB: The InnoDB memory heap is disabled 2016-03-16 10:18:41 139706426107776 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-03-16 10:18:41 139706426107776 [Note] InnoDB: Memory barrier is not used 2016-03-16 10:18:41 139706426107776 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-03-16 10:18:41 139706426107776 [Note] InnoDB: Using Linux native AIO 2016-03-16 10:18:41 139706426107776 [Note] InnoDB: Using generic crc32 instructions 2016-03-16 10:18:41 139706426107776 [Note] InnoDB: Initializing buffer pool, size = 128.0M 2016-03-16 10:18:41 139706426107776 [Note] InnoDB: Completed initialization of buffer pool 2016-03-16 10:18:41 139706426107776 [Note] InnoDB: Highest supported file format is Barracuda. 2016-03-16 10:18:42 139706426107776 [Note] InnoDB: 128 rollback segment(s) are active. 2016-03-16 10:18:42 139706426107776 [Note] InnoDB: Waiting for purge to start 2016-03-16 10:18:42 139706426107776 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 225203203057 2016-03-16 10:18:42 139705928644352 [Note] InnoDB: Dumping buffer pool(s) not yet started 2016-03-16 10:18:42 139706426107776 [Note] CONNECT: Version 1.04.0005 January 24, 2016 2016-03-16 10:18:42 139706426107776 [Note] Plugin 'FEEDBACK' is disabled. 2016-03-16 10:18:42 139706426107776 [Note] GSSAPI plugin : using principal name 'mariadb/ichigo.wilkesbarre.scent-team.local@wilkesbarre.scent-team.local' 2016-03-16 10:19:02 139706426107776 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-16 10:19:02 139706426107776 [Note] Server socket created on IP: '192.168.123.4'. 2016-03-16 10:19:02 139706426107776 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.1.12-MariaDB' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Source distribution