180724 16:01:24 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.1.23-MariaDB key_buffer_size=33554432 read_buffer_size=8388608 max_used_connections=114 max_threads=2001 thread_count=76 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 41029699 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7feccd2a2008 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7fed04767ff8 thread_stack 0x48400 *** buffer overflow detected ***: /usr/sbin/mysqld terminated ======= Backtrace: ========= /lib64/libc.so.6(__fortify_fail+0x37)[0x7ff2dfa9ed87] /lib64/libc.so.6(+0x10df40)[0x7ff2dfa9cf40] /lib64/libc.so.6(+0x10fcf7)[0x7ff2dfa9ecf7] /usr/sbin/mysqld(my_addr_resolve+0x48)[0x55e8df19afe8] /usr/sbin/mysqld(my_print_stacktrace+0x1c2)[0x55e8df187662] /usr/sbin/mysqld(handle_fatal_signal+0x305)[0x55e8decaa345] /lib64/libpthread.so.0(+0xf5e0)[0x7ff2e16eb5e0] /usr/sbin/mysqld(_ZN13QUERY_PROFILE10new_statusEPKcS1_S1_j+0x70)[0x55e8debf9550] /usr/sbin/mysqld(set_thd_stage_info+0xd4)[0x55e8deaf2964] /usr/sbin/mysqld(_ZN11Query_cache8try_lockEP3THDNS_19Cache_try_lock_modeE+0x91)[0x55e8deae9dd1] /usr/sbin/mysqld(_ZN11Query_cache6insertEP3THDP15Query_cache_tlsPKcmj+0x3f)[0x55e8deaedfaf] /usr/sbin/mysqld(net_real_write+0x45)[0x55e8dea98ca5] /usr/sbin/mysqld(net_flush+0x23)[0x55e8dea98fe3] /usr/sbin/mysqld(net_write_command+0x3fb)[0x55e8dea9974b] /usr/sbin/mysqld(cli_advanced_command+0xe2)[0x55e8dec89fb2] /usr/sbin/mysqld(mysql_send_query+0x31)[0x55e8dec87691] /usr/sbin/mysqld(mysql_real_query+0x11)[0x55e8dec876b1] /usr/lib64/mysql/plugin/ha_federated.so(_ZN12ha_federated4infoEj+0x13c)[0x7ff2d7df85fc] /usr/sbin/mysqld(+0x49d4b9)[0x55e8deb904b9] /usr/sbin/mysqld(+0x490dad)[0x55e8deb83dad] /usr/sbin/mysqld(_Z14get_all_tablesP3THDP10TABLE_LISTP4Item+0x7e0)[0x55e8deb971c0] /usr/sbin/mysqld(_Z24get_schema_tables_resultP4JOIN23enum_schema_table_state+0x28e)[0x55e8deb989fe] /usr/sbin/mysqld(_ZN4JOIN10exec_innerEv+0x6bd)[0x55e8deb7ec7d] /usr/sbin/mysqld(_ZN4JOIN4execEv+0x54)[0x55e8deb81104] /usr/sbin/mysqld(_Z12mysql_selectP3THDPPP4ItemP10TABLE_LISTjR4ListIS1_ES2_jP8st_orderSB_S2_SB_yP13select_resultP18st_select_lex_unitP13st_select_lex+0x112)[0x55e8deb7d7a2] /usr/sbin/mysqld(_Z13handle_selectP3THDP3LEXP13select_resultm+0x245)[0x55e8deb7e285] /usr/sbin/mysqld(+0x42a5c1)[0x55e8deb1d5c1] /usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x5deb)[0x55e8deb299db] /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x332)[0x55e8deb2cfb2] /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x25fa)[0x55e8deb3048a] /usr/sbin/mysqld(_Z10do_commandP3THD+0x14a)[0x55e8deb30cea] /usr/sbin/mysqld(_Z26threadpool_process_requestP3THD+0xfb)[0x55e8dec354cb] /usr/sbin/mysqld(+0x58ff75)[0x55e8dec82f75] /lib64/libpthread.so.0(+0x7e25)[0x7ff2e16e3e25] /lib64/libc.so.6(clone+0x6d)[0x7ff2dfa8734d] ======= Memory map: ======== 55e8de6f3000-55e8df676000 r-xp 00000000 fd:00 101308739 /usr/sbin/mysqld 55e8df875000-55e8df926000 r--p 00f82000 fd:00 101308739 /usr/sbin/mysqld 55e8df926000-55e8df9d8000 rw-p 01033000 fd:00 101308739 /usr/sbin/mysqld 55e8df9d8000-55e8e0250000 rw-p 00000000 00:00 0 7fec6776c000-7fec6776d000 ---p 00000000 00:00 0 7fec6776d000-7fec677b6000 rw-p 00000000 00:00 0 7fec677b6000-7fec677b7000 ---p 00000000 00:00 0 7fec677b7000-7feca6c00000 rw-p 00000000 00:00 0 [stack:32870] 7feca6c3e000-7feca6c3f000 ---p 00000000 00:00 0 7feca6c3f000-7feca6c88000 rw-p 00000000 00:00 0 7feca6c88000-7feca6c89000 ---p 00000000 00:00 0 7feca6c89000-7feca6cd2000 rw-p 00000000 00:00 0 [stack:31303] 7feca6cd2000-7feca6cd3000 ---p 00000000 00:00 0 7feca6cd3000-7feca6d1c000 rw-p 00000000 00:00 0 [stack:173853] 7feca6d1c000-7feca6d1d000 ---p 00000000 00:00 0 7feca6d1d000-7feca6d66000 rw-p 00000000 00:00 0 [stack:81261] 7feca6d66000-7feca6d67000 ---p 00000000 00:00 0 7feca6d67000-7feca6db0000 rw-p 00000000 00:00 0 [stack:162448] 7feca6db0000-7feca6db1000 ---p 00000000 00:00 0 7feca6db1000-7feca6dfa000 rw-p 00000000 00:00 0 [stack:16860] 7feca6dfa000-7feca6dfb000 ---p 00000000 00:00 0 7feca6dfb000-7feca6e44000 rw-p 00000000 00:00 0 [stack:14568] 7feca6e44000-7feca6e45000 ---p 00000000 00:00 0 7feca6e45000-7feca6e8e000 rw-p 00000000 00:00 0 [stack:176407] 7feca6e8e000-7feca6e8f000 ---p 00000000 00:00 0 7feca6e8f000-7feca6ed8000 rw-p 00000000 00:00 0 [stack:165650] 7feca6ed8000-7feca6ed9000 ---p 00000000 00:00 0 7feca6ed9000-7feca6f22000 rw-p 00000000 00:00 0 [stack:41492] 7feca6f22000-7feca6f23000 ---p 00000000 00:00 0 7feca6f23000-7feca6f6c000 rw-p 00000000 00:00 0 [stack:25292] 7feca6f6c000-7feca6f6d000 ---p 00000000 00:00 0 7feca6f6d000-7feca6fb6000 rw-p 00000000 00:00 0 [stack:33381] 7feca6fb6000-7feca6fb7000 ---p 00000000 00:00 0 7feca6fb7000-7fecb6000000 rw-p 00000000 00:00 0 [stack:178656] 7fecb603e000-7fecb603f000 ---p 00000000 00:00 0 7fecb603f000-7fecb6088000 rw-p 00000000 00:00 0 [stack:38509] 7fecb6088000-7fecb6089000 ---p 00000000 00:00 0 7fecb6089000-7fecb60d2000 rw-p 00000000 00:00 0 [stack:174800] 7fecb60d2000-7fecb60d3000 ---p 00000000 00:00 0 7ff2e1aa8000-7ff2e1aab000 rw-s 00000000 00:0a 59358058 /[aio] (deleted) 7ff2e1aab000-7ff2e1aae000 rw-s 00000000 00:0a 59358057 /[aio] (deleted) 7ff2e1aae000-7ff2e1ab1000 rw-s 00000000 00:0a 59358056 /[aio] (deleted) 7ff2e1ab1000-7ff2e1ab4000 rw-s 00000000 00:0a 59358055 /[aio] (deleted) 7ff2e1ab4000-7ff2e1ab7000 rw-s 00000000 00:0a 59358054 /[aio] (deleted) 7ff2e1ab7000-7ff2e1aba000 rw-s 00000000 00:0a 59358053 /[aio] (deleted) 7ff2e1aba000-7ff2e1abd000 rw-s 00000000 00:0a 59358052 /[aio] (deleted) 7ff2e1abd000-7ff2e1ac0000 rw-s 00000000 00:0a 59358051 /[aio] (deleted) 7ff2e1ac0000-7ff2e1ac3000 rw-s 00000000 00:0a 59358050 /[aio] (deleted) 7ff2e1ac3000-7ff2e1ac6000 rw-s 00000000 00:0a 59358049 /[aio] (deleted) 7ff2e1ac6000-7ff2e1ac9000 rw-s 00000000 00:0a 59358048 /[aio] (deleted) 7ff2e1ac9000-7ff2e1acc000 rw-s 00000000 00:0a 59358047 /[aio] (deleted) 7ff2e1acc000-7ff2e1acf000 rw-s 00000000 00:0a 59358046 /[aio] (deleted) 7ff2e1acf000-7ff2e1ad2000 rw-s 00000000 00:0a 59358045 /[aio] (deleted) 7ff2e1ad2000-7ff2e1ad5000 rw-s 00000000 00:0a 59358044 /[aio] (deleted) 7ff2e1ad5000-7ff2e1ad8000 rw-s 00000000 00:0a 59358043 /[aio] (deleted) 7ff2e1ad8000-7ff2e1ae8000 rw-p 00000000 00:00 0 7ff2e1ae8000-7ff2e1b0e000 r-xp 00000000 fd:00 100749380 /usr/lib64/libsystemd.so.0.6.0 7ff2e1b0e000-7ff2e1b0f000 r--p 00025000 fd:00 100749380 /usr/lib64/libsystemd.so.0.6.0 7ff2e1b0f000-7ff2e1b10000 rw-p 00026000 fd:00 100749380 /usr/lib64/libsystemd.so.0.6.0 7ff2e1b10000-7ff2e1b13000 rw-p 00000000 00:00 0 7ff2e1b13000-7ff2e1b14000 rw-s 00000000 00:0a 59358076 /[aio] (deleted) 7ff2e1b14000-7ff2e1b17000 rw-s 00000000 00:0a 59358042 /[aio] (deleted) 7ff2e1b17000-7ff2e1b18000 rw-s 00000000 00:0a 61178144 /[aio] (deleted) 7ff2e1b18000-7ff2e1b19000 rw-p 00000000 00:00 0 7ff2e1b19000-7ff2e1b1a000 r--p 00021000 fd:00 100664214 /usr/lib64/ld-2.17.so 7ff2e1b1a000-7ff2e1b1b000 rw-p 00022000 fd:00 100664214 /usr/lib64/ld-2.17.so 7ff2e1b1b000-7ff2e1b1c000 rw-p 00000000 00:00 0 7fffb1c1c000-7fffb1c3d000 rw-p 00000000 00:00 0 [stack] 7fffb1cb6000-7fffb1cb8000 r-xp 00000000 00:00 0 [vdso] ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall] Fatal signal 6 while backtracing innodb_open_files should not be greater than the open_files_limit. 2018-07-24 16:01:32 140241060288768 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2018-07-24 16:01:32 140241060288768 [Note] InnoDB: The InnoDB memory heap is disabled 2018-07-24 16:01:32 140241060288768 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2018-07-24 16:01:32 140241060288768 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier 2018-07-24 16:01:32 140241060288768 [Note] InnoDB: Compressed tables use zlib 1.2.7 2018-07-24 16:01:32 140241060288768 [Note] InnoDB: Using Linux native AIO 2018-07-24 16:01:32 140241060288768 [Note] InnoDB: Using SSE crc32 instructions 2018-07-24 16:01:32 140241060288768 [Note] InnoDB: Initializing buffer pool, size = 20.0G 2018-07-24 16:01:33 140241060288768 [Note] InnoDB: Completed initialization of buffer pool 2018-07-24 16:01:33 140241060288768 [Note] InnoDB: Highest supported file format is Barracuda. 2018-07-24 16:01:33 140241060288768 [Note] InnoDB: Starting crash recovery from checkpoint LSN=681466868569 2018-07-24 16:01:34 140241060288768 [Note] InnoDB: Restoring possible half-written data pages from the doublewrite buffer... 2018-07-24 16:01:38 140241060288768 [Note] InnoDB: Starting final batch to recover 100971 pages from redo log InnoDB: Last MySQL binlog file position 0 216723689, file name ./mysql-bin.000331 2018-07-24 16:01:41 140241060288768 [Note] InnoDB: 128 rollback segment(s) are active. 2018-07-24 16:01:41 140241060288768 [Note] InnoDB: Waiting for purge to start 2018-07-24 16:01:41 140241060288768 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.35-80.0 started; log sequence number 681633321599 2018-07-24 16:01:57 140241060288768 [Note] Plugin 'FEEDBACK' is disabled. 2018-07-24 16:01:57 140241060288768 [Note] Recovering after a crash using mysql-bin 2018-07-24 16:01:57 140216820016896 [Note] InnoDB: Dumping buffer pool(s) not yet started 2018-07-24 16:01:58 140241060288768 [Note] Starting crash recovery... 2018-07-24 16:01:58 140241060288768 [Note] Crash recovery finished. 2018-07-24 16:01:58 140241060288768 [Note] Server socket created on IP: '::'. 2018-07-24 16:01:58 140241060288768 [ERROR] mysqld: Table './mysql/event' is marked as crashed and should be repaired 2018-07-24 16:01:58 140241060288768 [Warning] Checking table: './mysql/event' 2018-07-24 16:01:58 140241060288768 [ERROR] mysql.event: 1 client is using or hasn't closed the table properly 2018-07-24 16:01:58 140241059261184 [Note] Event Scheduler: scheduler thread started with id 2 2018-07-24 16:01:58 140241060288768 [Warning] Neither --relay-log nor --relay-log-index were used; so replication may break when this MySQL server acts as a slave and has his hostname changed!! Please use '--log-basename=#' or '--rel ay-log=s1-prd-mysql-sp-06-relay-bin' to avoid this problem. 2018-07-24 16:01:58 140240979647232 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.000792' at position 4, relay log './s1-prd-mysql-sp-06-relay-bin.000001' position: 4; GTID position '0-21-407317402' 2018-07-24 16:01:58 140241060288768 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.1.23-MariaDB' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server 2018-07-24 16:01:58 140240979950336 [Note] Slave I/O thread: connected to master 'repl@xxx:3306',replication starts at GTID position '0-21-407317402' 2018-07-24 22:04:27 140216126761728 [ERROR] Event Scheduler: [dhcs@%][dhcs.DcsAppplyAutoAdd] UPDATE command denied to user 'dhcs'@'%' for table 'm_user' 2018-07-24 22:04:27 140216126761728 [Note] Event Scheduler: [dhcs@%].[dhcs.DcsAppplyAutoAdd] event execution failed. table_open_cache用于ibd文件， table_definition_cache用于frm文件