2019-11-14 4:13:28 154179 [Warning] Aborted connection 154179 to db: 'rndp' user: 'RNDP_MGR' host: '10.33.48.115' (Got an error reading communication packets) 2019-11-14 4:13:28 154178 [Warning] Aborted connection 154178 to db: 'rndp' user: 'RNDP_MGR' host: '10.33.48.115' (Got an error reading communication packets) 2019-11-14 4:13:28 154180 [Warning] Aborted connection 154180 to db: 'rndp' user: 'RNDP_MGR' host: '10.33.48.115' (Got an error reading communication packets) 191114 5:27:39 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.3.8-MariaDB-log key_buffer_size=16777216 read_buffer_size=2097152 max_used_connections=69 max_threads=1002 thread_count=74 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 4142942 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x2ad07ea5a788 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x2acdbf580de8 thread_stack 0x40000 /rdsdbbin/mysql/bin/mysqld(my_print_stacktrace+0x29)[0x5588e743f5f9] /rdsdbbin/mysql/bin/mysqld(handle_fatal_signal+0x57d)[0x5588e6ed25ed] 2019-11-14 5:27:55 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-11-14 5:27:55 0 [Note] InnoDB: Uses event mutexes 2019-11-14 5:27:55 0 [Note] InnoDB: Compressed tables use zlib 1.2.8 2019-11-14 5:27:55 0 [Note] InnoDB: Number of pools: 1 2019-11-14 5:27:55 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-11-14 5:27:55 0 [Note] InnoDB: Initializing buffer pool, total size = 11G, instances = 8, chunk size = 128M 2019-11-14 5:27:55 0 [Note] InnoDB: Completed initialization of buffer pool 2019-11-14 5:27:55 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-11-14 5:27:55 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=14475785616 2019-11-14 5:27:55 0 [Note] InnoDB: Transaction 2152957 was in the XA prepared state. 2019-11-14 5:27:55 0 [Note] InnoDB: 1 transaction(s) which must be rolled back or cleaned up in total 0 row operations to undo 2019-11-14 5:27:55 0 [Note] InnoDB: Trx id counter is 2152958 2019-11-14 5:27:55 0 [Note] InnoDB: Starting final batch to recover 1 pages from redo log. 2019-11-14 5:27:56 0 [Note] InnoDB: Last binlog file 'mysql-bin-changelog.000004', position 1065 2019-11-14 5:27:56 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-11-14 5:27:56 0 [Note] InnoDB: Starting in background the rollback of recovered transactions 2019-11-14 5:27:56 0 [Note] InnoDB: Rollback of non-prepared transactions completed 2019-11-14 5:27:56 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2019-11-14 5:27:56 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-11-14 5:27:56 0 [Note] InnoDB: Setting file '/rdsdbdata/db/innodb/ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-11-14 5:27:56 0 [Note] InnoDB: File '/rdsdbdata/db/innodb/ibtmp1' size is now 12 MB. 2019-11-14 5:27:56 0 [Note] InnoDB: Waiting for purge to start 2019-11-14 5:27:56 0 [Note] InnoDB: 10.3.8 started; log sequence number 14475786254; transaction id 2152960 2019-11-14 5:27:56 0 [Note] InnoDB: Loading buffer pool(s) from /rdsdbdata/db/innodb/ib_buffer_pool 2019-11-14 5:27:56 0 [Note] Plugin 'FEEDBACK' is disabled. 191114 5:27:56 server_audit: MariaDB Audit Plugin version 1.4.0 STARTED. 191114 5:27:56 server_audit: Query cache is enabled with the TABLE events. Some table reads can be veiled.2019-11-14 5:27:56 0 [Warning] /rdsdbbin/mysql/bin/mysqld: unknown variable 'loose-rocksdb_log_dir=/rdsdbdata/db/log' 2019-11-14 5:27:56 0 [Note] Recovering after a crash using /rdsdbdata/log/binlog/mysql-bin-changelog 2019-11-14 5:27:56 0 [Note] Starting crash recovery... 2019-11-14 5:27:56 0 [Note] InnoDB: Starting recovery for XA transactions... 2019-11-14 5:27:56 0 [Note] InnoDB: Transaction 2152957 in prepared state after recovery 2019-11-14 5:27:56 0 [Note] InnoDB: Transaction contains changes to 1 rows 2019-11-14 5:27:56 0 [Note] InnoDB: 1 transactions in prepared state after recovery 2019-11-14 5:27:56 0 [Note] Found 1 prepared transaction(s) in InnoDB 2019-11-14 5:27:56 0 [Note] Crash recovery finished. 2019-11-14 5:27:56 0 [Note] Server socket created on IP: '::'. 2019-11-14 5:27:56 0 [Note] Reading of all Master_info entries succeded 2019-11-14 5:27:56 0 [Note] Added new Master_info '' to hash table 2019-11-14 5:27:56 0 [Note] /rdsdbbin/mysql/bin/mysqld: ready for connections. Version: '10.3.8-MariaDB-log' socket: '/tmp/mysql.sock' port: 3306 Source distribution 2019-11-14 5:27:56 9 [Warning] IP address '10.88.120.19' could not be resolved: Name or service not known 2019-11-14 5:27:57 12 [Warning] IP address '10.33.48.115' could not be resolved: Name or service not known 2019-11-14 5:27:57 13 [Warning] IP address '10.88.120.156' could not be resolved: Name or service not known 2019-11-14 5:27:59 22 [Warning] IP address '10.31.178.75' could not be resolved: Name or service not known 191114 5:27:59 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.3.8-MariaDB-log key_buffer_size=16777216 read_buffer_size=2097152 max_used_connections=16 max_threads=1002 thread_count=23 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 4142942 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x2af1f4c62c48 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x2af1c472fde8 thread_stack 0x40000 /rdsdbbin/mysql/bin/mysqld(my_print_stacktrace+0x29)[0x55aa5be0b5f9] 2019-11-14 5:28:11 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-11-14 5:28:11 0 [Note] InnoDB: Uses event mutexes 2019-11-14 5:28:11 0 [Note] InnoDB: Compressed tables use zlib 1.2.8 2019-11-14 5:28:11 0 [Note] InnoDB: Number of pools: 1 2019-11-14 5:28:11 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-11-14 5:28:11 0 [Note] InnoDB: Initializing buffer pool, total size = 11G, instances = 8, chunk size = 128M 2019-11-14 5:28:11 0 [Note] InnoDB: Completed initialization of buffer pool 2019-11-14 5:28:11 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-11-14 5:28:11 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=14475788488 2019-11-14 5:28:11 0 [Note] InnoDB: Starting final batch to recover 2 pages from redo log. 2019-11-14 5:28:12 0 [Note] InnoDB: Last binlog file 'mysql-bin-changelog.000004', position 1065 2019-11-14 5:28:12 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-11-14 5:28:12 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2019-11-14 5:28:12 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-11-14 5:28:12 0 [Note] InnoDB: Setting file '/rdsdbdata/db/innodb/ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-11-14 5:28:12 0 [Note] InnoDB: File '/rdsdbdata/db/innodb/ibtmp1' size is now 12 MB. 2019-11-14 5:28:12 0 [Note] InnoDB: Waiting for purge to start 2019-11-14 5:28:12 0 [Note] InnoDB: 10.3.8 started; log sequence number 14475789347; transaction id 2152991 2019-11-14 5:28:12 0 [Note] InnoDB: Loading buffer pool(s) from /rdsdbdata/db/innodb/ib_buffer_pool 2019-11-14 5:28:12 0 [Note] Plugin 'FEEDBACK' is disabled. 191114 5:28:12 server_audit: MariaDB Audit Plugin version 1.4.0 STARTED. 191114 5:28:12 server_audit: Query cache is enabled with the TABLE events. Some table reads can be veiled.2019-11-14 5:28:12 0 [Warning] /rdsdbbin/mysql/bin/mysqld: unknown variable 'loose-rocksdb_log_dir=/rdsdbdata/db/log' 2019-11-14 5:28:12 0 [Note] Recovering after a crash using /rdsdbdata/log/binlog/mysql-bin-changelog 2019-11-14 5:28:12 0 [Note] Starting crash recovery... 2019-11-14 5:28:12 0 [Note] Crash recovery finished. 2019-11-14 5:28:12 0 [Note] Server socket created on IP: '::'. 2019-11-14 5:28:12 0 [Note] Reading of all Master_info entries succeded 2019-11-14 5:28:12 0 [Note] Added new Master_info '' to hash table 2019-11-14 5:28:12 0 [Note] /rdsdbbin/mysql/bin/mysqld: ready for connections. Version: '10.3.8-MariaDB-log' socket: '/tmp/mysql.sock' port: 3306 Source distribution 2019-11-14 5:28:12 9 [Warning] IP address '10.88.120.156' could not be resolved: Name or service not known 2019-11-14 5:28:12 10 [Warning] IP address '10.33.48.115' could not be resolved: Name or service not known 191114 5:28:15 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.3.8-MariaDB-log key_buffer_size=16777216 read_buffer_size=2097152 max_used_connections=6 max_threads=1002 thread_count=13 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 4142942 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x2ba197e480c8 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x2b9e4d3b4de8 thread_stack 0x40000 /rdsdbbin/mysql/bin/mysqld(my_print_stacktrace+0x29)[0x5603a0c5f5f9] mysys/stacktrace.c:270(my_print_stacktrace)[0x5603a06f25ed] sigaction.c:0(__restore_rt)[0x2b9e4e133100] /rdsdbbin/mysql/bin/mysqld(_Z8filesortP3THDP5TABLEP8FilesortP16Filesort_trackerP4JOINy+0x584)[0x5603a06f0a44] sql/filesort.cc:1954(sortlength)[0x5603a056a89e] sql/sql_select.cc:22413(create_sort_index(THD*, JOIN*, st_join_table*, Filesort*))[0x5603a065832d] sql/sql_window.cc:2938(Window_funcs_sort::exec(JOIN*))[0x5603a0658ba8] sql/sql_window.cc:3063(Window_funcs_computation::exec(JOIN*))[0x5603a057a35a] sql/sql_select.cc:27242(AGGR_OP::end_send())[0x5603a057a54d] sql/sql_select.cc:18988(sub_select_postjoin_aggr(JOIN*, st_join_table*, bool))[0x5603a057ae7b] sql/sql_select.cc:18813(do_select)[0x5603a057b1f9] sql/sql_select.cc:3816(JOIN::exec())[0x5603a057b34a] sql/sql_select.cc:4222(mysql_select(THD*, TABLE_LIST*, unsigned int, List&, Item*, unsigned int, st_order*, st_order*, Item*, st_order*, unsigned long long, select_result*, st_select_lex_unit*, st_select_lex*))[0x5603a04f2094] sql/sql_derived.cc:1152(mysql_derived_fill(THD*, LEX*, TABLE_LIST*))[0x5603a04f1d01] sql/sql_derived.cc:197(mysql_handle_single_derived(LEX*, TABLE_LIST*, unsigned int))[0x5603a055cf37] sql/sql_select.cc:12448(st_join_table::preread_init())[0x5603a055d448] sql/sql_select.cc:19239(sub_select(JOIN*, st_join_table*, bool))[0x5603a057ae4e] sql/sql_select.cc:18812(do_select)[0x5603a057b1f9] sql/sql_select.cc:3816(JOIN::exec())[0x5603a057b34a] sql/sql_select.cc:4222(mysql_select(THD*, TABLE_LIST*, unsigned int, List&, Item*, unsigned int, st_order*, st_order*, Item*, st_order*, unsigned long long, select_result*, st_select_lex_unit*, st_select_lex*))[0x5603a057bce6] sql/sql_select.cc:370(handle_select(THD*, LEX*, select_result*, unsigned long))[0x5603a051edc8] sql/sql_parse.cc:6649(execute_sqlcom_select)[0x5603a052c0f8] sql/sql_parse.cc:3787(mysql_execute_command(THD*))[0x5603a052e6cc] sql/sql_parse.cc:8236(mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x5603a0530fad] sql/sql_parse.cc:1851(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool))[0x5603a0531b6f] sql/sql_parse.cc:1399(do_command(THD*))[0x5603a05faeec] sql/sql_connect.cc:1445(do_handle_one_connection(CONNECT*))[0x5603a05fb0c4] sql/sql_connect.cc:1353(handle_one_connection)[0x5603a0c116fa] pthread_create.c:0(start_thread)[0x2b9e4e12bdc5] /lib64/libc.so.6(clone+0x6d)[0x2b9e4e94ec9d] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x2ba197e98da0): # SELECT * FROM ( SELECT A.CONNECT_SYSTEM , B.USER_NO , B.USER_NAME , A.CONNECT_POSITION_NAME , A.CONNECT_DEPT_CODE , A.CONNECT_DEPT_NAME , COUNT(DISTINCT(DATE_FORMAT(A.CONNECT_DATE, '%Y.%m.%d'))) AS DAY_CNT , COUNT(*) AS CONNECT_CNT , ROW_NUMBER() OVER (PARTITION BY A.CONNECT_SYSTEM ORDER BY A.CONNECT_SYSTEM , COUNT(*) DESC) FROM TB_SPT_GCLOUD_CONNECT_LOG A LEFT JOIN TB_SYS_USER B ON B.USER_NO = A.CONNECT_USER_NO AND A.CONNECT_USER_NO IS NOT NULL WHERE 1=1 AND A.CONNECT_RESULT = '1' AND A.CONNECT_MSG = '[ ] .' GROUP BY A.CONNECT_SYSTEM, B.USER_NO, B.USER_NAME, A.CONNECT_POSITION_NAME, A.CONNECT_DEPT_CODE, A.CONNECT_DEPT_NAME ) AS AA LEFT JOIN ( WITH RECURSIVE CTE (DEPT_CODE, DEPT_NAME, PARENT_DEPT_CODE, PARENT_DEPT_NAME, DEPTH, SORT) AS (SELECT RT.DEPT_CODE , RT.DEPT_NAME , RT.PARENT_DEPT_CODE , RT.PARENT_DEPT_NAME , RT.DEPTH , RT.DEPT_CODE AS SORT FROM TB_SYS_DEPT RT WHERE RT.DEPT_CODE = '50000000' AND RT.USE_YN = 'Y' AND RT.IS_ERP_ORG = 'Y' UNION ALL SELECT RT.DEPT_CODE , RT.DEPT_NAME , RT.PARENT_DEPT_CODE , RT.PARENT_DEPT_NAME , RT.DEPTH , CE.DEPTH + '>' + RT.DEPTH SORT FROM TB_SYS_DEPT RT, CTE CE WHERE RT.PARENT_DEPT_CODE = CE.DEPT_CODE AND RT.USE_YN = 'Y' AND RT.IS_ERP_ORG = 'Y' ) SELECT TM.DEPT_CODE ,TM.DEPT_NAME ,TM.PARENT_DEPT_CODE ,TM.PARENT_DEPT_NAME ,DEPTH ,SORT FROM CTE TM WHERE 1=1 #TM.DEPTH = '3' ) AS BB ON BB.DEPT_CODE = AA.CONNECT_DEPT_CODE Connection ID (thread ID): 10 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. 2019-11-14 5:28:25 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-11-14 5:28:25 0 [Note] InnoDB: Uses event mutexes 2019-11-14 5:28:25 0 [Note] InnoDB: Compressed tables use zlib 1.2.8 2019-11-14 5:28:25 0 [Note] InnoDB: Number of pools: 1 2019-11-14 5:28:25 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-11-14 5:28:25 0 [Note] InnoDB: Initializing buffer pool, total size = 11G, instances = 8, chunk size = 128M 2019-11-14 5:28:25 0 [Note] InnoDB: Completed initialization of buffer pool 2019-11-14 5:28:25 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-11-14 5:28:25 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=14475789890 2019-11-14 5:28:25 0 [Note] InnoDB: Starting final batch to recover 2 pages from redo log. 2019-11-14 5:28:26 0 [Note] InnoDB: Last binlog file 'mysql-bin-changelog.000004', position 1065 2019-11-14 5:28:26 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-11-14 5:28:26 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2019-11-14 5:28:26 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-11-14 5:28:26 0 [Note] InnoDB: Setting file '/rdsdbdata/db/innodb/ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-11-14 5:28:26 0 [Note] InnoDB: File '/rdsdbdata/db/innodb/ibtmp1' size is now 12 MB. 2019-11-14 5:28:26 0 [Note] InnoDB: Waiting for purge to start 2019-11-14 5:28:26 0 [Note] InnoDB: 10.3.8 started; log sequence number 14475792403; transaction id 2153007 2019-11-14 5:28:26 0 [Note] InnoDB: Loading buffer pool(s) from /rdsdbdata/db/innodb/ib_buffer_pool 2019-11-14 5:28:26 0 [Note] Plugin 'FEEDBACK' is disabled. 191114 5:28:26 server_audit: MariaDB Audit Plugin version 1.4.0 STARTED. 191114 5:28:26 server_audit: Query cache is enabled with the TABLE events. Some table reads can be veiled.2019-11-14 5:28:26 0 [Warning] /rdsdbbin/mysql/bin/mysqld: unknown variable 'loose-rocksdb_log_dir=/rdsdbdata/db/log' 2019-11-14 5:28:26 0 [Note] Recovering after a crash using /rdsdbdata/log/binlog/mysql-bin-changelog 2019-11-14 5:28:26 0 [Note] Starting crash recovery... 2019-11-14 5:28:26 0 [Note] Crash recovery finished. 2019-11-14 5:28:26 0 [Note] Server socket created on IP: '::'. 2019-11-14 5:28:26 0 [Note] Reading of all Master_info entries succeded 2019-11-14 5:28:26 0 [Note] Added new Master_info '' to hash table 2019-11-14 5:28:26 0 [Note] /rdsdbbin/mysql/bin/mysqld: ready for connections. Version: '10.3.8-MariaDB-log' socket: '/tmp/mysql.sock' port: 3306 Source distribution 2019-11-14 5:28:26 9 [Warning] IP address '10.33.48.115' could not be resolved: Name or service not known 2019-11-14 5:28:27 10 [Warning] IP address '10.88.120.156' could not be resolved: Name or service not known 191114 5:28:29 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.3.8-MariaDB-log key_buffer_size=16777216 read_buffer_size=2097152 max_used_connections=2 max_threads=1002 thread_count=9 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 4142942 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x2b8013655008 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x2b7cc8bb9de8 thread_stack 0x40000 /rdsdbbin/mysql/bin/mysqld(my_print_stacktrace+0x29)[0x5584ef5c05f9] mysys/stacktrace.c:270(my_print_stacktrace)[0x5584ef0535ed] sigaction.c:0(__restore_rt)[0x2b7cc9979100] /rdsdbbin/mysql/bin/mysqld(_Z8filesortP3THDP5TABLEP8FilesortP16Filesort_trackerP4JOINy+0x584)[0x5584ef051a44] sql/filesort.cc:1954(sortlength)[0x5584eeecb89e] sql/sql_select.cc:22413(create_sort_index(THD*, JOIN*, st_join_table*, Filesort*))[0x5584eefb932d] sql/sql_window.cc:2938(Window_funcs_sort::exec(JOIN*))[0x5584eefb9ba8] sql/sql_window.cc:3063(Window_funcs_computation::exec(JOIN*))[0x5584eeedb35a] sql/sql_select.cc:27242(AGGR_OP::end_send())[0x5584eeedb54d] sql/sql_select.cc:18813(do_select)[0x5584eeedbe7b] sql/sql_select.cc:3816(JOIN::exec())[0x5584eeedc1f9] sql/sql_select.cc:4222(mysql_select(THD*, TABLE_LIST*, unsigned int, List&, Item*, unsigned int, st_order*, st_order*, Item*, st_order*, unsigned long long, select_result*, st_select_lex_unit*, st_select_lex*))[0x5584eeedc34a] sql/sql_derived.cc:1152(mysql_derived_fill(THD*, LEX*, TABLE_LIST*))[0x5584eee53094] sql/sql_derived.cc:197(mysql_handle_single_derived(LEX*, TABLE_LIST*, unsigned int))[0x5584eee52d01] sql/sql_select.cc:12448(st_join_table::preread_init())[0x5584eeebdf37] sql/sql_select.cc:19239(sub_select(JOIN*, st_join_table*, bool))[0x5584eeebe448] sql/sql_select.cc:18812(do_select)[0x5584eeedbe4e] sql/sql_select.cc:3816(JOIN::exec())[0x5584eeedc1f9] sql/sql_select.cc:4222(mysql_select(THD*, TABLE_LIST*, unsigned int, List&, Item*, unsigned int, st_order*, st_order*, Item*, st_order*, unsigned long long, select_result*, st_select_lex_unit*, st_select_lex*))[0x5584eeedc34a] sql/sql_select.cc:370(handle_select(THD*, LEX*, select_result*, unsigned long))[0x5584eeedcce6] sql/sql_parse.cc:6649(execute_sqlcom_select)[0x5584eee7fdc8] sql/sql_parse.cc:3787(mysql_execute_command(THD*))[0x5584eee8d0f8] sql/sql_parse.cc:8236(mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x5584eee8f6cc] sql/sql_parse.cc:1851(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool))[0x5584eee91fad] sql/sql_parse.cc:1399(do_command(THD*))[0x5584eee92b6f] sql/sql_connect.cc:1445(do_handle_one_connection(CONNECT*))[0x5584eef5beec] sql/sql_connect.cc:1353(handle_one_connection)[0x5584eef5c0c4] perfschema/pfs.cc:1865(pfs_spawn_thread)[0x5584ef5726fa] pthread_create.c:0(start_thread)[0x2b7cc9971dc5] /lib64/libc.so.6(clone+0x6d)[0x2b7cca194c9d] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x2b80136a5ea0): # SELECT * FROM ( SELECT A.CONNECT_SYSTEM , B.USER_NO , B.USER_NAME , A.CONNECT_POSITION_NAME , A.CONNECT_DEPT_CODE , A.CONNECT_DEPT_NAME , COUNT(DISTINCT(DATE_FORMAT(A.CONNECT_DATE, '%Y.%m.%d'))) AS DAY_CNT , COUNT(*) AS CONNECT_CNT , ROW_NUMBER() OVER (PARTITION BY A.CONNECT_SYSTEM ORDER BY A.CONNECT_SYSTEM , COUNT(*) DESC) FROM TB_SPT_GCLOUD_CONNECT_LOG A LEFT JOIN TB_SYS_USER B ON B.USER_NO = A.CONNECT_USER_NO AND A.CONNECT_USER_NO IS NOT NULL WHERE 1=1 AND A.CONNECT_RESULT = '1' AND A.CONNECT_MSG = '[ ] .' GROUP BY A.CONNECT_SYSTEM, B.USER_NO, B.USER_NAME, A.CONNECT_POSITION_NAME, A.CONNECT_DEPT_CODE, A.CONNECT_DEPT_NAME ) AS AA LEFT JOIN ( WITH RECURSIVE CTE (DEPT_CODE, DEPT_NAME, PARENT_DEPT_CODE, PARENT_DEPT_NAME, DEPTH, SORT) AS (SELECT RT.DEPT_CODE , RT.DEPT_NAME , RT.PARENT_DEPT_CODE , RT.PARENT_DEPT_NAME , RT.DEPTH , RT.DEPT_CODE AS SORT FROM TB_SYS_DEPT RT WHERE RT.DEPT_CODE = '50000000' AND RT.USE_YN = 'Y' AND RT.IS_ERP_ORG = 'Y' UNION ALL SELECT RT.DEPT_CODE , RT.DEPT_NAME , RT.PARENT_DEPT_CODE , RT.PARENT_DEPT_NAME , RT.DEPTH , CE.DEPTH + '>' + RT.DEPTH SORT FROM TB_SYS_DEPT RT, CTE CE WHERE RT.PARENT_DEPT_CODE = CE.DEPT_CODE AND RT.USE_YN = 'Y' AND RT.IS_ERP_ORG = 'Y' ) SELECT TM.DEPT_CODE ,TM.DEPT_NAME ,TM.PARENT_DEPT_CODE ,TM.PARENT_DEPT_NAME ,DEPTH ,SORT FROM CTE TM WHERE 1=1 #TM.DEPTH = '3' ) AS BB ON BB.DEPT_CODE = AA.CONNECT_DEPT_CODE Connection ID (thread ID): 9 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. 2019-11-14 5:28:41 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-11-14 5:28:41 0 [Note] InnoDB: Uses event mutexes 2019-11-14 5:28:41 0 [Note] InnoDB: Compressed tables use zlib 1.2.8 2019-11-14 5:28:41 0 [Note] InnoDB: Number of pools: 1 2019-11-14 5:28:41 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-11-14 5:28:41 0 [Note] InnoDB: Initializing buffer pool, total size = 11G, instances = 8, chunk size = 128M 2019-11-14 5:28:41 0 [Note] InnoDB: Completed initialization of buffer pool 2019-11-14 5:28:41 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-11-14 5:28:41 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=14475794712 2019-11-14 5:28:41 0 [Note] InnoDB: Last binlog file 'mysql-bin-changelog.000004', position 1065 2019-11-14 5:28:42 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-11-14 5:28:42 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2019-11-14 5:28:42 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-11-14 5:28:42 0 [Note] InnoDB: Setting file '/rdsdbdata/db/innodb/ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-11-14 5:28:42 0 [Note] InnoDB: File '/rdsdbdata/db/innodb/ibtmp1' size is now 12 MB. 2019-11-14 5:28:42 0 [Note] InnoDB: Waiting for purge to start 2019-11-14 5:28:42 0 [Note] InnoDB: 10.3.8 started; log sequence number 14475794764; transaction id 2153020 2019-11-14 5:28:42 0 [Note] InnoDB: Loading buffer pool(s) from /rdsdbdata/db/innodb/ib_buffer_pool 2019-11-14 5:28:42 0 [Note] Plugin 'FEEDBACK' is disabled. 191114 5:28:42 server_audit: MariaDB Audit Plugin version 1.4.0 STARTED. 191114 5:28:42 server_audit: Query cache is enabled with the TABLE events. Some table reads can be veiled.2019-11-14 5:28:42 0 [Warning] /rdsdbbin/mysql/bin/mysqld: unknown variable 'loose-rocksdb_log_dir=/rdsdbdata/db/log' 2019-11-14 5:28:42 0 [Note] Recovering after a crash using /rdsdbdata/log/binlog/mysql-bin-changelog 2019-11-14 5:28:42 0 [Note] Starting crash recovery... 2019-11-14 5:28:42 0 [Note] Crash recovery finished. 2019-11-14 5:28:42 0 [Note] Server socket created on IP: '::'. 2019-11-14 5:28:42 0 [Note] Reading of all Master_info entries succeded 2019-11-14 5:28:42 0 [Note] Added new Master_info '' to hash table 2019-11-14 5:28:42 0 [Note] /rdsdbbin/mysql/bin/mysqld: ready for connections. Version: '10.3.8-MariaDB-log' socket: '/tmp/mysql.sock' port: 3306 Source distribution 2019-11-14 5:28:42 9 [Warning] IP address '10.33.48.115' could not be resolved: Name or service not known 2019-11-14 5:28:43 10 [Warning] IP address '10.88.120.19' could not be resolved: Name or service not known 2019-11-14 5:28:43 11 [Warning] IP address '10.88.120.156' could not be resolved: Name or service not known 2019-11-14 5:28:43 13 [Warning] IP address '10.31.178.75' could not be resolved: Name or service not known 2019-11-14 5:28:49 0 [Note] InnoDB: Buffer pool(s) load completed at 191114 5:28:49 191114 5:28:54 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.3.8-MariaDB-log key_buffer_size=16777216 read_buffer_size=2097152 max_used_connections=17 max_threads=1002 thread_count=24 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 4142942 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x2af3f9824548 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x2af0af222de8 thread_stack 0x40000 /rdsdbbin/mysql/bin/mysqld(my_print_stacktrace+0x29)[0x560a61f705f9] mysys/stacktrace.c:270(my_print_stacktrace)[0x560a61a035ed] 2019-11-14 5:29:11 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-11-14 5:29:11 0 [Note] InnoDB: Uses event mutexes 2019-11-14 5:29:11 0 [Note] InnoDB: Compressed tables use zlib 1.2.8 2019-11-14 5:29:11 0 [Note] InnoDB: Number of pools: 1 2019-11-14 5:29:11 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-11-14 5:29:11 0 [Note] InnoDB: Initializing buffer pool, total size = 11G, instances = 8, chunk size = 128M 2019-11-14 5:29:11 0 [Note] InnoDB: Completed initialization of buffer pool 2019-11-14 5:29:11 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-11-14 5:29:11 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=14475826888 2019-11-14 5:29:11 0 [Note] InnoDB: Starting final batch to recover 6 pages from redo log. 2019-11-14 5:29:12 0 [Note] InnoDB: Last binlog file 'mysql-bin-changelog.000004', position 1065 2019-11-14 5:29:12 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-11-14 5:29:12 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2019-11-14 5:29:12 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-11-14 5:29:12 0 [Note] InnoDB: Setting file '/rdsdbdata/db/innodb/ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-11-14 5:29:12 0 [Note] InnoDB: File '/rdsdbdata/db/innodb/ibtmp1' size is now 12 MB. 2019-11-14 5:29:12 0 [Note] InnoDB: Waiting for purge to start 2019-11-14 5:29:12 0 [Note] InnoDB: 10.3.8 started; log sequence number 14475853836; transaction id 2153082 2019-11-14 5:29:12 0 [Note] InnoDB: Loading buffer pool(s) from /rdsdbdata/db/innodb/ib_buffer_pool 2019-11-14 5:29:12 0 [Note] Plugin 'FEEDBACK' is disabled. 191114 5:29:12 server_audit: MariaDB Audit Plugin version 1.4.0 STARTED. 191114 5:29:12 server_audit: Query cache is enabled with the TABLE events. Some table reads can be veiled.2019-11-14 5:29:12 0 [Warning] /rdsdbbin/mysql/bin/mysqld: unknown variable 'loose-rocksdb_log_dir=/rdsdbdata/db/log' 2019-11-14 5:29:12 0 [Note] Recovering after a crash using /rdsdbdata/log/binlog/mysql-bin-changelog 2019-11-14 5:29:12 0 [Note] Starting crash recovery... 2019-11-14 5:29:12 0 [Note] Crash recovery finished. 2019-11-14 5:29:12 0 [Note] Server socket created on IP: '::'. 2019-11-14 5:29:12 0 [Note] Reading of all Master_info entries succeded 2019-11-14 5:29:12 0 [Note] Added new Master_info '' to hash table 2019-11-14 5:29:12 0 [Note] /rdsdbbin/mysql/bin/mysqld: ready for connections. Version: '10.3.8-MariaDB-log' socket: '/tmp/mysql.sock' port: 3306 Source distribution 2019-11-14 5:29:13 9 [Warning] IP address '10.88.120.156' could not be resolved: Name or service not known 2019-11-14 5:29:18 0 [Note] InnoDB: Buffer pool(s) load completed at 191114 5:29:18 2019-11-14 5:29:18 13 [Warning] IP address '10.31.178.75' could not be resolved: Name or service not known 2019-11-14 5:29:32 26 [Warning] IP address '10.88.120.19' could not be resolved: Name or service not known 2019-11-14 5:31:29 60 [Warning] IP address '10.33.48.115' could not be resolved: Name or service not known 2019-11-14 5:37:13 709 [Warning] IP address '10.33.31.161' could not be resolved: Name or service not known 2019-11-14 5:37:33 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-11-14 5:37:33 0 [Note] InnoDB: Uses event mutexes 2019-11-14 5:37:33 0 [Note] InnoDB: Compressed tables use zlib 1.2.8 2019-11-14 5:37:33 0 [Note] InnoDB: Number of pools: 1 2019-11-14 5:37:33 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-11-14 5:37:33 0 [Note] InnoDB: Initializing buffer pool, total size = 11G, instances = 8, chunk size = 128M 2019-11-14 5:37:33 0 [Note] InnoDB: Completed initialization of buffer pool 2019-11-14 5:37:33 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-11-14 5:37:33 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=14482015603 2019-11-14 5:37:33 0 [Note] InnoDB: Last binlog file 'mysql-bin-changelog.000004', position 1065 2019-11-14 5:37:34 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-11-14 5:37:34 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2019-11-14 5:37:34 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-11-14 5:37:34 0 [Note] InnoDB: Setting file '/rdsdbdata/db/innodb/ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-11-14 5:37:34 0 [Note] InnoDB: File '/rdsdbdata/db/innodb/ibtmp1' size is now 12 MB. 2019-11-14 5:37:34 0 [Note] InnoDB: Waiting for purge to start 2019-11-14 5:37:34 0 [Note] InnoDB: 10.3.8 started; log sequence number 14482015612; transaction id 2155640 2019-11-14 5:37:34 0 [Note] InnoDB: Loading buffer pool(s) from /rdsdbdata/db/innodb/ib_buffer_pool 2019-11-14 5:37:34 0 [Note] Plugin 'FEEDBACK' is disabled. 191114 5:37:34 server_audit: MariaDB Audit Plugin version 1.4.0 STARTED. 191114 5:37:34 server_audit: Query cache is enabled with the TABLE events. Some table reads can be veiled.2019-11-14 5:37:34 0 [Warning] /rdsdbbin/mysql/bin/mysqld: unknown variable 'loose-rocksdb_log_dir=/rdsdbdata/db/log' 2019-11-14 5:37:34 0 [Note] Recovering after a crash using /rdsdbdata/log/binlog/mysql-bin-changelog 2019-11-14 5:37:34 0 [Note] Starting crash recovery... 2019-11-14 5:37:34 0 [Note] Crash recovery finished. 2019-11-14 5:37:34 0 [Note] Server socket created on IP: '::'. 2019-11-14 5:37:34 0 [Note] Reading of all Master_info entries succeded 2019-11-14 5:37:34 0 [Note] Added new Master_info '' to hash table 2019-11-14 5:37:34 0 [Note] /rdsdbbin/mysql/bin/mysqld: ready for connections. Version: '10.3.8-MariaDB-log' socket: '/tmp/mysql.sock' port: 3306 Source distribution 2019-11-14 5:37:40 0 [Note] InnoDB: Buffer pool(s) load completed at 191114 5:37:40 2019-11-14 5:37:42 10 [Warning] IP address '10.31.178.75' could not be resolved: Name or service not known 2019-11-14 5:37:50 13 [Warning] IP address '10.88.120.156' could not be resolved: Name or service not known 2019-11-14 5:37:51 14 [Warning] IP address '10.88.120.19' could not be resolved: Name or service not known 2019-11-14 5:38:10 30 [Warning] IP address '10.33.31.161' could not be resolved: Name or service not known 2019-11-14 5:39:19 64 [Warning] IP address '10.33.48.115' could not be resolved: Name or service not known 2019-11-14 5:41:02 288 [Warning] IP address '10.31.203.132' could not be resolved: Name or service not known 2019-11-14 5:41:12 288 [ERROR] mysqld: Can't find record in 'slow_log' 2019-11-14 5:41:52 288 [ERROR] mysqld: Can't find record in 'slow_log' 191114 5:45:50 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.3.8-MariaDB-log key_buffer_size=16777216 read_buffer_size=2097152 max_used_connections=36 max_threads=1002 thread_count=43 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 4142942 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x2ba266f04f08 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x2b9fa473fde8 thread_stack 0x40000 /rdsdbbin/mysql/bin/mysqld(my_print_stacktrace+0x29)[0x564a229c55f9] /rdsdbbin/mysql/bin/mysqld(handle_fatal_signal+0x57d)[0x564a224585ed] sigaction.c:0(__restore_rt)[0x2b9f164e1100] /rdsdbbin/mysql/bin/mysqld(_Z8filesortP3THDP5TABLEP8FilesortP16Filesort_trackerP4JOINy+0x584)[0x564a22456a44] sql/filesort.cc:1954(sortlength)[0x564a222d089e] sql/sql_select.cc:22413(create_sort_index(THD*, JOIN*, st_join_table*, Filesort*))[0x564a223be32d] sql/sql_window.cc:2938(Window_funcs_sort::exec(JOIN*))[0x564a223beba8] sql/sql_window.cc:3063(Window_funcs_computation::exec(JOIN*))[0x564a222e035a] sql/sql_select.cc:27242(AGGR_OP::end_send())[0x564a222e054d] sql/sql_select.cc:18988(sub_select_postjoin_aggr(JOIN*, st_join_table*, bool))[0x564a222e0e7b] sql/sql_select.cc:18813(do_select)[0x564a222e11f9] sql/sql_select.cc:3816(JOIN::exec())[0x564a222e134a] sql/sql_select.cc:4222(mysql_select(THD*, TABLE_LIST*, unsigned int, List&, Item*, unsigned int, st_order*, st_order*, Item*, st_order*, unsigned long long, select_result*, st_select_lex_unit*, st_select_lex*))[0x564a222e1ce6] sql/sql_select.cc:370(handle_select(THD*, LEX*, select_result*, unsigned long))[0x564a22284dc8] sql/sql_parse.cc:6649(execute_sqlcom_select)[0x564a222920f8] sql/sql_parse.cc:3787(mysql_execute_command(THD*))[0x564a222946cc] sql/sql_parse.cc:8236(mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x564a22296fad] sql/sql_parse.cc:1851(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool))[0x564a22297b6f] sql/sql_parse.cc:1399(do_command(THD*))[0x564a22360eec] sql/sql_connect.cc:1445(do_handle_one_connection(CONNECT*))[0x564a223610c4] sql/sql_connect.cc:1353(handle_one_connection)[0x564a229776fa] pthread_create.c:0(start_thread)[0x2b9f164d9dc5] /lib64/libc.so.6(clone+0x6d)[0x2b9f16cfcc9d] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x2ba26746d6a0): # SELECT A.CONNECT_SYSTEM , B.USER_NO , B.USER_NAME , A.CONNECT_POSITION_NAME , A.CONNECT_DEPT_CODE , A.CONNECT_DEPT_NAME , COUNT(DISTINCT(DATE_FORMAT(A.CONNECT_DATE, '%Y.%m.%d'))) AS DAY_CNT , COUNT(*) AS CONNECT_CNT , ROW_NUMBER() OVER (PARTITION BY A.CONNECT_SYSTEM ORDER BY A.CONNECT_SYSTEM , COUNT(*) DESC) FROM TB_SPT_GCLOUD_CONNECT_LOG A LEFT JOIN TB_SYS_USER B ON B.USER_NO = A.CONNECT_USER_NO AND A.CONNECT_USER_NO IS NOT NULL WHERE 1=1 AND A.CONNECT_RESULT = '1' AND A.CONNECT_MSG = '[ ] .' GROUP BY A.CONNECT_SYSTEM, B.USER_NO, B.USER_NAME, A.CONNECT_POSITION_NAME, A.CONNECT_DEPT_CODE, A.CONNECT_DEPT_NAME Connection ID (thread ID): 669 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. 2019-11-14 5:46:11 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-11-14 5:46:11 0 [Note] InnoDB: Uses event mutexes 2019-11-14 5:46:11 0 [Note] InnoDB: Compressed tables use zlib 1.2.8 2019-11-14 5:46:11 0 [Note] InnoDB: Number of pools: 1 2019-11-14 5:46:11 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-11-14 5:46:11 0 [Note] InnoDB: Initializing buffer pool, total size = 11G, instances = 8, chunk size = 128M 2019-11-14 5:46:11 0 [Note] InnoDB: Completed initialization of buffer pool 2019-11-14 5:46:11 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-11-14 5:46:11 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=14488081245 2019-11-14 5:46:11 0 [Note] InnoDB: Starting final batch to recover 13 pages from redo log. 2019-11-14 5:46:12 0 [Note] InnoDB: Last binlog file 'mysql-bin-changelog.000004', position 1065 2019-11-14 5:46:12 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-11-14 5:46:12 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2019-11-14 5:46:12 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-11-14 5:46:12 0 [Note] InnoDB: Setting file '/rdsdbdata/db/innodb/ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-11-14 5:46:12 0 [Note] InnoDB: File '/rdsdbdata/db/innodb/ibtmp1' size is now 12 MB. 2019-11-14 5:46:12 0 [Note] InnoDB: Waiting for purge to start 2019-11-14 5:46:12 0 [Note] InnoDB: 10.3.8 started; log sequence number 14488103530; transaction id 2158728 2019-11-14 5:46:12 0 [Note] InnoDB: Loading buffer pool(s) from /rdsdbdata/db/innodb/ib_buffer_pool 2019-11-14 5:46:12 0 [Note] Plugin 'FEEDBACK' is disabled. 191114 5:46:12 server_audit: MariaDB Audit Plugin version 1.4.0 STARTED. 191114 5:46:12 server_audit: Query cache is enabled with the TABLE events. Some table reads can be veiled.2019-11-14 5:46:12 0 [Warning] /rdsdbbin/mysql/bin/mysqld: unknown variable 'loose-rocksdb_log_dir=/rdsdbdata/db/log' 2019-11-14 5:46:12 0 [Note] Recovering after a crash using /rdsdbdata/log/binlog/mysql-bin-changelog 2019-11-14 5:46:12 0 [Note] Starting crash recovery... 2019-11-14 5:46:12 0 [Note] Crash recovery finished. 2019-11-14 5:46:12 0 [Note] Server socket created on IP: '::'. 2019-11-14 5:46:12 0 [Note] Reading of all Master_info entries succeded 2019-11-14 5:46:12 0 [Note] Added new Master_info '' to hash table 2019-11-14 5:46:12 0 [Note] /rdsdbbin/mysql/bin/mysqld: ready for connections. Version: '10.3.8-MariaDB-log' socket: '/tmp/mysql.sock' port: 3306 Source distribution 2019-11-14 5:46:13 9 [Warning] IP address '10.88.120.156' could not be resolved: Name or service not known 2019-11-14 5:46:13 11 [Warning] IP address '10.88.120.19' could not be resolved: Name or service not known 2019-11-14 5:46:14 12 [Warning] IP address '10.31.178.75' could not be resolved: Name or service not known 2019-11-14 5:46:19 0 [Note] InnoDB: Buffer pool(s) load completed at 191114 5:46:19 2019-11-14 5:46:44 96 [Warning] IP address '10.31.203.132' could not be resolved: Name or service not known 2019-11-14 5:46:44 96 [ERROR] mysqld: Can't find record in 'slow_log' 2019-11-14 5:47:50 247 [Warning] IP address '10.34.73.41' could not be resolved: Name or service not known 2019-11-14 5:47:58 96 [ERROR] mysqld: Table 'slow_log' is marked as crashed and should be repaired 2019-11-14 5:48:14 307 [Warning] IP address '10.33.48.115' could not be resolved: Name or service not known 2019-11-14 5:50:01 28 [Warning] Aborted connection 28 to db: 'rndp' user: 'RNDP_APP' host: '10.88.120.19' (Got an error reading communication packets) 2019-11-14 5:50:01 87 [Warning] Aborted connection 87 to db: 'rndp' user: 'RNDP_APP' host: '10.88.120.19' (Got an error reading communication packets) 2019-11-14 5:50:01 19 [Warning] Aborted connection 19 to db: 'rndp' user: 'RNDP_APP' host: '10.88.120.19' (Got an error reading communication packets) 2019-11-14 5:50:01 128 [Warning] Aborted connection 128 to db: 'rndp' user: 'RNDP_APP' host: '10.88.120.19' (Got an error reading communication packets) 2019-11-14 5:50:01 11 [Warning] Aborted connection 11 to db: 'rndp' user: 'RNDP_APP' host: '10.88.120.19' (Got an error reading communication packets) 2019-11-14 5:50:01 18 [Warning] Aborted connection 18 to db: 'rndp' user: 'RNDP_APP' host: '10.88.120.19' (Got an error reading communication packets) 2019-11-14 5:50:01 535 [Warning] Aborted connection 535 to db: 'rndp' user: 'RNDP_APP' host: '10.88.120.19' (Got an error reading communication packets) 2019-11-14 5:50:01 86 [Warning] Aborted connection 86 to db: 'rndp' user: 'RNDP_APP' host: '10.88.120.19' (Got an error reading communication packets) 2019-11-14 5:50:01 61 [Warning] Aborted connection 61 to db: 'rndp' user: 'RNDP_APP' host: '10.88.120.19' (Got an error reading communication packets) 2019-11-14 5:51:28 208 [Warning] Aborted connection 208 to db: 'rndp' user: 'RNDP_APP' host: '10.88.120.156' (Got an error reading communication packets) 2019-11-14 5:51:28 67 [Warning] Aborted connection 67 to db: 'rndp' user: 'RNDP_APP' host: '10.88.120.156' (Got an error reading communication packets) 2019-11-14 5:51:28 206 [Warning] Aborted connection 206 to db: 'rndp' user: 'RNDP_APP' host: '10.88.120.156' (Got an error reading communication packets) 2019-11-14 5:51:28 207 [Warning] Aborted connection 207 to db: 'rndp' user: 'RNDP_APP' host: '10.88.120.156' (Got an error reading communication packets)