Jan 16 13:19:51 db2 mysqld[27002]: 2020-01-16 13:19:51 880026261 [ERROR] [FATAL] InnoDB: Unknown error code 19: Required history data has been deleted Jan 16 13:19:51 db2 mysqld[27002]: 200116 13:19:51 [ERROR] mysqld got signal 6 ; Jan 16 13:19:51 db2 mysqld[27002]: This could be because you hit a bug. It is also possible that this binary Jan 16 13:19:51 db2 mysqld[27002]: or one of the libraries it was linked against is corrupt, improperly built, Jan 16 13:19:51 db2 mysqld[27002]: or misconfigured. This error can also be caused by malfunctioning hardware. Jan 16 13:19:51 db2 mysqld[27002]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs Jan 16 13:19:51 db2 mysqld[27002]: We will try our best to scrape up some info that will hopefully help Jan 16 13:19:51 db2 mysqld[27002]: diagnose the problem, but since we have already crashed, Jan 16 13:19:51 db2 mysqld[27002]: something is definitely wrong and this may fail. Jan 16 13:19:51 db2 mysqld[27002]: Server version: 10.3.10-MariaDB-1:10.3.10+maria~xenial-log Jan 16 13:19:51 db2 mysqld[27002]: key_buffer_size=134217728 Jan 16 13:19:51 db2 mysqld[27002]: read_buffer_size=2097152 Jan 16 13:19:51 db2 mysqld[27002]: max_used_connections=1669 Jan 16 13:19:51 db2 mysqld[27002]: max_threads=5002 Jan 16 13:19:51 db2 mysqld[27002]: thread_count=575 Jan 16 13:19:51 db2 mysqld[27002]: It is possible that mysqld could use up to Jan 16 13:19:51 db2 mysqld[27002]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 30975179 K byt es of memory Jan 16 13:19:51 db2 mysqld[27002]: Hope that's ok; if not, decrease some variables in the equation. Jan 16 13:19:51 db2 mysqld[27002]: Thread pointer: 0x7fbc7c82e648 Jan 16 13:19:51 db2 mysqld[27002]: Attempting backtrace. You can use the following information to find out Jan 16 13:19:51 db2 mysqld[27002]: where mysqld died. If you see no messages after this, something went Jan 16 13:19:51 db2 mysqld[27002]: terribly wrong... Jan 16 13:19:51 db2 mysqld[27002]: stack_bottom = 0x7fbd45ffbdd8 thread_stack 0x49000 Jan 16 13:19:51 db2 mysqld[27002]: /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x5581afbf194e] Jan 16 13:19:51 db2 mysqld[27002]: /usr/sbin/mysqld(handle_fatal_signal+0x347)[0x5581af69e4a7] Jan 16 13:19:51 db2 mysqld[27002]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12890)[0x7fc2f9f93890] Jan 16 13:19:52 db2 mysqld[27002]: /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xc7)[0x7fc2f94a7e97] Jan 16 13:19:52 db2 mysqld[27002]: /lib/x86_64-linux-gnu/libc.so.6(abort+0x141)[0x7fc2f94a9801] Jan 16 13:19:52 db2 mysqld[27002]: /usr/sbin/mysqld(+0xaebfa8)[0x5581afa39fa8] Jan 16 13:19:52 db2 mysqld[27002]: /usr/sbin/mysqld(+0xa5eeac)[0x5581af9aceac] Jan 16 13:19:52 db2 mysqld[27002]: /usr/sbin/mysqld(+0xa7d2fc)[0x5581af9cb2fc] Jan 16 13:19:53 db2 mysqld[27002]: /usr/sbin/mysqld(+0x9a31da)[0x5581af8f11da] Jan 16 13:19:53 db2 mysqld[27002]: 2020-01-16 13:19:53 873282076 [Warning] Aborted connection 873282076 to db: 'unconnec ted' user: 'root' host: 'maxscale.abc.com' (Got an error reading communication packets) Jan 16 13:19:53 db2 mysqld[27002]: /usr/sbin/mysqld(_ZN7handler18index_read_idx_mapEPhjPKhm16ha_rkey_function+0x6e)[0x55 81af69efae] Jan 16 13:19:53 db2 mysqld[27002]: /usr/sbin/mysqld(_ZN7handler21ha_index_read_idx_mapEPhjPKhm16ha_rkey_function+0x14b)[ 0x5581af6a3a5b] Jan 16 13:19:53 db2 mysqld[27002]: /usr/sbin/mysqld(+0x5b7524)[0x5581af505524] Jan 16 13:19:53 db2 mysqld[27002]: /usr/sbin/mysqld(+0x5b761e)[0x5581af50561e] Jan 16 13:19:54 db2 mysqld[27002]: /usr/sbin/mysqld(+0x5becff)[0x5581af50ccff] Jan 16 13:19:54 db2 mysqld[27002]: /usr/sbin/mysqld(_ZN4JOIN14optimize_innerEv+0x981)[0x5581af5163f1] Jan 16 13:19:54 db2 mysqld[27002]: /usr/sbin/mysqld(_ZN4JOIN8optimizeEv+0x37)[0x5581af5166b7] Jan 16 13:19:54 db2 mysqld[27002]: /usr/sbin/mysqld(_Z12mysql_selectP3THDP10TABLE_LISTjR4ListI4ItemEPS4_jP8st_orderS9_S7 _S9_yP13select_resultP18st_select_lex_unitP13st_select_lex+0x8a3)[0x5581af518593] Jan 16 13:19:54 db2 mysqld[27002]: /usr/sbin/mysqld(_Z13handle_selectP3THDP3LEXP13select_resultm+0xf8)[0x5581af5186d8] Jan 16 13:19:55 db2 mysqld[27002]: /usr/sbin/mysqld(+0x48b95c)[0x5581af3d995c] Jan 16 13:19:55 db2 mysqld[27002]: /usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x6d2d)[0x5581af4c583d] Jan 16 13:19:55 db2 mysqld[27002]: /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_statebb+0x21a)[0x5581af4c782a] Jan 16 13:19:55 db2 mysqld[27002]: /usr/sbin/mysqld(+0x57a0f6)[0x5581af4c80f6] Jan 16 13:19:55 db2 mysqld[27002]: /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0xe9a)[0x5581af4c944a] Jan 16 13:19:56 db2 mysqld[27002]: /usr/sbin/mysqld(_Z10do_commandP3THD+0x13c)[0x5581af4cacfc] Jan 16 13:19:56 db2 mysqld[27002]: /usr/sbin/mysqld(_Z24do_handle_one_connectionP7CONNECT+0x252)[0x5581af59c022] Jan 16 13:19:56 db2 mysqld[27002]: /usr/sbin/mysqld(handle_one_connection+0x3d)[0x5581af59c19d] Jan 16 13:19:56 db2 mysqld[27002]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db)[0x7fc2f9f886db] Jan 16 13:19:56 db2 mysqld[27002]: /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7fc2f958a88f] Jan 16 13:19:56 db2 mysqld[27002]: Trying to get some variables. Jan 16 13:19:56 db2 mysqld[27002]: Some pointers may be invalid and cause the dump to abort. Jan 16 13:19:56 db2 mysqld[27002]: Query (0x7fbc7cd1f730): SELECT .... Jan 16 13:19:56 db2 mysqld[27002]: Connection ID (thread ID): 880026261 Jan 16 13:19:56 db2 mysqld[27002]: Status: NOT_KILLED Jan 16 13:19:56 db2 mysqld[27002]: Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on Jan 16 13:19:56 db2 mysqld[27002]: The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains Jan 16 13:19:56 db2 mysqld[27002]: information that should help you find out what is causing the crash. Jan 16 13:19:59 db2 systemd[1]: mariadb.service: Main process exited, code=dumped, status=6/ABRT Jan 16 13:19:59 db2 systemd[1]: mariadb.service: Failed with result 'core-dump'. Jan 16 13:20:01 db2 metricbeat[8803]: [mysql] 2020/01/16 13:20:01 packets.go:36: unexpected EOF Jan 16 13:20:01 db2 metricbeat[8803]: [mysql] 2020/01/16 13:20:01 packets.go:36: unexpected EOF Jan 16 13:20:04 db2 systemd[1]: mariadb.service: Service hold-off time over, scheduling restart. Jan 16 13:20:04 db2 systemd[1]: mariadb.service: Scheduled restart job, restart counter is at 1. Jan 16 13:20:04 db2 systemd[1]: Stopped MariaDB 10.3.10 database server. Jan 16 13:20:04 db2 systemd[1]: Starting MariaDB 10.3.10 database server... Jan 16 13:20:31 db2 metricbeat[8803]: [mysql] 2020/01/16 13:20:31 packets.go:36: read tcp 127.0.0.1:47522->127.0.0.1:3306: i/o timeout Jan 16 13:20:31 db2 metricbeat[8803]: [mysql] 2020/01/16 13:20:31 packets.go:36: read tcp 127.0.0.1:47524->127.0.0.1:3306: i/o timeout Jan 16 13:20:41 db2 metricbeat[8803]: [mysql] 2020/01/16 13:20:41 packets.go:36: read tcp 127.0.0.1:47526->127.0.0.1:3306: read: connection reset by peer Jan 16 13:20:41 db2 metricbeat[8803]: [mysql] 2020/01/16 13:20:41 packets.go:36: read tcp 127.0.0.1:47528->127.0.0.1:3306: read: connection reset by peer Jan 16 13:20:41 db2 mysqld[21524]: WSREP: Recovered position a9d35db8-d6af-11e8-8f59-9aa569aa7b88:391857368 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] /usr/sbin/mysqld (mysqld 10.3.10-MariaDB-1:10.3.10+maria~xenial-log) starting as process 21799 ... Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: Read nil XID from storage engines, skipping position init Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: wsrep_load(): Galera 25.3.24(r3825) by Codership Oy loaded successfully. Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: CRC-32C: using hardware acceleration. Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: Found saved state: a9d35db8-d6af-11e8-8f59-9aa569aa7b88:-1, safe_to_bootstrap: 0 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = x.x.x.40; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_fact or = 0.8; gcs.fc_limit = 160; gcs.fc_master_slave = yes; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; p Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: GCache history reset: a9d35db8-d6af-11e8-8f59-9aa569aa7b88:0 -> a9d35db8-d6af-11e8-8f59-9aa569aa7b88:391857368 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: Assign initial position for certification: 391857368, protocol version: -1 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: wsrep_sst_grab() Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: Start replication Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: Setting initial position to a9d35db8-d6af-11e8-8f59-9aa569aa7b88:391857368 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: protonet asio version 0 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: Using CRC-32C for message checksums. Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: backend: asio Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: restore pc from disk successfully Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: GMCast version 0 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: (87336b6d, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: (87336b6d, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: EVS version 0 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: gcomm: connecting to group 'productiondb', peer 'x.x.x.39:,x.x.x.40:,x.x.x.41:,x.x.x.42:,x.x.x.43:,x.x.x.44:,x.x.x.45:' Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: (87336b6d, 'tcp://0.0.0.0:4567') connection established to 87336b6d tcp://x.x.x.40:4567 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Warning] WSREP: (87336b6d, 'tcp://0.0.0.0:4567') address 'tcp://x.x.x.40:4567' points to own listening address, blacklisting Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: (87336b6d, 'tcp://0.0.0.0:4567') connection established to 23ba6012 tcp://x.x.x.39:4567 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: (87336b6d, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: (87336b6d, 'tcp://0.0.0.0:4567') connection established to 41a0de5d tcp://x.x.x.41:4567 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: declaring 23ba6012 at tcp://x.x.x.39:4567 stable Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: declaring 41a0de5d at tcp://x.x.x.41:4567 stable Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: gcomm: connected Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: Opened channel 'productiondb' Jan 16 13:20:41 db2 mysqld[21799]: 2020-01-16 13:20:41 0 [Note] WSREP: Waiting for SST to complete. Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: Node 23ba6012 state prim Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: view(view_id(PRIM,23ba6012,42) memb { Jan 16 13:20:42 db2 mysqld[21799]: #01123ba6012,0 Jan 16 13:20:42 db2 mysqld[21799]: #01141a0de5d,0 Jan 16 13:20:42 db2 mysqld[21799]: #01187336b6d,0 Jan 16 13:20:42 db2 mysqld[21799]: } joined { Jan 16 13:20:42 db2 mysqld[21799]: } left { Jan 16 13:20:42 db2 mysqld[21799]: } partitioned { Jan 16 13:20:42 db2 mysqld[21799]: }) Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: save pc into disk Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: discarding pending addr without UUID: tcp://192.1 68.10.42:4567 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: discarding pending addr proto entry 0x55ae037e7f7 0 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: discarding pending addr without UUID: tcp://192.1 68.10.43:4567 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: discarding pending addr proto entry 0x55ae037f088 0 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: discarding pending addr without UUID: tcp://x.x.x.44:4567 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: discarding pending addr proto entry 0x55ae037f9190 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: discarding pending addr without UUID: tcp://x.x.x.45:4567 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: discarding pending addr proto entry 0x55ae03801aa0 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: clear restored view Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Warning] WSREP: Action message in non-primary configuration from member 0 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 9d3a1610-385a-11ea-a4a3-f629f4200696 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9d3a1610-385a-11ea-a4a3-f629f4200696 from 0 (db1.abc.com) Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9d3a1610-385a-11ea-a4a3-f629f4200696 from 1 (db3.abc.com) Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9d3a1610-385a-11ea-a4a3-f629f4200696 from 2 (db2) Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: Quorum results: Jan 16 13:20:42 db2 mysqld[21799]: #011version = 4, Jan 16 13:20:42 db2 mysqld[21799]: #011component = PRIMARY, Jan 16 13:20:42 db2 mysqld[21799]: #011conf_id = 40, Jan 16 13:20:42 db2 mysqld[21799]: #011members = 2/3 (joined/total), Jan 16 13:20:42 db2 mysqld[21799]: #011act_id = 391858659, Jan 16 13:20:42 db2 mysqld[21799]: #011last_appl. = -1, Jan 16 13:20:42 db2 mysqld[21799]: #011protocols = 0/9/3 (gcs/repl/appl), Jan 16 13:20:42 db2 mysqld[21799]: #011group UUID = a9d35db8-d6af-11e8-8f59-9aa569aa7b88 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: Flow-control interval: [128, 160] Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: Trying to continue unpaused monitor Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 391858659) Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 2 [Note] WSREP: State transfer required: Jan 16 13:20:42 db2 mysqld[21799]: #011Group state: a9d35db8-d6af-11e8-8f59-9aa569aa7b88:391858659 Jan 16 13:20:42 db2 mysqld[21799]: #011Local state: a9d35db8-d6af-11e8-8f59-9aa569aa7b88:391857368 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 2 [Note] WSREP: New cluster view: global state: a9d35db8-d6af-11e8-8f59-9aa569aa7b88:391858659, view# 41: Primary, number of nodes: 3, my index: 2, protocol version 3 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 2 [Warning] WSREP: Gap in state sequence. Need state transfer. Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address 'x.x.x.40' --datadir '/var/lib/mysql/' --parent '21799' --binlog '/var/log/mysql/mariadb-bin' --binlog-index '/var/log/mysql/mariadb-bin.index'' Jan 16 13:20:42 db2 rsyncd[21863]: rsyncd version 3.1.2 starting, listening on port 4444 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 2 [Note] WSREP: Prepared SST request: rsync|x.x.x.40:4444/rs ync_sst Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notific ation. Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 2 [Note] WSREP: REPL Protocols: 9 (4, 2) Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 2 [Note] WSREP: Assign initial position for certification: 391858659, protocol version: 4 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: Service thread queue flushed. Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 2 [Note] WSREP: IST receiver addr using tcp://x.x.x.40:4568 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 2 [Note] WSREP: Prepared IST receiver, listening at: tcp://x.x.x.40:4568 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: Member 2.0 (db2) requested state transfer from '*any*'. Selected 1.0 (db3.abc.com)(SYNCED) as donor. Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 391858683) Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 2 [Note] WSREP: Requesting state transfer: success, donor: 1 Jan 16 13:20:42 db2 mysqld[21799]: 2020-01-16 13:20:42 2 [Note] WSREP: GCache history reset: a9d35db8-d6af-11e8-8f59-9aa569aa7b88:0 -> a9d35db8-d6af-11e8-8f59-9aa569aa7b88:391858659 Jan 16 13:20:43 db2 systemd-resolved[821]: Server returned error NXDOMAIN, mitigating potential DNS violation DVE-2018-0001, retrying transaction with reduced feature level UDP. Jan 16 13:20:43 db2 rsyncd[21884]: name lookup failed for x.x.x.41: Name or service not known Jan 16 13:20:43 db2 rsyncd[21884]: connect from UNKNOWN (x.x.x.41) Jan 16 13:20:43 db2 rsyncd[21884]: rsync to rsync_sst/ from UNKNOWN (x.x.x.41) Jan 16 13:20:43 db2 rsyncd[21884]: receiving file list Jan 16 13:20:43 db2 rsyncd[21884]: sent 48 bytes received 192 bytes total size 49 Jan 16 13:20:43 db2 mysqld[21799]: 2020-01-16 13:20:43 0 [Note] WSREP: 1.0 (db3.abc.com): State transfer to 2.0 (db2) complete. Jan 16 13:20:43 db2 mysqld[21799]: 2020-01-16 13:20:43 0 [Note] WSREP: Member 1.0 (db3.abc.com) synced with group. Jan 16 13:20:43 db2 mysqld[21799]: WSREP_SST: [INFO] Joiner cleanup. rsync PID: 21863 (20200116 13:20:43.562) Jan 16 13:20:43 db2 rsyncd[21863]: sent 0 bytes received 0 bytes total size 0 Jan 16 13:20:44 db2 mysqld[21799]: WSREP_SST: [INFO] Joiner cleanup done. (20200116 13:20:44.069) Jan 16 13:20:44 db2 mysqld[21799]: 2020-01-16 13:20:44 0 [Note] WSREP: SST complete, seqno: 391857368 Jan 16 13:20:44 db2 mysqld[21799]: 2020-01-16 13:20:44 0 [Note] InnoDB: Using Linux native AIO Jan 16 13:20:44 db2 mysqld[21799]: 2020-01-16 13:20:44 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins Jan 16 13:20:44 db2 mysqld[21799]: 2020-01-16 13:20:44 0 [Note] InnoDB: Uses event mutexes Jan 16 13:20:44 db2 mysqld[21799]: 2020-01-16 13:20:44 0 [Note] InnoDB: Compressed tables use zlib 1.2.8 Jan 16 13:20:44 db2 mysqld[21799]: 2020-01-16 13:20:44 0 [Note] InnoDB: Number of pools: 1 Jan 16 13:20:44 db2 mysqld[21799]: 2020-01-16 13:20:44 0 [Note] InnoDB: Using SSE2 crc32 instructions Jan 16 13:20:44 db2 mysqld[21799]: 2020-01-16 13:20:44 0 [Note] InnoDB: Initializing buffer pool, total size = 20G, instances = 20, chunk size = 128M Jan 16 13:20:44 db2 mysqld[21799]: 2020-01-16 13:20:44 0 [Note] WSREP: (87336b6d, 'tcp://0.0.0.0:4567') connection to peer 87336b6d with addr tcp://x.x.x.40:4567 timed out, no messages seen in PT3S Jan 16 13:20:44 db2 mysqld[21799]: 2020-01-16 13:20:44 0 [Note] WSREP: (87336b6d, 'tcp://0.0.0.0:4567') turning message relay requesting off Jan 16 13:20:44 db2 mysqld[21799]: 2020-01-16 13:20:44 0 [Note] InnoDB: Completed initialization of buffer pool Jan 16 13:20:44 db2 mysqld[21799]: 2020-01-16 13:20:44 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] InnoDB: 128 out of 128 rollback segments are active. Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] InnoDB: Creating shared tablespace for temporary tables Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] InnoDB: Waiting for purge to start Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] InnoDB: 10.3.10 started; log sequence number 435143409109; transaction id 895582899 Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] Plugin 'FEEDBACK' is disabled. Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] Server socket created on IP: '::'. Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] WSREP: Signalling provider to continue. Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] WSREP: SST received: a9d35db8-d6af-11e8-8f59-9aa569aa7b88:391857368 Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 2 [Note] WSREP: Receiving IST: 1291 writesets, seqnos 391857368-391858659 Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] WSREP: Receiving IST... 0.0% ( 0/1291 events) complete. Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] Reading of all Master_info entries succeded Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] Added new Master_info '' to hash table Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] /usr/sbin/mysqld: ready for connections. Jan 16 13:20:45 db2 mysqld[21799]: Version: '10.3.10-MariaDB-1:10.3.10+maria~xenial-log' socket: '/var/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution Jan 16 13:20:45 db2 /etc/mysql/debian-start[21971]: Upgrading MySQL tables if necessary. Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 42 [Warning] Access denied for user 'debian-sys-maint'@'localhost' (using password: YES) Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 43 [Warning] Access denied for user 'debian-sys-maint'@'localhost' (using password: YES) Jan 16 13:20:45 db2 /etc/mysql/debian-start[21975]: /usr/bin/mysql_upgrade: the '--basedir' option is always ignored Jan 16 13:20:45 db2 /etc/mysql/debian-start[21975]: Looking for 'mysql' as: /usr/bin/mysql Jan 16 13:20:45 db2 /etc/mysql/debian-start[21975]: Looking for 'mysqlcheck' as: /usr/bin/mysqlcheck Jan 16 13:20:45 db2 /etc/mysql/debian-start[21975]: Version check failed. Got the following error when calling the 'mysql' command line client Jan 16 13:20:45 db2 /etc/mysql/debian-start[21975]: ERROR 1045 (28000): Access denied for user 'debian-sys-maint'@'localhost' (using password: YES) Jan 16 13:20:45 db2 /etc/mysql/debian-start[21975]: FATAL ERROR: Upgrade failed Jan 16 13:20:45 db2 /etc/mysql/debian-start[21985]: Checking for insecure root accounts. Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 44 [Warning] Access denied for user 'debian-sys-maint'@'localhost' (using password: YES) Jan 16 13:20:45 db2 mysqld[21969]: ERROR 1045 (28000): Access denied for user 'debian-sys-maint'@'localhost' (using password: YES) Jan 16 13:20:45 db2 systemd[1]: Started MariaDB 10.3.10 database server. Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] WSREP: Receiving IST...100.0% (1291/1291 events) complete. Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 2 [Note] WSREP: IST received: a9d35db8-d6af-11e8-8f59-9aa569aa7b88:391858659 Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] WSREP: 2.0 (db2): State transfer from 1.0 (db3.abc.com) complete. Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 391858764) Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] WSREP: Member 2.0 (db2) synced with group. Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 391858764) Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 36 [Note] WSREP: Synchronized with group, ready for connections Jan 16 13:20:45 db2 mysqld[21799]: 2020-01-16 13:20:45 36 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.