galera_sr.galera_sr_cc_master 'innodb' w2 [ fail ]
|
Test ended at 2020-08-26 13:28:21
|
|
CURRENT_TEST: galera_sr.galera_sr_cc_master
|
mysqltest: At line 44: query 'SET GLOBAL wsrep_cluster_address = ''' failed: 2013: Lost connection to MySQL server during query
|
|
The result from queries just before the failure was:
|
< snip >
|
SET AUTOCOMMIT=OFF;
|
START TRANSACTION;
|
INSERT INTO t1 VALUES (1);
|
INSERT INTO t1 VALUES (2);
|
INSERT INTO t1 VALUES (3);
|
INSERT INTO t1 VALUES (4);
|
INSERT INTO t1 VALUES (5);
|
SELECT COUNT(*) FROM mysql.wsrep_streaming_log;
|
COUNT(*)
|
5
|
connection node_1;
|
SELECT COUNT(*) FROM mysql.wsrep_streaming_log;
|
COUNT(*)
|
5
|
connect node_2a, 127.0.0.1, root, , test, $NODE_MYPORT_2;
|
connection node_2a;
|
SET SESSION wsrep_sync_wait=0;
|
SET GLOBAL wsrep_cluster_address = '';
|
|
More results from queries before failure can be found in /dev/shm/var/2/log/galera_sr_cc_master.log
|
|
|
Server [mysqld.2 - pid: 30295, winpid: 30295, exit: 256] failed during test run
|
Server log from this test:
|
----------SERVER LOG START-----------
|
2020-08-26 13:28:09 190 [Note] WSREP: Stop replication by 190
|
2020-08-26 13:28:09 190 [Note] WSREP: Server status change synced -> disconnecting
|
2020-08-26 13:28:09 190 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
|
2020-08-26 13:28:09 190 [Note] WSREP: Closing send monitor...
|
2020-08-26 13:28:09 190 [Note] WSREP: Closed send monitor.
|
2020-08-26 13:28:09 190 [Note] WSREP: gcomm: terminating thread
|
2020-08-26 13:28:09 190 [Note] WSREP: gcomm: joining thread
|
2020-08-26 13:28:09 190 [Note] WSREP: gcomm: closing backend
|
2020-08-26 13:28:10 190 [Note] WSREP: view(view_id(NON_PRIM,da890db4-8cab,2) memb {
|
dac1d348-a891,0
|
} joined {
|
} left {
|
} partitioned {
|
da890db4-8cab,0
|
})
|
2020-08-26 13:28:10 190 [Note] WSREP: PC protocol downgrade 1 -> 0
|
2020-08-26 13:28:10 190 [Note] WSREP: view((empty))
|
2020-08-26 13:28:10 190 [Note] WSREP: gcomm: closed
|
2020-08-26 13:28:10 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
|
2020-08-26 13:28:10 0 [Note] WSREP: Flow-control interval: [16, 16]
|
2020-08-26 13:28:10 0 [Note] WSREP: Received NON-PRIMARY.
|
2020-08-26 13:28:10 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 280)
|
2020-08-26 13:28:10 0 [Note] WSREP: New SELF-LEAVE.
|
2020-08-26 13:28:10 0 [Note] WSREP: Flow-control interval: [0, 0]
|
2020-08-26 13:28:10 0 [Note] WSREP: Received SELF-LEAVE. Closing connection.
|
2020-08-26 13:28:10 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 280)
|
2020-08-26 13:28:10 0 [Note] WSREP: RECV thread exiting 0: Success
|
2020-08-26 13:28:10 2 [Note] WSREP: ================================================
|
View:
|
id: da893b78-e79f-11ea-8c68-73bde832192b:280
|
status: non-primary
|
protocol_version: 4
|
capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
|
final: no
|
own_index: 0
|
members(1):
|
0: dac1d348-e79f-11ea-a891-e6e150a3dc34, centos74-amd64
|
=================================================
|
2020-08-26 13:28:10 2 [Note] WSREP: Non-primary view
|
2020-08-26 13:28:10 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
|
2020-08-26 13:28:10 190 [Note] WSREP: recv_thread() joined.
|
2020-08-26 13:28:10 190 [Note] WSREP: Closing replication queue.
|
2020-08-26 13:28:10 190 [Note] WSREP: Closing slave action queue.
|
2020-08-26 13:28:10 2 [Note] WSREP: ================================================
|
View:
|
id: da893b78-e79f-11ea-8c68-73bde832192b:280
|
status: non-primary
|
protocol_version: 4
|
capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
|
final: yes
|
own_index: -1
|
members(0):
|
=================================================
|
2020-08-26 13:28:10 2 [Note] WSREP: Non-primary view
|
2020-08-26 13:28:10 2 [Note] WSREP: Server status change disconnecting -> disconnected
|
2020-08-26 13:28:10 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
|
2020-08-26 13:28:10 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
|
2020-08-26 13:28:10 2 [Note] WSREP: Applier thread exiting ret: 0 thd: 2
|
2020-08-26 13:28:10 2 [Warning] Aborted connection 2 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
|
2020-08-26 13:28:10 190 [Note] WSREP: killing local connection: 189
|
mysqld: /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.4.15/include/mysql/psi/mysql_socket.h:785: inline_mysql_socket_recv: Assertion `mysql_socket.fd != -1' failed.
|
200826 13:28:10 [ERROR] mysqld got signal 6 ;
|
This could be because you hit a bug. It is also possible that this binary
|
or one of the libraries it was linked against is corrupt, improperly built,
|
or misconfigured. This error can also be caused by malfunctioning hardware.
|
|
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
|
|
We will try our best to scrape up some info that will hopefully help
|
diagnose the problem, but since we have already crashed,
|
something is definitely wrong and this may fail.
|
|
Server version: 10.4.15-MariaDB-debug-log
|
key_buffer_size=1048576
|
read_buffer_size=131072
|
max_used_connections=2
|
max_threads=153
|
thread_count=10
|
It is possible that mysqld could use up to
|
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 63634 K bytes of memory
|
Hope that's ok; if not, decrease some variables in the equation.
|
|
Thread pointer: 0x55ad9ac54870
|
Attempting backtrace. You can use the following information to find out
|
where mysqld died. If you see no messages after this, something went
|
terribly wrong...
|
stack_bottom = 0x7fa28a83cc58 thread_stack 0x49000
|
/usr/sbin/mysqld(my_print_stacktrace+0x2b)[0x55ad914aff06]
|
/usr/sbin/mysqld(handle_fatal_signal+0x311)[0x55ad90d7400e]
|
addr2line: Dwarf Error: Offset (6516329) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 6516329.
|
addr2line: Dwarf Error: Offset (6514020) greater than or equal to .debug_str size (3474297).
|
addr2line: Dwarf Error: Offset (1047528) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 1047528.
|
addr2line: Dwarf Error: Offset (1198800) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 1198800.
|
addr2line: Dwarf Error: Offset (1178796291) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Could not find abbrev number 149.
|
addr2line: Dwarf Error: Offset (1144133) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 1144133.
|
addr2line: Dwarf Error: Offset (1047528) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 1047528.
|
addr2line: Dwarf Error: Offset (1198800) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 1198800.
|
addr2line: Dwarf Error: Offset (6514020) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (6516329) greater than or equal to .debug_str size (3474297).
|
addr2line: Dwarf Error: Offset (553653570) greater than or equal to .debug_str size (3474297).
|
addr2line: Dwarf Error: Could not find abbrev number 123318.
|
addr2line: Dwarf Error: Could not find abbrev number 161.
|
addr2line: Dwarf Error: Offset (7628135) greater than or equal to .debug_str size (3474297).
|
addr2line: Dwarf Error: Offset (119131417) greater than or equal to .debug_str size (3474297).
|
addr2line: Dwarf Error: Offset (7628147) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3204451875) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (6514020) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (5390925) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Could not find abbrev number 130.
|
addr2line: Dwarf Error: Offset (1037550) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 1037550.
|
addr2line: Dwarf Error: Offset (7628135) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
sigaction.c:0(__restore_rt)[0x7fa29ba6b5e0]
|
:0(__GI_raise)[0x7fa299f771f7]
|
:0(__GI_abort)[0x7fa299f788e8]
|
:0(__assert_fail_base)[0x7fa299f70266]
|
:0(__GI___assert_fail)[0x7fa299f70312]
|
/usr/sbin/mysqld(vio_read+0x19b)[0x55ad915050f3]
|
/usr/sbin/mysqld(+0xa6dcad)[0x55ad90eafcad]
|
/usr/sbin/mysqld(my_net_read_packet_reallen+0x39)[0x55ad90eb0d3d]
|
/usr/sbin/mysqld(my_net_read_packet+0x1d)[0x55ad90eb0fa3]
|
/usr/sbin/mysqld(_Z10do_commandP3THD+0x18f)[0x55ad90b11c36]
|
/usr/sbin/mysqld(_Z24do_handle_one_connectionP7CONNECT+0x1fd)[0x55ad90c1b9be]
|
/usr/sbin/mysqld(handle_one_connection+0x3d)[0x55ad90c1ba90]
|
/usr/sbin/mysqld(+0x10176fd)[0x55ad914596fd]
|
addr2line: Dwarf Error: Offset (6516329) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 6516329.
|
addr2line: Dwarf Error: Offset (6514020) greater than or equal to .debug_str size (3474297).
|
addr2line: Dwarf Error: Offset (1047528) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 1047528.
|
addr2line: Dwarf Error: Offset (1198800) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 1198800.
|
addr2line: Dwarf Error: Offset (1178796291) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Could not find abbrev number 149.
|
addr2line: Dwarf Error: Offset (1144133) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 1144133.
|
addr2line: Dwarf Error: Offset (1047528) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 1047528.
|
addr2line: Dwarf Error: Offset (1198800) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 1198800.
|
addr2line: Dwarf Error: Offset (6514020) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (6516329) greater than or equal to .debug_str size (3474297).
|
addr2line: Dwarf Error: Offset (553653570) greater than or equal to .debug_str size (3474297).
|
addr2line: Dwarf Error: Could not find abbrev number 123318.
|
addr2line: Dwarf Error: Could not find abbrev number 161.
|
addr2line: Dwarf Error: Offset (7628135) greater than or equal to .debug_str size (3474297).
|
addr2line: Dwarf Error: Offset (119131417) greater than or equal to .debug_str size (3474297).
|
addr2line: Dwarf Error: Offset (7628147) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3204451875) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (6514020) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (5390925) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Could not find abbrev number 130.
|
addr2line: Dwarf Error: Offset (1037550) greater than or equal to .debug_info size (876553).
|
addr2line: Dwarf Error: Unable to read alt ref 1037550.
|
addr2line: Dwarf Error: Offset (7628135) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (245173908) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (245173908) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (7628147) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (7628147) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (3724748323) greater than or equal to .debug_str size (1506642).
|
addr2line: Dwarf Error: Offset (319931146) greater than or equal to .debug_str size (1506642).
|
pthread_create.c:0(start_thread)[0x7fa29ba63e25]
|
/lib64/libc.so.6(clone+0x6d)[0x7fa29a03a34d]
|
|
Trying to get some variables.
|
Some pointers may be invalid and cause the dump to abort.
|
Query (0x0): (null)
|
Connection ID (thread ID): 189
|
Status: KILL_CONNECTION
|
|
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on
|
|
The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains
|
information that should help you find out what is causing the crash.
|
|
We think the query pointer is invalid, but we will try to print it anyway.
|
Query:
|
|
Writing a core file...
|
Working directory at /dev/shm/var/2/mysqld.2/data
|
Resource Limits:
|
Limit Soft Limit Hard Limit Units
|
Max cpu time unlimited unlimited seconds
|
Max file size unlimited unlimited bytes
|
Max data size unlimited unlimited bytes
|
Max stack size 8388608 unlimited bytes
|
Max core file size unlimited unlimited bytes
|
Max resident set unlimited unlimited bytes
|
Max processes 4096 23142 processes
|
Max open files 1024 1024 files
|
Max locked memory 65536 65536 bytes
|
Max address space unlimited unlimited bytes
|
Max file locks unlimited unlimited locks
|
Max pending signals 23142 23142 signals
|
Max msgqueue size 819200 819200 bytes
|
Max nice priority 0 0
|
Max realtime priority 0 0
|
Max realtime timeout unlimited unlimited us
|
Core pattern: core
|
|
----------SERVER LOG END-------------
|
|
|
- found 'core.30297' (0/0)
|
|
Trying 'dbx' to get a backtrace
|
gdb not found, cannot get the stack trace
|
|
Trying 'lldb' to get a backtrace from coredump /dev/shm/var/2/log/galera_sr.galera_sr_cc_master-innodb/mysqld.2/data/core.30297
|
- deleting it, already saved 0
|
- skipping '/dev/shm/var/2/log/galera_sr.galera_sr_cc_master-innodb/'
|
|
Retrying test galera_sr.galera_sr_cc_master, attempt(2/3)...
|
|
worker[2] > Restart - not started
|
worker[2] > Restart - not started
|
***Warnings generated in error logs during shutdown after running tests: galera_sr.GCF-620 galera_sr.GCF-627 galera_sr.GCF-900 galera_sr.GCF-889 galera_sr.GCF-561 galera_sr.GCF-597 galera_sr.GCF-572 galera_sr.galera_sr_blob galera_sr.GCF-1051 galera_sr.GCF-851 galera_sr.GCF-571 galera_sr.GCF-585 galera_sr.galera_sr_bf_abort galera_sr.GCF-845 galera_sr.galera_sr_cc_master galera_sr.GCF-623 galera_sr.GCF-580 galera_sr.GCF-867 galera_sr.MDEV-22616
|
|
mysqld: /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.4.15/include/mysql/psi/mysql_socket.h:785: inline_mysql_socket_recv: Assertion `mysql_socket.fd != -1' failed.
|
Attempting backtrace. You can use the following information to find out
|
|
galera_sr.galera_sr_cc_master 'innodb' w2 [ retry-pass ] 6133
|
|
Retrying test galera_sr.galera_sr_cc_master, attempt(3/3)...
|
MDEV-23609_104_logs_201222.zip
