Details
-
Bug
-
Status: Closed (View Workflow)
-
Major
-
Resolution: Incomplete
-
10.5.6
-
RedHat Enterprise Linux, On-Premise, Virtualized
Description
User is hitting Signal 11 repeatedly(114 times) after applying SSL(TDE). Here is the stacktrace.
201124 12:14:54 [ERROR] mysqld got signal 11 ; |
This could be because you hit a bug. It is also possible that this binary |
or one of the libraries it was linked against is corrupt, improperly built,
|
or misconfigured. This error can also be caused by malfunctioning hardware.
|
|
To report this bug, see https://mariadb.com/kb/en/reporting-bugs |
|
We will try our best to scrape up some info that will hopefully help |
diagnose the problem, but since we have already crashed,
|
something is definitely wrong and this may fail. |
|
Server version: 10.5.6-MariaDB |
key_buffer_size=134217728 |
read_buffer_size=131072 |
max_used_connections=11 |
max_threads=153 |
thread_count=34 |
It is possible that mysqld could use up to
|
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 467800 K bytes of memory |
Hope that's ok; if not, decrease some variables in the equation. |
|
Thread pointer: 0x7f19d40b1408 |
Attempting backtrace. You can use the following information to find out
|
where mysqld died. If you see no messages after this, something went |
terribly wrong...
|
stack_bottom = 0x7f1a5ec24c90 thread_stack 0x49000 |
??:0(my_print_stacktrace)[0x55ac7a77d0ae] |
??:0(handle_fatal_signal)[0x55ac7a17e5d7] |
sigaction.c:0(__restore_rt)[0x7f1a735a9630] |
src/replicator_smm.cpp:1054(galera::ReplicatorSMM::replay_trx(galera::TrxHandleMaster&, galera::TrxHandleLock&, void*))[0x7f1a6e5dce19] |
src/trx_handle.hpp:1126(~TrxHandleLock)[0x7f1a6e5f177d] |
??:0(wsrep::wsrep_provider_v26::replay(wsrep::ws_handle const&, wsrep::high_priority_service*))[0x55ac7a81d259] |
??:0(Wsrep_client_service::replay())[0x55ac7a424a56] |
??:0(wsrep::transaction::replay(wsrep::unique_lock<wsrep::mutex>&))[0x55ac7a8172a8] |
??:0(wsrep::transaction::after_statement())[0x55ac7a8187d4] |
??:0(wsrep::client_state::after_statement())[0x55ac7a7f44fd] |
??:0(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool))[0x55ac79f86bfb] |
??:0(do_command(THD*))[0x55ac79f88feb] |
??:0(do_handle_one_connection(CONNECT*, bool))[0x55ac7a071b29] |
??:0(handle_one_connection)[0x55ac7a071db4] |
??:0(MyCTX_nopad::finish(unsigned char*, unsigned int*))[0x55ac7a3c627d] |
pthread_create.c:0(start_thread)[0x7f1a735a1ea5] |
??:0(__clone)[0x7f1a716ca96d] |
|
Trying to get some variables.
|
Some pointers may be invalid and cause the dump to abort.
|
Query (0x0): |
Connection ID (thread ID): 1 |
Status: NOT_KILLED
|
|
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off |
|
The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains |
information that should help you find out what is causing the crash.
|
Writing a core file...
|
Working directory at /MariaDB/base/mysql
|
Resource Limits:
|
Limit Soft Limit Hard Limit Units
|
Max cpu time unlimited unlimited seconds
|
Max file size unlimited unlimited bytes
|
Max data size unlimited unlimited bytes
|
Max stack size 8388608 unlimited bytes |
Max core file size 0 unlimited bytes |
Max resident set unlimited unlimited bytes
|
Max processes 63412 63412 processes |
Max open files 16384 16384 files |
Max locked memory 65536 65536 bytes |
Max address space unlimited unlimited bytes
|
Max file locks unlimited unlimited locks
|
Max pending signals 63412 63412 signals |
Max msgqueue size 819200 819200 bytes |
Max nice priority 0 0 |
Max realtime priority 0 0 |
Max realtime timeout unlimited unlimited us
|
Core pattern: core
|
|
2020-11-24 12:15:03 0 [Note] WSREP: Loading provider /usr/lib64/galera-4/libgalera_smm.so initial position: 33c3e167-0a8e-11eb-bf65-f322c7adba58:646 |
2020-11-24 12:15:03 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera-4/libgalera_smm.so' |
2020-11-24 12:15:03 0 [Note] WSREP: wsrep_load(): Galera 26.4.5(rb3764ab) by Codership Oy <info@codership.com> loaded successfully. |
2020-11-24 12:15:03 0 [Note] WSREP: CRC-32C: using hardware acceleration. |
2020-11-24 12:15:03 0 [Note] WSREP: Found saved state: 33c3e167-0a8e-11eb-bf65-f322c7adba58:-1, safe_to_bootstrap: 0 |
2020-11-24 12:15:03 0 [Note] WSREP: GCache DEBUG: opened preamble: |
Version: 2 |
UUID: 33c3e167-0a8e-11eb-bf65-f322c7adba58
|
Seqno: -1 - -1 |
Offset: -1 |
Synced: 0 |
This is 5 ndoe galara cluster and some galera config as below.
# Mandatory settings
|
wsrep_on=ON
|
wsrep_provider=/usr/lib64/galera-4/libgalera_smm.so |
wsrep_cluster_address="gcomm://xxx-oitmrdb01,xxx-oitmrdb02,xxx-oitmrdb03,xxx-oitmrdb04,d2-us-oitmrdb01,d2-us-oitmrdb02,d2-us-oitmrdb03" |
wsrep_cluster_name='D1_D2_MARIADB_STAGE_CLUSTER' |
wsrep_node_address='xxx-oitmrdb01' |
wsrep_node_name='xxx-oitmrdb01' |
wsrep_sst_method=mariabackup
|
wsrep_sst_auth=sst:xxx
|
wsrep_log_conflicts=ON
|
#wsrep_debug=ON
|
|
# Optional setting
|
wsrep_slave_threads=20 |
wsrep_certify_nonPK=1 |
wsrep_max_ws_size=1073741824 |
wsrep_convert_LOCK_to_trx=0 |
wsrep_retry_autocommit=1 |
wsrep_auto_increment_control=1 |
|
#The following parameters can tolerate 30 second connectivity outages on a wan replication |
wsrep_provider_options = "evs.keepalive_period = PT3S
|
wsrep_provider_options = "evs.suspect_timeout = PT30S" |
wsrep_provider_options = "evs.inactive_timeout = PT5S" |
wsrep_provider_options = "evs.install_timeout = PT5S" |
wsrep_provider_options = "pc.weight=1" |
wsrep_provider_options = "evs.join_retrans_period=PT0.10S" |
wsrep_provider_options = "gcache.recover = yes; gcache.size = 1G;gcs.fc_factor = 0.8; gcs.fc_limit = 64; gcs.fc_master_slave = yes;" |
wsrep_provider_options = "ist.recv_addr=xxx-oitmrdb01" |
wsrep_provider_options = "socket.ssl_key=/etc/mysql/ssl/mariadb-server-stage.key;socket.ssl_cert=/etc/mysql/ssl/mariadb-server-stage.cer;socket.ssl_ca=/etc/mysql/ssl/SEC_Root_CA.cer" |
wsrep_provider_options = "socket.checksum=2" |
wsrep_provider_options = "socket.ssl_cipher=ALL:!EXP:!NULL:!ADH:!LOW:!SSLv2:!SSLv3:!MD5:!RC4:!RSA" |
wsrep_provider_options = "cert.log_conflicts=ON" |