Details
-
Bug
-
Status: Open (View Workflow)
-
Critical
-
Resolution: Unresolved
-
10.5.19
-
Debian 11 VM on VMware vSphere with Storage on NetApp.
Description
This Bug now happend twice and the server stopped to replicate in the galera cluster with wsrep because of an high load (not sure) with an classic mysql replication of the second mariadb server which replicates with an mysql 5.7 server for data migration.
We dont understand why the server stopps to replicate over wsrep but still runs normally and is reachable, queryble, ...
The haproxy in front can still login so it doesnt switch to the other backup server for connections.
This is the problematic one:
MariaDB [(none)]> show status like "%wsrep%";
|
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
|
| Variable_name | Value |
|
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
|
| wsrep_local_state_uuid | 00000000-0000-0000-0000-000000000000 |
|
| wsrep_protocol_version | 10 |
|
| wsrep_last_committed | -1 |
|
| wsrep_replicated | 3928800 |
|
| wsrep_replicated_bytes | 6318098688 |
|
| wsrep_repl_keys | 31628277 |
|
| wsrep_repl_keys_bytes | 347319288 |
|
| wsrep_repl_data_bytes | 5696592424 |
|
| wsrep_repl_other_bytes | 0 |
|
| wsrep_received | 495184 |
|
| wsrep_received_bytes | 334286424 |
|
| wsrep_local_commits | 3928751 |
|
| wsrep_local_cert_failures | 0 |
|
| wsrep_local_replays | 0 |
|
| wsrep_local_send_queue | 0 |
|
| wsrep_local_send_queue_max | 26 |
|
| wsrep_local_send_queue_min | 0 |
|
| wsrep_local_send_queue_avg | 0.0146288 |
|
| wsrep_local_recv_queue | 0 |
|
| wsrep_local_recv_queue_max | 102 |
|
| wsrep_local_recv_queue_min | 0 |
|
| wsrep_local_recv_queue_avg | 0.0784936 |
|
| wsrep_local_cached_downto | 9752343 |
|
| wsrep_flow_control_paused_ns | 9770684545 |
|
| wsrep_flow_control_paused | 4.2607e-06 |
|
| wsrep_flow_control_sent | 48 |
|
| wsrep_flow_control_recv | 584 |
|
| wsrep_flow_control_active | false |
|
| wsrep_flow_control_requested | false |
|
| wsrep_cert_deps_distance | 23.8889 |
|
| wsrep_apply_oooe | 0.0216107 |
|
| wsrep_apply_oool | 0.0038792 |
|
| wsrep_apply_window | 1.03378 |
|
| wsrep_apply_waits | 0 |
|
| wsrep_commit_oooe | 0 |
|
| wsrep_commit_oool | 0 |
|
| wsrep_commit_window | 1.00543 |
|
| wsrep_local_state | 5 |
|
| wsrep_local_state_comment | Inconsistent |
|
| wsrep_cert_index_size | 21 |
|
| wsrep_causal_reads | 0 |
|
| wsrep_cert_interval | 152.001 |
|
| wsrep_open_transactions | 0 |
|
| wsrep_open_connections | 0 |
|
| wsrep_incoming_addresses | |
|
| wsrep_applier_thread_count | 0 |
|
| wsrep_cluster_capabilities | |
|
| wsrep_cluster_conf_id | 18446744073709551615 |
|
| wsrep_cluster_size | 0 |
|
| wsrep_cluster_state_uuid | d33e2bef-eb15-11ed-b37c-bbeed863e828 |
|
| wsrep_cluster_status | Disconnected |
|
| wsrep_connected | OFF |
|
| wsrep_local_bf_aborts | 0 |
|
| wsrep_local_index | 18446744073709551615 |
|
| wsrep_provider_capabilities | :MULTI_MASTER:CERTIFICATION:PARALLEL_APPLYING:TRX_REPLAY:ISOLATION:PAUSE:CAUSAL_READS:INCREMENTAL_WRITESET:UNORDERED:PREORDERED:STREAMING:NBO: |
|
| wsrep_provider_name | Galera |
|
| wsrep_provider_vendor | Codership Oy <info@codership.com> |
|
| wsrep_provider_version | 4.11(r7b59af73) |
|
| wsrep_ready | OFF |
|
| wsrep_rollbacker_thread_count | 1 |
|
| wsrep_thread_count | 1 |
|
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
|
And the other one:
MariaDB [(none)]> show status like "%wsrep%";
|
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
|
| Variable_name | Value |
|
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
|
| wsrep_local_state_uuid | 00000000-0000-0000-0000-000000000000 |
|
| wsrep_protocol_version | 10 |
|
| wsrep_last_committed | -1 |
|
| wsrep_replicated | 3928800 |
|
| wsrep_replicated_bytes | 6318098688 |
|
| wsrep_repl_keys | 31628277 |
|
| wsrep_repl_keys_bytes | 347319288 |
|
| wsrep_repl_data_bytes | 5696592424 |
|
| wsrep_repl_other_bytes | 0 |
|
| wsrep_received | 495184 |
|
| wsrep_received_bytes | 334286424 |
|
| wsrep_local_commits | 3928751 |
|
| wsrep_local_cert_failures | 0 |
|
| wsrep_local_replays | 0 |
|
| wsrep_local_send_queue | 0 |
|
| wsrep_local_send_queue_max | 26 |
|
| wsrep_local_send_queue_min | 0 |
|
| wsrep_local_send_queue_avg | 0.0146288 |
|
| wsrep_local_recv_queue | 0 |
|
| wsrep_local_recv_queue_max | 102 |
|
| wsrep_local_recv_queue_min | 0 |
|
| wsrep_local_recv_queue_avg | 0.0784936 |
|
| wsrep_local_cached_downto | 9752343 |
|
| wsrep_flow_control_paused_ns | 9770684545 |
|
| wsrep_flow_control_paused | 4.26199e-06 |
|
| wsrep_flow_control_sent | 48 |
|
| wsrep_flow_control_recv | 584 |
|
| wsrep_flow_control_active | false |
|
| wsrep_flow_control_requested | false |
|
| wsrep_cert_deps_distance | 23.8889 |
|
| wsrep_apply_oooe | 0.0216107 |
|
| wsrep_apply_oool | 0.0038792 |
|
| wsrep_apply_window | 1.03378 |
|
| wsrep_apply_waits | 0 |
|
| wsrep_commit_oooe | 0 |
|
| wsrep_commit_oool | 0 |
|
| wsrep_commit_window | 1.00543 |
|
| wsrep_local_state | 5 |
|
| wsrep_local_state_comment | Inconsistent |
|
| wsrep_cert_index_size | 21 |
|
| wsrep_causal_reads | 0 |
|
| wsrep_cert_interval | 152.001 |
|
| wsrep_open_transactions | 0 |
|
| wsrep_open_connections | 0 |
|
| wsrep_incoming_addresses | |
|
| wsrep_applier_thread_count | 0 |
|
| wsrep_cluster_capabilities | |
|
| wsrep_cluster_conf_id | 18446744073709551615 |
|
| wsrep_cluster_size | 0 |
|
| wsrep_cluster_state_uuid | d33e2bef-eb15-11ed-b37c-bbeed863e828 |
|
| wsrep_cluster_status | Disconnected |
|
| wsrep_connected | OFF |
|
| wsrep_local_bf_aborts | 0 |
|
| wsrep_local_index | 18446744073709551615 |
|
| wsrep_provider_capabilities | :MULTI_MASTER:CERTIFICATION:PARALLEL_APPLYING:TRX_REPLAY:ISOLATION:PAUSE:CAUSAL_READS:INCREMENTAL_WRITESET:UNORDERED:PREORDERED:STREAMING:NBO: |
|
| wsrep_provider_name | Galera |
|
| wsrep_provider_vendor | Codership Oy <info@codership.com> |
|
| wsrep_provider_version | 4.11(r7b59af73) |
|
| wsrep_ready | OFF |
|
| wsrep_rollbacker_thread_count | 1 |
|
| wsrep_thread_count | 1 |
|
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
|