[MDEV-28172] DDL statement of MYSQL leads to replication break and (3 Node MariaDB Galera Cluster) leaving node in inconsistent with group--> Leaving cluster. Created: 2022-03-25  Updated: 2022-09-20  Resolved: 2022-04-25

Status: Closed
Project: MariaDB Server
Component/s: Galera, Replication
Affects Version/s: 10.5.9, 10.5.16
Fix Version/s: N/A

Type: Bug Priority: Critical
Reporter: Pramod Mahto Assignee: Pramod Mahto
Resolution: Not a Bug Votes: 0
Labels: Migration


 Description   

Environment Details

server_id and wsrep_gtid_domain_id are same across the 3 nodes galera cluster 
 
gtid_domain_id iset to 11,12 and 13 each Galera node

 
1. MySQL 
 
	Server Version : 5.7.18
 
2. Three Node Galera Cluster (node001,noe002 and node003)
 
	Server Version : 10.5.9
 
Traditional Replication using Binary log file and Position 
 
	Master : MySQL 
	Slave : node001 (Node of 3 Node Galera cluster)

Reproducing Steps

On MYSQL 5.7.18 (Master)

mysql> create database test;
Query OK, 1 row affected (0.00 sec)
 
mysql> use test;
Database changed
mysql> CREATE TABLE `t1` (
    ->   `id` int(10) DEFAULT NULL,
    ->   `name` varchar(20) DEFAULT NULL,
    ->   KEY `id_1` (`id`)
    -> ) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4;
Query OK, 0 rows affected (0.02 sec)
 
mysql> insert into test.t1 values(10,'John');
Query OK, 1 row affected (0.01 sec)
 
mysql> insert into test.t1 values(20,'rob');
Query OK, 1 row affected (0.01 sec)
 
mysql> insert into test.t1 values(30,'Marry');
Query OK, 1 row affected (0.00 sec)
 
mysql> select * from test.t1;
+------+-------+
| id   | name  |
+------+-------+
|   10 | John  |
|   20 | rob   |
|   30 | Marry |
+------+-------+
3 rows in set (0.00 sec)
 
mysql> show binlog events in 'mysql57_bin.000001';
+--------------------+------+----------------+-----------+-------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Log_name           | Pos  | Event_type     | Server_id | End_log_pos | Info                                                                                                                                                        |
+--------------------+------+----------------+-----------+-------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
| mysql57_bin.000001 |    4 | Format_desc    |      2797 |         123 | Server ver: 5.7.18-log, Binlog ver: 4                                                                                                                       |
| mysql57_bin.000001 |  123 | Previous_gtids |      2797 |         154 |                                                                                                                                                             |
| mysql57_bin.000001 |  154 | Anonymous_Gtid |      2797 |         219 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 |  219 | Query          |      2797 |         313 | create database test                                                                                                                                        |
| mysql57_bin.000001 |  313 | Anonymous_Gtid |      2797 |         378 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 |  378 | Query          |      2797 |         595 | use `test`; CREATE TABLE `t1` (
  `id` int(10) DEFAULT NULL,
  `name` varchar(20) DEFAULT NULL,
  KEY `id_1` (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 |
| mysql57_bin.000001 |  595 | Anonymous_Gtid |      2797 |         660 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 |  660 | Query          |      2797 |         732 | BEGIN                                                                                                                                                       |
| mysql57_bin.000001 |  732 | Table_map      |      2797 |         780 | table_id: 225 (test.t1)                                                                                                                                     |
| mysql57_bin.000001 |  780 | Write_rows     |      2797 |         825 | table_id: 225 flags: STMT_END_F                                                                                                                             |
| mysql57_bin.000001 |  825 | Xid            |      2797 |         856 | COMMIT /* xid=44 */                                                                                                                                         |
| mysql57_bin.000001 |  856 | Anonymous_Gtid |      2797 |         921 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 |  921 | Query          |      2797 |         993 | BEGIN                                                                                                                                                       |
| mysql57_bin.000001 |  993 | Table_map      |      2797 |        1041 | table_id: 225 (test.t1)                                                                                                                                     |
| mysql57_bin.000001 | 1041 | Write_rows     |      2797 |        1085 | table_id: 225 flags: STMT_END_F                                                                                                                             |
| mysql57_bin.000001 | 1085 | Xid            |      2797 |        1116 | COMMIT /* xid=45 */                                                                                                                                         |
| mysql57_bin.000001 | 1116 | Anonymous_Gtid |      2797 |        1181 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 | 1181 | Query          |      2797 |        1253 | BEGIN                                                                                                                                                       |
| mysql57_bin.000001 | 1253 | Table_map      |      2797 |        1301 | table_id: 225 (test.t1)                                                                                                                                     |
| mysql57_bin.000001 | 1301 | Write_rows     |      2797 |        1347 | table_id: 225 flags: STMT_END_F                                                                                                                             |
| mysql57_bin.000001 | 1347 | Xid            |      2797 |        1378 | COMMIT /* xid=46 */                                                                                                                                         |
+--------------------+------+----------------+-----------+-------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
21 rows in set (0.00 sec)

Take mysqldump backup on MySQL 5.7

 
[root@mysql57 log]# mysqldump -u root -pMahto@128807 --master-data=2 --databases test > /tmp/test_backup.sql
 
[root@mysql57 tmp]# cat test_backup.sql |grep -i 'CHANGE MASTER TO MASTER_LOG_FILE'
-- CHANGE MASTER TO MASTER_LOG_FILE='mysql57_bin.000001', MASTER_LOG_POS=1378;

Copy backup to node001 of 3 node galera cluster.

 
[root@mysql57 tmp]# scp test_backup.sql root@192.168.47.11:/tmp/
The authenticity of host '192.168.47.11 (192.168.47.11)' can't be established.
root@192.168.47.11's password:
test_backup.sql      

On node001 Restore the backup file.

 
[root@node001 tmp]# mysql -u root -proot </tmp/test_backup.sql
 
 
MariaDB [(none)]> show global status  like 'wsrep_cluster_%';
+----------------------------+--------------------------------------+
| Variable_name              | Value                                |
+----------------------------+--------------------------------------+
| wsrep_cluster_weight       | 3                                    |
| wsrep_cluster_capabilities |                                      |
| wsrep_cluster_conf_id      | 3                                    |
| wsrep_cluster_size         | 3                                    |
| wsrep_cluster_state_uuid   | 6f95938e-a9ab-11ec-b11d-dab1913bedfb |
| wsrep_cluster_status       | Primary                              |
+----------------------------+--------------------------------------+
6 rows in set (0.001 sec)
 
MariaDB [(none)]> select * from test.t1;
+------+-------+
| id   | name  |
+------+-------+
|   10 | John  |
|   20 | rob   |
|   30 | Marry |
+------+-------+
3 rows in set (0.001 sec)

Enable replication from MySQL .7 to MariaDB 10.5.9 using binary log file and its position.

On Node001

 
MariaDB [test]> show binlog events in 'node001.000003';
+----------------+------+-------------------+-----------+-------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Log_name       | Pos  | Event_type        | Server_id | End_log_pos | Info                                                                                                                                                                                                   |
+----------------+------+-------------------+-----------+-------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| node001.000003 |    4 | Format_desc       |       900 |         256 | Server ver: 10.5.9-6-MariaDB-enterprise-log, Binlog ver: 4                                                                                                                                             |
| node001.000003 |  256 | Gtid_list         |       900 |         285 | []                                                                                                                                                                                                     |
| node001.000003 |  285 | Binlog_checkpoint |       900 |         326 | node001.000003                                                                                                                                                                                         |
| node001.000003 |  326 | Gtid              |       900 |         368 | GTID 100-900-1                                                                                                                                                                                         |
| node001.000003 |  368 | Query             |       900 |         524 | set foreign_key_checks=1, unique_checks=1; CREATE DATABASE /*!32312 IF NOT EXISTS*/ `test` /*!40100 DEFAULT CHARACTER SET utf8mb4 */                                                                   |
| node001.000003 |  524 | Gtid              |       900 |         566 | GTID 100-900-2                                                                                                                                                                                         |
| node001.000003 |  566 | Query             |       900 |         684 | use `test`; set foreign_key_checks=1, unique_checks=1; DROP TABLE IF EXISTS `t1` /* generated by server */                                                                                             |
| node001.000003 |  684 | Gtid              |       900 |         726 | GTID 100-900-3                                                                                                                                                                                         |
| node001.000003 |  726 | Query             |       900 |         936 | use `test`; set foreign_key_checks=1, unique_checks=1; CREATE TABLE `t1` (
  `id` int(10) DEFAULT NULL,
  `name` varchar(20) DEFAULT NULL,
  KEY `id_1` (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 |
| node001.000003 |  936 | Gtid              |       900 |         978 | GTID 100-900-4                                                                                                                                                                                         |
| node001.000003 |  978 | Query             |       900 |        1086 | use `test`; set foreign_key_checks=1, unique_checks=1; /*!40000 ALTER TABLE `t1` DISABLE KEYS */                                                                                                       |
| node001.000003 | 1086 | Gtid              |       900 |        1128 | BEGIN GTID 100-900-5                                                                                                                                                                                   |
| node001.000003 | 1128 | Annotate_rows     |       900 |        1210 | INSERT INTO `t1` VALUES (10,'John'),(20,'rob'),(30,'Marry')                                                                                                                                            |
| node001.000003 | 1210 | Table_map         |       900 |        1258 | table_id: 24 (test.t1)                                                                                                                                                                                 |
| node001.000003 | 1258 | Write_rows_v1     |       900 |        1321 | table_id: 24 flags: STMT_END_F                                                                                                                                                                         |
| node001.000003 | 1321 | Xid               |       900 |        1352 | COMMIT /* xid=24 */                                                                                                                                                                                    |
| node001.000003 | 1352 | Gtid              |       900 |        1394 | GTID 100-900-6                                                                                                                                                                                         |
| node001.000003 | 1394 | Query             |       900 |        1501 | use `test`; set foreign_key_checks=1, unique_checks=1; /*!40000 ALTER TABLE `t1` ENABLE KEYS */                                                                                                        |
+----------------+------+-------------------+-----------+-------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
18 rows in set (0.001 sec)
 
 
MariaDB [test]> change master to master_host='192.168.47.18', master_user='replica', master_password='Replica@128807', master_log_file='mysql57_bin.000001',master_Log_pos=1378;                                                                                                                                             Query OK, 0 rows affected (0.015 sec)
 
MariaDB [test]> start slave;
Query OK, 0 rows affected (0.003 sec)
 
MariaDB [test]> show slave status\G
*************************** 1. row ***************************
                Slave_IO_State: Waiting for master to send event
                   Master_Host: 192.168.47.18
                   Master_User: replica
                   Master_Port: 3306
                 Connect_Retry: 60
               Master_Log_File: mysql57_bin.000001
           Read_Master_Log_Pos: 1378
                Relay_Log_File: node001-relay-bin.000002
                 Relay_Log_Pos: 424
         Relay_Master_Log_File: mysql57_bin.000001
              Slave_IO_Running: Yes
             Slave_SQL_Running: Yes
               Replicate_Do_DB:
           Replicate_Ignore_DB:
            Replicate_Do_Table:
        Replicate_Ignore_Table:
       Replicate_Wild_Do_Table:
   Replicate_Wild_Ignore_Table:
                    Last_Errno: 0
                    Last_Error:
                  Skip_Counter: 0
           Exec_Master_Log_Pos: 1378
               Relay_Log_Space: 741
               Until_Condition: None
                Until_Log_File:
                 Until_Log_Pos: 0
            Master_SSL_Allowed: No
            Master_SSL_CA_File:
            Master_SSL_CA_Path:
               Master_SSL_Cert:
             Master_SSL_Cipher:
                Master_SSL_Key:
         Seconds_Behind_Master: 0
 Master_SSL_Verify_Server_Cert: No
                 Last_IO_Errno: 0
                 Last_IO_Error:
                Last_SQL_Errno: 0
                Last_SQL_Error:
   Replicate_Ignore_Server_Ids:
              Master_Server_Id: 2797
                Master_SSL_Crl:
            Master_SSL_Crlpath:
                    Using_Gtid: No
                   Gtid_IO_Pos:
       Replicate_Do_Domain_Ids:
   Replicate_Ignore_Domain_Ids:
                 Parallel_Mode: optimistic
                     SQL_Delay: 0
           SQL_Remaining_Delay: NULL
       Slave_SQL_Running_State: Slave has read all relay log; waiting for more updates
              Slave_DDL_Groups: 0
Slave_Non_Transactional_Groups: 0
    Slave_Transactional_Groups: 0
1 row in set (0.000 sec)
 
MariaDB [test]> show global status  like 'wsrep_cluster_%';
+----------------------------+--------------------------------------+
| Variable_name              | Value                                |
+----------------------------+--------------------------------------+
| wsrep_cluster_weight       | 3                                    |
| wsrep_cluster_capabilities |                                      |
| wsrep_cluster_conf_id      | 3                                    |
| wsrep_cluster_size         | 3                                    |
| wsrep_cluster_state_uuid   | 6f95938e-a9ab-11ec-b11d-dab1913bedfb |
| wsrep_cluster_status       | Primary                              |
+----------------------------+--------------------------------------+
6 rows in set (0.001 sec)

Performed some insert,update and delete on MySQL 5.7 , replication on MariaDB 105.9 (3 node galera cluster) is working fine.

Now lets create one database test2 on MYSQL 5.7 and see how it goes to 3 Node galera cluster.

 
mysql> create database test2;
Query OK, 1 row affected (0.01 sec)
 
mysql> show binlog events in 'mysql57_bin.000001';
+--------------------+------+----------------+-----------+-------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Log_name           | Pos  | Event_type     | Server_id | End_log_pos | Info                                                                                                                                                        |
+--------------------+------+----------------+-----------+-------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
| mysql57_bin.000001 |    4 | Format_desc    |      2797 |         123 | Server ver: 5.7.18-log, Binlog ver: 4                                                                                                                       |
| mysql57_bin.000001 |  123 | Previous_gtids |      2797 |         154 |                                                                                                                                                             |
| mysql57_bin.000001 |  154 | Anonymous_Gtid |      2797 |         219 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 |  219 | Query          |      2797 |         313 | create database test                                                                                                                                        |
| mysql57_bin.000001 |  313 | Anonymous_Gtid |      2797 |         378 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 |  378 | Query          |      2797 |         595 | use `test`; CREATE TABLE `t1` (
  `id` int(10) DEFAULT NULL,
  `name` varchar(20) DEFAULT NULL,
  KEY `id_1` (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 |
| mysql57_bin.000001 |  595 | Anonymous_Gtid |      2797 |         660 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 |  660 | Query          |      2797 |         732 | BEGIN                                                                                                                                                       |
| mysql57_bin.000001 |  732 | Table_map      |      2797 |         780 | table_id: 225 (test.t1)                                                                                                                                     |
| mysql57_bin.000001 |  780 | Write_rows     |      2797 |         825 | table_id: 225 flags: STMT_END_F                                                                                                                             |
| mysql57_bin.000001 |  825 | Xid            |      2797 |         856 | COMMIT /* xid=44 */                                                                                                                                         |
| mysql57_bin.000001 |  856 | Anonymous_Gtid |      2797 |         921 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 |  921 | Query          |      2797 |         993 | BEGIN                                                                                                                                                       |
| mysql57_bin.000001 |  993 | Table_map      |      2797 |        1041 | table_id: 225 (test.t1)                                                                                                                                     |
| mysql57_bin.000001 | 1041 | Write_rows     |      2797 |        1085 | table_id: 225 flags: STMT_END_F                                                                                                                             |
| mysql57_bin.000001 | 1085 | Xid            |      2797 |        1116 | COMMIT /* xid=45 */                                                                                                                                         |
| mysql57_bin.000001 | 1116 | Anonymous_Gtid |      2797 |        1181 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 | 1181 | Query          |      2797 |        1253 | BEGIN                                                                                                                                                       |
| mysql57_bin.000001 | 1253 | Table_map      |      2797 |        1301 | table_id: 225 (test.t1)                                                                                                                                     |
| mysql57_bin.000001 | 1301 | Write_rows     |      2797 |        1347 | table_id: 225 flags: STMT_END_F                                                                                                                             |
| mysql57_bin.000001 | 1347 | Xid            |      2797 |        1378 | COMMIT /* xid=46 */                                                                                                                                         |
| mysql57_bin.000001 | 1378 | Anonymous_Gtid |      2797 |        1443 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 | 1443 | Query          |      2797 |        1515 | BEGIN                                                                                                                                                       |
| mysql57_bin.000001 | 1515 | Table_map      |      2797 |        1563 | table_id: 227 (test.t1)                                                                                                                                     |
| mysql57_bin.000001 | 1563 | Write_rows     |      2797 |        1611 | table_id: 227 flags: STMT_END_F                                                                                                                             |
| mysql57_bin.000001 | 1611 | Xid            |      2797 |        1642 | COMMIT /* xid=101 */                                                                                                                                        |
| mysql57_bin.000001 | 1642 | Anonymous_Gtid |      2797 |        1707 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 | 1707 | Query          |      2797 |        1779 | BEGIN                                                                                                                                                       |
| mysql57_bin.000001 | 1779 | Table_map      |      2797 |        1827 | table_id: 227 (test.t1)                                                                                                                                     |
| mysql57_bin.000001 | 1827 | Write_rows     |      2797 |        1875 | table_id: 227 flags: STMT_END_F                                                                                                                             |
| mysql57_bin.000001 | 1875 | Xid            |      2797 |        1906 | COMMIT /* xid=102 */                                                                                                                                        |
| mysql57_bin.000001 | 1906 | Anonymous_Gtid |      2797 |        1971 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 | 1971 | Query          |      2797 |        2043 | BEGIN                                                                                                                                                       |
| mysql57_bin.000001 | 2043 | Table_map      |      2797 |        2091 | table_id: 227 (test.t1)                                                                                                                                     |
| mysql57_bin.000001 | 2091 | Write_rows     |      2797 |        2139 | table_id: 227 flags: STMT_END_F                                                                                                                             |
| mysql57_bin.000001 | 2139 | Xid            |      2797 |        2170 | COMMIT /* xid=103 */                                                                                                                                        |
| mysql57_bin.000001 | 2170 | Anonymous_Gtid |      2797 |        2235 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 | 2235 | Query          |      2797 |        2307 | BEGIN                                                                                                                                                       |
| mysql57_bin.000001 | 2307 | Table_map      |      2797 |        2355 | table_id: 227 (test.t1)                                                                                                                                     |
| mysql57_bin.000001 | 2355 | Update_rows    |      2797 |        2417 | table_id: 227 flags: STMT_END_F                                                                                                                             |
| mysql57_bin.000001 | 2417 | Xid            |      2797 |        2448 | COMMIT /* xid=105 */                                                                                                                                        |
| mysql57_bin.000001 | 2448 | Anonymous_Gtid |      2797 |        2513 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 | 2513 | Query          |      2797 |        2585 | BEGIN                                                                                                                                                       |
| mysql57_bin.000001 | 2585 | Table_map      |      2797 |        2633 | table_id: 227 (test.t1)                                                                                                                                     |
| mysql57_bin.000001 | 2633 | Delete_rows    |      2797 |        2681 | table_id: 227 flags: STMT_END_F                                                                                                                             |
| mysql57_bin.000001 | 2681 | Xid            |      2797 |        2712 | COMMIT /* xid=106 */                                                                                                                                        |
| mysql57_bin.000001 | 2712 | Anonymous_Gtid |      2797 |        2777 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 | 2777 | Query          |      2797 |        2874 | create database test2                                                                                                                                       |
| mysql57_bin.000001 | 2874 | Anonymous_Gtid |      2797 |        2939 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
| mysql57_bin.000001 | 2939 | Query          |      2797 |        3026 | drop database test2                                                                                                                                         |
+--------------------+------+----------------+-----------+-------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
50 rows in set (0.00 sec)
 

No error in MySQL 5.7

On Node001

Replication IO/SQL Thread status show running as YES , Database creation of test2 got replicated while Cluster dropped.

 
MariaDB [(none)]> show binlog events in 'node001.000003';
+----------------+------+-------------------+-----------+-------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Log_name       | Pos  | Event_type        | Server_id | End_log_pos | Info                                                                                                                                                                                                   |
+----------------+------+-------------------+-----------+-------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| node001.000003 |    4 | Format_desc       |       900 |         256 | Server ver: 10.5.9-6-MariaDB-enterprise-log, Binlog ver: 4                                                                                                                                             |
| node001.000003 |  256 | Gtid_list         |       900 |         285 | []                                                                                                                                                                                                     |
| node001.000003 |  285 | Binlog_checkpoint |       900 |         326 | node001.000003                                                                                                                                                                                         |
| node001.000003 |  326 | Gtid              |       900 |         368 | GTID 100-900-1                                                                                                                                                                                         |
| node001.000003 |  368 | Query             |       900 |         524 | set foreign_key_checks=1, unique_checks=1; CREATE DATABASE /*!32312 IF NOT EXISTS*/ `test` /*!40100 DEFAULT CHARACTER SET utf8mb4 */                                                                   |
| node001.000003 |  524 | Gtid              |       900 |         566 | GTID 100-900-2                                                                                                                                                                                         |
| node001.000003 |  566 | Query             |       900 |         684 | use `test`; set foreign_key_checks=1, unique_checks=1; DROP TABLE IF EXISTS `t1` /* generated by server */                                                                                             |
| node001.000003 |  684 | Gtid              |       900 |         726 | GTID 100-900-3                                                                                                                                                                                         |
| node001.000003 |  726 | Query             |       900 |         936 | use `test`; set foreign_key_checks=1, unique_checks=1; CREATE TABLE `t1` (
  `id` int(10) DEFAULT NULL,
  `name` varchar(20) DEFAULT NULL,
  KEY `id_1` (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 |
| node001.000003 |  936 | Gtid              |       900 |         978 | GTID 100-900-4                                                                                                                                                                                         |
| node001.000003 |  978 | Query             |       900 |        1086 | use `test`; set foreign_key_checks=1, unique_checks=1; /*!40000 ALTER TABLE `t1` DISABLE KEYS */                                                                                                       |
| node001.000003 | 1086 | Gtid              |       900 |        1128 | BEGIN GTID 100-900-5                                                                                                                                                                                   |
| node001.000003 | 1128 | Annotate_rows     |       900 |        1210 | INSERT INTO `t1` VALUES (10,'John'),(20,'rob'),(30,'Marry')                                                                                                                                            |
| node001.000003 | 1210 | Table_map         |       900 |        1258 | table_id: 24 (test.t1)                                                                                                                                                                                 |
| node001.000003 | 1258 | Write_rows_v1     |       900 |        1321 | table_id: 24 flags: STMT_END_F                                                                                                                                                                         |
| node001.000003 | 1321 | Xid               |       900 |        1352 | COMMIT /* xid=24 */                                                                                                                                                                                    |
| node001.000003 | 1352 | Gtid              |       900 |        1394 | GTID 100-900-6                                                                                                                                                                                         |
| node001.000003 | 1394 | Query             |       900 |        1501 | use `test`; set foreign_key_checks=1, unique_checks=1; /*!40000 ALTER TABLE `t1` ENABLE KEYS */                                                                                                        |
| node001.000003 | 1501 | Gtid              |       900 |        1543 | BEGIN GTID 100-900-7                                                                                                                                                                                   |
| node001.000003 | 1543 | Table_map         |      2797 |        1591 | table_id: 25 (test.t1)                                                                                                                                                                                 |
| node001.000003 | 1591 | Write_rows_v1     |      2797 |        1637 | table_id: 25 flags: STMT_END_F                                                                                                                                                                         |
| node001.000003 | 1637 | Xid               |       900 |        1668 | COMMIT /* xid=26 */                                                                                                                                                                                    |
| node001.000003 | 1668 | Gtid              |       900 |        1710 | BEGIN GTID 100-900-8                                                                                                                                                                                   |
| node001.000003 | 1710 | Table_map         |      2797 |        1758 | table_id: 25 (test.t1)                                                                                                                                                                                 |
| node001.000003 | 1758 | Write_rows_v1     |      2797 |        1804 | table_id: 25 flags: STMT_END_F                                                                                                                                                                         |
| node001.000003 | 1804 | Xid               |       900 |        1835 | COMMIT /* xid=27 */                                                                                                                                                                                    |
| node001.000003 | 1835 | Gtid              |       900 |        1877 | BEGIN GTID 100-900-9                                                                                                                                                                                   |
| node001.000003 | 1877 | Table_map         |      2797 |        1925 | table_id: 25 (test.t1)                                                                                                                                                                                 |
| node001.000003 | 1925 | Write_rows_v1     |      2797 |        1971 | table_id: 25 flags: STMT_END_F                                                                                                                                                                         |
| node001.000003 | 1971 | Xid               |       900 |        2002 | COMMIT /* xid=28 */                                                                                                                                                                                    |
| node001.000003 | 2002 | Gtid              |       900 |        2044 | BEGIN GTID 100-900-10                                                                                                                                                                                  |
| node001.000003 | 2044 | Table_map         |      2797 |        2092 | table_id: 25 (test.t1)                                                                                                                                                                                 |
| node001.000003 | 2092 | Update_rows_v1    |      2797 |        2152 | table_id: 25 flags: STMT_END_F                                                                                                                                                                         |
| node001.000003 | 2152 | Xid               |       900 |        2183 | COMMIT /* xid=29 */                                                                                                                                                                                    |
| node001.000003 | 2183 | Gtid              |       900 |        2225 | BEGIN GTID 100-900-11                                                                                                                                                                                  |
| node001.000003 | 2225 | Table_map         |      2797 |        2273 | table_id: 25 (test.t1)                                                                                                                                                                                 |
| node001.000003 | 2273 | Delete_rows_v1    |      2797 |        2319 | table_id: 25 flags: STMT_END_F                                                                                                                                                                         |
| node001.000003 | 2319 | Xid               |       900 |        2350 | COMMIT /* xid=30 */                                                                                                                                                                                    |
| node001.000003 | 2350 | Gtid              |       900 |        2392 | GTID 100-900-12                                                                                                                                                                                        |
| node001.000003 | 2392 | Query             |       900 |        2481 | create database test2                                                                                                                                                                                  |
+----------------+------+-------------------+-----------+-------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
40 rows in set (0.000 sec)
 
 
MariaDB [test]> show databases;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| mysql              |
| performance_schema |
| sys                |
| test               |
| test2              |
+--------------------+
6 rows in set (0.000 sec)
 
MariaDB [test]> show global status  like 'wsrep_cluster_%';
+----------------------------+--------------------------------------+
| Variable_name              | Value                                |
+----------------------------+--------------------------------------+
| wsrep_cluster_capabilities |                                      |
| wsrep_cluster_conf_id      | 18446744073709551615                 |
| wsrep_cluster_size         | 0                                    |
| wsrep_cluster_state_uuid   | 6f95938e-a9ab-11ec-b11d-dab1913bedfb |
| wsrep_cluster_status       | Disconnected                         |
+----------------------------+--------------------------------------+
5 rows in set (0.001 sec)

While node002 and Node003

 
MariaDB [(none)]> show global status  like 'wsrep_cluster_%';
+----------------------------+--------------------------------------+
| Variable_name              | Value                                |
+----------------------------+--------------------------------------+
| wsrep_cluster_weight       | 2                                    |
| wsrep_cluster_capabilities |                                      |
| wsrep_cluster_conf_id      | 4                                    |
| wsrep_cluster_size         | 2                                    |
| wsrep_cluster_state_uuid   | 6f95938e-a9ab-11ec-b11d-dab1913bedfb |
| wsrep_cluster_status       | Primary                              |
+----------------------------+--------------------------------------+
6 rows in set (0.001 sec)

Error log :-

Node001

 
2022-03-25  1:03:43 10 [Note] 'CHANGE MASTER TO executed'. Previous state master_host='', master_port='3306', master_log_file='', master_log_pos='4'. New state master_host='192.168.47.18', master_port='3306', master_log_file='mysql57_bin.000001', master_log_pos='1378'.
2022-03-25  1:03:47 11 [Note] Slave I/O thread: Start asynchronous replication to master 'replica@192.168.47.18:3306' in log 'mysql57_bin.000001' at position 1378
2022-03-25  1:03:47 12 [Note] Slave SQL thread initialized, starting replication in log 'mysql57_bin.000001' at position 1378, relay log './node001-relay-bin.000001' position: 4
2022-03-25  1:03:47 11 [Note] Slave I/O thread: connected to master 'replica@192.168.47.18:3306',replication started in log 'mysql57_bin.000001' at position 1378
2022-03-25  1:08:37 0 [Note] WSREP: Member 1(ohcimaria02m) initiates vote on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53:  Storage engine InnoDB of the table `test`.`t1` doesn't have this option, Error_code: 1031;
2022-03-25  1:08:37 0 [Note] WSREP: Votes over 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31:
   f6875b17d3c93d53:   1/3
Waiting for more votes.
2022-03-25  1:08:37 0 [Note] WSREP: Member 2(ohcimaria03m) initiates vote on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53:  Storage engine InnoDB of the table `test`.`t1` doesn't have this option, Error_code: 1031;
2022-03-25  1:08:37 0 [Note] WSREP: Votes over 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31:
   f6875b17d3c93d53:   2/3
Winner: f6875b17d3c93d53
2022-03-25  1:08:37 2 [Note] WSREP: Got vote request for seqno 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31
2022-03-25  1:08:37 0 [Note] WSREP: Recovering vote result from history: 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53
2022-03-25  1:08:37 2 [ERROR] WSREP: Vote 0 (success) on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31 is inconsistent with group. Leaving cluster.
2022-03-25  1:08:37 2 [Note] WSREP: Closing send monitor...
2022-03-25  1:08:37 2 [Note] WSREP: Closed send monitor.
2022-03-25  1:08:37 2 [Note] WSREP: gcomm: terminating thread
2022-03-25  1:08:37 2 [Note] WSREP: gcomm: joining thread
2022-03-25  1:08:37 2 [Note] WSREP: gcomm: closing backend
2022-03-25  1:08:37 2 [Note] WSREP: view(view_id(NON_PRIM,7cbb1ffa-84ee,3) memb {
        7cbb1ffa-84ee,0
} joined {
} left {
} partitioned {
        87d88297-be21,0
        8a783c88-891a,0
})
2022-03-25  1:08:37 2 [Note] WSREP: PC protocol downgrade 1 -> 0
2022-03-25  1:08:37 2 [Note] WSREP: view((empty))
2022-03-25  1:08:37 2 [Note] WSREP: gcomm: closed
2022-03-25  1:08:37 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
2022-03-25  1:08:37 0 [Note] WSREP: Flow-control interval: [16, 16]
2022-03-25  1:08:37 0 [Note] WSREP: Received NON-PRIMARY.
2022-03-25  1:08:37 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 31)
2022-03-25  1:08:37 0 [Note] WSREP: New SELF-LEAVE.
2022-03-25  1:08:37 0 [Note] WSREP: Flow-control interval: [0, 0]
2022-03-25  1:08:37 0 [Note] WSREP: Received SELF-LEAVE. Closing connection.
2022-03-25  1:08:37 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 31)
2022-03-25  1:08:37 0 [Note] WSREP: RECV thread exiting 0: Success
2022-03-25  1:08:37 2 [Note] WSREP: recv_thread() joined.
2022-03-25  1:08:37 2 [Note] WSREP: Closing replication queue.
2022-03-25  1:08:37 2 [Note] WSREP: Closing slave action queue.
2022-03-25  1:08:37 2 [Note] WSREP: ================================================
View:
  id: 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31
  status: non-primary
  protocol_version: 4
  capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
  final: no
  own_index: 0
  members(1):
        0: 7cbb1ffa-abf7-11ec-84ee-aef4b648d4fe, ohcimaria01m
=================================================
2022-03-25  1:08:37 2 [Note] WSREP: Non-primary view
2022-03-25  1:08:37 2 [Note] WSREP: Server status change synced -> connected
2022-03-25  1:08:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-03-25  1:08:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-03-25  1:08:37 2 [Note] WSREP: ================================================
View:
  id: 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31
  status: non-primary
  protocol_version: 4
  capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
  final: yes
  own_index: -1
  members(0):
=================================================
2022-03-25  1:08:37 2 [Note] WSREP: Non-primary view
2022-03-25  1:08:37 2 [Note] WSREP: Server status change connected -> disconnected
2022-03-25  1:08:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-03-25  1:08:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-03-25  1:08:37 0 [Note] WSREP: Service thread queue flushed.
2022-03-25  1:08:37 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: 5
2022-03-25  1:08:37 2 [Note] WSREP: Applier thread exiting ret: 0 thd: 2

Node002

 
2022-03-25  1:08:37 2 [ERROR] Error in Log_event::read_log_event(): 'Found invalid event in binary log', data_len: 42, event_type: -94
2022-03-25  1:08:37 2 [ERROR] WSREP: applier could not read binlog event, seqno: 31, len: 89
2022-03-25  1:08:37 0 [Note] WSREP: Member 1(ohcimaria02m) initiates vote on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53:  Storage engine InnoDB of the table `test`.`t1` doesn't have this option, Error_code: 1031;
2022-03-25  1:08:37 0 [Note] WSREP: Votes over 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31:
   f6875b17d3c93d53:   1/3
Waiting for more votes.
2022-03-25  1:08:37 0 [Note] WSREP: Member 2(ohcimaria03m) initiates vote on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53:  Storage engine InnoDB of the table `test`.`t1` doesn't have this option, Error_code: 1031;
2022-03-25  1:08:37 0 [Note] WSREP: Votes over 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31:
   f6875b17d3c93d53:   2/3
Winner: f6875b17d3c93d53
2022-03-25  1:08:37 0 [Note] WSREP: declaring 8a783c88-891a at tcp://192.168.47.14:4567 stable
2022-03-25  1:08:37 0 [Note] WSREP: forgetting 7cbb1ffa-84ee (tcp://192.168.47.11:4567)
2022-03-25  1:08:37 0 [Note] WSREP: Node 87d88297-be21 state prim
2022-03-25  1:08:37 0 [Note] WSREP: view(view_id(PRIM,87d88297-be21,4) memb {
        87d88297-be21,0
        8a783c88-891a,0
} joined {
} left {
} partitioned {
        7cbb1ffa-84ee,0
})
2022-03-25  1:08:37 0 [Note] WSREP: save pc into disk
2022-03-25  1:08:37 0 [Note] WSREP: forgetting 7cbb1ffa-84ee (tcp://192.168.47.11:4567)
2022-03-25  1:08:37 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2
2022-03-25  1:08:37 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a0efcdeb-abf9-11ec-bb55-a654fec48f17
2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a0efcdeb-abf9-11ec-bb55-a654fec48f17
2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: got state msg: a0efcdeb-abf9-11ec-bb55-a654fec48f17 from 0 (ohcimaria02m)
2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: got state msg: a0efcdeb-abf9-11ec-bb55-a654fec48f17 from 1 (ohcimaria03m)
2022-03-25  1:08:37 0 [Note] WSREP: Quorum results:
        version    = 6,
        component  = PRIMARY,
        conf_id    = 3,
        members    = 2/2 (joined/total),
        act_id     = 31,
        last_appl. = 16,
        protocols  = 2/10/4 (gcs/repl/appl),
        vote policy= 0,
        group UUID = 6f95938e-a9ab-11ec-b11d-dab1913bedfb
2022-03-25  1:08:37 0 [Note] WSREP: Flow-control interval: [23, 23]
2022-03-25  1:08:37 2 [Note] WSREP: ####### processing CC 32, local, ordered
2022-03-25  1:08:37 2 [Note] WSREP: ####### My UUID: 87d88297-abf7-11ec-be21-d70c093ba375
2022-03-25  1:08:37 2 [Note] WSREP: Skipping cert index reset
2022-03-25  1:08:37 2 [Note] WSREP: REPL Protocols: 10 (5)
2022-03-25  1:08:37 2 [Note] WSREP: ####### Adjusting cert position: 31 -> 32
2022-03-25  1:08:37 0 [Note] WSREP: Service thread queue flushed.
2022-03-25  1:08:37 2 [Note] WSREP: ================================================
View:
  id: 6f95938e-a9ab-11ec-b11d-dab1913bedfb:32
  status: primary
  protocol_version: 4
  capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
  final: no
  own_index: 0
  members(2):
        0: 87d88297-abf7-11ec-be21-d70c093ba375, ohcimaria02m
        1: 8a783c88-abf7-11ec-891a-6bd4db5d6579, ohcimaria03m
=================================================
2022-03-25  1:08:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-03-25  1:08:37 2 [Note] WSREP: Lowest cert index boundary for CC from group: 20
2022-03-25  1:08:37 2 [Note] WSREP: Min available from gcache for CC from group: 2
2022-03-25  1:08:42 0 [Note] WSREP:  cleaning up 7cbb1ffa-84ee (tcp://192.168.47.11:4567)

Node003

 
2022-03-25  1:08:37 2 [ERROR] Error in Log_event::read_log_event(): 'Found invalid event in binary log', data_len: 42, event_type: -94
2022-03-25  1:08:37 2 [ERROR] WSREP: applier could not read binlog event, seqno: 31, len: 89
2022-03-25  1:08:37 0 [Note] WSREP: Member 1(ohcimaria02m) initiates vote on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53:  Storage engine InnoDB of the table `test`.`t1` doesn't have this option, Error_code: 1031;
2022-03-25  1:08:37 0 [Note] WSREP: Votes over 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31:
   f6875b17d3c93d53:   1/3
Waiting for more votes.
2022-03-25  1:08:37 0 [Note] WSREP: Member 2(ohcimaria03m) initiates vote on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53:  Storage engine InnoDB of the table `test`.`t1` doesn't have this option, Error_code: 1031;
2022-03-25  1:08:37 0 [Note] WSREP: Votes over 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31:
   f6875b17d3c93d53:   2/3
Winner: f6875b17d3c93d53
2022-03-25  1:08:37 2 [Note] WSREP: Got vote request for seqno 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31
2022-03-25  1:08:37 2 [Note] WSREP: 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31 already voted on. Continue.
2022-03-25  1:08:37 0 [Note] WSREP: declaring 87d88297-be21 at tcp://192.168.47.12:4567 stable
2022-03-25  1:08:37 0 [Note] WSREP: Deferred close timer started for socket with remote endpoint: tcp://192.168.47.11:4567
2022-03-25  1:08:37 0 [Note] WSREP: forgetting 7cbb1ffa-84ee (tcp://192.168.47.11:4567)
2022-03-25  1:08:37 0 [Note] WSREP: Deferred close timer handle_wait asio.system:125 for 0x55a3303fcf88
2022-03-25  1:08:37 0 [Note] WSREP: Deferred close timer destruct
2022-03-25  1:08:37 0 [Note] WSREP: Node 87d88297-be21 state prim
2022-03-25  1:08:37 0 [Note] WSREP: view(view_id(PRIM,87d88297-be21,4) memb {
        87d88297-be21,0
        8a783c88-891a,0
} joined {
} left {
} partitioned {
        7cbb1ffa-84ee,0
})
2022-03-25  1:08:37 0 [Note] WSREP: save pc into disk
2022-03-25  1:08:37 0 [Note] WSREP: forgetting 7cbb1ffa-84ee (tcp://192.168.47.11:4567)
2022-03-25  1:08:37 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a0efcdeb-abf9-11ec-bb55-a654fec48f17
2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: got state msg: a0efcdeb-abf9-11ec-bb55-a654fec48f17 from 0 (ohcimaria02m)
2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: got state msg: a0efcdeb-abf9-11ec-bb55-a654fec48f17 from 1 (ohcimaria03m)
2022-03-25  1:08:37 0 [Note] WSREP: Quorum results:
        version    = 6,
        component  = PRIMARY,
        conf_id    = 3,
        members    = 2/2 (joined/total),
        act_id     = 31,
        last_appl. = 16,
        protocols  = 2/10/4 (gcs/repl/appl),
        vote policy= 0,
        group UUID = 6f95938e-a9ab-11ec-b11d-dab1913bedfb
2022-03-25  1:08:37 0 [Note] WSREP: Flow-control interval: [23, 23]
2022-03-25  1:08:37 2 [Note] WSREP: ####### processing CC 32, local, ordered
2022-03-25  1:08:37 2 [Note] WSREP: ####### My UUID: 8a783c88-abf7-11ec-891a-6bd4db5d6579
2022-03-25  1:08:37 2 [Note] WSREP: Skipping cert index reset
2022-03-25  1:08:37 2 [Note] WSREP: REPL Protocols: 10 (5)
2022-03-25  1:08:37 2 [Note] WSREP: ####### Adjusting cert position: 31 -> 32
2022-03-25  1:08:37 0 [Note] WSREP: Service thread queue flushed.
2022-03-25  1:08:37 2 [Note] WSREP: ================================================
View:
  id: 6f95938e-a9ab-11ec-b11d-dab1913bedfb:32
  status: primary
  protocol_version: 4
  capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
  final: no
  own_index: 1
  members(2):
        0: 87d88297-abf7-11ec-be21-d70c093ba375, ohcimaria02m
        1: 8a783c88-abf7-11ec-891a-6bd4db5d6579, ohcimaria03m
=================================================
2022-03-25  1:08:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-03-25  1:08:37 2 [Note] WSREP: Lowest cert index boundary for CC from group: 20
2022-03-25  1:08:37 2 [Note] WSREP: Min available from gcache for CC from group: 2
2022-03-25  1:08:43 0 [Note] WSREP:  cleaning up 7cbb1ffa-84ee (tcp://192.168.47.11:4567)

Now Execute another DDL command on MySQL 5.7

 
mysql> drop database test2 ;
Query OK, 0 rows affected (0.00 sec)

On node001

 
MariaDB [(none)]> show slave status\G
*************************** 1. row ***************************
                Slave_IO_State: Waiting for master to send event
                   Master_Host: 192.168.47.18
                   Master_User: replica
                   Master_Port: 3306
                 Connect_Retry: 60
               Master_Log_File: mysql57_bin.000001
           Read_Master_Log_Pos: 3026
                Relay_Log_File: node001-relay-bin.000002
                 Relay_Log_Pos: 1530
         Relay_Master_Log_File: mysql57_bin.000001
              Slave_IO_Running: Yes
             Slave_SQL_Running: No
               Replicate_Do_DB:
           Replicate_Ignore_DB:
            Replicate_Do_Table:
        Replicate_Ignore_Table:
       Replicate_Wild_Do_Table:
   Replicate_Wild_Ignore_Table:
                    Last_Errno: 1047
                    Last_Error: Node has dropped from cluster
                  Skip_Counter: 0
           Exec_Master_Log_Pos: 2874
               Relay_Log_Space: 1934
               Until_Condition: None
                Until_Log_File:
                 Until_Log_Pos: 0
            Master_SSL_Allowed: No
            Master_SSL_CA_File:
            Master_SSL_CA_Path:
               Master_SSL_Cert:
             Master_SSL_Cipher:
                Master_SSL_Key:
         Seconds_Behind_Master: NULL
 Master_SSL_Verify_Server_Cert: No
                 Last_IO_Errno: 0
                 Last_IO_Error:
                Last_SQL_Errno: 1047
                Last_SQL_Error: Node has dropped from cluster
   Replicate_Ignore_Server_Ids:
              Master_Server_Id: 2797
                Master_SSL_Crl:
            Master_SSL_Crlpath:
                    Using_Gtid: No
                   Gtid_IO_Pos:
       Replicate_Do_Domain_Ids:
   Replicate_Ignore_Domain_Ids:
                 Parallel_Mode: optimistic
                     SQL_Delay: 0
           SQL_Remaining_Delay: NULL
       Slave_SQL_Running_State:
              Slave_DDL_Groups: 0
Slave_Non_Transactional_Groups: 0
    Slave_Transactional_Groups: 0
1 row in set (0.000 sec)

Node001 Error log

 
 
2022-03-25  1:17:29 12 [Warning] WSREP: TO isolation failed for: 1, schema: test2, sql: drop database test2. Check your wsrep connection state and retry the query.
2022-03-25  1:17:29 12 [ERROR] Slave SQL: Error 'Deadlock found when trying to get lock; try restarting transaction' on query. Default database: 'test2'. Query: 'drop database test2', Internal MariaDB error code: 1213
2022-03-25  1:17:29 12 [ERROR] Slave SQL: Node has dropped from cluster, Internal MariaDB error code: 1047
2022-03-25  1:17:29 12 [Note] Slave SQL thread exiting, replication stopped in log 'mysql57_bin.000001' at position 2874
2022-03-25  1:17:29 12 [Note] master was 192.168.47.18:3306
2022-03-25  1:17:29 12 [Note] WSREP: Slave error due to node going non-primary
2022-03-25  1:17:29 12 [Note] WSREP: wsrep_restart_slave was set and therefore slave will be automatically restarted when node joins back to cluster

Node002 & Node003 continued as a 2 Node Galera cluster.



 Comments   
Comment by Pramod Mahto [ 2022-03-25 ]

If we set wsrep_gtid_mode=OFF on each node of the Galera cluster then entire cluster goes down with wsrep_local_state_comment=Inconsistent

{{MariaDB [(none)]> show global status like 'wsrep_cluster_%';
----------------------------------------------------------------+

Variable_name Value

----------------------------------------------------------------+

wsrep_cluster_capabilities  
wsrep_cluster_conf_id 18446744073709551615
wsrep_cluster_size 0
wsrep_cluster_state_uuid 5e384c39-ac16-11ec-bc2f-be8f0b8f175b
wsrep_cluster_status Disconnected

----------------------------------------------------------------+
5 rows in set (0.000 sec)}}

Generated at Thu Feb 08 09:58:39 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.