Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-28172

DDL statement of MYSQL leads to replication break and (3 Node MariaDB Galera Cluster) leaving node in inconsistent with group--> Leaving cluster.

    XMLWordPrintable

Details

    Description

      Environment Details

      server_id and wsrep_gtid_domain_id are same across the 3 nodes galera cluster 
       
      gtid_domain_id iset to 11,12 and 13 each Galera node
      
      

       
      1. MySQL 
       
      	Server Version : 5.7.18
       
      2. Three Node Galera Cluster (node001,noe002 and node003)
       
      	Server Version : 10.5.9
       
      Traditional Replication using Binary log file and Position 
       
      	Master : MySQL 
      	Slave : node001 (Node of 3 Node Galera cluster)
      
      

      Reproducing Steps

      On MYSQL 5.7.18 (Master)

      mysql> create database test;
      Query OK, 1 row affected (0.00 sec)
       
      mysql> use test;
      Database changed
      mysql> CREATE TABLE `t1` (
          ->   `id` int(10) DEFAULT NULL,
          ->   `name` varchar(20) DEFAULT NULL,
          ->   KEY `id_1` (`id`)
          -> ) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4;
      Query OK, 0 rows affected (0.02 sec)
       
      mysql> insert into test.t1 values(10,'John');
      Query OK, 1 row affected (0.01 sec)
       
      mysql> insert into test.t1 values(20,'rob');
      Query OK, 1 row affected (0.01 sec)
       
      mysql> insert into test.t1 values(30,'Marry');
      Query OK, 1 row affected (0.00 sec)
       
      mysql> select * from test.t1;
      +------+-------+
      | id   | name  |
      +------+-------+
      |   10 | John  |
      |   20 | rob   |
      |   30 | Marry |
      +------+-------+
      3 rows in set (0.00 sec)
       
      mysql> show binlog events in 'mysql57_bin.000001';
      +--------------------+------+----------------+-----------+-------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | Log_name           | Pos  | Event_type     | Server_id | End_log_pos | Info                                                                                                                                                        |
      +--------------------+------+----------------+-----------+-------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | mysql57_bin.000001 |    4 | Format_desc    |      2797 |         123 | Server ver: 5.7.18-log, Binlog ver: 4                                                                                                                       |
      | mysql57_bin.000001 |  123 | Previous_gtids |      2797 |         154 |                                                                                                                                                             |
      | mysql57_bin.000001 |  154 | Anonymous_Gtid |      2797 |         219 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 |  219 | Query          |      2797 |         313 | create database test                                                                                                                                        |
      | mysql57_bin.000001 |  313 | Anonymous_Gtid |      2797 |         378 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 |  378 | Query          |      2797 |         595 | use `test`; CREATE TABLE `t1` (
        `id` int(10) DEFAULT NULL,
        `name` varchar(20) DEFAULT NULL,
        KEY `id_1` (`id`)
      ) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 |
      | mysql57_bin.000001 |  595 | Anonymous_Gtid |      2797 |         660 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 |  660 | Query          |      2797 |         732 | BEGIN                                                                                                                                                       |
      | mysql57_bin.000001 |  732 | Table_map      |      2797 |         780 | table_id: 225 (test.t1)                                                                                                                                     |
      | mysql57_bin.000001 |  780 | Write_rows     |      2797 |         825 | table_id: 225 flags: STMT_END_F                                                                                                                             |
      | mysql57_bin.000001 |  825 | Xid            |      2797 |         856 | COMMIT /* xid=44 */                                                                                                                                         |
      | mysql57_bin.000001 |  856 | Anonymous_Gtid |      2797 |         921 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 |  921 | Query          |      2797 |         993 | BEGIN                                                                                                                                                       |
      | mysql57_bin.000001 |  993 | Table_map      |      2797 |        1041 | table_id: 225 (test.t1)                                                                                                                                     |
      | mysql57_bin.000001 | 1041 | Write_rows     |      2797 |        1085 | table_id: 225 flags: STMT_END_F                                                                                                                             |
      | mysql57_bin.000001 | 1085 | Xid            |      2797 |        1116 | COMMIT /* xid=45 */                                                                                                                                         |
      | mysql57_bin.000001 | 1116 | Anonymous_Gtid |      2797 |        1181 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 | 1181 | Query          |      2797 |        1253 | BEGIN                                                                                                                                                       |
      | mysql57_bin.000001 | 1253 | Table_map      |      2797 |        1301 | table_id: 225 (test.t1)                                                                                                                                     |
      | mysql57_bin.000001 | 1301 | Write_rows     |      2797 |        1347 | table_id: 225 flags: STMT_END_F                                                                                                                             |
      | mysql57_bin.000001 | 1347 | Xid            |      2797 |        1378 | COMMIT /* xid=46 */                                                                                                                                         |
      +--------------------+------+----------------+-----------+-------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
      21 rows in set (0.00 sec)
      
      

      Take mysqldump backup on MySQL 5.7

       
      [root@mysql57 log]# mysqldump -u root -pMahto@128807 --master-data=2 --databases test > /tmp/test_backup.sql
       
      [root@mysql57 tmp]# cat test_backup.sql |grep -i 'CHANGE MASTER TO MASTER_LOG_FILE'
      -- CHANGE MASTER TO MASTER_LOG_FILE='mysql57_bin.000001', MASTER_LOG_POS=1378;
      
      

      Copy backup to node001 of 3 node galera cluster.

       
      [root@mysql57 tmp]# scp test_backup.sql root@192.168.47.11:/tmp/
      The authenticity of host '192.168.47.11 (192.168.47.11)' can't be established.
      root@192.168.47.11's password:
      test_backup.sql      
      
      

      On node001 Restore the backup file.

       
      [root@node001 tmp]# mysql -u root -proot </tmp/test_backup.sql
       
       
      MariaDB [(none)]> show global status  like 'wsrep_cluster_%';
      +----------------------------+--------------------------------------+
      | Variable_name              | Value                                |
      +----------------------------+--------------------------------------+
      | wsrep_cluster_weight       | 3                                    |
      | wsrep_cluster_capabilities |                                      |
      | wsrep_cluster_conf_id      | 3                                    |
      | wsrep_cluster_size         | 3                                    |
      | wsrep_cluster_state_uuid   | 6f95938e-a9ab-11ec-b11d-dab1913bedfb |
      | wsrep_cluster_status       | Primary                              |
      +----------------------------+--------------------------------------+
      6 rows in set (0.001 sec)
       
      MariaDB [(none)]> select * from test.t1;
      +------+-------+
      | id   | name  |
      +------+-------+
      |   10 | John  |
      |   20 | rob   |
      |   30 | Marry |
      +------+-------+
      3 rows in set (0.001 sec)
      
      

      Enable replication from MySQL .7 to MariaDB 10.5.9 using binary log file and its position.

      On Node001

       
      MariaDB [test]> show binlog events in 'node001.000003';
      +----------------+------+-------------------+-----------+-------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | Log_name       | Pos  | Event_type        | Server_id | End_log_pos | Info                                                                                                                                                                                                   |
      +----------------+------+-------------------+-----------+-------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | node001.000003 |    4 | Format_desc       |       900 |         256 | Server ver: 10.5.9-6-MariaDB-enterprise-log, Binlog ver: 4                                                                                                                                             |
      | node001.000003 |  256 | Gtid_list         |       900 |         285 | []                                                                                                                                                                                                     |
      | node001.000003 |  285 | Binlog_checkpoint |       900 |         326 | node001.000003                                                                                                                                                                                         |
      | node001.000003 |  326 | Gtid              |       900 |         368 | GTID 100-900-1                                                                                                                                                                                         |
      | node001.000003 |  368 | Query             |       900 |         524 | set foreign_key_checks=1, unique_checks=1; CREATE DATABASE /*!32312 IF NOT EXISTS*/ `test` /*!40100 DEFAULT CHARACTER SET utf8mb4 */                                                                   |
      | node001.000003 |  524 | Gtid              |       900 |         566 | GTID 100-900-2                                                                                                                                                                                         |
      | node001.000003 |  566 | Query             |       900 |         684 | use `test`; set foreign_key_checks=1, unique_checks=1; DROP TABLE IF EXISTS `t1` /* generated by server */                                                                                             |
      | node001.000003 |  684 | Gtid              |       900 |         726 | GTID 100-900-3                                                                                                                                                                                         |
      | node001.000003 |  726 | Query             |       900 |         936 | use `test`; set foreign_key_checks=1, unique_checks=1; CREATE TABLE `t1` (
        `id` int(10) DEFAULT NULL,
        `name` varchar(20) DEFAULT NULL,
        KEY `id_1` (`id`)
      ) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 |
      | node001.000003 |  936 | Gtid              |       900 |         978 | GTID 100-900-4                                                                                                                                                                                         |
      | node001.000003 |  978 | Query             |       900 |        1086 | use `test`; set foreign_key_checks=1, unique_checks=1; /*!40000 ALTER TABLE `t1` DISABLE KEYS */                                                                                                       |
      | node001.000003 | 1086 | Gtid              |       900 |        1128 | BEGIN GTID 100-900-5                                                                                                                                                                                   |
      | node001.000003 | 1128 | Annotate_rows     |       900 |        1210 | INSERT INTO `t1` VALUES (10,'John'),(20,'rob'),(30,'Marry')                                                                                                                                            |
      | node001.000003 | 1210 | Table_map         |       900 |        1258 | table_id: 24 (test.t1)                                                                                                                                                                                 |
      | node001.000003 | 1258 | Write_rows_v1     |       900 |        1321 | table_id: 24 flags: STMT_END_F                                                                                                                                                                         |
      | node001.000003 | 1321 | Xid               |       900 |        1352 | COMMIT /* xid=24 */                                                                                                                                                                                    |
      | node001.000003 | 1352 | Gtid              |       900 |        1394 | GTID 100-900-6                                                                                                                                                                                         |
      | node001.000003 | 1394 | Query             |       900 |        1501 | use `test`; set foreign_key_checks=1, unique_checks=1; /*!40000 ALTER TABLE `t1` ENABLE KEYS */                                                                                                        |
      +----------------+------+-------------------+-----------+-------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
      18 rows in set (0.001 sec)
       
       
      MariaDB [test]> change master to master_host='192.168.47.18', master_user='replica', master_password='Replica@128807', master_log_file='mysql57_bin.000001',master_Log_pos=1378;                                                                                                                                             Query OK, 0 rows affected (0.015 sec)
       
      MariaDB [test]> start slave;
      Query OK, 0 rows affected (0.003 sec)
       
      MariaDB [test]> show slave status\G
      *************************** 1. row ***************************
                      Slave_IO_State: Waiting for master to send event
                         Master_Host: 192.168.47.18
                         Master_User: replica
                         Master_Port: 3306
                       Connect_Retry: 60
                     Master_Log_File: mysql57_bin.000001
                 Read_Master_Log_Pos: 1378
                      Relay_Log_File: node001-relay-bin.000002
                       Relay_Log_Pos: 424
               Relay_Master_Log_File: mysql57_bin.000001
                    Slave_IO_Running: Yes
                   Slave_SQL_Running: Yes
                     Replicate_Do_DB:
                 Replicate_Ignore_DB:
                  Replicate_Do_Table:
              Replicate_Ignore_Table:
             Replicate_Wild_Do_Table:
         Replicate_Wild_Ignore_Table:
                          Last_Errno: 0
                          Last_Error:
                        Skip_Counter: 0
                 Exec_Master_Log_Pos: 1378
                     Relay_Log_Space: 741
                     Until_Condition: None
                      Until_Log_File:
                       Until_Log_Pos: 0
                  Master_SSL_Allowed: No
                  Master_SSL_CA_File:
                  Master_SSL_CA_Path:
                     Master_SSL_Cert:
                   Master_SSL_Cipher:
                      Master_SSL_Key:
               Seconds_Behind_Master: 0
       Master_SSL_Verify_Server_Cert: No
                       Last_IO_Errno: 0
                       Last_IO_Error:
                      Last_SQL_Errno: 0
                      Last_SQL_Error:
         Replicate_Ignore_Server_Ids:
                    Master_Server_Id: 2797
                      Master_SSL_Crl:
                  Master_SSL_Crlpath:
                          Using_Gtid: No
                         Gtid_IO_Pos:
             Replicate_Do_Domain_Ids:
         Replicate_Ignore_Domain_Ids:
                       Parallel_Mode: optimistic
                           SQL_Delay: 0
                 SQL_Remaining_Delay: NULL
             Slave_SQL_Running_State: Slave has read all relay log; waiting for more updates
                    Slave_DDL_Groups: 0
      Slave_Non_Transactional_Groups: 0
          Slave_Transactional_Groups: 0
      1 row in set (0.000 sec)
       
      MariaDB [test]> show global status  like 'wsrep_cluster_%';
      +----------------------------+--------------------------------------+
      | Variable_name              | Value                                |
      +----------------------------+--------------------------------------+
      | wsrep_cluster_weight       | 3                                    |
      | wsrep_cluster_capabilities |                                      |
      | wsrep_cluster_conf_id      | 3                                    |
      | wsrep_cluster_size         | 3                                    |
      | wsrep_cluster_state_uuid   | 6f95938e-a9ab-11ec-b11d-dab1913bedfb |
      | wsrep_cluster_status       | Primary                              |
      +----------------------------+--------------------------------------+
      6 rows in set (0.001 sec)
      
      

      Performed some insert,update and delete on MySQL 5.7 , replication on MariaDB 105.9 (3 node galera cluster) is working fine.

      Now lets create one database test2 on MYSQL 5.7 and see how it goes to 3 Node galera cluster.

       
      mysql> create database test2;
      Query OK, 1 row affected (0.01 sec)
       
      mysql> show binlog events in 'mysql57_bin.000001';
      +--------------------+------+----------------+-----------+-------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | Log_name           | Pos  | Event_type     | Server_id | End_log_pos | Info                                                                                                                                                        |
      +--------------------+------+----------------+-----------+-------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | mysql57_bin.000001 |    4 | Format_desc    |      2797 |         123 | Server ver: 5.7.18-log, Binlog ver: 4                                                                                                                       |
      | mysql57_bin.000001 |  123 | Previous_gtids |      2797 |         154 |                                                                                                                                                             |
      | mysql57_bin.000001 |  154 | Anonymous_Gtid |      2797 |         219 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 |  219 | Query          |      2797 |         313 | create database test                                                                                                                                        |
      | mysql57_bin.000001 |  313 | Anonymous_Gtid |      2797 |         378 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 |  378 | Query          |      2797 |         595 | use `test`; CREATE TABLE `t1` (
        `id` int(10) DEFAULT NULL,
        `name` varchar(20) DEFAULT NULL,
        KEY `id_1` (`id`)
      ) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 |
      | mysql57_bin.000001 |  595 | Anonymous_Gtid |      2797 |         660 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 |  660 | Query          |      2797 |         732 | BEGIN                                                                                                                                                       |
      | mysql57_bin.000001 |  732 | Table_map      |      2797 |         780 | table_id: 225 (test.t1)                                                                                                                                     |
      | mysql57_bin.000001 |  780 | Write_rows     |      2797 |         825 | table_id: 225 flags: STMT_END_F                                                                                                                             |
      | mysql57_bin.000001 |  825 | Xid            |      2797 |         856 | COMMIT /* xid=44 */                                                                                                                                         |
      | mysql57_bin.000001 |  856 | Anonymous_Gtid |      2797 |         921 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 |  921 | Query          |      2797 |         993 | BEGIN                                                                                                                                                       |
      | mysql57_bin.000001 |  993 | Table_map      |      2797 |        1041 | table_id: 225 (test.t1)                                                                                                                                     |
      | mysql57_bin.000001 | 1041 | Write_rows     |      2797 |        1085 | table_id: 225 flags: STMT_END_F                                                                                                                             |
      | mysql57_bin.000001 | 1085 | Xid            |      2797 |        1116 | COMMIT /* xid=45 */                                                                                                                                         |
      | mysql57_bin.000001 | 1116 | Anonymous_Gtid |      2797 |        1181 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 | 1181 | Query          |      2797 |        1253 | BEGIN                                                                                                                                                       |
      | mysql57_bin.000001 | 1253 | Table_map      |      2797 |        1301 | table_id: 225 (test.t1)                                                                                                                                     |
      | mysql57_bin.000001 | 1301 | Write_rows     |      2797 |        1347 | table_id: 225 flags: STMT_END_F                                                                                                                             |
      | mysql57_bin.000001 | 1347 | Xid            |      2797 |        1378 | COMMIT /* xid=46 */                                                                                                                                         |
      | mysql57_bin.000001 | 1378 | Anonymous_Gtid |      2797 |        1443 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 | 1443 | Query          |      2797 |        1515 | BEGIN                                                                                                                                                       |
      | mysql57_bin.000001 | 1515 | Table_map      |      2797 |        1563 | table_id: 227 (test.t1)                                                                                                                                     |
      | mysql57_bin.000001 | 1563 | Write_rows     |      2797 |        1611 | table_id: 227 flags: STMT_END_F                                                                                                                             |
      | mysql57_bin.000001 | 1611 | Xid            |      2797 |        1642 | COMMIT /* xid=101 */                                                                                                                                        |
      | mysql57_bin.000001 | 1642 | Anonymous_Gtid |      2797 |        1707 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 | 1707 | Query          |      2797 |        1779 | BEGIN                                                                                                                                                       |
      | mysql57_bin.000001 | 1779 | Table_map      |      2797 |        1827 | table_id: 227 (test.t1)                                                                                                                                     |
      | mysql57_bin.000001 | 1827 | Write_rows     |      2797 |        1875 | table_id: 227 flags: STMT_END_F                                                                                                                             |
      | mysql57_bin.000001 | 1875 | Xid            |      2797 |        1906 | COMMIT /* xid=102 */                                                                                                                                        |
      | mysql57_bin.000001 | 1906 | Anonymous_Gtid |      2797 |        1971 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 | 1971 | Query          |      2797 |        2043 | BEGIN                                                                                                                                                       |
      | mysql57_bin.000001 | 2043 | Table_map      |      2797 |        2091 | table_id: 227 (test.t1)                                                                                                                                     |
      | mysql57_bin.000001 | 2091 | Write_rows     |      2797 |        2139 | table_id: 227 flags: STMT_END_F                                                                                                                             |
      | mysql57_bin.000001 | 2139 | Xid            |      2797 |        2170 | COMMIT /* xid=103 */                                                                                                                                        |
      | mysql57_bin.000001 | 2170 | Anonymous_Gtid |      2797 |        2235 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 | 2235 | Query          |      2797 |        2307 | BEGIN                                                                                                                                                       |
      | mysql57_bin.000001 | 2307 | Table_map      |      2797 |        2355 | table_id: 227 (test.t1)                                                                                                                                     |
      | mysql57_bin.000001 | 2355 | Update_rows    |      2797 |        2417 | table_id: 227 flags: STMT_END_F                                                                                                                             |
      | mysql57_bin.000001 | 2417 | Xid            |      2797 |        2448 | COMMIT /* xid=105 */                                                                                                                                        |
      | mysql57_bin.000001 | 2448 | Anonymous_Gtid |      2797 |        2513 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 | 2513 | Query          |      2797 |        2585 | BEGIN                                                                                                                                                       |
      | mysql57_bin.000001 | 2585 | Table_map      |      2797 |        2633 | table_id: 227 (test.t1)                                                                                                                                     |
      | mysql57_bin.000001 | 2633 | Delete_rows    |      2797 |        2681 | table_id: 227 flags: STMT_END_F                                                                                                                             |
      | mysql57_bin.000001 | 2681 | Xid            |      2797 |        2712 | COMMIT /* xid=106 */                                                                                                                                        |
      | mysql57_bin.000001 | 2712 | Anonymous_Gtid |      2797 |        2777 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 | 2777 | Query          |      2797 |        2874 | create database test2                                                                                                                                       |
      | mysql57_bin.000001 | 2874 | Anonymous_Gtid |      2797 |        2939 | SET @@SESSION.GTID_NEXT= 'ANONYMOUS'                                                                                                                        |
      | mysql57_bin.000001 | 2939 | Query          |      2797 |        3026 | drop database test2                                                                                                                                         |
      +--------------------+------+----------------+-----------+-------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------+
      50 rows in set (0.00 sec)
       
      
      

      No error in MySQL 5.7

      On Node001

      Replication IO/SQL Thread status show running as YES , Database creation of test2 got replicated while Cluster dropped.

       
      MariaDB [(none)]> show binlog events in 'node001.000003';
      +----------------+------+-------------------+-----------+-------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | Log_name       | Pos  | Event_type        | Server_id | End_log_pos | Info                                                                                                                                                                                                   |
      +----------------+------+-------------------+-----------+-------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | node001.000003 |    4 | Format_desc       |       900 |         256 | Server ver: 10.5.9-6-MariaDB-enterprise-log, Binlog ver: 4                                                                                                                                             |
      | node001.000003 |  256 | Gtid_list         |       900 |         285 | []                                                                                                                                                                                                     |
      | node001.000003 |  285 | Binlog_checkpoint |       900 |         326 | node001.000003                                                                                                                                                                                         |
      | node001.000003 |  326 | Gtid              |       900 |         368 | GTID 100-900-1                                                                                                                                                                                         |
      | node001.000003 |  368 | Query             |       900 |         524 | set foreign_key_checks=1, unique_checks=1; CREATE DATABASE /*!32312 IF NOT EXISTS*/ `test` /*!40100 DEFAULT CHARACTER SET utf8mb4 */                                                                   |
      | node001.000003 |  524 | Gtid              |       900 |         566 | GTID 100-900-2                                                                                                                                                                                         |
      | node001.000003 |  566 | Query             |       900 |         684 | use `test`; set foreign_key_checks=1, unique_checks=1; DROP TABLE IF EXISTS `t1` /* generated by server */                                                                                             |
      | node001.000003 |  684 | Gtid              |       900 |         726 | GTID 100-900-3                                                                                                                                                                                         |
      | node001.000003 |  726 | Query             |       900 |         936 | use `test`; set foreign_key_checks=1, unique_checks=1; CREATE TABLE `t1` (
        `id` int(10) DEFAULT NULL,
        `name` varchar(20) DEFAULT NULL,
        KEY `id_1` (`id`)
      ) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 |
      | node001.000003 |  936 | Gtid              |       900 |         978 | GTID 100-900-4                                                                                                                                                                                         |
      | node001.000003 |  978 | Query             |       900 |        1086 | use `test`; set foreign_key_checks=1, unique_checks=1; /*!40000 ALTER TABLE `t1` DISABLE KEYS */                                                                                                       |
      | node001.000003 | 1086 | Gtid              |       900 |        1128 | BEGIN GTID 100-900-5                                                                                                                                                                                   |
      | node001.000003 | 1128 | Annotate_rows     |       900 |        1210 | INSERT INTO `t1` VALUES (10,'John'),(20,'rob'),(30,'Marry')                                                                                                                                            |
      | node001.000003 | 1210 | Table_map         |       900 |        1258 | table_id: 24 (test.t1)                                                                                                                                                                                 |
      | node001.000003 | 1258 | Write_rows_v1     |       900 |        1321 | table_id: 24 flags: STMT_END_F                                                                                                                                                                         |
      | node001.000003 | 1321 | Xid               |       900 |        1352 | COMMIT /* xid=24 */                                                                                                                                                                                    |
      | node001.000003 | 1352 | Gtid              |       900 |        1394 | GTID 100-900-6                                                                                                                                                                                         |
      | node001.000003 | 1394 | Query             |       900 |        1501 | use `test`; set foreign_key_checks=1, unique_checks=1; /*!40000 ALTER TABLE `t1` ENABLE KEYS */                                                                                                        |
      | node001.000003 | 1501 | Gtid              |       900 |        1543 | BEGIN GTID 100-900-7                                                                                                                                                                                   |
      | node001.000003 | 1543 | Table_map         |      2797 |        1591 | table_id: 25 (test.t1)                                                                                                                                                                                 |
      | node001.000003 | 1591 | Write_rows_v1     |      2797 |        1637 | table_id: 25 flags: STMT_END_F                                                                                                                                                                         |
      | node001.000003 | 1637 | Xid               |       900 |        1668 | COMMIT /* xid=26 */                                                                                                                                                                                    |
      | node001.000003 | 1668 | Gtid              |       900 |        1710 | BEGIN GTID 100-900-8                                                                                                                                                                                   |
      | node001.000003 | 1710 | Table_map         |      2797 |        1758 | table_id: 25 (test.t1)                                                                                                                                                                                 |
      | node001.000003 | 1758 | Write_rows_v1     |      2797 |        1804 | table_id: 25 flags: STMT_END_F                                                                                                                                                                         |
      | node001.000003 | 1804 | Xid               |       900 |        1835 | COMMIT /* xid=27 */                                                                                                                                                                                    |
      | node001.000003 | 1835 | Gtid              |       900 |        1877 | BEGIN GTID 100-900-9                                                                                                                                                                                   |
      | node001.000003 | 1877 | Table_map         |      2797 |        1925 | table_id: 25 (test.t1)                                                                                                                                                                                 |
      | node001.000003 | 1925 | Write_rows_v1     |      2797 |        1971 | table_id: 25 flags: STMT_END_F                                                                                                                                                                         |
      | node001.000003 | 1971 | Xid               |       900 |        2002 | COMMIT /* xid=28 */                                                                                                                                                                                    |
      | node001.000003 | 2002 | Gtid              |       900 |        2044 | BEGIN GTID 100-900-10                                                                                                                                                                                  |
      | node001.000003 | 2044 | Table_map         |      2797 |        2092 | table_id: 25 (test.t1)                                                                                                                                                                                 |
      | node001.000003 | 2092 | Update_rows_v1    |      2797 |        2152 | table_id: 25 flags: STMT_END_F                                                                                                                                                                         |
      | node001.000003 | 2152 | Xid               |       900 |        2183 | COMMIT /* xid=29 */                                                                                                                                                                                    |
      | node001.000003 | 2183 | Gtid              |       900 |        2225 | BEGIN GTID 100-900-11                                                                                                                                                                                  |
      | node001.000003 | 2225 | Table_map         |      2797 |        2273 | table_id: 25 (test.t1)                                                                                                                                                                                 |
      | node001.000003 | 2273 | Delete_rows_v1    |      2797 |        2319 | table_id: 25 flags: STMT_END_F                                                                                                                                                                         |
      | node001.000003 | 2319 | Xid               |       900 |        2350 | COMMIT /* xid=30 */                                                                                                                                                                                    |
      | node001.000003 | 2350 | Gtid              |       900 |        2392 | GTID 100-900-12                                                                                                                                                                                        |
      | node001.000003 | 2392 | Query             |       900 |        2481 | create database test2                                                                                                                                                                                  |
      +----------------+------+-------------------+-----------+-------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
      40 rows in set (0.000 sec)
       
       
      MariaDB [test]> show databases;
      +--------------------+
      | Database           |
      +--------------------+
      | information_schema |
      | mysql              |
      | performance_schema |
      | sys                |
      | test               |
      | test2              |
      +--------------------+
      6 rows in set (0.000 sec)
       
      MariaDB [test]> show global status  like 'wsrep_cluster_%';
      +----------------------------+--------------------------------------+
      | Variable_name              | Value                                |
      +----------------------------+--------------------------------------+
      | wsrep_cluster_capabilities |                                      |
      | wsrep_cluster_conf_id      | 18446744073709551615                 |
      | wsrep_cluster_size         | 0                                    |
      | wsrep_cluster_state_uuid   | 6f95938e-a9ab-11ec-b11d-dab1913bedfb |
      | wsrep_cluster_status       | Disconnected                         |
      +----------------------------+--------------------------------------+
      5 rows in set (0.001 sec)
      
      

      While node002 and Node003

       
      MariaDB [(none)]> show global status  like 'wsrep_cluster_%';
      +----------------------------+--------------------------------------+
      | Variable_name              | Value                                |
      +----------------------------+--------------------------------------+
      | wsrep_cluster_weight       | 2                                    |
      | wsrep_cluster_capabilities |                                      |
      | wsrep_cluster_conf_id      | 4                                    |
      | wsrep_cluster_size         | 2                                    |
      | wsrep_cluster_state_uuid   | 6f95938e-a9ab-11ec-b11d-dab1913bedfb |
      | wsrep_cluster_status       | Primary                              |
      +----------------------------+--------------------------------------+
      6 rows in set (0.001 sec)
      
      

      Error log :-

      Node001

       
      2022-03-25  1:03:43 10 [Note] 'CHANGE MASTER TO executed'. Previous state master_host='', master_port='3306', master_log_file='', master_log_pos='4'. New state master_host='192.168.47.18', master_port='3306', master_log_file='mysql57_bin.000001', master_log_pos='1378'.
      2022-03-25  1:03:47 11 [Note] Slave I/O thread: Start asynchronous replication to master 'replica@192.168.47.18:3306' in log 'mysql57_bin.000001' at position 1378
      2022-03-25  1:03:47 12 [Note] Slave SQL thread initialized, starting replication in log 'mysql57_bin.000001' at position 1378, relay log './node001-relay-bin.000001' position: 4
      2022-03-25  1:03:47 11 [Note] Slave I/O thread: connected to master 'replica@192.168.47.18:3306',replication started in log 'mysql57_bin.000001' at position 1378
      2022-03-25  1:08:37 0 [Note] WSREP: Member 1(ohcimaria02m) initiates vote on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53:  Storage engine InnoDB of the table `test`.`t1` doesn't have this option, Error_code: 1031;
      2022-03-25  1:08:37 0 [Note] WSREP: Votes over 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31:
         f6875b17d3c93d53:   1/3
      Waiting for more votes.
      2022-03-25  1:08:37 0 [Note] WSREP: Member 2(ohcimaria03m) initiates vote on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53:  Storage engine InnoDB of the table `test`.`t1` doesn't have this option, Error_code: 1031;
      2022-03-25  1:08:37 0 [Note] WSREP: Votes over 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31:
         f6875b17d3c93d53:   2/3
      Winner: f6875b17d3c93d53
      2022-03-25  1:08:37 2 [Note] WSREP: Got vote request for seqno 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31
      2022-03-25  1:08:37 0 [Note] WSREP: Recovering vote result from history: 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53
      2022-03-25  1:08:37 2 [ERROR] WSREP: Vote 0 (success) on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31 is inconsistent with group. Leaving cluster.
      2022-03-25  1:08:37 2 [Note] WSREP: Closing send monitor...
      2022-03-25  1:08:37 2 [Note] WSREP: Closed send monitor.
      2022-03-25  1:08:37 2 [Note] WSREP: gcomm: terminating thread
      2022-03-25  1:08:37 2 [Note] WSREP: gcomm: joining thread
      2022-03-25  1:08:37 2 [Note] WSREP: gcomm: closing backend
      2022-03-25  1:08:37 2 [Note] WSREP: view(view_id(NON_PRIM,7cbb1ffa-84ee,3) memb {
              7cbb1ffa-84ee,0
      } joined {
      } left {
      } partitioned {
              87d88297-be21,0
              8a783c88-891a,0
      })
      2022-03-25  1:08:37 2 [Note] WSREP: PC protocol downgrade 1 -> 0
      2022-03-25  1:08:37 2 [Note] WSREP: view((empty))
      2022-03-25  1:08:37 2 [Note] WSREP: gcomm: closed
      2022-03-25  1:08:37 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
      2022-03-25  1:08:37 0 [Note] WSREP: Flow-control interval: [16, 16]
      2022-03-25  1:08:37 0 [Note] WSREP: Received NON-PRIMARY.
      2022-03-25  1:08:37 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 31)
      2022-03-25  1:08:37 0 [Note] WSREP: New SELF-LEAVE.
      2022-03-25  1:08:37 0 [Note] WSREP: Flow-control interval: [0, 0]
      2022-03-25  1:08:37 0 [Note] WSREP: Received SELF-LEAVE. Closing connection.
      2022-03-25  1:08:37 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 31)
      2022-03-25  1:08:37 0 [Note] WSREP: RECV thread exiting 0: Success
      2022-03-25  1:08:37 2 [Note] WSREP: recv_thread() joined.
      2022-03-25  1:08:37 2 [Note] WSREP: Closing replication queue.
      2022-03-25  1:08:37 2 [Note] WSREP: Closing slave action queue.
      2022-03-25  1:08:37 2 [Note] WSREP: ================================================
      View:
        id: 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31
        status: non-primary
        protocol_version: 4
        capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
        final: no
        own_index: 0
        members(1):
              0: 7cbb1ffa-abf7-11ec-84ee-aef4b648d4fe, ohcimaria01m
      =================================================
      2022-03-25  1:08:37 2 [Note] WSREP: Non-primary view
      2022-03-25  1:08:37 2 [Note] WSREP: Server status change synced -> connected
      2022-03-25  1:08:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      2022-03-25  1:08:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      2022-03-25  1:08:37 2 [Note] WSREP: ================================================
      View:
        id: 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31
        status: non-primary
        protocol_version: 4
        capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
        final: yes
        own_index: -1
        members(0):
      =================================================
      2022-03-25  1:08:37 2 [Note] WSREP: Non-primary view
      2022-03-25  1:08:37 2 [Note] WSREP: Server status change connected -> disconnected
      2022-03-25  1:08:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      2022-03-25  1:08:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      2022-03-25  1:08:37 0 [Note] WSREP: Service thread queue flushed.
      2022-03-25  1:08:37 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: 5
      2022-03-25  1:08:37 2 [Note] WSREP: Applier thread exiting ret: 0 thd: 2
      
      

      Node002

       
      2022-03-25  1:08:37 2 [ERROR] Error in Log_event::read_log_event(): 'Found invalid event in binary log', data_len: 42, event_type: -94
      2022-03-25  1:08:37 2 [ERROR] WSREP: applier could not read binlog event, seqno: 31, len: 89
      2022-03-25  1:08:37 0 [Note] WSREP: Member 1(ohcimaria02m) initiates vote on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53:  Storage engine InnoDB of the table `test`.`t1` doesn't have this option, Error_code: 1031;
      2022-03-25  1:08:37 0 [Note] WSREP: Votes over 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31:
         f6875b17d3c93d53:   1/3
      Waiting for more votes.
      2022-03-25  1:08:37 0 [Note] WSREP: Member 2(ohcimaria03m) initiates vote on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53:  Storage engine InnoDB of the table `test`.`t1` doesn't have this option, Error_code: 1031;
      2022-03-25  1:08:37 0 [Note] WSREP: Votes over 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31:
         f6875b17d3c93d53:   2/3
      Winner: f6875b17d3c93d53
      2022-03-25  1:08:37 0 [Note] WSREP: declaring 8a783c88-891a at tcp://192.168.47.14:4567 stable
      2022-03-25  1:08:37 0 [Note] WSREP: forgetting 7cbb1ffa-84ee (tcp://192.168.47.11:4567)
      2022-03-25  1:08:37 0 [Note] WSREP: Node 87d88297-be21 state prim
      2022-03-25  1:08:37 0 [Note] WSREP: view(view_id(PRIM,87d88297-be21,4) memb {
              87d88297-be21,0
              8a783c88-891a,0
      } joined {
      } left {
      } partitioned {
              7cbb1ffa-84ee,0
      })
      2022-03-25  1:08:37 0 [Note] WSREP: save pc into disk
      2022-03-25  1:08:37 0 [Note] WSREP: forgetting 7cbb1ffa-84ee (tcp://192.168.47.11:4567)
      2022-03-25  1:08:37 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2
      2022-03-25  1:08:37 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a0efcdeb-abf9-11ec-bb55-a654fec48f17
      2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a0efcdeb-abf9-11ec-bb55-a654fec48f17
      2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: got state msg: a0efcdeb-abf9-11ec-bb55-a654fec48f17 from 0 (ohcimaria02m)
      2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: got state msg: a0efcdeb-abf9-11ec-bb55-a654fec48f17 from 1 (ohcimaria03m)
      2022-03-25  1:08:37 0 [Note] WSREP: Quorum results:
              version    = 6,
              component  = PRIMARY,
              conf_id    = 3,
              members    = 2/2 (joined/total),
              act_id     = 31,
              last_appl. = 16,
              protocols  = 2/10/4 (gcs/repl/appl),
              vote policy= 0,
              group UUID = 6f95938e-a9ab-11ec-b11d-dab1913bedfb
      2022-03-25  1:08:37 0 [Note] WSREP: Flow-control interval: [23, 23]
      2022-03-25  1:08:37 2 [Note] WSREP: ####### processing CC 32, local, ordered
      2022-03-25  1:08:37 2 [Note] WSREP: ####### My UUID: 87d88297-abf7-11ec-be21-d70c093ba375
      2022-03-25  1:08:37 2 [Note] WSREP: Skipping cert index reset
      2022-03-25  1:08:37 2 [Note] WSREP: REPL Protocols: 10 (5)
      2022-03-25  1:08:37 2 [Note] WSREP: ####### Adjusting cert position: 31 -> 32
      2022-03-25  1:08:37 0 [Note] WSREP: Service thread queue flushed.
      2022-03-25  1:08:37 2 [Note] WSREP: ================================================
      View:
        id: 6f95938e-a9ab-11ec-b11d-dab1913bedfb:32
        status: primary
        protocol_version: 4
        capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
        final: no
        own_index: 0
        members(2):
              0: 87d88297-abf7-11ec-be21-d70c093ba375, ohcimaria02m
              1: 8a783c88-abf7-11ec-891a-6bd4db5d6579, ohcimaria03m
      =================================================
      2022-03-25  1:08:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      2022-03-25  1:08:37 2 [Note] WSREP: Lowest cert index boundary for CC from group: 20
      2022-03-25  1:08:37 2 [Note] WSREP: Min available from gcache for CC from group: 2
      2022-03-25  1:08:42 0 [Note] WSREP:  cleaning up 7cbb1ffa-84ee (tcp://192.168.47.11:4567)
      
      

      Node003

       
      2022-03-25  1:08:37 2 [ERROR] Error in Log_event::read_log_event(): 'Found invalid event in binary log', data_len: 42, event_type: -94
      2022-03-25  1:08:37 2 [ERROR] WSREP: applier could not read binlog event, seqno: 31, len: 89
      2022-03-25  1:08:37 0 [Note] WSREP: Member 1(ohcimaria02m) initiates vote on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53:  Storage engine InnoDB of the table `test`.`t1` doesn't have this option, Error_code: 1031;
      2022-03-25  1:08:37 0 [Note] WSREP: Votes over 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31:
         f6875b17d3c93d53:   1/3
      Waiting for more votes.
      2022-03-25  1:08:37 0 [Note] WSREP: Member 2(ohcimaria03m) initiates vote on 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31,f6875b17d3c93d53:  Storage engine InnoDB of the table `test`.`t1` doesn't have this option, Error_code: 1031;
      2022-03-25  1:08:37 0 [Note] WSREP: Votes over 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31:
         f6875b17d3c93d53:   2/3
      Winner: f6875b17d3c93d53
      2022-03-25  1:08:37 2 [Note] WSREP: Got vote request for seqno 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31
      2022-03-25  1:08:37 2 [Note] WSREP: 6f95938e-a9ab-11ec-b11d-dab1913bedfb:31 already voted on. Continue.
      2022-03-25  1:08:37 0 [Note] WSREP: declaring 87d88297-be21 at tcp://192.168.47.12:4567 stable
      2022-03-25  1:08:37 0 [Note] WSREP: Deferred close timer started for socket with remote endpoint: tcp://192.168.47.11:4567
      2022-03-25  1:08:37 0 [Note] WSREP: forgetting 7cbb1ffa-84ee (tcp://192.168.47.11:4567)
      2022-03-25  1:08:37 0 [Note] WSREP: Deferred close timer handle_wait asio.system:125 for 0x55a3303fcf88
      2022-03-25  1:08:37 0 [Note] WSREP: Deferred close timer destruct
      2022-03-25  1:08:37 0 [Note] WSREP: Node 87d88297-be21 state prim
      2022-03-25  1:08:37 0 [Note] WSREP: view(view_id(PRIM,87d88297-be21,4) memb {
              87d88297-be21,0
              8a783c88-891a,0
      } joined {
      } left {
      } partitioned {
              7cbb1ffa-84ee,0
      })
      2022-03-25  1:08:37 0 [Note] WSREP: save pc into disk
      2022-03-25  1:08:37 0 [Note] WSREP: forgetting 7cbb1ffa-84ee (tcp://192.168.47.11:4567)
      2022-03-25  1:08:37 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
      2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
      2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a0efcdeb-abf9-11ec-bb55-a654fec48f17
      2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: got state msg: a0efcdeb-abf9-11ec-bb55-a654fec48f17 from 0 (ohcimaria02m)
      2022-03-25  1:08:37 0 [Note] WSREP: STATE EXCHANGE: got state msg: a0efcdeb-abf9-11ec-bb55-a654fec48f17 from 1 (ohcimaria03m)
      2022-03-25  1:08:37 0 [Note] WSREP: Quorum results:
              version    = 6,
              component  = PRIMARY,
              conf_id    = 3,
              members    = 2/2 (joined/total),
              act_id     = 31,
              last_appl. = 16,
              protocols  = 2/10/4 (gcs/repl/appl),
              vote policy= 0,
              group UUID = 6f95938e-a9ab-11ec-b11d-dab1913bedfb
      2022-03-25  1:08:37 0 [Note] WSREP: Flow-control interval: [23, 23]
      2022-03-25  1:08:37 2 [Note] WSREP: ####### processing CC 32, local, ordered
      2022-03-25  1:08:37 2 [Note] WSREP: ####### My UUID: 8a783c88-abf7-11ec-891a-6bd4db5d6579
      2022-03-25  1:08:37 2 [Note] WSREP: Skipping cert index reset
      2022-03-25  1:08:37 2 [Note] WSREP: REPL Protocols: 10 (5)
      2022-03-25  1:08:37 2 [Note] WSREP: ####### Adjusting cert position: 31 -> 32
      2022-03-25  1:08:37 0 [Note] WSREP: Service thread queue flushed.
      2022-03-25  1:08:37 2 [Note] WSREP: ================================================
      View:
        id: 6f95938e-a9ab-11ec-b11d-dab1913bedfb:32
        status: primary
        protocol_version: 4
        capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
        final: no
        own_index: 1
        members(2):
              0: 87d88297-abf7-11ec-be21-d70c093ba375, ohcimaria02m
              1: 8a783c88-abf7-11ec-891a-6bd4db5d6579, ohcimaria03m
      =================================================
      2022-03-25  1:08:37 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      2022-03-25  1:08:37 2 [Note] WSREP: Lowest cert index boundary for CC from group: 20
      2022-03-25  1:08:37 2 [Note] WSREP: Min available from gcache for CC from group: 2
      2022-03-25  1:08:43 0 [Note] WSREP:  cleaning up 7cbb1ffa-84ee (tcp://192.168.47.11:4567)
      
      

      Now Execute another DDL command on MySQL 5.7

       
      mysql> drop database test2 ;
      Query OK, 0 rows affected (0.00 sec)
      
      

      On node001

       
      MariaDB [(none)]> show slave status\G
      *************************** 1. row ***************************
                      Slave_IO_State: Waiting for master to send event
                         Master_Host: 192.168.47.18
                         Master_User: replica
                         Master_Port: 3306
                       Connect_Retry: 60
                     Master_Log_File: mysql57_bin.000001
                 Read_Master_Log_Pos: 3026
                      Relay_Log_File: node001-relay-bin.000002
                       Relay_Log_Pos: 1530
               Relay_Master_Log_File: mysql57_bin.000001
                    Slave_IO_Running: Yes
                   Slave_SQL_Running: No
                     Replicate_Do_DB:
                 Replicate_Ignore_DB:
                  Replicate_Do_Table:
              Replicate_Ignore_Table:
             Replicate_Wild_Do_Table:
         Replicate_Wild_Ignore_Table:
                          Last_Errno: 1047
                          Last_Error: Node has dropped from cluster
                        Skip_Counter: 0
                 Exec_Master_Log_Pos: 2874
                     Relay_Log_Space: 1934
                     Until_Condition: None
                      Until_Log_File:
                       Until_Log_Pos: 0
                  Master_SSL_Allowed: No
                  Master_SSL_CA_File:
                  Master_SSL_CA_Path:
                     Master_SSL_Cert:
                   Master_SSL_Cipher:
                      Master_SSL_Key:
               Seconds_Behind_Master: NULL
       Master_SSL_Verify_Server_Cert: No
                       Last_IO_Errno: 0
                       Last_IO_Error:
                      Last_SQL_Errno: 1047
                      Last_SQL_Error: Node has dropped from cluster
         Replicate_Ignore_Server_Ids:
                    Master_Server_Id: 2797
                      Master_SSL_Crl:
                  Master_SSL_Crlpath:
                          Using_Gtid: No
                         Gtid_IO_Pos:
             Replicate_Do_Domain_Ids:
         Replicate_Ignore_Domain_Ids:
                       Parallel_Mode: optimistic
                           SQL_Delay: 0
                 SQL_Remaining_Delay: NULL
             Slave_SQL_Running_State:
                    Slave_DDL_Groups: 0
      Slave_Non_Transactional_Groups: 0
          Slave_Transactional_Groups: 0
      1 row in set (0.000 sec)
      
      

      Node001 Error log

       
       
      2022-03-25  1:17:29 12 [Warning] WSREP: TO isolation failed for: 1, schema: test2, sql: drop database test2. Check your wsrep connection state and retry the query.
      2022-03-25  1:17:29 12 [ERROR] Slave SQL: Error 'Deadlock found when trying to get lock; try restarting transaction' on query. Default database: 'test2'. Query: 'drop database test2', Internal MariaDB error code: 1213
      2022-03-25  1:17:29 12 [ERROR] Slave SQL: Node has dropped from cluster, Internal MariaDB error code: 1047
      2022-03-25  1:17:29 12 [Note] Slave SQL thread exiting, replication stopped in log 'mysql57_bin.000001' at position 2874
      2022-03-25  1:17:29 12 [Note] master was 192.168.47.18:3306
      2022-03-25  1:17:29 12 [Note] WSREP: Slave error due to node going non-primary
      2022-03-25  1:17:29 12 [Note] WSREP: wsrep_restart_slave was set and therefore slave will be automatically restarted when node joins back to cluster
      
      

      Node002 & Node003 continued as a 2 Node Galera cluster.

      Attachments

        Activity

          People

            pramod.mahto@mariadb.com Pramod Mahto
            pramod.mahto@mariadb.com Pramod Mahto
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.