Edward Stoever added a comment - 2023-08-23 14:05 This was tested on 10.6.14 Enterprise.

Jan Lindström added a comment - 2023-10-10 09:25 - edited Test case 1) Start the 3 node cluster 2) OLTP load started on all nodes 3) The second node is restarted 4) After 1 minute all nodes are stopped one by one 3) bootstrapped node3 and initialized remaining nodes Note: reproduces with mariabackup not with rsync

Jan Lindström added a comment - 2023-10-11 08:48 edward Does customer use mariabacup as SST method? With mariabackup I can reproduce it even at startup connection node_1; CREATE SCHEMA IF NOT EXISTS mysqlslap; USE mysqlslap; CREATE TABLE t1 (id bigint not null primary key auto_increment, name VARCHAR(64)) ENGINE=innodb; # node_1 show variables like '%gtid_binlog_pos%'; Variable_name Value gtid_binlog_pos 1111-1-2 connection node_2; # node_2 show variables like '%gtid_binlog_pos%'; Variable_name Value gtid_binlog_pos 0-1-2 connection node_3; # node_3 show variables like '%gtid_binlog_pos%'; Variable_name Value gtid_binlog_pos 0-1-2

Richard Stracke added a comment - 2023-12-12 16:15 - edited I checked the sourcecode and I shortened the relevant parts   ****************************************** uint wsrep_gtid_domain_id= 0 ; // Domain id on above structure void wsrep_init_globals() wsrep_init_gtid(); wsrep_server_gtid_t stored_gtid= wsrep_get_SE_checkpoint<wsrep_server_gtid_t>(); stored_gtid.domain_id= wsrep_gtid_server.domain_id; if (stored_gtid.server_id == 0 ) rpl_gtid wsrep_last_gtid; mysql_bin_log.lookup_domain_in_binlog_state(stored_gtid.domain_id, &wsrep_last_gtid)) wsrep_gtid_server.gtid(stored_gtid);     if (wsrep_new_cluster) new_gtid.domain_id= wsrep_gtid_domain_id; # wsrep_gtid_domain_id= 0 ; /* Try to search for domain_id and server_id combination in binlog if found continue from last seqno */ wsrep_get_binlog_gtid_seqno(new_gtid); wsrep_gtid_server.gtid(new_gtid); ********************************************* So domain_id will be initialized with wsrep_gtid_domain_id=0 wsrep_gtid_domain_id can be set from SST , otherwise it remain 0 wsrep_server_gtid_t stored_gtid= wsrep_get_SE_checkpoint<wsrep_server_gtid_t>(); will set the grid from recovery process, otherwise it kept empty. If new cluster the domain_id will be set to new_gtid.domain_id= wsrep_gtid_domain_id; IF the recovery process gives no result and new cluster flag is set, wsrep_gtid_domain_id kept 0 and will be overwritten here if (wsrep_new_cluster) new_gtid.domain_id= wsrep_gtid_domain_id; # wsrep_gtid_domain_id= 0 ; rsync copies maybe some more files for a successful recovery or whatever wsrep_get_SE_checkpoint<wsrep_server_gtid_t>(); do . So I suggest to init uint wsrep_gtid_domain_id=0; // Domain id on above structure to real wsrep_gtid_domain_id defined in config file or sst_method = mariabackup have to copy the same files like rsync for a successul wsrep_get_SE_checkpoint<wsrep_server_gtid_t>(); seppo and janlindstrom Can you check this, if this makes sense to you ?

Seppo Jaakola added a comment - 2023-12-14 13:55 Pull request to handle domain-id inconsistency due to mariabackup SST was submitted yesterday

Seppo Jaakola added a comment - 2023-12-14 13:57 PR is submitted here: https://github.com/MariaDB/server/pull/2932

Julius Goryavsky added a comment - 2023-12-23 00:47 Fix merged with head revision as https://github.com/MariaDB/server/commit/c89f769f2412202dd8d7e69b0942778c91602ec7