Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-32821

galera.galera_sst_rsync2 fails in 11.2 (release)

    XMLWordPrintable

Details

    Description

      galera.galera_sst_rsync2 'innodb,release' w1 [ fail ]
              Test ended at 2023-11-16 02:38:34
       
      CURRENT_TEST: galera.galera_sst_rsync2
      mysqltest: In included file "./suite/galera/include/galera_wsrep_recover.inc": 
      included from ./suite/galera/include/galera_st_kill_slave.inc at line 60:
      included from /usr/share/mariadb-test/suite/galera/t/galera_sst_rsync2.test at line 13:
      At line 4: exec of '/usr/sbin/mariadbd --defaults-group-suffix=.2 --defaults-file=/dev/shm/var/1/my.cnf --log-error=/dev/shm/var/tmp/1/galera_wsrep_recover.log --innodb --wsrep-recover --log-bin=/dev/shm/var/1/mysqld.2/server2_binlog --log-bin-index=/dev/shm/var/1/tmp/server2_binlog_index.index > /dev/shm/var/tmp/1/galera_wsrep_recover.log 2>&1' failed, error: 256, status: 1, errno: 2
      Output from before failure:
      Performing --wsrep-recover ...
       
       
       
      The result from queries just before the failure was:
      < snip >
      INSERT INTO t1 VALUES (13,'node1_committed_during');
      INSERT INTO t1 VALUES (14,'node1_committed_during');
      INSERT INTO t1 VALUES (15,'node1_committed_during');
      COMMIT;
      START TRANSACTION;
      INSERT INTO t1 VALUES (16,'node1_to_be_committed_after');
      INSERT INTO t1 VALUES (17,'node1_to_be_committed_after');
      INSERT INTO t1 VALUES (18,'node1_to_be_committed_after');
      INSERT INTO t1 VALUES (19,'node1_to_be_committed_after');
      INSERT INTO t1 VALUES (20,'node1_to_be_committed_after');
      connect node_1a_galera_st_kill_slave, 127.0.0.1, root, , test, $NODE_MYPORT_1;
      SET AUTOCOMMIT=OFF;
      START TRANSACTION;
      INSERT INTO t1 VALUES (21,'node1_to_be_rollbacked_after');
      INSERT INTO t1 VALUES (22,'node1_to_be_rollbacked_after');
      INSERT INTO t1 VALUES (23,'node1_to_be_rollbacked_after');
      INSERT INTO t1 VALUES (24,'node1_to_be_rollbacked_after');
      INSERT INTO t1 VALUES (25,'node1_to_be_rollbacked_after');
      connection node_2;
      Performing --wsrep-recover ...
       
      More results from queries before failure can be found in /dev/shm/var/1/log/galera_sst_rsync2.log
       
       - saving '/dev/shm/var/1/log/galera.galera_sst_rsync2-innodb,release/' to '/dev/shm/var/log/galera.galera_sst_rsync2-innodb,release/'
       
      Retrying test galera.galera_sst_rsync2, attempt(2/3)...
       
      worker[01] > Restart  - not started
      worker[01] > Restart  - not started
      galera.galera_sst_rsync_binlogname 'innodb' w2 [ pass ]   9719
      worker[02] > Restart [mysqld.1 - pid: 55714, winpid: 55714] - using different config file
      worker[02] > Restart [mysqld.2 - pid: 56574, winpid: 56574] - using different config file
      galera.galera_sst_rsync2 'innodb,release' w1 [ retry-fail ]
              Test ended at 2023-11-16 02:39:06
       
      CURRENT_TEST: galera.galera_sst_rsync2
      mysqltest: In included file "./suite/galera/include/galera_wsrep_recover.inc": 
      included from ./suite/galera/include/galera_st_kill_slave.inc at line 60:
      included from /usr/share/mariadb-test/suite/galera/t/galera_sst_rsync2.test at line 13:
      At line 4: exec of '/usr/sbin/mariadbd --defaults-group-suffix=.2 --defaults-file=/dev/shm/var/1/my.cnf --log-error=/dev/shm/var/tmp/1/galera_wsrep_recover.log --innodb --wsrep-recover --log-bin=/dev/shm/var/1/mysqld.2/server2_binlog --log-bin-index=/dev/shm/var/1/tmp/server2_binlog_index.index > /dev/shm/var/tmp/1/galera_wsrep_recover.log 2>&1' failed, error: 256, status: 1, errno: 2
      Output from before failure:
      Performing --wsrep-recover ...
       
       
       
      The result from queries just before the failure was:
      < snip >
      INSERT INTO t1 VALUES (13,'node1_committed_during');
      INSERT INTO t1 VALUES (14,'node1_committed_during');
      INSERT INTO t1 VALUES (15,'node1_committed_during');
      COMMIT;
      START TRANSACTION;
      INSERT INTO t1 VALUES (16,'node1_to_be_committed_after');
      INSERT INTO t1 VALUES (17,'node1_to_be_committed_after');
      INSERT INTO t1 VALUES (18,'node1_to_be_committed_after');
      INSERT INTO t1 VALUES (19,'node1_to_be_committed_after');
      INSERT INTO t1 VALUES (20,'node1_to_be_committed_after');
      connect node_1a_galera_st_kill_slave, 127.0.0.1, root, , test, $NODE_MYPORT_1;
      SET AUTOCOMMIT=OFF;
      START TRANSACTION;
      INSERT INTO t1 VALUES (21,'node1_to_be_rollbacked_after');
      INSERT INTO t1 VALUES (22,'node1_to_be_rollbacked_after');
      INSERT INTO t1 VALUES (23,'node1_to_be_rollbacked_after');
      INSERT INTO t1 VALUES (24,'node1_to_be_rollbacked_after');
      INSERT INTO t1 VALUES (25,'node1_to_be_rollbacked_after');
      connection node_2;
      Performing --wsrep-recover ...
       
      More results from queries before failure can be found in /dev/shm/var/1/log/galera_sst_rsync2.log
       
       - skipping '/dev/shm/var/1/log/galera.galera_sst_rsync2-innodb,release/'
       
      Test galera.galera_sst_rsync2 has failed 2 times, no more retries!
       
      worker[01] > Restart  - using different config file
      worker[01] > Restart  - using different config file
      galera.galera_sync_wait_upto 'binlogon,innodb' w1 [ skipped ]  debug_sync is not available
      line
      2023-11-16  2:39:10 0 [Warning] WSREP: Ignoring server id for non bootstrap node.
      ^ Found warnings in /dev/shm/var/1/log/mysqld.2.err
      ok
       
      worker[01] > Restart [mysqld.1 - pid: 57653, winpid: 57653] - running with different options '--innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-sync-wait=0 --wsrep-causal-reads=OFF' != '--log-bin=master-bin --log-bin-index=master-bin --log-slave-updates --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-sync-wait=0 --wsrep-causal-reads=OFF'
      worker[01] > Restart [mysqld.2 - pid: 57824, winpid: 57824] - running with different options '--innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-sync-wait=0 --wsrep-causal-reads=OFF' != '--log-bin=master-bin --log-bin-index=master-bin --log-slave-updates --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-sync-wait=0 --wsrep-causal-reads=OFF'
      galera.galera_sst_rsync_logbasename 'innodb' w2 [ pass ]   9616
      worker[02] > Restart [mysqld.1 - pid: 57610, winpid: 57610] - using different config file
      worker[02] > Restart [mysqld.2 - pid: 58510, winpid: 58510] - using different config file
      galera.galera_sync_wait_upto 'binlogoff,innodb' w1 [ skipped ]  debug_sync is not available
      line
      2023-11-16  2:39:36 0 [Warning] WSREP: Ignoring server id for non bootstrap node.
      ^ Found warnings in /dev/shm/var/1/log/mysqld.2.err
      ok
       
      worker[01] > Restart [mysqld.1 - pid: 58826, winpid: 58826] - using different config file
      worker[01] > Restart [mysqld.2 - pid: 58847, winpid: 58847] - using different config file
      galera.galera_unicode_pk 'innodb'        w2 [ pass ]   2216
      worker[02] > Restart [mysqld.1 - pid: 58857, winpid: 58857] - using different config file
      worker[02] > Restart [mysqld.2 - pid: 58944, winpid: 58944] - using different config file
      galera.galera_update_limit 'innodb'      w1 [ pass ]   2240
      worker[01] > Restart [mysqld.1 - pid: 59672, winpid: 59672] - using different config file
      worker[01] > Restart [mysqld.2 - pid: 59693, winpid: 59693] - using different config file
      galera.galera_v1_row_events 'innodb'     w2 [ pass ]   2228
      worker[02] > Restart [mysqld.1 - pid: 59701, winpid: 59701] - using different config file
      worker[02] > Restart [mysqld.2 - pid: 59844, winpid: 59844] - using different config file
      galera.galera_var_auto_inc_control_on 'innodb' w1 [ pass ]   2238
      worker[01] > Restart [mysqld.1 - pid: 60520, winpid: 60520] - using different config file
      worker[01] > Restart [mysqld.2 - pid: 60541, winpid: 60541] - using different config file
      galera.galera_var_gtid_domain_id 'innodb' w2 [ pass ]   2226
      worker[02] > Restart [mysqld.1 - pid: 60549, winpid: 60549] - using different config file
      worker[02] > Restart [mysqld.2 - pid: 60701, winpid: 60701] - using different config file
      galera.galera_var_ignore_apply_errors 'innodb' w1 [ pass ]   2339
      worker[01] > Restart [mysqld.1 - pid: 61396, winpid: 61396] - using different config file
      worker[01] > Restart [mysqld.2 - pid: 61417, winpid: 61417] - using different config file
      galera.galera_var_log_bin 'innodb'       w2 [ pass ]   2214
      worker[02] > Restart [mysqld.1 - pid: 61425, winpid: 61425] - using different config file
      worker[02] > Restart [mysqld.2 - pid: 61577, winpid: 61577] - using different config file
      galera.galera_var_notify_ssl_ipv6 'innodb' w1 [ pass ]   2213
      worker[01] > Restart  - using different config file
      worker[01] > Restart  - using different config file
      galera.galera_var_slave_threads 'innodb' w2 [ pass ]   2278
      worker[02] > Restart  - using different config file
      worker[02] > Restart  - using different config file
      galera.galera_var_sst_auth 'innodb'      w1 [ pass ]   8677
      worker[01] > Restart [mysqld.1 - pid: 63424, winpid: 63424] - using different config file
      worker[01] > Restart [mysqld.2 - pid: 63869, winpid: 63869] - using different config file
      galera.galera_wan 'innodb'               w2 [ pass ]   2430
      worker[02] > Restart [mysqld.1 - pid: 63452, winpid: 63452] - using different config file
      worker[02] > Restart [mysqld.2 - pid: 63587, winpid: 63587] - using different config file
      worker[02] > Restart [mysqld.3 - pid: 63589, winpid: 63589] - using different config file
      worker[02] > Restart [mysqld.4 - pid: 63603, winpid: 63603] - using different config file
      galera.mdev_10518 'innodb'               w2 [ pass ]   2240
      worker[02] > Restart [mysqld.1 - pid: 65367, winpid: 65367] - using different config file
      worker[02] > Restart [mysqld.2 - pid: 65389, winpid: 65389] - using different config file
      galera.galera_wsrep_log_conficts 'innodb' w1 [ pass ]   2361
      worker[01] > Restart [mysqld.1 - pid: 65397, winpid: 65397] - using different config file
      worker[01] > Restart [mysqld.2 - pid: 65418, winpid: 65418] - using different config file
      galera.mysql-wsrep#201 'innodb'          w1 [ pass ]   2770
      worker[01] > Restart [mysqld.1 - pid: 66275, winpid: 66275] - using different config file
      worker[01] > Restart [mysqld.2 - pid: 66296, winpid: 66296] - using different config file
      galera.mysql-wsrep#198 'innodb'          w2 [ pass ]   2422
      worker[02] > Restart  - using different config file
      worker[02] > Restart  - using different config file
      galera.rpl_row_annotate 'innodb'         w1 [ pass ]   2235
      worker[01] > Restart [mysqld.1 - pid: 67378, winpid: 67378] - using different config file
      worker[01] > Restart [mysqld.2 - pid: 67560, winpid: 67560] - using different config file
      galera_3nodes.galera-features#119 'innodb' w2 [ pass ]  23225
      galera_3nodes.galera_certification_ccc 'innodb' w2 [ pass ]  16335
      galera_3nodes.galera_certification_double_failure 'innodb' w2 [ pass ]   3329
      galera_3nodes.GAL-501 'innodb'           w1 [ pass ]  14570
      worker[01] > Restart  - using different config file
      worker[01] > Restart  - using different config file
      worker[01] > Restart  - using different config file
      galera_3nodes.galera_evs_suspect_timeout 'innodb' w2 [ pass ]  12409
      galera_3nodes.galera_join_with_cc_A 'innodb' w2 [ skipped ]  Test requires Galera debug library with debug_sync functionality
      galera_3nodes.galera_join_with_cc_B 'innodb' w2 [ skipped ]  Test requires Galera debug library with debug_sync functionality
      galera_3nodes.galera_join_with_cc_C 'innodb' w2 [ skipped ]  Test requires Galera debug library with debug_sync functionality
      galera_3nodes.GCF-354 'innodb'           w1 [ pass ]  12135
      worker[01] > Restart  - using different config file
      worker[01] > Restart  - using different config file
      worker[01] > Restart  - using different config file
      galera_3nodes.galera_var_dirty_reads2 'innodb' w2 [ pass ]  19600
      galera_3nodes.GCF-363 'innodb'           w1 [ pass ]  10065
      worker[01] > Restart [mysqld.1 - pid: 71385, winpid: 71385] - using different config file
      worker[01] > Restart [mysqld.2 - pid: 71406, winpid: 71406] - using different config file
      worker[01] > Restart [mysqld.3 - pid: 72232, winpid: 72232] - using different config file
      galera_3nodes.galera_wsrep_schema 'innodb' w2 [ pass ]   8867
      worker[02] > Restart [mysqld.1 - pid: 67107, winpid: 67107] - using different config file
      worker[02] > Restart [mysqld.2 - pid: 72239, winpid: 72239] - using different config file
      worker[02] > Restart [mysqld.3 - pid: 67130, winpid: 67130] - using different config file
      galera_3nodes.GCF-376 'innodb'           w1 [ pass ]  26251
      worker[01] > Restart [mysqld.1 - pid: 72965, winpid: 72965] - using different config file
      worker[01] > Restart [mysqld.2 - pid: 74585, winpid: 74585] - using different config file
      worker[01] > Restart [mysqld.3 - pid: 72988, winpid: 72988] - using different config file
      galera_3nodes.MDEV-29171 'innodb'        w2 [ pass ]  39383
      worker[02] > Restart [mysqld.1 - pid: 74984, winpid: 74984] - using different config file
      worker[02] > Restart [mysqld.2 - pid: 75033, winpid: 75033] - using different config file
      worker[02] > Restart [mysqld.3 - pid: 76071, winpid: 76071] - using different config file
      galera_3nodes.galera_allowlist 'innodb'  w1 [ pass ]  20650
      worker[01] > Restart [mysqld.1 - pid: 75005, winpid: 75005] - using different config file
      worker[01] > Restart [mysqld.2 - pid: 75026, winpid: 75026] - using different config file
      worker[01] > Restart [mysqld.3 - pid: 76842, winpid: 76842] - using different config file
      galera_3nodes.galera_ist_gcache_rollover 'innodb' w1 [ skipped ]  debug_sync is not available
      worker[01] > Restart [mysqld.1 - pid: 77607, winpid: 77607] - using different config file
      worker[01] > Restart [mysqld.2 - pid: 77628, winpid: 77628] - using different config file
      worker[01] > Restart [mysqld.3 - pid: 77630, winpid: 77630] - using different config file
      galera_3nodes.galera_ipv6_mysqldump 'innodb' w2 [ pass ]  16573
      worker[02] > Restart  - using different config file
      worker[02] > Restart  - using different config file
      worker[02] > Restart  - using different config file
      galera_3nodes.galera_toi_vote 'innodb'   w2 [ pass ]   8732
      worker[02] > Restart [mysqld.1 - pid: 79568, winpid: 79568] - using different config file
      worker[02] > Restart [mysqld.2 - pid: 79639, winpid: 79639] - using different config file
      worker[02] > Restart [mysqld.3 - pid: 80716, winpid: 80716] - using different config file
      galera_3nodes.galera_wsrep_schema_init 'innodb' w2 [ pass ]   2333
      worker[02] > Restart [mysqld.1 - pid: 81478, winpid: 81478] - using different config file
      worker[02] > Restart [mysqld.2 - pid: 81499, winpid: 81499] - using different config file
      worker[02] > Restart [mysqld.3 - pid: 81501, winpid: 81501] - using different config file
      galera_3nodes.galera_safe_to_bootstrap 'innodb' w1 [ pass ]  29825
      worker[01] > Restart  - using different config file
      worker[01] > Restart  - using different config file
      worker[01] > Restart  - using different config file
      

      Attachments

        Activity

          People

            nikitamalyavin Nikita Malyavin
            sanja Oleksandr Byelkin
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.