Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-24036

galera_3nodes.galera_ipv6_mysqldump: rare random crashes during shutdown

    XMLWordPrintable

Details

    Description

      Sometimes (in rare cases) there is a failure on node number 2 during shutdown, which does not replay after restart of this test:

      galera_3nodes.galera_ipv6_mysqldump 'innodb' w2 [ fail ]
              Test ended at 2020-10-22 06:17:57
       
      CURRENT_TEST: galera_3nodes.galera_ipv6_mysqldump
      mysqltest: In included file "./include/shutdown_mysqld.inc": 
      included from ./include/restart_mysqld.inc at line 10:
      included from /usr/share/mysql/mysql-test/suite/galera_3nodes/t/galera_ipv6_mysqldump.test at line 84:
      At line 40: mysql_shutdown failed
       
      The result from queries just before the failure was:
      < snip >
      connection node_1;
      CREATE USER 'sst';
      GRANT ALL PRIVILEGES ON *.* TO 'sst';
      SET GLOBAL wsrep_sst_auth = 'sst:';
      connection node_2;
      SET GLOBAL wsrep_sst_method = 'mysqldump';
      Shutting down server ...
      connection node_1;
      Cleaning var directory ...
      CREATE TABLE t1 (f1 INTEGER NOT NULL PRIMARY KEY) ENGINE=InnoDB;
      INSERT INTO t1 VALUES (1);
      connection node_2;
      Starting server ...
      SELECT COUNT(*) AS EXPECT_1 FROM t1;
      EXPECT_1
      1
      DROP TABLE t1;
      SELECT VARIABLE_VALUE LIKE '%[::1]%' FROM INFORMATION_SCHEMA.GLOBAL_STATUS WHERE VARIABLE_NAME = 'wsrep_incoming_addresses';
      VARIABLE_VALUE LIKE '%[::1]%'
      1
       
      More results from queries before failure can be found in /dev/shm/var/2/log/galera_ipv6_mysqldump.log
       
       - saving '/dev/shm/var/2/log/galera_3nodes.galera_ipv6_mysqldump-innodb/' to '/dev/shm/var/log/galera_3nodes.galera_ipv6_mysqldump-innodb/'
       
      Retrying test galera_3nodes.galera_ipv6_mysqldump, attempt(2/3)...
       
      worker[2] > Restart  - not started
      worker[2] > Restart  - not started
      worker[2] > Restart  - not started
      galera_3nodes.galera_ipv6_mariabackup_section 'innodb' w1 [ pass ]  13629
      

      snippet of the log for node 2:

      2020-10-22  6:17:56 2 [Note] WSREP: Non-primary view
      2020-10-22  6:17:56 2 [Note] WSREP: Server status change disconnecting -> disconnected
      2020-10-22  6:17:56 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      2020-10-22  6:17:56 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      2020-10-22  6:17:56 2 [Note] WSREP: Applier thread exiting ret: 0 thd: 2
      2020-10-22  6:17:56 2 [Warning] Aborted connection 2 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
      2020-10-22  6:17:56 0 [Note] WSREP: killing local connection: 13
      

      Attachments

        1. mysqld.3.err.2
          285 kB
          Julius Goryavsky
        2. mysqld.1.err.2
          1.18 MB
          Julius Goryavsky
        3. mysqld.2.err.2
          1.06 MB
          Julius Goryavsky

        Issue Links

          Activity

            People

              sysprg Julius Goryavsky (Inactive)
              sysprg Julius Goryavsky (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: