Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-24036

galera_3nodes.galera_ipv6_mysqldump: rare random crashes during shutdown

    XMLWordPrintable

    Details

      Description

      Sometimes (in rare cases) there is a failure on node number 2 during shutdown, which does not replay after restart of this test:

      galera_3nodes.galera_ipv6_mysqldump 'innodb' w2 [ fail ]
              Test ended at 2020-10-22 06:17:57
       
      CURRENT_TEST: galera_3nodes.galera_ipv6_mysqldump
      mysqltest: In included file "./include/shutdown_mysqld.inc": 
      included from ./include/restart_mysqld.inc at line 10:
      included from /usr/share/mysql/mysql-test/suite/galera_3nodes/t/galera_ipv6_mysqldump.test at line 84:
      At line 40: mysql_shutdown failed
       
      The result from queries just before the failure was:
      < snip >
      connection node_1;
      CREATE USER 'sst';
      GRANT ALL PRIVILEGES ON *.* TO 'sst';
      SET GLOBAL wsrep_sst_auth = 'sst:';
      connection node_2;
      SET GLOBAL wsrep_sst_method = 'mysqldump';
      Shutting down server ...
      connection node_1;
      Cleaning var directory ...
      CREATE TABLE t1 (f1 INTEGER NOT NULL PRIMARY KEY) ENGINE=InnoDB;
      INSERT INTO t1 VALUES (1);
      connection node_2;
      Starting server ...
      SELECT COUNT(*) AS EXPECT_1 FROM t1;
      EXPECT_1
      1
      DROP TABLE t1;
      SELECT VARIABLE_VALUE LIKE '%[::1]%' FROM INFORMATION_SCHEMA.GLOBAL_STATUS WHERE VARIABLE_NAME = 'wsrep_incoming_addresses';
      VARIABLE_VALUE LIKE '%[::1]%'
      1
       
      More results from queries before failure can be found in /dev/shm/var/2/log/galera_ipv6_mysqldump.log
       
       - saving '/dev/shm/var/2/log/galera_3nodes.galera_ipv6_mysqldump-innodb/' to '/dev/shm/var/log/galera_3nodes.galera_ipv6_mysqldump-innodb/'
       
      Retrying test galera_3nodes.galera_ipv6_mysqldump, attempt(2/3)...
       
      worker[2] > Restart  - not started
      worker[2] > Restart  - not started
      worker[2] > Restart  - not started
      galera_3nodes.galera_ipv6_mariabackup_section 'innodb' w1 [ pass ]  13629
      

      snippet of the log for node 2:

      2020-10-22  6:17:56 2 [Note] WSREP: Non-primary view
      2020-10-22  6:17:56 2 [Note] WSREP: Server status change disconnecting -> disconnected
      2020-10-22  6:17:56 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      2020-10-22  6:17:56 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
      2020-10-22  6:17:56 2 [Note] WSREP: Applier thread exiting ret: 0 thd: 2
      2020-10-22  6:17:56 2 [Warning] Aborted connection 2 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
      2020-10-22  6:17:56 0 [Note] WSREP: killing local connection: 13
      

        Attachments

        1. MDEV-24036_102_logs_201215.zip
          337 kB
        2. mysqld.1.err.2
          1.18 MB
        3. mysqld.2.err.2
          1.06 MB
        4. mysqld.3.err.2
          285 kB

          Issue Links

            Activity

              People

              Assignee:
              sysprg Julius Goryavsky
              Reporter:
              sysprg Julius Goryavsky
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Git Integration