Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-25614

Galera test failure on GCF-354

Details

    Description

      http://buildbot.askmonty.org/buildbot/builders/kvm-deb-bionic-aarch64/builds/5758/steps/mtr-galera/logs/stdio

      galera_3nodes.GCF-354 'innodb'           w1 [ fail ]
      		 
              Test ended at 2021-05-06 14:22:10
      		 
       
      		 
      CURRENT_TEST: galera_3nodes.GCF-354
      		 
      mysqltest: At line 39: query 'DROP TABLE test.t1' failed: 1047: WSREP has not yet prepared node for application use
      		 
       
      		 
      The result from queries just before the failure was:
      		 
      < snip >
      		 
      connection node_2;
      		 
      SET SESSION wsrep_on=OFF;
      		 
      DROP SCHEMA test;
      		 
      connection node_3;
      		 
      SET SESSION wsrep_on=OFF;
      		 
      CREATE TABLE test.t1 (f1 INTEGER NOT NULL PRIMARY KEY) engine=innodb;
      		 
      connection node_1;
      		 
      CREATE TABLE test.t1 (f1 INTEGER NOT NULL PRIMARY KEY) engine=innodb;
      		 
      INSERT INTO test.t1 values (1);
      		 
      Timeout in wait_condition.inc for SELECT VARIABLE_VALUE = 'Primary' FROM INFORMATION_SCHEMA.GLOBAL_STATUS WHERE VARIABLE_NAME = 'wsrep_cluster_status'
      		 
      Id	User	Host	db	Command	Time	State	Info	Progress
      		 
      1	system user		NULL	Sleep	43	closing tables	NULL	0.000
      		 
      2	system user		NULL	Sleep	43	wsrep aborter idle	NULL	0.000
      		 
      10	root	localhost	test	Sleep	34		NULL	0.000
      		 
      11	root	localhost:51412	test	Query	0	starting	show full processlist	0.000
      		 
      SHOW STATUS LIKE 'wsrep_cluster_status';
      		 
      Variable_name	Value
      		 
      wsrep_cluster_status	non-Primary
      		 
      DROP TABLE test.t1;
      		 
       
      		 
      More results from queries before failure can be found in /dev/shm/var/1/log/GCF-354.log
      		 
       
      		 
       - saving '/dev/shm/var/1/log/galera_3nodes.GCF-354-innodb/' to '/dev/shm/var/log/galera_3nodes.GCF-354-innodb/'
      		 
       
      		 
      Retrying test galera_3nodes.GCF-354, attempt(2/3)...
      		 
       
      		 
      worker[1] > Restart  - not started
      		 
      worker[1] > Restart  - not started
      		 
      worker[1] > Restart  - not started
      		 
      ***Warnings generated in error logs during shutdown after running tests: galera_3nodes.GCF-354
      		 
       
      		 
      2021-05-06 14:21:37 2 [ERROR] WSREP: Inconsistency detected: Inconsistent by consensus on deaeb02a-ae97-11eb-86d7-3a4fb7f19fe0:4
      		 
      2021-05-06 14:21:37 2 [ERROR] WSREP: Inconsistency detected: Inconsistent by consensus on deaeb02a-ae97-11eb-86d7-3a4fb7f19fe0:4

      Attachments

        Issue Links

          is part of

          Task - A task that needs to be done. MDEV-33073 always green buildbot

          • Major - Major loss of function.
          • Stalled

          Activity

            Ascending order - Click to sort in descending order
            danblack Daniel Black added a comment -

            10.11-0c6cac0a6fab8bf80f5509bec7eb8eff04446dde https://buildbot.mariadb.org/#/builders/621/builds/2688

            		 
             
            		 
            galera_3nodes.GCF-354 'innodb'           w2 [ retry-fail ]
            		 
                    Test ended at 2024-03-27 10:02:47
            		 
            CURRENT_TEST: galera_3nodes.GCF-354
            		 
            mysqltest: At line 32: query 'INSERT INTO test.t1 values (1)' failed: ER_ERROR_DURING_COMMIT (1180): Got error 6 "No such device or address" during COMMIT
            		 
            The result from queries just before the failure was:
            		 
            connection node_2;
            		 
            connection node_1;
            		 
            connection node_1;
            		 
            connection node_2;
            		 
            connection node_3;
            		 
            connection node_2;
            		 
            SET SESSION wsrep_on=OFF;
            		 
            DROP SCHEMA test;
            		 
            connection node_3;
            		 
            SET SESSION wsrep_on=OFF;
            		 
            CREATE TABLE test.t1 (f1 INTEGER NOT NULL PRIMARY KEY) engine=innodb;
            		 
            connection node_1;
            		 
            CREATE TABLE test.t1 (f1 INTEGER NOT NULL PRIMARY KEY) engine=innodb;
            		 
            INSERT INTO test.t1 values (1);
            		 
             - saving '/home/buildbot/amd64-debian-10-last-N-failed/build/mysql-test/var/2/log/galera_3nodes.GCF-354-innodb/' to '/home/buildbot/amd64-debian-10-last-N-failed/build/mysql-test/var/log/galera_3nodes.GCF-354-innodb/'
            		 
            ***Warnings generated in error logs during shutdown after running tests: galera_3nodes.GCF-354
            		 
            2024-03-27 10:02:46 12 [Warning] WSREP: Send action {(nil), 272, WRITESET} returned -107 (Transport endpoint is not connected)
            		 
            2024-03-27 10:02:46 2 [ERROR] WSREP: Inconsistency detected: Inconsistent by consensus on 208d5d6d-ec21-11ee-a967-8bfe007c1372:4
            		 
            2024-03-27 10:02:46 2 [ERROR] WSREP: Inconsistency detected: Inconsistent by consensus on 208d5d6d-ec21-11ee-a967-8bfe007c1372:4

            danblack Daniel Black added a comment - 10.11-0c6cac0a6fab8bf80f5509bec7eb8eff04446dde https://buildbot.mariadb.org/#/builders/621/builds/2688   galera_3nodes.GCF-354 'innodb' w2 [ retry-fail ] Test ended at 2024-03-27 10:02:47 CURRENT_TEST: galera_3nodes.GCF-354 mysqltest: At line 32: query 'INSERT INTO test.t1 values (1)' failed: ER_ERROR_DURING_COMMIT (1180): Got error 6 "No such device or address" during COMMIT The result from queries just before the failure was: connection node_2; connection node_1; connection node_1; connection node_2; connection node_3; connection node_2; SET SESSION wsrep_on=OFF; DROP SCHEMA test; connection node_3; SET SESSION wsrep_on=OFF; CREATE TABLE test.t1 (f1 INTEGER NOT NULL PRIMARY KEY) engine=innodb; connection node_1; CREATE TABLE test.t1 (f1 INTEGER NOT NULL PRIMARY KEY) engine=innodb; INSERT INTO test.t1 values (1); - saving '/home/buildbot/amd64-debian-10-last-N-failed/build/mysql-test/var/2/log/galera_3nodes.GCF-354-innodb/' to '/home/buildbot/amd64-debian-10-last-N-failed/build/mysql-test/var/log/galera_3nodes.GCF-354-innodb/' ***Warnings generated in error logs during shutdown after running tests: galera_3nodes.GCF-354 2024-03-27 10:02:46 12 [Warning] WSREP: Send action {(nil), 272, WRITESET} returned -107 (Transport endpoint is not connected) 2024-03-27 10:02:46 2 [ERROR] WSREP: Inconsistency detected: Inconsistent by consensus on 208d5d6d-ec21-11ee-a967-8bfe007c1372:4 2024-03-27 10:02:46 2 [ERROR] WSREP: Inconsistency detected: Inconsistent by consensus on 208d5d6d-ec21-11ee-a967-8bfe007c1372:4
            janlindstrom Jan Lindström added a comment -

            https://github.com/MariaDB/server/pull/3435

            janlindstrom Jan Lindström added a comment - https://github.com/MariaDB/server/pull/3435
            sysprg Julius Goryavsky added a comment -

            Fix merged with the head revision: https://github.com/MariaDB/server/commit/71f289e5d1691a060148d7063c663730f580f26d

            sysprg Julius Goryavsky added a comment - Fix merged with the head revision: https://github.com/MariaDB/server/commit/71f289e5d1691a060148d7063c663730f580f26d

            People

              sysprg Julius Goryavsky
              jplindst Jan Lindström (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.