Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-37966

Galera cluster goes to hang mode when running RQG on release build

    XMLWordPrintable

Details

    • Can result in hang or crash

    Description

      Galera cluster goes to hang mode when running RQG on release build
      Test case

      perl gendata.pl --dsn=dbi:mysql:host=127.0.0.1:port=12325:user=root:database=test --spec=conf/mariadb/oltp.zz
      perl gentest.pl --dsn=dbi:mysql:host=127.0.0.1:port=12325:user=root:database=test --grammar=conf/mariadb/oltp_fun.yy --threads=64 --duration=10300 --queries=100000000 &
      perl gentest.pl --dsn=dbi:mysql:host=127.0.0.1:port=10054:user=root:database=test --grammar=conf/mariadb/oltp_fun.yy --threads=64 --duration=10300 --queries=100000000 &
      

      Attached RQG grammar files, full back trace and cnf files

      process list

        node1:root@localhost> show processlist;
      +----+-------------+-----------------+------+---------+------+---------------------------------+------------------------------------------------------------------------------------------------------+----------+
      | Id | User        | Host            | db   | Command | Time | State                           | Info                                                                                                 | Progress |
      +----+-------------+-----------------+------+---------+------+---------------------------------+------------------------------------------------------------------------------------------------------+----------+
      |  1 | system user |                 | NULL | Sleep   | 1742 | wsrep aborter idle              | NULL                                                                                                 |    0.000 |
      |  2 | system user |                 | NULL | Sleep   | 1573 | Waiting for certification       | NULL                                                                                                 |    0.000 |
      |  6 | system user |                 | NULL | Sleep   | 1573 | Waiting for certification       | NULL                                                                                                 |    0.000 |
      | 12 | root        | localhost       | test | Sleep   | 1733 |                                 | NULL                                                                                                 |    0.000 |
      | 17 | root        | localhost:37956 | test | Query   | 1574 | Waiting for table metadata lock | OPTIMIZE TABLE t31 /* QNO 75 CON_ID 17 */                                                            |    0.000 |
      | 18 | root        | localhost:37966 | test | Query   | 1574 | Waiting to execute in isolation | OPTIMIZE TABLE t79 /* QNO 62 CON_ID 18 */                                                            |    0.000 |
      | 19 | root        | localhost:37974 | test | Query   | 1573 | Waiting to execute in isolation | FLUSH TABLES /* QNO 79 CON_ID 19 */                                                                  |    0.000 |
      | 20 | root        | localhost:37976 | test | Query   | 1573 | Waiting to execute in isolation | FLUSH TABLE t31 /* QNO 51 CON_ID 20 */                                                               |    0.000 |
      | 21 | root        | localhost:37986 | test | Query   | 1573 | Waiting to execute in isolation | FLUSH TABLES /* QNO 29 CON_ID 21 */                                                                  |    0.000 |
      | 22 | root        | localhost:37996 | test | Query   | 1573 | Waiting to execute in isolation | FLUSH TABLES /* QNO 15 CON_ID 22 */                                                                  |    0.000 |
      | 23 | root        | localhost:38012 | test | Query   | 1573 | Waiting for certification       | INSERT INTO `table90_innodb_dynamic_100110_page_compressed_1` ( `id` ) VALUES ( NULL ) /* QNO 10 CON |    0.000 |
      | 24 | root        | localhost:38018 | test | Query   | 1573 | Waiting to execute in isolation | OPTIMIZE TABLE t84 /* QNO 25 CON_ID 24 */                                                            |    0.000 |
      | 25 | root        | localhost:38020 | test | Query   | 1573 | Waiting to execute in isolation | FLUSH TABLES /* QNO 2 CON_ID 25 */                                                                   |    0.000 |
      | 26 | root        | localhost:38032 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v3 AS SELECT * FROM t27 /* QNO 35 CON_ID 26 */                                           |    0.000 |
      | 27 | root        | localhost:38048 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t11 /* QNO 12 CON_ID 27 */                                           |    0.000 |
      | 28 | root        | localhost:38058 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v3 AS SELECT * FROM t88 /* QNO 50 CON_ID 28 */                                           |    0.000 |
      | 29 | root        | localhost:38070 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v9 AS SELECT * FROM t31 /* QNO 33 CON_ID 29 */                                           |    0.000 |
      | 30 | root        | localhost:38072 | test | Query   |  577 | Waiting for certification       | INSERT INTO `oltp40` ( `id` ) VALUES ( 16452 ) /* QNO 64 CON_ID 30 */                                |    0.000 |
      | 31 | root        | localhost:38086 | test | Query   |  577 | Waiting to execute in isolation | OPTIMIZE TABLE t84 /* QNO 41 CON_ID 31 */                                                            |    0.000 |
      | 32 | root        | localhost:38092 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t53 /* QNO 37 CON_ID 32 */                                           |    0.000 |
      | 33 | root        | localhost:38094 | test | Query   | 1573 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t31 /* QNO 19 CON_ID 33 */                                           |    0.000 |
      | 34 | root        | localhost:38106 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v3 AS SELECT * FROM t68 /* QNO 23 CON_ID 34 */                                           |    0.000 |
      | 35 | root        | localhost:38112 | test | Query   |  577 | Waiting for table metadata lock | CREATE VIEW v6 AS SELECT * FROM t31 /* QNO 62 CON_ID 35 */                                           |    0.000 |
      | 36 | root        | localhost:38116 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t13 /* QNO 27 CON_ID 36 */                                           |    0.000 |
      | 37 | root        | localhost:38130 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t60 /* QNO 38 CON_ID 37 */                                           |    0.000 |
      | 38 | root        | localhost:38136 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t54 /* QNO 10 CON_ID 38 */                                           |    0.000 |
      | 39 | root        | localhost:38148 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t33 /* QNO 12 CON_ID 39 */                                           |    0.000 |
      | 40 | root        | localhost:38158 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v9 AS SELECT * FROM t83 /* QNO 13 CON_ID 40 */                                           |    0.000 |
      | 41 | root        | localhost:38166 | test | Query   | 1572 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t28 /* QNO 14 CON_ID 41 */                                           |    0.000 |
      | 42 | root        | localhost:38174 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v9 AS SELECT * FROM t58 /* QNO 26 CON_ID 42 */                                           |    0.000 |
      | 43 | root        | localhost:38176 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t46 /* QNO 20 CON_ID 43 */                                           |    0.000 |
      | 44 | root        | localhost:38190 | test | Query   | 1571 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t97 /* QNO 3 CON_ID 44 */                                            |    0.000 |
      | 45 | root        | localhost:38194 | test | Query   |  577 | Waiting to execute in isolation | OPTIMIZE TABLE t3 /* QNO 36 CON_ID 45 */                                                             |    0.000 |
      | 46 | root        | localhost:38208 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t77 /* QNO 7 CON_ID 46 */                                            |    0.000 |
      | 47 | root        | localhost:38220 | test | Query   | 1571 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t82 /* QNO 2 CON_ID 47 */                                            |    0.000 |
      | 48 | root        | localhost:38236 | test | Query   |  577 | Waiting to execute in isolation | OPTIMIZE TABLE t48 /* QNO 23 CON_ID 48 */                                                            |    0.000 |
      | 49 | root        | localhost:38252 | test | Query   | 1571 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t69 /* QNO 7 CON_ID 49 */                                            |    0.000 |
      | 50 | root        | localhost:38256 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t68 /* QNO 4 CON_ID 50 */                                            |    0.000 |
      | 51 | root        | localhost:38264 | test | Query   |  577 | Waiting for table metadata lock | CREATE VIEW v9 AS SELECT * FROM t75 /* QNO 38 CON_ID 51 */                                           |    0.000 |
      | 52 | root        | localhost:38274 | test | Query   |  577 | Waiting to execute in isolation | FLUSH TABLE t13 /* QNO 42 CON_ID 52 */                                                               |    0.000 |
      | 53 | root        | localhost:38284 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v3 AS SELECT * FROM t57 /* QNO 27 CON_ID 53 */                                           |    0.000 |
      | 54 | root        | localhost:38298 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t51 /* QNO 21 CON_ID 54 */                                           |    0.000 |
      | 55 | root        | localhost:38310 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t16 /* QNO 13 CON_ID 55 */                                           |    0.000 |
      | 56 | root        | localhost:38322 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t79 /* QNO 33 CON_ID 56 */                                           |    0.000 |
      | 57 | root        | localhost:38338 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v3 AS SELECT * FROM t31 /* QNO 35 CON_ID 57 */                                           |    0.000 |
      | 58 | root        | localhost:38354 | test | Query   | 1570 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t42 /* QNO 11 CON_ID 58 */                                           |    0.000 |
      | 59 | root        | localhost:38364 | test | Query   |  578 | Waiting for table metadata lock | CHECKSUM TABLE t31 /* QNO 7 CON_ID 59 */                                                             |    0.000 |
      | 60 | root        | localhost:38370 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t87 /* QNO 32 CON_ID 60 */                                           |    0.000 |
      | 61 | root        | localhost:38372 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v9 AS SELECT * FROM t83 /* QNO 18 CON_ID 61 */                                           |    0.000 |
      | 62 | root        | localhost:38386 | test | Query   |  577 | Waiting for certification       | INSERT INTO `oltp29` ( `id`, `c` ) VALUES ( NULL, 'j' ) /* QNO 64 CON_ID 62 */                       |    0.000 |
      | 63 | root        | localhost:38388 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v3 AS SELECT * FROM t93 /* QNO 14 CON_ID 63 */                                           |    0.000 |
      | 64 | root        | localhost:38398 | test | Query   |  577 | Waiting for certification       | DELETE FROM `table10000_innodb_dynamic` WHERE `id` = 16285 /* QNO 46 CON_ID 64 */                    |    0.000 |
      | 65 | root        | localhost:38408 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v3 AS SELECT * FROM t11 /* QNO 30 CON_ID 65 */                                           |    0.000 |
      | 66 | root        | localhost:38418 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t57 /* QNO 16 CON_ID 66 */                                           |    0.000 |
      | 67 | root        | localhost:38432 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v3 AS SELECT * FROM t70 /* QNO 18 CON_ID 67 */                                           |    0.000 |
      | 68 | root        | localhost:38444 | test | Query   |  577 | Waiting to execute in isolation | FLUSH TABLES /* QNO 20 CON_ID 68 */                                                                  |    0.000 |
      | 69 | root        | localhost:38460 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v9 AS SELECT * FROM t53 /* QNO 13 CON_ID 69 */                                           |    0.000 |
      | 70 | root        | localhost:38466 | test | Query   |  577 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t100 /* QNO 26 CON_ID 70 */                                          |    0.000 |
      | 71 | root        | localhost:38476 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t45 /* QNO 7 CON_ID 71 */                                            |    0.000 |
      | 72 | root        | localhost:42308 | test | Query   |  577 | Waiting to execute in isolation | OPTIMIZE TABLE t94 /* QNO 40 CON_ID 72 */                                                            |    0.000 |
      | 73 | root        | localhost:42320 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t42 /* QNO 19 CON_ID 73 */                                           |    0.000 |
      | 74 | root        | localhost:42336 | test | Query   | 1568 | Waiting for table metadata lock | CREATE VIEW v4 AS SELECT * FROM t45 /* QNO 2 CON_ID 74 */                                            |    0.000 |
      | 75 | root        | localhost:42342 | test | Query   |  578 | Waiting for table metadata lock | CREATE VIEW v3 AS SELECT * FROM t67 /* QNO 21 CON_ID 75 */                                           |    0.000 |
      | 76 | root        | localhost:42346 | test | Query   |  577 | Waiting for table metadata lock | CREATE VIEW v9 AS SELECT * FROM t3 /* QNO 22 CON_ID 76 */                                            |    0.000 |
      | 77 | root        | localhost:42354 | test | Query   |  577 | Waiting to execute in isolation | OPTIMIZE TABLE t15 /* QNO 35 CON_ID 77 */                                                            |    0.000 |
      | 78 | root        | localhost:42356 | test | Query   |  577 | Waiting to execute in isolation | OPTIMIZE TABLE t69 /* QNO 33 CON_ID 78 */                                                            |    0.000 |
      | 79 | root        | localhost:42368 | test | Query   |  577 | Waiting to execute in isolation | FLUSH TABLES /* QNO 29 CON_ID 79 */                                                                  |    0.000 |
      | 80 | root        | localhost:42376 | test | Query   |  577 | Waiting to execute in isolation | OPTIMIZE TABLE t89 /* QNO 43 CON_ID 80 */                                                            |    0.000 |
      | 82 | root        | localhost       | test | Query   |    0 | starting                        | show processlist                                                                                     |    0.000 |
      +----+-------------+-----------------+------+---------+------+---------------------------------+------------------------------------------------------------------------------------------------------+----------+
      69 rows in set (0.002 sec)
       
      node1:root@localhost> 
      node1:root@localhost> create database test_one;
      
      

      Attachments

        1. oltp.zz
          2 kB
        2. oltp_fun.yy
          4 kB
        3. n2.cnf
          1.0 kB
        4. n1.cnf
          1.0 kB
        5. bt_all.txt
          373 kB

        Activity

          People

            janlindstrom Jan Lindström
            ramesh Ramesh Sivaraman
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.