Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-12277

rocksdb.rocksdb fails with Sort Aborted error in server stderr

Details

    Description

      It started to fail like this after the last merge:

      rocksdb.rocksdb                          [ fail ]  Found warnings/errors in server log file!
              Test ended at 2017-03-15 22:07:01
      line
      2017-03-15 22:06:03 139761695200000 [Warning] Sort aborted, host: localhost, user: root, thread: 9, query: DELETE IGNORE FROM t1 ORDER BY i
      ^ Found warnings in /home/psergey/dev-git/10.2-mariarocks/mysql-test/var/log/mysqld.1.err
      ok
       
       - saving '/home/psergey/dev-git/10.2-mariarocks/mysql-test/var/log/rocksdb.rocksdb/' to '/home/psergey/dev-git/10.2-mariarocks/mysql-test/var/log/rocksdb.rocksdb/'
      --------------------------------------------------------------------------
      The servers were restarted 0 times
      Spent 0.000 of 94 seconds executing testcases
      mysql-test-run: WARNING: Got errors/warnings while running tests, please examine '/home/psergey/dev-git/10.2-mariarocks/mysql-test/var/log/warnings' for details.
      

      maybe other tests have similar issues.

      The error:

      2017-03-15 22:06:03 139761695200000 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction
      2017-03-15 22:06:03 139761695200000 [Warning] Sort aborted, host: localhost, user: root, thread: 9, query: DELETE IGNORE FROM t1 ORDER BY i
      

      The relevant rocksdb.rocksdb test:

      --echo # 
      --echo # MDEV-4298: RocksDB: Assertion `thd->is_error() || kill_errno' fails in ha_rows filesort
      --echo # 
      CREATE TABLE t1 (pk INT PRIMARY KEY, i INT, KEY(i)) ENGINE=RocksDB;
      INSERT INTO t1 VALUES (1,1),(2,2);
      BEGIN;
      UPDATE t1 SET i = 100;
       
      --connect (con1,localhost,root,,test)
      --error ER_LOCK_WAIT_TIMEOUT
      DELETE IGNORE FROM t1 ORDER BY i;
      --disconnect con1
      

      Attachments

        Issue Links

          Activity

            psergei Sergei Petrunia created issue -
            psergei Sergei Petrunia made changes -
            Field Original Value New Value
            psergei Sergei Petrunia made changes -
            Component/s Storage Engine - RocksDB [ 13901 ]
            psergei Sergei Petrunia made changes -
            Fix Version/s 10.2 [ 14601 ]
            psergei Sergei Petrunia made changes -
            Description It started to fail like this after the last merge:

            {noformat}
            rocksdb.rocksdb [ fail ] Found warnings/errors in server log file!
                    Test ended at 2017-03-15 22:07:01
            line
            2017-03-15 22:06:03 139761695200000 [Warning] Sort aborted, host: localhost, user: root, thread: 9, query: DELETE IGNORE FROM t1 ORDER BY i
            ^ Found warnings in /home/psergey/dev-git/10.2-mariarocks/mysql-test/var/log/mysqld.1.err
            ok

             - saving '/home/psergey/dev-git/10.2-mariarocks/mysql-test/var/log/rocksdb.rocksdb/' to '/home/psergey/dev-git/10.2-mariarocks/mysql-test/var/log/rocksdb.rocksdb/'
            --------------------------------------------------------------------------
            The servers were restarted 0 times
            Spent 0.000 of 94 seconds executing testcases
            mysql-test-run: WARNING: Got errors/warnings while running tests, please examine '/home/psergey/dev-git/10.2-mariarocks/mysql-test/var/log/warnings' for details.
            {noformat}

            maybe other tests have similar issues.
            It started to fail like this after the last merge:

            {noformat}
            rocksdb.rocksdb [ fail ] Found warnings/errors in server log file!
                    Test ended at 2017-03-15 22:07:01
            line
            2017-03-15 22:06:03 139761695200000 [Warning] Sort aborted, host: localhost, user: root, thread: 9, query: DELETE IGNORE FROM t1 ORDER BY i
            ^ Found warnings in /home/psergey/dev-git/10.2-mariarocks/mysql-test/var/log/mysqld.1.err
            ok

             - saving '/home/psergey/dev-git/10.2-mariarocks/mysql-test/var/log/rocksdb.rocksdb/' to '/home/psergey/dev-git/10.2-mariarocks/mysql-test/var/log/rocksdb.rocksdb/'
            --------------------------------------------------------------------------
            The servers were restarted 0 times
            Spent 0.000 of 94 seconds executing testcases
            mysql-test-run: WARNING: Got errors/warnings while running tests, please examine '/home/psergey/dev-git/10.2-mariarocks/mysql-test/var/log/warnings' for details.
            {noformat}

            maybe other tests have similar issues.


            The error:
            {noformat}
            2017-03-15 22:06:03 139761695200000 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction
            2017-03-15 22:06:03 139761695200000 [Warning] Sort aborted, host: localhost, user: root, thread: 9, query: DELETE IGNORE FROM t1 ORDER BY i
            {noformat}

            The relevant rocksdb.rocksdb test:
            {noformat}
            --echo #
            --echo # MDEV-4298: RocksDB: Assertion `thd->is_error() || kill_errno' fails in ha_rows filesort
            --echo #
            CREATE TABLE t1 (pk INT PRIMARY KEY, i INT, KEY(i)) ENGINE=RocksDB;
            INSERT INTO t1 VALUES (1,1),(2,2);
            BEGIN;
            UPDATE t1 SET i = 100;

            --connect (con1,localhost,root,,test)
            --error ER_LOCK_WAIT_TIMEOUT
            DELETE IGNORE FROM t1 ORDER BY i;
            --disconnect con1
            {noformat}

            psergei Sergei Petrunia added a comment - - edited

            Running the test on fb/mysql-5.6. The test passes, but var/log/mysqld.1.err has the same kind of error messages:

            2017-03-16 01:14:33 14518 [ERROR] /home/ubuntu/mysql-5.6/sql/mysqld: Lock wait timeout exceeded; try restarting transaction: Timeout on index: test.t1.PRIMARY
            2017-03-16 01:14:33 14518 [ERROR] /home/ubuntu/mysql-5.6/sql/mysqld: Sort aborted: Lock wait timeout exceeded; try restarting transaction: Timeout on index: test.t1.PRIMARY
            

            and looking through mysql-test/suite/rocksdb , I can't find any suppression being added for this.

            psergei Sergei Petrunia added a comment - - edited Running the test on fb/mysql-5.6. The test passes, but var/log/mysqld.1.err has the same kind of error messages: 2017-03-16 01:14:33 14518 [ERROR] /home/ubuntu/mysql-5.6/sql/mysqld: Lock wait timeout exceeded; try restarting transaction: Timeout on index: test.t1.PRIMARY 2017-03-16 01:14:33 14518 [ERROR] /home/ubuntu/mysql-5.6/sql/mysqld: Sort aborted: Lock wait timeout exceeded; try restarting transaction: Timeout on index: test.t1.PRIMARY and looking through mysql-test/suite/rocksdb , I can't find any suppression being added for this.

            With Elena's help, figured that the upstream has Sort aborted stderr message globally suppressed.

            Should rocksdb test suite have some suite-wide suppressions? Galera has, see ../plugin/wsrep_info/mysql-test/wsrep_info/suite.pm for an example.

            For now, will just add a suppression to rocksdb.rocksdb.

            psergei Sergei Petrunia added a comment - With Elena's help, figured that the upstream has Sort aborted stderr message globally suppressed. Should rocksdb test suite have some suite-wide suppressions? Galera has, see ../plugin/wsrep_info/mysql-test/wsrep_info/suite.pm for an example. For now, will just add a suppression to rocksdb.rocksdb.

            Fix pushed to bb-10.2-mariarocks.

            psergei Sergei Petrunia added a comment - Fix pushed to bb-10.2-mariarocks.
            psergei Sergei Petrunia made changes -
            Fix Version/s N/A [ 14700 ]
            Fix Version/s 10.2 [ 14601 ]
            Resolution Fixed [ 1 ]
            Status Open [ 1 ] Closed [ 6 ]

            Got interested why this error message shows up now but didn't show up before. It's because the current server has log_warnings=2, while before the merge it had log_warnings=1. This is why rocksdb.rocksdb did not print Sort aborted into stderr.

            psergei Sergei Petrunia added a comment - Got interested why this error message shows up now but didn't show up before. It's because the current server has log_warnings=2 , while before the merge it had log_warnings=1 . This is why rocksdb.rocksdb did not print Sort aborted into stderr.
            serg Sergei Golubchik made changes -
            Workflow MariaDB v3 [ 80001 ] MariaDB v4 [ 133175 ]

            People

              Unassigned Unassigned
              psergei Sergei Petrunia
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.