Details

    Description

      To run galera test suite on Galera 4.

      Attachments

        Issue Links

          Activity

            Status as of 31.12.2018:

            galera suite test run result:

            "Completed: Failed 6/246 tests, 97.56% were successful.

            Failing test(s): galera.galera_concurrent_ctas galera.galera_as_slave_nonprim galera.galera_autoinc_sst_mariabackup galera.galera_gcs_fragment galera.galera_sst_rsync2 galera.galera_sst_rsync_data_dir"

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited Status as of 31.12.2018: galera suite test run result: "Completed: Failed 6/246 tests, 97.56% were successful. Failing test(s): galera.galera_concurrent_ctas galera.galera_as_slave_nonprim galera.galera_autoinc_sst_mariabackup galera.galera_gcs_fragment galera.galera_sst_rsync2 galera.galera_sst_rsync_data_dir"

            Status as of 2.1.2019 is the same:

            "Completed: Failed 6/246 tests, 97.56% were successful.

            Failing test(s): galera.galera_concurrent_ctas galera.galera_as_slave_nonprim galera.galera_autoinc_sst_mariabackup galera.galera_gcs_fragment galera.galera_sst_rsync2 galera.galera_sst_rsync_data_dir"

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited Status as of 2.1.2019 is the same: "Completed: Failed 6/246 tests, 97.56% were successful. Failing test(s): galera.galera_concurrent_ctas galera.galera_as_slave_nonprim galera.galera_autoinc_sst_mariabackup galera.galera_gcs_fragment galera.galera_sst_rsync2 galera.galera_sst_rsync_data_dir"

            Two tests were skipped due to wrong Galera lib version:

            "galera.galera#505 'innodb' [ skipped ] Test requires Galera library version >= 25.3.24
            galera.galera_defaults 'innodb' [ skipped ] Test requires Galera library version >= 25.3.20"

            But at the same time:
            "wsrep loader: [INFO] wsrep_load(): Galera 26.4.0(r4454) by Codership Oy <info@codership.com> loaded successfully."

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited Two tests were skipped due to wrong Galera lib version: "galera.galera#505 'innodb' [ skipped ] Test requires Galera library version >= 25.3.24 galera.galera_defaults 'innodb' [ skipped ] Test requires Galera library version >= 25.3.20" But at the same time: "wsrep loader: [INFO] wsrep_load(): Galera 26.4.0(r4454) by Codership Oy <info@codership.com> loaded successfully."

            Status as of 3.1.2019 is the same except that galera.galera#505 and galera.galera_defaults was passed, not skipped as previous time.

            temeo [6:11 PM]:
            "galera_autoinc_sst_mariabackup failure leaves sometimes socat process lingering on background and it reserves the SST port. This may make some following tests on same MTR worker to fail because the SST fails when starting servers for the test."

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited Status as of 3.1.2019 is the same except that galera.galera#505 and galera.galera_defaults was passed, not skipped as previous time. temeo [6:11 PM] : "galera_autoinc_sst_mariabackup failure leaves sometimes socat process lingering on background and it reserves the SST port. This may make some following tests on same MTR worker to fail because the SST fails when starting servers for the test."

            Status as of 7.1.2019: 10 failed tests (last time there were only 6):

            "Completed: Failed 10/248 tests, 95.97% were successful.

            Failing test(s): galera.galera_bf_lock_wait galera.galera_concurrent_ctas galera.galera_autoinc_sst_mariabackup galera.galera_gcs_fragment galera.galera_gcs_max_packet_size galera.galera_gtid_slave galera.galera_gtid_slave_sst_rsync galera.galera_ist_mariabackup galera.galera_sst_rsync2 galera.galera_sst_rsync_data_dir"

            Here you are the new failed tests in comparing with test run on 04.01.2019:
            galera.galera_bf_lock_wait
            galera.galera_gcs_max_packet_size
            galera.galera_gtid_slave
            galera.galera_gtid_slave_sst_rsync
            galera.galera_ist_mariabackup

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited Status as of 7.1.2019: 10 failed tests (last time there were only 6): "Completed: Failed 10/248 tests, 95.97% were successful. Failing test(s): galera.galera_bf_lock_wait galera.galera_concurrent_ctas galera.galera_autoinc_sst_mariabackup galera.galera_gcs_fragment galera.galera_gcs_max_packet_size galera.galera_gtid_slave galera.galera_gtid_slave_sst_rsync galera.galera_ist_mariabackup galera.galera_sst_rsync2 galera.galera_sst_rsync_data_dir" Here you are the new failed tests in comparing with test run on 04.01.2019: galera.galera_bf_lock_wait galera.galera_gcs_max_packet_size galera.galera_gtid_slave galera.galera_gtid_slave_sst_rsync galera.galera_ist_mariabackup

            All of these tests being running separately have been passed successfully:

            galera.galera_bf_lock_wait
            galera.galera_gcs_max_packet_size
            galera.galera_gtid_slave
            galera.galera_ist_mariabackup

            And only galera.galera_gtid_slave_sst_rsync has failed.
            But one time it has passed anyway:

            galera.galera_gtid_slave_sst_rsync 'innodb' [ pass ] 42818
            galera.galera_gtid_slave_sst_rsync 'innodb' [ 2 fail ]

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited All of these tests being running separately have been passed successfully: galera.galera_bf_lock_wait galera.galera_gcs_max_packet_size galera.galera_gtid_slave galera.galera_ist_mariabackup And only galera.galera_gtid_slave_sst_rsync has failed. But one time it has passed anyway: galera.galera_gtid_slave_sst_rsync 'innodb' [ pass ] 42818 galera.galera_gtid_slave_sst_rsync 'innodb' [ 2 fail ]

            Status as of 9.1.2019: there is only one failed test remains:

            "Completed: Failed 1/240 tests, 99.58% were successful.

            Failing test(s): galera.galera_gcs_fragment"

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - Status as of 9.1.2019: there is only one failed test remains: "Completed: Failed 1/240 tests, 99.58% were successful. Failing test(s): galera.galera_gcs_fragment"

            Status as of 10.1.2019:

            "Completed: All 240 tests were successful."

            Just MTR's internal check of the test case 'galera.galera#500' failed:

            "Check of testcase failed for: galera.galera_bf_abort_shutdown galera.galera#500
            This means that the test case does not preserve the state that existed
            before the test case was executed. Most likely the test case did not
            do a proper clean-up. It could also be caused by the previous test run
            by this thread, if the server wasn't restarted.

            -AUTO_INCREMENT_OFFSET 1
            +AUTO_INCREMENT_OFFSET 2"

            I.e. the test is not preserving the value of the global variable `auto_increment_offset`.

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited Status as of 10.1.2019: "Completed: All 240 tests were successful." Just MTR's internal check of the test case ' galera.galera#500 ' failed: "Check of testcase failed for: galera.galera_bf_abort_shutdown galera.galera#500 This means that the test case does not preserve the state that existed before the test case was executed. Most likely the test case did not do a proper clean-up. It could also be caused by the previous test run by this thread, if the server wasn't restarted. -AUTO_INCREMENT_OFFSET 1 +AUTO_INCREMENT_OFFSET 2" I.e. the test is not preserving the value of the global variable `auto_increment_offset`.

            Status as of 16.01.2019:

            6/250 failed tests:

            galera.galera_as_slave_gtid_replicate_do_db_cc
            galera.galera_query_cache
            galera.galera_kill_nochanges
            galera.galera_split_brain
            galera.galera_bf_abort_group_commit
            galera.GCF-1081

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited Status as of 16.01.2019: 6/250 failed tests: galera.galera_as_slave_gtid_replicate_do_db_cc galera.galera_query_cache galera.galera_kill_nochanges galera.galera_split_brain galera.galera_bf_abort_group_commit galera.GCF-1081

            Status as of 17.01.2019:

            There are 3 failed tests:

            Completed: Failed 3/246 tests, 98.78% were successful.

            Failing test(s):
            galera.galera_var_slave_threads
            galera.galera_sst_mysqldump
            galera.galera_FK_duplicate_client_insert

            galera.galera_var_slave_threads is not failed on a laptop with SSD, but on a desktop with HDD is failed.

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited Status as of 17.01.2019: There are 3 failed tests: Completed: Failed 3/246 tests, 98.78% were successful. Failing test(s): galera.galera_var_slave_threads galera.galera_sst_mysqldump galera.galera_FK_duplicate_client_insert galera.galera_var_slave_threads is not failed on a laptop with SSD, but on a desktop with HDD is failed.

            Status as of 18.01.2019:

            "Completed: Failed 2/246 tests, 99.19% were successful.

            Failing test(s):
            galera.galera_FK_duplicate_client_insert
            galera.galera_sst_mysqldump"

            But `galera.galera_sst_mysqldump` is passed being run separately.

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - Status as of 18.01.2019: "Completed: Failed 2/246 tests, 99.19% were successful. Failing test(s): galera.galera_FK_duplicate_client_insert galera.galera_sst_mysqldump" But ` galera.galera_sst_mysqldump ` is passed being run separately.

            Status as of 21.01.2019:

            All tests are passed on a laptop with SSD.

            But on a desktop with HDD:

            "Completed: Failed 5/246 tests, 97.97% were successful.

            Failing test(s):

            galera.galera_ist_innodb_flush_logs
            galera.galera_gcache_re
            cover_full_gcache
            galera.galera_ist_mariabackup_innodb_flush_logs
            galera.galera_parallel_autoinc_manytrx
            galera.galera_sst_mysqldump"

            During separate runs all of them were passed except only `galera.galera_sst_mysqldump` which had the result "Failed 2/3 tests".

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - Status as of 21.01.2019: All tests are passed on a laptop with SSD. But on a desktop with HDD: "Completed: Failed 5/246 tests, 97.97% were successful. Failing test(s): galera.galera_ist_innodb_flush_logs galera.galera_gcache_re cover_full_gcache galera.galera_ist_mariabackup_innodb_flush_logs galera.galera_parallel_autoinc_manytrx galera.galera_sst_mysqldump" During separate runs all of them were passed except only ` galera.galera_sst_mysqldump ` which had the result "Failed 2/3 tests".

            Status as of 23.01.2019:

            After the merge with 10.4 all 246 `galera` suite tests have been passed on HDD and SSD.

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - Status as of 23.01.2019: After the merge with 10.4 all 246 `galera` suite tests have been passed on HDD and SSD.

            Status as of 12.02.2019:

            On a laptop with SSD all tests are passed, but on a desktop with HDD they are failed only if mtr is run with "--parallel=auto":

            "Completed: Failed 5/249 tests, 97.99% were successful.

            Failing test(s):
            galera.galera_gcache_recover_full_gcache
            galera.galera_ist_innodb_flush_logs
            galera.galera_ist_mariabackup_innodb_flush_logs
            galera.galera_parallel_autoinc_manytrx
            galera.galera_ist_recv_bind"

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited Status as of 12.02.2019: On a laptop with SSD all tests are passed, but on a desktop with HDD they are failed only if mtr is run with "--parallel=auto": "Completed: Failed 5/249 tests, 97.99% were successful. Failing test(s): galera.galera_gcache_recover_full_gcache galera.galera_ist_innodb_flush_logs galera.galera_ist_mariabackup_innodb_flush_logs galera.galera_parallel_autoinc_manytrx galera.galera_ist_recv_bind"

            Status as of 26.03.2019 on Server 10.4.4 (debug build from 10.4 branch).
            All the tests passed successfully on a laptop with SSD and on a desktop with HDD except some sporadic failures which however all passed being run separately:

            galera.galera_pc_recovery
            galera.galera_var_innodb_disallow_writes
            galera.galera_binlog_stmt_autoinc
            galera.MW-388
            galera_sr.GCF-1018
            galera.galera_transaction_replay

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - Status as of 26.03.2019 on Server 10.4.4 (debug build from 10.4 branch). All the tests passed successfully on a laptop with SSD and on a desktop with HDD except some sporadic failures which however all passed being run separately: galera.galera_pc_recovery galera.galera_var_innodb_disallow_writes galera.galera_binlog_stmt_autoinc galera.MW-388 galera_sr.GCF-1018 galera.galera_transaction_replay

            Status as of 04.04.2019.
            Server debug build from 10.4 branch, commit ba7d33a898d383f19f18733e6c25b029cdc304f3.

            SSD:

            Without parallel=auto. Sporadic failures:
            galera.galera_binlog_stmt_autoinc
            galera.galera_var_slave_threads
            galera.galera_transaction_replay

            With parallel=auto. Sporadic failures:
            galera.galera_binlog_stmt_autoinc
            galera.MDEV-16509

            HDD:

            Without parallel=auto and with default testcase-timeout=15 mins. Failures:
            galera.galera_var_innodb_disallow_writes
            galera.MDEV-16509
            galera.galera_binlog_stmt_autoinc
            galera.galera_transaction_replay
            galera.galera_wan_restart_ist
            galera.versioning_trx_id

            With parallel=auto:
            All passed.

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited Status as of 04.04.2019. Server debug build from 10.4 branch, commit ba7d33a898d383f19f18733e6c25b029cdc304f3. SSD : Without parallel=auto. Sporadic failures: galera.galera_binlog_stmt_autoinc galera.galera_var_slave_threads galera.galera_transaction_replay With parallel=auto. Sporadic failures: galera.galera_binlog_stmt_autoinc galera. MDEV-16509 HDD : Without parallel=auto and with default testcase-timeout=15 mins. Failures: galera.galera_var_innodb_disallow_writes galera. MDEV-16509 galera.galera_binlog_stmt_autoinc galera.galera_transaction_replay galera.galera_wan_restart_ist galera.versioning_trx_id With parallel=auto: All passed.

            Additional suite runs have updated yesterday status:

            On SSD without parallel=auto only one test failed:
            galera.galera_binlog_stmt_autoinc

            On HDD without parallel=auto and with testcase-timeout=270 only 3 tests failed:
            galera.galera_var_innodb_disallow_writes
            galera.galera_transaction_replay
            galera.versioning_trx_id

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited Additional suite runs have updated yesterday status: On SSD without parallel=auto only one test failed: galera.galera_binlog_stmt_autoinc On HDD without parallel=auto and with testcase-timeout=270 only 3 tests failed: galera.galera_var_innodb_disallow_writes galera.galera_transaction_replay galera.versioning_trx_id

            Status as of 15.04.2019.
            Server debug build from 10.4 branch, commit e4c5551964f398ebbe2b1b34fef028eff6f22fbe.
            Tests run on SSD.

            Without parallel=auto.
            All 255 tests were successful.

            With parallel=auto. Sporadic failures:
            galera.MW-388

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - Status as of 15.04.2019. Server debug build from 10.4 branch, commit e4c5551964f398ebbe2b1b34fef028eff6f22fbe. Tests run on SSD. Without parallel=auto. All 255 tests were successful. With parallel=auto. Sporadic failures: galera.MW-388

            Remaining issues reported separately.

            jplindst Jan Lindström (Inactive) added a comment - Remaining issues reported separately.

            People

              stepan.patryshev Stepan Patryshev (Inactive)
              stepan.patryshev Stepan Patryshev (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.