[MDEV-18111] Galera 4: run galera test suite Created: 2018-12-31  Updated: 2019-06-12  Resolved: 2019-06-12

Status: Closed
Project: MariaDB Server
Component/s: Galera
Fix Version/s: 10.4.6

Type: Task Priority: Critical
Reporter: Stepan Patryshev (Inactive) Assignee: Stepan Patryshev (Inactive)
Resolution: Done Votes: 0
Labels: tests

Issue Links:
Relates
relates to MDEV-18590 galera.versioning_trx_id: Test failur... Stalled
relates to MDEV-18593 galera.galera_gcache_recover_full_gca... Closed
relates to MDEV-18754 galera.galera_bf_lock_wait: Test fail... Closed
relates to MDEV-18760 galera.galera_transaction_replay: Tes... Closed
relates to MDEV-18761 galera.galera_var_slave_threads: Test... Closed
relates to MDEV-18837 galera.MW-388: Test failure: mysqltes... Closed
relates to MDEV-18838 galera.galera_toi_truncate: Test fail... Closed

 Description   

To run galera test suite on Galera 4.



 Comments   
Comment by Stepan Patryshev (Inactive) [ 2018-12-31 ]

Status as of 31.12.2018:

galera suite test run result:

"Completed: Failed 6/246 tests, 97.56% were successful.

Failing test(s): galera.galera_concurrent_ctas galera.galera_as_slave_nonprim galera.galera_autoinc_sst_mariabackup galera.galera_gcs_fragment galera.galera_sst_rsync2 galera.galera_sst_rsync_data_dir"

Comment by Stepan Patryshev (Inactive) [ 2019-01-02 ]

Status as of 2.1.2019 is the same:

"Completed: Failed 6/246 tests, 97.56% were successful.

Failing test(s): galera.galera_concurrent_ctas galera.galera_as_slave_nonprim galera.galera_autoinc_sst_mariabackup galera.galera_gcs_fragment galera.galera_sst_rsync2 galera.galera_sst_rsync_data_dir"

Comment by Stepan Patryshev (Inactive) [ 2019-01-02 ]

Two tests were skipped due to wrong Galera lib version:

"galera.galera#505 'innodb' [ skipped ] Test requires Galera library version >= 25.3.24
galera.galera_defaults 'innodb' [ skipped ] Test requires Galera library version >= 25.3.20"

But at the same time:
"wsrep loader: [INFO] wsrep_load(): Galera 26.4.0(r4454) by Codership Oy <info@codership.com> loaded successfully."

Comment by Stepan Patryshev (Inactive) [ 2019-01-03 ]

Status as of 3.1.2019 is the same except that galera.galera#505 and galera.galera_defaults was passed, not skipped as previous time.

temeo [6:11 PM]:
"galera_autoinc_sst_mariabackup failure leaves sometimes socat process lingering on background and it reserves the SST port. This may make some following tests on same MTR worker to fail because the SST fails when starting servers for the test."

Comment by Stepan Patryshev (Inactive) [ 2019-01-07 ]

Status as of 7.1.2019: 10 failed tests (last time there were only 6):

"Completed: Failed 10/248 tests, 95.97% were successful.

Failing test(s): galera.galera_bf_lock_wait galera.galera_concurrent_ctas galera.galera_autoinc_sst_mariabackup galera.galera_gcs_fragment galera.galera_gcs_max_packet_size galera.galera_gtid_slave galera.galera_gtid_slave_sst_rsync galera.galera_ist_mariabackup galera.galera_sst_rsync2 galera.galera_sst_rsync_data_dir"

Here you are the new failed tests in comparing with test run on 04.01.2019:
galera.galera_bf_lock_wait
galera.galera_gcs_max_packet_size
galera.galera_gtid_slave
galera.galera_gtid_slave_sst_rsync
galera.galera_ist_mariabackup

Comment by Stepan Patryshev (Inactive) [ 2019-01-08 ]

All of these tests being running separately have been passed successfully:

galera.galera_bf_lock_wait
galera.galera_gcs_max_packet_size
galera.galera_gtid_slave
galera.galera_ist_mariabackup

And only galera.galera_gtid_slave_sst_rsync has failed.
But one time it has passed anyway:

galera.galera_gtid_slave_sst_rsync 'innodb' [ pass ] 42818
galera.galera_gtid_slave_sst_rsync 'innodb' [ 2 fail ]

Comment by Stepan Patryshev (Inactive) [ 2019-01-09 ]

Status as of 9.1.2019: there is only one failed test remains:

"Completed: Failed 1/240 tests, 99.58% were successful.

Failing test(s): galera.galera_gcs_fragment"

Comment by Stepan Patryshev (Inactive) [ 2019-01-10 ]

Status as of 10.1.2019:

"Completed: All 240 tests were successful."

Just MTR's internal check of the test case 'galera.galera#500' failed:

"Check of testcase failed for: galera.galera_bf_abort_shutdown galera.galera#500
This means that the test case does not preserve the state that existed
before the test case was executed. Most likely the test case did not
do a proper clean-up. It could also be caused by the previous test run
by this thread, if the server wasn't restarted.

-AUTO_INCREMENT_OFFSET 1
+AUTO_INCREMENT_OFFSET 2"

I.e. the test is not preserving the value of the global variable `auto_increment_offset`.

Comment by Stepan Patryshev (Inactive) [ 2019-01-16 ]

Status as of 16.01.2019:

6/250 failed tests:

galera.galera_as_slave_gtid_replicate_do_db_cc
galera.galera_query_cache
galera.galera_kill_nochanges
galera.galera_split_brain
galera.galera_bf_abort_group_commit
galera.GCF-1081

Comment by Stepan Patryshev (Inactive) [ 2019-01-17 ]

Status as of 17.01.2019:

There are 3 failed tests:

Completed: Failed 3/246 tests, 98.78% were successful.

Failing test(s):
galera.galera_var_slave_threads
galera.galera_sst_mysqldump
galera.galera_FK_duplicate_client_insert

galera.galera_var_slave_threads is not failed on a laptop with SSD, but on a desktop with HDD is failed.

Comment by Stepan Patryshev (Inactive) [ 2019-01-18 ]

Status as of 18.01.2019:

"Completed: Failed 2/246 tests, 99.19% were successful.

Failing test(s):
galera.galera_FK_duplicate_client_insert
galera.galera_sst_mysqldump"

But `galera.galera_sst_mysqldump` is passed being run separately.

Comment by Stepan Patryshev (Inactive) [ 2019-01-21 ]

Status as of 21.01.2019:

All tests are passed on a laptop with SSD.

But on a desktop with HDD:

"Completed: Failed 5/246 tests, 97.97% were successful.

Failing test(s):

galera.galera_ist_innodb_flush_logs
galera.galera_gcache_re
cover_full_gcache
galera.galera_ist_mariabackup_innodb_flush_logs
galera.galera_parallel_autoinc_manytrx
galera.galera_sst_mysqldump"

During separate runs all of them were passed except only `galera.galera_sst_mysqldump` which had the result "Failed 2/3 tests".

Comment by Stepan Patryshev (Inactive) [ 2019-01-23 ]

Status as of 23.01.2019:

After the merge with 10.4 all 246 `galera` suite tests have been passed on HDD and SSD.

Comment by Stepan Patryshev (Inactive) [ 2019-02-12 ]

Status as of 12.02.2019:

On a laptop with SSD all tests are passed, but on a desktop with HDD they are failed only if mtr is run with "--parallel=auto":

"Completed: Failed 5/249 tests, 97.99% were successful.

Failing test(s):
galera.galera_gcache_recover_full_gcache
galera.galera_ist_innodb_flush_logs
galera.galera_ist_mariabackup_innodb_flush_logs
galera.galera_parallel_autoinc_manytrx
galera.galera_ist_recv_bind"

Comment by Stepan Patryshev (Inactive) [ 2019-03-26 ]

Status as of 26.03.2019 on Server 10.4.4 (debug build from 10.4 branch).
All the tests passed successfully on a laptop with SSD and on a desktop with HDD except some sporadic failures which however all passed being run separately:

galera.galera_pc_recovery
galera.galera_var_innodb_disallow_writes
galera.galera_binlog_stmt_autoinc
galera.MW-388
galera_sr.GCF-1018
galera.galera_transaction_replay

Comment by Stepan Patryshev (Inactive) [ 2019-04-04 ]

Status as of 04.04.2019.
Server debug build from 10.4 branch, commit ba7d33a898d383f19f18733e6c25b029cdc304f3.

SSD:

Without parallel=auto. Sporadic failures:
galera.galera_binlog_stmt_autoinc
galera.galera_var_slave_threads
galera.galera_transaction_replay

With parallel=auto. Sporadic failures:
galera.galera_binlog_stmt_autoinc
galera.MDEV-16509

HDD:

Without parallel=auto and with default testcase-timeout=15 mins. Failures:
galera.galera_var_innodb_disallow_writes
galera.MDEV-16509
galera.galera_binlog_stmt_autoinc
galera.galera_transaction_replay
galera.galera_wan_restart_ist
galera.versioning_trx_id

With parallel=auto:
All passed.

Comment by Stepan Patryshev (Inactive) [ 2019-04-05 ]

Additional suite runs have updated yesterday status:

On SSD without parallel=auto only one test failed:
galera.galera_binlog_stmt_autoinc

On HDD without parallel=auto and with testcase-timeout=270 only 3 tests failed:
galera.galera_var_innodb_disallow_writes
galera.galera_transaction_replay
galera.versioning_trx_id

Comment by Stepan Patryshev (Inactive) [ 2019-04-15 ]

Status as of 15.04.2019.
Server debug build from 10.4 branch, commit e4c5551964f398ebbe2b1b34fef028eff6f22fbe.
Tests run on SSD.

Without parallel=auto.
All 255 tests were successful.

With parallel=auto. Sporadic failures:
galera.MW-388

Comment by Jan Lindström (Inactive) [ 2019-06-12 ]

Remaining issues reported separately.

Generated at Thu Feb 08 08:41:35 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.