[MDEV-18109] Galera 4: run galera_sr test suite Created: 2018-12-31  Updated: 2019-06-12  Resolved: 2019-06-12

Status: Closed
Project: MariaDB Server
Component/s: Galera
Fix Version/s: 10.4.6

Type: Task Priority: Critical
Reporter: Stepan Patryshev (Inactive) Assignee: Stepan Patryshev (Inactive)
Resolution: Done Votes: 0
Labels: tests


 Description   

To run galera_sr test suite on Galera 4.

 Comments   
Comment by Stepan Patryshev (Inactive) [ 2018-12-31 ]

Status as of 31.12.2018:

galera_sr suite test run result:

"Completed: Failed 13/83 tests, 84.34% were successful.

Failing test(s): galera_sr.GCF-437 galera_sr.galera_sr_load_data_splitting galera_sr.GCF-1043A galera_sr.GCF-1043B galera_sr.GCF-1060 galera_sr.GCF-597 galera_sr.galera_sr_bf_abort galera_sr.galera_sr_cc_slave galera_sr.galera_sr_rollback_statement galera_sr.galera_sr_table_contents galera_sr.mysql-wsrep#215 galera_sr.mysql-wsrep-features#165 galera_sr.galera_sr_mysqldump_sst"

Comment by Stepan Patryshev (Inactive) [ 2019-01-02 ]

Status as of 2.1.2019:

"Completed: Failed 14/83 tests, 83.13% were successful.

Failing test(s): galera_sr.GCF-437 galera_sr.galera_sr_load_data_splitting galera_sr.galera_sr_many_fragments galera_sr.GCF-1043A galera_sr.GCF-1043B galera_sr.GCF-1060 galera_sr.GCF-597 galera_sr.galera_sr_bf_abort galera_sr.galera_sr_cc_slave galera_sr.galera_sr_rollback_statement galera_sr.galera_sr_table_contents galera_sr.mysql-wsrep#215 galera_sr.mysql-wsrep-features#165 galera_sr.galera_sr_mysqldump_sst"

Comment by Stepan Patryshev (Inactive) [ 2019-01-03 ]

Status as of 3.1.2019:
There are 6 more failed tests:

"Completed: Failed 20/83 tests, 75.90% were successful.

Failing test(s): galera_sr.galera_sr_large_fragment galera_sr.GCF-437 galera_sr.galera_sr_load_data_splitting galera_sr.galera_sr_many_fragments galera_sr.mysql-wsrep-features#8 galera_sr.GCF-1043A galera_sr.GCF-1043B galera_sr.GCF-1060 galera_sr.GCF-597 galera_sr.galera-features#56 galera_sr.galera_sr_cc_master galera_sr.galera_sr_cc_slave galera_sr.galera_sr_insert_select galera_sr.galera_sr_load_data galera_sr.galera_sr_rollback_statement galera_sr.galera_sr_table_contents galera_sr.mysql-wsrep#215 galera_sr.mysql-wsrep-features#165 galera_sr.galera_sr_mysqldump_sst galera_sr.galera_sr_small_gcache"

Comment by Stepan Patryshev (Inactive) [ 2019-01-04 ]

Status as of 4.1.2019:
There are 14 failed tests today (yesterday there were 20):

"Completed: Failed 14/83 tests, 83.13% were successful.

Failing test(s): galera_sr.GCF-437 galera_sr.galera_sr_load_data_splitting galera_sr.galera_sr_many_fragments galera_sr.GCF-1018 galera_sr.GCF-1043A galera_sr.GCF-1043B galera_sr.GCF-1060 galera_sr.galera_sr_cc_master galera_sr.galera_sr_cc_slave galera_sr.galera_sr_rollback_statement galera_sr.galera_sr_table_contents galera_sr.mysql-wsrep#215 galera_sr.mysql-wsrep-features#165 galera_sr.galera_sr_mysqldump_sst"

sciascid [12:44 PM]:
"those are all expected failures, except for galera_sr_cc_master."

Comment by Stepan Patryshev (Inactive) [ 2019-01-07 ]

Status as of 07.01.2019:
It's again 20 failed tests (last time there were 14 ones):

"Completed: Failed 20/83 tests, 75.90% were successful.

Failing test(s): galera_sr.galera_sr_large_fragment galera_sr.GCF-437 galera_sr.galera_sr_load_data_splitting galera_sr.galera_sr_many_fragments galera_sr.mysql-wsrep-features#8 galera_sr.GCF-1018 galera_sr.GCF-1043A galera_sr.GCF-1043B galera_sr.GCF-1060 galera_sr.galera-features#56 galera_sr.galera_sr_cc_master galera_sr.galera_sr_cc_slave galera_sr.galera_sr_insert_select galera_sr.galera_sr_load_data galera_sr.galera_sr_rollback_statement galera_sr.galera_sr_table_contents galera_sr.mysql-wsrep#215 galera_sr.mysql-wsrep-features#165 galera_sr.galera_sr_mysqldump_sst galera_sr.galera_sr_small_gcache"

The new failed tests compared with the test run on 04.01.2019 are the following:

galera_sr.galera_sr_large_fragment
galera_sr.mysql-wsrep-features#8
galera_sr.galera-features#56
galera_sr.galera_sr_insert_select
galera_sr.galera_sr_load_data
galera_sr.galera_sr_small_gcache

Comment by Stepan Patryshev (Inactive) [ 2019-01-09 ]

Status as of 08.01.2019:
I've run these new failed tests from `galera_sr` suite separately:
galera_sr.galera_sr_large_fragment
galera_sr.mysql-wsrep-features#8
galera_sr.galera-features#56
galera_sr.galera_sr_insert_select
galera_sr.galera_sr_load_data
galera_sr.galera_sr_small_gcache

And it looks like they are passed on one of my machine and are failed on another one.

Comment by Stepan Patryshev (Inactive) [ 2019-01-10 ]

Status as of 09.01.2019:

"Completed: Failed 12/83 tests, 85.54% were successful.

Failing test(s):

galera_sr.GCF-437
galera_sr.galera_sr_rollback_statement
galera_sr.galera_sr_table_contents
galera_sr.mysql-wsrep-features#165
galera_sr.galera_sr_mysqldump_sst
galera_sr.galera_sr_cc_master
galera_sr.galera_sr_cc_slave
galera_sr.GCF-1018
galera_sr.galera_sr_load_data_splitting
galera_sr.GCF-1060
galera_sr.GCF-1043A
galera_sr.GCF-1043B"

Comment by Stepan Patryshev (Inactive) [ 2019-01-18 ]

Status as of 17.01.2019:

Completed: Failed 9/83 tests, 89.16% were successful.
Failing test(s):

galera_sr.GCF-437
galera_sr.galera_sr_load_data_splitting
galera_sr.galera_sr_cc_master
galera_sr.galera_sr_cc_slave
galera_sr.galera_sr_rollback_statement
galera_sr.galera_sr_shutdown_slave
galera_sr.galera_sr_table_contents
galera_sr.mysql-wsrep-features#165
galera_sr.galera_sr_mysqldump_sst

Comment by Stepan Patryshev (Inactive) [ 2019-01-23 ]

Status as of 23.01.2019:

"Completed: Failed 7/83 tests, 91.57% were successful.

Failing test(s):
galera_sr.GCF-437
galera_sr.galera_sr_rollback_statement
galera_sr.galera_sr_table_contents
galera_sr.mysql-wsrep-features#165
galera_sr.galera_sr_mysqldump_sst
galera_sr.galera_sr_cc_master
galera_sr.galera_sr_load_data_splitting"

Comment by Stepan Patryshev (Inactive) [ 2019-02-12 ]

Status as of 12.02.2019:

On a laptop with SSD:
"Completed: Failed 8/83 tests, 90.36% were successful.

Failing test(s):
galera_sr.GCF-437
galera_sr.galera_sr_rollback_statement
galera_sr.galera_sr_table_contents
galera_sr.mysql-wsrep-features#165
galera_sr.galera_sr_mysqldump_sst
galera_sr.galera_sr_cc_master
galera_sr.galera_sr_load_data_splitting
galera_sr.GCF-1060"

On a desktop with HDD:
"Completed: Failed 18/83 tests, 78.31% were successful.

Failing test(s):
galera_sr.galera_sr_large_fragment
galera_sr.GCF-437
galera_sr.galera_sr_load_data_splitting
galera_sr.galera_sr_many_fragments
galera_sr.mysql-wsrep-features#8
galera_sr.GCF-1043A
galera_sr.GCF-1043B
galera_sr.GCF-867
galera_sr.galera-features#56
galera_sr.galera_sr_cc_master
galera_sr.galera_sr_ddl_master
galera_sr.galera_sr_insert_select
galera_sr.galera_sr_load_data
galera_sr.galera_sr_rollback_statement
galera_sr.galera_sr_table_contents
galera_sr.mysql-wsrep-features#165
galera_sr.galera_sr_mysqldump_sst
galera_sr.galera_sr_small_gcache"

Comment by Stepan Patryshev (Inactive) [ 2019-03-13 ]

Status as of 13.03.2019 on Server 10.4.4:

On a laptop with SSD:
All 85 tests were successful.

On a desktop with HDD:
There are 12 failed test:

galera_sr.galera_sr_large_fragment
galera_sr.galera_sr_many_fragments
galera_sr.mysql-wsrep-features#8
galera_sr.GCF-1043A
galera_sr.GCF-1043B
galera_sr.GCF-867
galera_sr.galera-features#56
galera_sr.galera_sr_insert_select
galera_sr.galera_sr_kill_all_norecovery
galera_sr.galera_sr_small_gcache
galera_sr.mysql-wsrep#215
galera_sr.galera_sr_cc_master

Comment by Stepan Patryshev (Inactive) [ 2019-03-14 ]

Here you are the results playing with `testcase-timeout` on HDD with Server 10.4.4:

testcase-timeout   failed tests
 
15                  12    
40                  10 
90                   5
 
180                  4
 
270                  2
 
360                  4
 
600                  3

Comment by Stepan Patryshev (Inactive) [ 2019-03-14 ]

loose-skip-innodb-flush-log-at-trx-commit and loose-skip-sync-binlog options results:

./mtr --suite galera_sr --force --big-test --max-test-fail=0 --parallel=auto --mysqld=--loose-skip-sync-binlog --mysqld=--loose-skip-innodb-flush-log-at-trx-commit

On SSD galera_sr.galera_sr_cc_master has failed.

And on HDD Only 3 tests have failed:
galera_sr.galera_sr_kill_all_norecovery
galera_sr.galera_sr_large_fragment
galera_sr.GCF-1018

Comment by Stepan Patryshev (Inactive) [ 2019-03-26 ]

Status as of 26.03.2019 on Server 10.4.4 (debug build from 10.4 branch).
The following tests failed:

SSD laptop:
galera_sr.GCF-1018

HDD desktop:
galera_sr.galera_sr_large_fragment (due to timeout 15 mins)
galera_sr.galera-features#56

And there is another one sporadic failure that passed during outstanding run:
galera_sr.GCF-597

Comment by Stepan Patryshev (Inactive) [ 2019-04-04 ]

Status as of 04.04.2019.
Server debug build from 10.4 branch, commit ba7d33a898d383f19f18733e6c25b029cdc304f3.

SSD:

Without parallel=auto: all passed.

With parallel=auto. Sporadic failures:
galera_sr.galera_sr_mysqldump_sst
galera_sr.GCF-1060

HDD:

Without parallel=auto and with default testcase-timeout=15 mins. Failures:

galera_sr.galera_sr_large_fragment
galera_sr.galera_sr_many_fragments
galera_sr.mysql-wsrep-features#8
galera_sr.GCF-1043A
galera_sr.GCF-1043B
galera_sr.GCF-867
galera_sr.galera-features#56
galera_sr.galera_sr_insert_select
galera_sr.galera_sr_small_gcache

With parallel=auto. The suite run does not reach its usual end. The last output is:

Attempting backtrace. You can use the following information to find out

Comment by Stepan Patryshev (Inactive) [ 2019-04-15 ]

Status as of 15.04.2019.
Server debug build from 10.4 branch, commit e4c5551964f398ebbe2b1b34fef028eff6f22fbe.
Tests run on SSD.

Without parallel=auto.
All 85 tests were successful.

With parallel=auto. Sporadic failures:
galera_sr.galera_sr_mysqldump_sst
galera_sr.GCF-623

Comment by Jan Lindström (Inactive) [ 2019-06-12 ]

Remaining failing test cases reported separately.

Generated at Thu Feb 08 08:41:34 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.