[MDEV-17062] Test failure on galera.MW-336 Created: 2018-08-24  Updated: 2020-04-06  Resolved: 2020-04-06

Status: Closed
Project: MariaDB Server
Component/s: Galera, Tests
Affects Version/s: None
Fix Version/s: 10.2.31, 10.3.22, 10.4.12

Type: Bug Priority: Critical
Reporter: Jan Lindström (Inactive) Assignee: Stepan Patryshev (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Duplicate
is duplicated by MDEV-20921 Galera test failure on galera.MW-336:... Closed
is duplicated by MDEV-21409 Galera test failure on MW-336 Closed
PartOf

 Description    

galera.MW-336 'innodb'                   w3 [ fail ]
 
        Test ended at 2018-08-24 01:18:05
 
 
 
CURRENT_TEST: galera.MW-336
 
--- /usr/share/mysql-test/suite/galera/r/MW-336.result	2018-08-24 00:47:16.000000000 +0000
 
+++ /dev/shm/var/3/log/MW-336.reject	2018-08-24 01:18:04.741813892 +0000
 
@@ -2,11 +2,63 @@
 
 connection node_1;
 
 SET GLOBAL wsrep_slave_threads = 10;
 
 SET GLOBAL wsrep_slave_threads = 1;
 
+Timeout in wait_condition.inc for SELECT COUNT(*) = 11 FROM INFORMATION_SCHEMA.PROCESSLIST WHERE USER = 'system user' AND (STATE IS NULL OR STATE NOT LIKE 'InnoDB%');
 
+Id	User	Host	db	Command	Time	State	Info	Progress
 
+1	system user		NULL	Sleep	97	WSREP aborter idle	NULL	0.000
 
+2	system user		NULL	Sleep	40	Committed 994	NULL	0.000
 
+3	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+4	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+5	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+6	system user		NULL	Daemon	NULL	InnoDB purge coordinator	NULL	0.000
 
+7	system user		NULL	Daemon	NULL	InnoDB shutdown handler	NULL	0.000
 
+80	root	localhost	test	Sleep	32		NULL	0.000
 
+81	root	localhost:38223	test	Query	0	Init	show full processlist	0.000
 
+82	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+83	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+84	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+85	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+86	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+87	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+88	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+89	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+90	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+91	system user		NULL	Sleep	30	NULL	NULL	0.000
 
 connection node_2;
 
 INSERT INTO t1 VALUES (1);
 
 connection node_1;
 
 SET GLOBAL wsrep_slave_threads = 10;
 
 SET GLOBAL wsrep_slave_threads = 20;
 
+Timeout in wait_condition.inc for SELECT COUNT(*) = 21 FROM INFORMATION_SCHEMA.PROCESSLIST WHERE USER = 'system user' AND (STATE IS NULL OR STATE NOT LIKE 'InnoDB%');
 
+Id	User	Host	db	Command	Time	State	Info	Progress
 
+1	system user		NULL	Sleep	128	WSREP aborter idle	NULL	0.000
 
+3	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+4	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+5	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+6	system user		NULL	Daemon	NULL	InnoDB purge coordinator	NULL	0.000
 
+7	system user		NULL	Daemon	NULL	InnoDB shutdown handler	NULL	0.000
 
+80	root	localhost	test	Sleep	62		NULL	0.000
 
+81	root	localhost:38223	test	Query	0	Init	show full processlist	0.000
 
+82	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+83	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+84	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+85	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+86	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+87	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+88	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+89	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+90	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+91	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+92	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+95	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+93	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+94	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+96	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+97	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+98	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+100	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+101	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+99	system user		NULL	Sleep	30	NULL	NULL	0.000
 
+102	system user		NULL	Sleep	30	NULL	NULL	0.000
 
 SET GLOBAL wsrep_slave_threads = 1;
 
 connection node_2;
 
 INSERT INTO t1 VALUES (1);
 
@@ -19,6 +71,28 @@
 
 INSERT INTO t1 VALUES (8);
 
 INSERT INTO t1 VALUES (9);
 
 connection node_1;
 
+Timeout in wait_condition.inc for SELECT COUNT(*) = 12 FROM INFORMATION_SCHEMA.PROCESSLIST WHERE USER = 'system user' AND (STATE IS NULL OR STATE NOT LIKE 'InnoDB%');
 
+Id	User	Host	db	Command	Time	State	Info	Progress
 
+1	system user		NULL	Sleep	158	WSREP aborter idle	NULL	0.000
 
+3	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+4	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+5	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+6	system user		NULL	Daemon	NULL	InnoDB purge coordinator	NULL	0.000
 
+7	system user		NULL	Daemon	NULL	InnoDB shutdown handler	NULL	0.000
 
+80	root	localhost	test	Sleep	92		NULL	0.000
 
+81	root	localhost:38223	test	Query	0	Init	show full processlist	0.000
 
+91	system user		NULL	Sleep	90	NULL	NULL	0.000
 
+92	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+95	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+93	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+94	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+96	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+97	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+98	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+100	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+101	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+99	system user		NULL	Sleep	60	NULL	NULL	0.000
 
+102	system user		NULL	Sleep	60	NULL	NULL	0.000
 
 SET GLOBAL wsrep_slave_threads = 10;
 
 SET GLOBAL wsrep_slave_threads = 0;
 
 Warnings:
 
@@ -36,5 +110,17 @@
 
 INSERT INTO t1 VALUES (19);
 
 INSERT INTO t1 VALUES (20);
 
 connection node_1;
 
+Timeout in wait_condition.inc for SELECT COUNT(*) = 2 FROM INFORMATION_SCHEMA.PROCESSLIST WHERE USER = 'system user' AND (STATE IS NULL OR STATE NOT LIKE 'InnoDB%');
 
+Id	User	Host	db	Command	Time	State	Info	Progress
 
+1	system user		NULL	Sleep	188	WSREP aborter idle	NULL	0.000
 
+3	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+4	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+5	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+6	system user		NULL	Daemon	NULL	InnoDB purge coordinator	NULL	0.000
 
+7	system user		NULL	Daemon	NULL	InnoDB shutdown handler	NULL	0.000
 
+80	root	localhost	test	Sleep	122		NULL	0.000
 
+81	root	localhost:38223	test	Query	0	Init	show full processlist	0.000
 
+98	system user		NULL	Sleep	30	Committed 1030	NULL	0.000
 
+100	system user		NULL	Sleep	90	NULL	NULL	0.000
 
 SET GLOBAL wsrep_slave_threads = 1;
 
 DROP TABLE t1;



 Comments   
Comment by Marko Mäkelä [ 2019-09-11 ]

The test still fails:

10.2 f7fe51f126043899d024a60f3f983d7b9be400ae

 
CURRENT_TEST: galera.MW-336
 
--- /usr/share/mysql/mysql-test/suite/galera/r/MW-336.result	2019-09-11 01:51:58.000000000 -0400
 
+++ /dev/shm/var/2/log/MW-336.reject	2019-09-11 03:58:04.424844440 -0400
 
@@ -12,6 +12,28 @@
 
 1
 
 SET GLOBAL wsrep_slave_threads = 10;
 
 # Set slave threads to 10 step 2
 
+Timeout in wait_condition.inc for SELECT COUNT(*) = 10 FROM INFORMATION_SCHEMA.PROCESSLIST WHERE USER = 'system user' AND STATE = 'wsrep applier idle';
 
+SELECT COUNT(*), 10 as EXPECTED_VALUE FROM INFORMATION_SCHEMA.PROCESSLIST WHERE USER = 'system user' AND STATE = 'wsrep applier idle'; show processlist;
 
+COUNT(*)	EXPECTED_VALUE
 
+9	10
 
+Id	User	Host	db	Command	Time	State	Info	Progress
 
+1	system user		NULL	Sleep	37	wsrep aborter idle	NULL	0.000
 
+3	system user		NULL	Daemon	NULL	InnoDB purge coordinator	NULL	0.000
 
+4	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+5	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+6	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+7	system user		NULL	Daemon	NULL	InnoDB shutdown handler	NULL	0.000
 
+11	root	localhost	test	Sleep	32		NULL	0.000
 
+12	root	localhost:33200	test	Query	0	init	show processlist	0.000
 
+13	system user		NULL	Sleep	30	wsrep applier idle	NULL	0.000
 
+18	system user		NULL	Sleep	30	wsrep applier idle	NULL	0.000
 
+15	system user		NULL	Sleep	30	wsrep applier idle	NULL	0.000
 
+19	system user		NULL	Sleep	30	wsrep applier idle	NULL	0.000
 
+16	system user		NULL	Sleep	30	wsrep applier idle	NULL	0.000
 
+14	system user		NULL	Sleep	30	wsrep applier idle	NULL	0.000
 
+17	system user		NULL	Sleep	30	wsrep applier idle	NULL	0.000
 
+21	system user		NULL	Sleep	30	wsrep applier idle	NULL	0.000
 
+20	system user		NULL	Sleep	30	wsrep applier idle	NULL	0.000
 
 SET GLOBAL wsrep_slave_threads = 20;
 
 # Set slave threads to 20
 
 SET GLOBAL wsrep_slave_threads = 1;
 
 
 
mysqltest: Result length mismatch

Comment by Stepan Patryshev (Inactive) [ 2020-01-06 ]

It is also reproduced on Azure and bb:

10.3 4923604ee2fba372f28c856a3f41274f

 
galera.MW-336 'innodb'                   w2 [ fail ]
 
        Test ended at 2019-12-29 16:57:09
 
 
 
CURRENT_TEST: galera.MW-336
 
--- /usr/share/mysql-test/suite/galera/r/MW-336.result	2019-12-29 14:42:34.000000000 +0000
 
+++ /dev/shm/var/2/log/MW-336.reject	2019-12-29 16:57:09.347355617 +0000
 
@@ -10,6 +10,40 @@
 
 # Set slave threads to 10 step 2
 
 SET GLOBAL wsrep_slave_threads = 20;
 
 # Set slave threads to 20
 
+Timeout in wait_condition.inc for SELECT VARIABLE_VALUE = 20 FROM INFORMATION_SCHEMA.GLOBAL_STATUS WHERE VARIABLE_NAME = 'wsrep_applier_thread_count';
 
+SELECT COUNT(*), 20 as EXPECTED_VALUE FROM INFORMATION_SCHEMA.PROCESSLIST WHERE USER = 'system user' AND STATE = 'wsrep applier idle'; show processlist;
 
+COUNT(*)	EXPECTED_VALUE
 
+21	20
 
+Id	User	Host	db	Command	Time	State	Info	Progress
 
+1	system user		NULL	Sleep	38	WSREP aborter idle	NULL	0.000
 
+3	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+4	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+5	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+6	system user		NULL	Daemon	NULL	InnoDB purge coordinator	NULL	0.000
 
+7	system user		NULL	Daemon	NULL	InnoDB shutdown handler	NULL	0.000
 
+13	root	localhost	test	Sleep	33		NULL	0.000
 
+14	root	localhost:32920	test	Query	0	Init	show processlist	0.000
 
+15	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+16	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+17	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+18	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+19	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+20	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+21	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+22	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+23	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+24	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+26	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+33	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+25	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+31	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+32	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+27	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+30	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+34	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+28	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+29	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
+35	system user		NULL	Sleep	31	wsrep applier idle	NULL	0.000
 
 SET GLOBAL wsrep_slave_threads = 1;
 
 connection node_2;
 
 INSERT INTO t1 VALUES (1);
 
@@ -28,6 +62,30 @@
 
 COUNT(*)
 
 11
 
 # Set slave threads to 10 step 3
 
+Timeout in wait_condition.inc for SELECT VARIABLE_VALUE = 10 FROM INFORMATION_SCHEMA.GLOBAL_STATUS WHERE VARIABLE_NAME = 'wsrep_applier_thread_count';
 
+SELECT COUNT(*), 10 as EXPECTED_VALUE FROM INFORMATION_SCHEMA.PROCESSLIST WHERE USER = 'system user' AND STATE = 'wsrep applier idle'; show processlist;
 
+COUNT(*)	EXPECTED_VALUE
 
+11	10
 
+Id	User	Host	db	Command	Time	State	Info	Progress
 
+1	system user		NULL	Sleep	69	WSREP aborter idle	NULL	0.000
 
+3	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+4	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+5	system user		NULL	Daemon	NULL	InnoDB purge worker	NULL	0.000
 
+6	system user		NULL	Daemon	NULL	InnoDB purge coordinator	NULL	0.000
 
+7	system user		NULL	Daemon	NULL	InnoDB shutdown handler	NULL	0.000
 
+13	root	localhost	test	Sleep	64		NULL	0.000
 
+14	root	localhost:32920	test	Query	0	Init	show processlist	0.000
 
+26	system user		NULL	Sleep	62	wsrep applier idle	NULL	0.000
 
+33	system user		NULL	Sleep	62	wsrep applier idle	NULL	0.000
 
+25	system user		NULL	Sleep	62	wsrep applier idle	NULL	0.000
 
+31	system user		NULL	Sleep	62	wsrep applier idle	NULL	0.000
 
+32	system user		NULL	Sleep	62	wsrep applier idle	NULL	0.000
 
+27	system user		NULL	Sleep	62	wsrep applier idle	NULL	0.000
 
+30	system user		NULL	Sleep	62	wsrep applier idle	NULL	0.000
 
+34	system user		NULL	Sleep	62	wsrep applier idle	NULL	0.000
 
+28	system user		NULL	Sleep	62	wsrep applier idle	NULL	0.000
 
+29	system user		NULL	Sleep	62	wsrep applier idle	NULL	0.000
 
+35	system user		NULL	Sleep	62	wsrep applier idle	NULL	0.000
 
 connection node_2;
 
 INSERT INTO t1 VALUES (11);
 
 INSERT INTO t1 VALUES (12);
 
 
 
mysqltest: Result length mismatch
 
 
 
 - saving '/dev/shm/var/2/log/galera.MW-336-innodb/' to '/dev/shm/var/log/galera.MW-336-innodb/'
 
 
 
Retrying test galera.MW-336, attempt(2/3)...
 
 
 
worker[2] > Restart  - not started
 
worker[2] > Restart  - not started

Comment by Stepan Patryshev (Inactive) [ 2020-01-08 ]

Increased the priority since it fails on Azure.

Comment by Stepan Patryshev (Inactive) [ 2020-02-19 ]

Reopened since it still fails on 10.3 and 10.4 on Azure.

Comment by Jan Lindström (Inactive) [ 2020-02-19 ]

Is fix really merged there as I can't see any failures on bb ?

Comment by Stepan Patryshev (Inactive) [ 2020-02-20 ]

The last time it failed on BB on 11.02.2020. And today is the first day in a row when it has not failed on Azure also.

Comment by Stepan Patryshev (Inactive) [ 2020-04-06 ]

julien.fritsch It has stopped to fail on Azure on ES 10.4. Closing as fixed.

Generated at Thu Feb 08 08:33:37 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.