[MDEV-22631] some test causes MTR interruption without generating summary and XML Created: 2020-05-12  Updated: 2021-03-01  Resolved: 2020-07-23

Status: Closed
Project: MariaDB Server
Component/s: Tests
Affects Version/s: 10.1, 10.2, 10.3, 10.4, 10.5
Fix Version/s: N/A

Type: Bug Priority: Critical
Reporter: Timofey Turenko Assignee: Timofey Turenko
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Relates
relates to MDEV-23769 MTR can abort before it prints the te... Closed

 Description   

Attempt to execute all the tests with --enable-disable option allowed to find several tests which causes interruption of MTR without generation any summary or XML file.

One example is "connect.json" test, another " galera.galera_var_node_address"

bash-4.2$ ./mysql-test-run.pl  connect.json --testcase-timeout=120 --big-test --max-save-core=0 --max-save-datadir=1 --force --retry=3 
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
	LANGUAGE = (unset),
	LC_ALL = (unset),
	LC_PAPER = "fi_FI.UTF-8",
	LC_ADDRESS = "fi_FI.UTF-8",
	LC_MONETARY = "fi_FI.UTF-8",
	LC_NUMERIC = "fi_FI.UTF-8",
	LC_TELEPHONE = "fi_FI.UTF-8",
	LC_IDENTIFICATION = "fi_FI.UTF-8",
	LC_MEASUREMENT = "fi_FI.UTF-8",
	LC_TIME = "fi_FI.UTF-8",
	LC_NAME = "fi_FI.UTF-8",
	LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Logging: ./mysql-test-run.pl  connect.json --testcase-timeout=120 --big-test --max-save-core=0 --max-save-datadir=1 --force --retry=3
vardir: /home/vagrant/MariaDBEnterprise/mysql-test/var
Checking leftover processes...
Removing old var directory...
Creating var directory '/home/vagrant/MariaDBEnterprise/mysql-test/var'...
Checking supported features...
MariaDB Version 10.4.12-6-MariaDB-enterprise
 - SSL connections supported
 - binaries built with wsrep patch
Collecting tests...
Installing system database...
 
==============================================================================
 
TEST                                      RESULT   TIME (ms) or COMMENT
--------------------------------------------------------------------------
 
worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 16000..16019
worker[1] mysql-test-run: WARNING: Process [mysqld.1 - pid: 25554, winpid: 25554, exit: 1792] died after mysql-test-run waited 0.3 seconds for /home/vagrant/MariaDBEnterprise/mysql-test/var/run/mysqld.1.pid to be created.
connect.json                             [ fail ]
        Test ended at 2020-05-12 14:17:38
 
CURRENT_TEST: connect.json
 
 
Failed to start mysqld.1
mysqltest failed but provided no output
 
 
 - saving '/home/vagrant/MariaDBEnterprise/mysql-test/var/log/connect.json/' to '/home/vagrant/MariaDBEnterprise/mysql-test/var/log/connect.json/'
 
Retrying test connect.json, attempt(2/3)...
 
mysql-test-run: *** ERROR: can't open file "/home/vagrant/MariaDBEnterprise/mysql-test/var/log/json.log": No such file or directory
bash-4.2$ ./mysql-test-run.pl  connect.json --testcase-timeout=120 --big-test --max-save-core=0 --max-save-datadir=1 --force --retry=3 
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
	LANGUAGE = (unset),
	LC_ALL = (unset),
	LC_PAPER = "fi_FI.UTF-8",
	LC_ADDRESS = "fi_FI.UTF-8",
	LC_MONETARY = "fi_FI.UTF-8",
	LC_NUMERIC = "fi_FI.UTF-8",
	LC_TELEPHONE = "fi_FI.UTF-8",
	LC_IDENTIFICATION = "fi_FI.UTF-8",
	LC_MEASUREMENT = "fi_FI.UTF-8",
	LC_TIME = "fi_FI.UTF-8",
	LC_NAME = "fi_FI.UTF-8",
	LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Logging: ./mysql-test-run.pl  connect.json --testcase-timeout=120 --big-test --max-save-core=0 --max-save-datadir=1 --force --retry=3
vardir: /home/vagrant/MariaDBEnterprise/mysql-test/var
Checking leftover processes...
Removing old var directory...
Creating var directory '/home/vagrant/MariaDBEnterprise/mysql-test/var'...
Checking supported features...
MariaDB Version 10.4.12-6-MariaDB-enterprise
 - SSL connections supported
 - binaries built with wsrep patch
Collecting tests...
Installing system database...
 
==============================================================================
 
TEST                                      RESULT   TIME (ms) or COMMENT
--------------------------------------------------------------------------
 
worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 16000..16019
worker[1] mysql-test-run: WARNING: Process [mysqld.1 - pid: 25643, winpid: 25643, exit: 1792] died after mysql-test-run waited 0.3 seconds for /home/vagrant/MariaDBEnterprise/mysql-test/var/run/mysqld.1.pid to be created.
connect.json                             [ fail ]
        Test ended at 2020-05-12 14:27:58
 
CURRENT_TEST: connect.json
 
 
Failed to start mysqld.1
mysqltest failed but provided no output
 
 
 - saving '/home/vagrant/MariaDBEnterprise/mysql-test/var/log/connect.json/' to '/home/vagrant/MariaDBEnterprise/mysql-test/var/log/connect.json/'
 
Retrying test connect.json, attempt(2/3)...
 
mysql-test-run: *** ERROR: can't open file "/home/vagrant/MariaDBEnterprise/mysql-test/var/log/json.log": No such file or directory



 Comments   
Comment by Timofey Turenko [ 2020-05-12 ]

bash-4.2$ export WSREP_PROVIDER=/usr/lib64/galera-enterprise-4/libgalera_enterprise_smm.so; ./mysql-test-run.pl galera.galera_var_node_address --testcase-timeout=120 --big-test --max-save-core=0 --max-save-datadir=1 --force --retry=3 --vardir=/var/tmp/mtr --max-test-fail=0 --xml-report=/tmp/mtr.xml --enable-disabled
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
	LANGUAGE = (unset),
	LC_ALL = (unset),
	LC_PAPER = "fi_FI.UTF-8",
	LC_ADDRESS = "fi_FI.UTF-8",
	LC_MONETARY = "fi_FI.UTF-8",
	LC_NUMERIC = "fi_FI.UTF-8",
	LC_TELEPHONE = "fi_FI.UTF-8",
	LC_IDENTIFICATION = "fi_FI.UTF-8",
	LC_MEASUREMENT = "fi_FI.UTF-8",
	LC_TIME = "fi_FI.UTF-8",
	LC_NAME = "fi_FI.UTF-8",
	LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Logging: ./mysql-test-run.pl  galera.galera_var_node_address --testcase-timeout=120 --big-test --max-save-core=0 --max-save-datadir=1 --force --retry=3 --vardir=/var/tmp/mtr --max-test-fail=0 --xml-report=/tmp/mtr.xml --enable-disabled
vardir: /var/tmp/mtr
Checking leftover processes...
Removing old var directory...
Creating var directory '/var/tmp/mtr'...
Checking supported features...
MariaDB Version 10.4.12-6-MariaDB-enterprise
 - SSL connections supported
 - binaries built with wsrep patch
Collecting tests...
 - galera.galera_var_node_address wil be run although it's been disabled
   due to 'MDEV-20485 Galera test failure'
Installing system database...
 
==============================================================================
 
TEST                                      RESULT   TIME (ms) or COMMENT
--------------------------------------------------------------------------
 
worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 16000..16019
worker[1] mysql-test-run: WARNING: Waited 60 seconds for /var/tmp/mtr/run/mysqld.4.pid to be created, still waiting for 120 seconds...
worker[1] mysql-test-run: WARNING: Waited 120 seconds for /var/tmp/mtr/run/mysqld.4.pid to be created, still waiting for 60 seconds...
worker[1] mysql-test-run: WARNING: Timeout after mysql-test-run waited 180 seconds for the process [mysqld.4 - pid: 25867, winpid: 25867] to create a pid file.
galera.galera_var_node_address 'innodb'  [ fail ]
        Test ended at 2020-05-12 14:51:28
 
CURRENT_TEST: galera.galera_var_node_address
 
 
Failed to start mysqld.4
mysqltest failed but provided no output
 
 
 - saving '/var/tmp/mtr/log/galera.galera_var_node_address-innodb/' to '/var/tmp/mtr/log/galera.galera_var_node_address-innodb/'
 
Retrying test galera.galera_var_node_address, attempt(2/3)...
 
mysql-test-run: *** ERROR: can't open file "/var/tmp/mtr/log/galera_var_node_address.log": No such file or directory
bash-4.2$ 

Comment by Timofey Turenko [ 2020-05-14 ]

the same test executed against old version (build March, 19) - no crash!

bash-4.2$ export WSREP_PROVIDER=/usr/lib64/galera-enterprise-4/libgalera_enterprise_smm.so; ./mysql-test-run.pl galera.galera_var_node_address --testcase-timeout=120 --big-test --max-save-core=0 --max-save-datadir=1 --force --retry=3 --vardir=/var/tmp/mtr --max-test-fail=0  --enable-disabled
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
	LANGUAGE = (unset),
	LC_ALL = (unset),
	LC_PAPER = "fi_FI.UTF-8",
	LC_ADDRESS = "fi_FI.UTF-8",
	LC_MONETARY = "fi_FI.UTF-8",
	LC_NUMERIC = "fi_FI.UTF-8",
	LC_TELEPHONE = "fi_FI.UTF-8",
	LC_IDENTIFICATION = "fi_FI.UTF-8",
	LC_MEASUREMENT = "fi_FI.UTF-8",
	LC_TIME = "fi_FI.UTF-8",
	LC_NAME = "fi_FI.UTF-8",
	LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Logging: ./mysql-test-run.pl  galera.galera_var_node_address --testcase-timeout=120 --big-test --max-save-core=0 --max-save-datadir=1 --force --retry=3 --vardir=/var/tmp/mtr --max-test-fail=0 --enable-disabled
vardir: /var/tmp/mtr
Checking leftover processes...
Removing old var directory...
Creating var directory '/var/tmp/mtr'...
Checking supported features...
MariaDB Version 10.4.12-6-MariaDB-enterprise
 - SSL connections supported
 - binaries built with wsrep patch
Collecting tests...
 - galera.galera_var_node_address wil be run although it's been disabled
   due to 'MDEV-20485 Galera test failure'
Installing system database...
 
==============================================================================
 
TEST                                      RESULT   TIME (ms) or COMMENT
--------------------------------------------------------------------------
 
worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 16000..16019
worker[1] mysql-test-run: WARNING: Waited 60 seconds for /var/tmp/mtr/run/mysqld.4.pid to be created, still waiting for 120 seconds...
worker[1] mysql-test-run: WARNING: Waited 120 seconds for /var/tmp/mtr/run/mysqld.4.pid to be created, still waiting for 60 seconds...
worker[1] mysql-test-run: WARNING: Timeout after mysql-test-run waited 180 seconds for the process [mysqld.4 - pid: 28810, winpid: 28810] to create a pid file.
galera.galera_var_node_address 'innodb'  [ fail ]
        Test ended at 2020-05-14 12:23:51
 
CURRENT_TEST: galera.galera_var_node_address
 
 
Failed to start mysqld.4
mysqltest failed but provided no output
 
 
 - saving '/var/tmp/mtr/log/galera.galera_var_node_address-innodb/' to '/var/tmp/mtr/log/galera.galera_var_node_address-innodb/'
 
Retrying test galera.galera_var_node_address, attempt(2/3)...
 
worker[1] mysql-test-run: WARNING: Waited 60 seconds for /var/tmp/mtr/run/mysqld.4.pid to be created, still waiting for 120 seconds...
worker[1] mysql-test-run: WARNING: Waited 120 seconds for /var/tmp/mtr/run/mysqld.4.pid to be created, still waiting for 60 seconds...
worker[1] mysql-test-run: WARNING: Timeout after mysql-test-run waited 180 seconds for the process [mysqld.4 - pid: 30063, winpid: 30063] to create a pid file.
galera.galera_var_node_address 'innodb'  [ retry-fail ]
        Test ended at 2020-05-14 12:27:00
 
CURRENT_TEST: galera.galera_var_node_address
CURRENT_TEST: galera.galera_var_node_address
 
 
Failed to start mysqld.4
 
 
 - skipping '/var/tmp/mtr/log/galera.galera_var_node_address-innodb/'
 
Test galera.galera_var_node_address has failed 2 times, no more retries!
 
--------------------------------------------------------------------------
The servers were restarted 1 times
Spent 0.000 of 387 seconds executing testcases
 
Completed: Failed 1/1 tests, 0.00% were successful.
 
Failing test(s): galera.galera_var_node_address
 
The log files in var/log may give you some hint of what went wrong.
 
If you want to report this error, please read first the documentation
at http://dev.mysql.com/doc/mysql/en/mysql-test-suite.html
 
mysql-test-run: *** ERROR: there were failing test cases
bash-4.2$ 

Generated at Thu Feb 08 09:16:14 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.