[MDEV-12470] 'make test' failing Created: 2017-04-07  Updated: 2021-06-05  Resolved: 2017-04-07

Status: Closed
Project: MariaDB Server
Component/s: Tests
Affects Version/s: 10.2.5
Fix Version/s: N/A

Type: Bug Priority: Blocker
Reporter: Michal Schorm Assignee: Sergei Golubchik
Resolution: Won't Fix Votes: 0
Labels: None
Environment:

Fedora 25 - GCC 6

Issue Links:
Duplicate
duplicates MDEV-25820 CUnit: 20 tests failed out of 86 when... Open
is duplicated by MDEV-16075 CTests failing Closed

 Description   

Hello,
after release 10.2.5, I was finally able to atleast compile it and pack it, if ommiting all tests.
However when running the testsuite, it fails on the very first and most basic tests.

74% tests passed, 21 tests failed out of 81
 
Total Test time (real) =  48.87 sec
 
The following tests FAILED:
 
	 23 - bulk1 (Failed)
 
	 24 - performance (Failed)
 
	 25 - basic-t (Failed)
 
	 26 - fetch (Failed)
 
	 27 - charset (Failed)
 
	 28 - logs (Failed)
 
	 29 - cursor (Failed)
 
	 30 - errors (Failed)
 
	 31 - view (Failed)
 
	 32 - ps (Failed)
 
	 33 - ps_bugs (Failed)
 
	 34 - sp (Failed)
 
	 35 - result (Failed)
 
	 36 - connection (Failed)
 
	 37 - misc (Failed)
 
	 38 - ps_new (Failed)
 
	 39 - sqlite3 (Failed)
 
	 40 - thread (Failed)
 
	 41 - features-10_2 (Failed)
 
	 42 - dyncol (Failed)
 
	 43 - async (Failed)
 
Errors while running CTest

Full build log can be found here.

 Comments   
Comment by Sergei Golubchik [ 2017-04-07 ]

Connector/C unit tests require a running server, they cannot be run standalone.

We use mysql-test-run for that, it sets up the environment, starts the server, and then runs C/C unit tests.

See, for example this build log, C/C tests start from "unit.conc_"

I understand that your problem is that make test fails, right? We could make C/C tests to be skipped, if the server isn't running, but that creates a danger of everything looking good in mysql-test, even when it's not. In fact, that's exactly what we had earlier, C/C tests "passed" perfectly, because they silently returned 0 if the server wasn't found.

Comment by Michal Schorm [ 2017-04-07 ]

Ok

  • By "that's exactly what we had earlier", you mean 10.1.21, for example?

In Fedora, we have both 'make test' and the 'mysql-test.run'.
I'll disable 'make test' tests, leaving 'mysql-test.run' testsuite do its work and I'll let you know about my progress.

Comment by Sergei Golubchik [ 2017-04-07 ]

No, not 10.1. Earlier releases of 10.2. We've replaced libmysqlclient with libmariadb in 10.2, libmariadb came with unit tests, mysql-test-run picked them up, they all passed, all was fine. And then we've realized that they "pass" because they return 0 (which means success) when they cannot connect to the server. After this was fixed, tests were not all passing anymore

Generated at Thu Feb 08 07:57:58 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.