[MCOL-5333] Drone CI to execute all MTR test suite Created: 2022-12-05  Updated: 2023-02-27  Resolved: 2023-02-27

Status: Closed
Project: MariaDB ColumnStore
Component/s: CI
Affects Version/s: None
Fix Version/s: 23.02

Type: Task Priority: Blocker
Reporter: Daniel Lee (Inactive) Assignee: Leonid Fedorov
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Relates
relates to MCOL-5127 Drone - to execute MTR on multi-node... Closed

 Description   

Currently for the develop branch, Drone CI creates packages for 7 distros. Each bistro executes only the 'basic' and 'bugfixes' MTR test suites.

We have the following test suites.

1pmonly
autopilot
basic
bugfixes
devregression
extended
mujltinode
oracle
setup

All of the above MTR test suite should be executed by Drone CI.

It will take a long time for each distro to execute all the test suites. Therefore, we should allocate specific test suite(s) for each distro. Please take a look at the number of test cases in each test suite to determine a 'balance' allocation.

Please note that the 'setup' test suite, which setup the databases and tables that are required by most of the test suites. Therefore, for each distro, we need to execute 'setup' first, before execute other test suites.

 Comments   
Comment by Daniel Lee (Inactive) [ 2023-02-17 ]

The following are the command to run all MTR test suites
./mtr --force --max-test-fail=0 --testcase-timeout=60 --extern socket=/var/lib/mysql/mysql.sock --suite=columnstore/setup
./mtr --force --max-test-fail=0 --testcase-timeout=60 --extern socket=/var/lib/mysql/mysql.sock --suite=columnstore/basic
./mtr --force --max-test-fail=0 --testcase-timeout=60 --extern socket=/var/lib/mysql/mysql.sock --suite=columnstore/bugfixes
./mtr --force --max-test-fail=0 --testcase-timeout=60 --extern socket=/var/lib/mysql/mysql.sock --suite=columnstore/devregression
./mtr --force --max-test-fail=0 --testcase-timeout=60 --extern socket=/var/lib/mysql/mysql.sock --suite=columnstore/autopilot
./mtr --force --max-test-fail=0 --testcase-timeout=60 --extern socket=/var/lib/mysql/mysql.sock --suite=columnstore/extended

Please note the "setup" suite must be executed first since it setup the test schemas tables required for the rest of the test suites(maybe 'basic' does not need it)

Generated at Thu Feb 08 02:57:05 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.