[MCOL-1401] PDI plugin - continuous integration tests Created: 2018-05-08  Updated: 2023-10-26  Resolved: 2018-08-13

Status: Closed
Project: MariaDB ColumnStore
Component/s: None
Affects Version/s: 1.1.4
Fix Version/s: 1.1.6

Type: New Feature Priority: Major
Reporter: Jens Röwekamp (Inactive) Assignee: Elena Kotsinova (Inactive)
Resolution: Fixed Votes: 1
Labels: None

Sprint: 2018-10, 2018-11, 2018-12, 2018-13, 2018-14, 2018-15, 2018-16

 Description   

Currently there are only manual tests for the PDI plugin.

CI tests either through docker or native file system should be added where applicable.



 Comments   
Comment by Jens Röwekamp (Inactive) [ 2018-05-11 ]

test.sh added for continious integration of PDI plugin

The script downloads PDI 7, and installs the build plugin + dependencies. Afterwards all defined tests from the test directory (./test/*.kjb) are executed.

Comment by Jens Röwekamp (Inactive) [ 2018-05-11 ]

For testing:
Test if the script executes the tests successfully in Ubuntu 16.04 and CentOS7. Afterwards modify the test that it fails, and check if it fails for CentOS7 and Ubuntu16.04.


After review and test are passed, the test script should be added to buildbot's CI suite.

Comment by Jens Röwekamp (Inactive) [ 2018-05-14 ]

more tests will be integrated tomorrow, then it'll get back to review.

Comment by Jens Röwekamp (Inactive) [ 2018-05-15 ]

Added a test.sh script that checks the tests sub-directories for kettle jobs and executes them. The defined jobs can have additional parameters defined in job.parameters which will be added during runtime.

Two CI tests are included so far:

  • all type data ingestion check
  • csv ingestion check (without verification, just checks if csv files can be injected)
Comment by Andrew Hutchings (Inactive) [ 2018-06-06 ]

This was merged so assuming review was good. Moving to test...

Comment by Elena Kotsinova (Inactive) [ 2018-06-13 ]

My assumption is that these tests will be part of the CI and regression tests for the version.
Let me know is this correct or I have to run them as separate test suite from somewhere.

Comment by Jens Röwekamp (Inactive) [ 2018-06-13 ]

Hi, yeah that's correct. The tests are part of the data-adapters regression suite invoked through make test.

You can manually execute just the regression test for the kettle adapter by running test.sh in the test directory.

Comment by Elena Kotsinova (Inactive) [ 2018-06-14 ]

1. Rename the adapter package name and related parts in test.sh script to refrect the recent changes. (mariadb-columnstore-kettle-bulk-exporter-plugin)
2. The check for installed pdi must include check also for installed mariadb connector. Currenlty if pdi is already installed the connectior will not be installed.

Comment by Jens Röwekamp (Inactive) [ 2018-06-14 ]

Made requested changes and included name change of MCOL-1470.

Test is the changed test.sh (to invoke manually our through make test)

Comment by Elena Kotsinova (Inactive) [ 2018-08-13 ]

Works fine, minor adjustments are needed. Will be reported as separate issues.

Generated at Thu Feb 08 02:28:28 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.