[MCOL-4101] Update & release the non-core packages Created: 2020-06-24  Updated: 2022-10-28  Resolved: 2022-10-28

Status: Closed
Project: MariaDB ColumnStore
Component/s: ?
Affects Version/s: None
Fix Version/s: None

Type: Epic Priority: Major
Reporter: Patrick LeBlanc (Inactive) Assignee: David Hall (Inactive)
Resolution: Won't Fix Votes: 0
Labels: None

Issue Links:
Relates
relates to MCOL-4041 Test backup package with OAM-less MCS. Closed
Sprint: 2021-5, 2021-6, 2021-7, 2021-8, 2021-9, 2021-10, 2021-11, 2021-12, 2021-13, 2021-14, 2021-15, 2021-16, 2021-17, 2022-22

 Description   

The 1.5.2 community release is done, now we have to get the non-core packages updated & released as well. backup, api, and data-adapters.



 Comments   
Comment by Ben Thompson (Inactive) [ 2020-08-10 ]

Changes to API for 1.5, you're probably best person for reviewing

Comment by Jens Röwekamp (Inactive) [ 2020-08-11 ]

The code changes look sane.

As I don't know what got changed with ColumnStore 1.5 compared to ColumnStore 1.2 I can't really assess the functionality impacts of these changes. This would require in-depth testing for every supported OS. The test suites should be a good indicator if everything is working as expected.

In my brief glance through the changes I only found following issues:
1. The spark-connector docker-compose.yaml files haven't been upgraded to multi node ColumnStore 1.5 [cf. 1, 2]
2. The Kettle data adapters tests still contain `COLUMNSTORE_INSTALL_DIR` instead of `COLUMNSTORE_XML_DIR`

jens@drop-table:~/mariadb-columnstore-data-adapters$ grep -rl "COLUMNSTORE_INSTALL_DIR" .
./kettle-columnstore-bulk-exporter-plugin/README.md
./kettle-columnstore-bulk-exporter-plugin/test/tests/all-datatype-ingestion-test/job.parameter.win
./kettle-columnstore-bulk-exporter-plugin/test/tests/cs-block-test/job.parameter.win
./kettle-columnstore-bulk-exporter-plugin/test/tests/csv-bool-test/job.parameter.win
./kettle-columnstore-bulk-exporter-plugin/test/tests/csv-ingestion-test/job.parameter.win
./kettle-columnstore-bulk-exporter-plugin/test/tests/csv-timestamp-test/job.parameter.win
./README.md

I also noted that the list of supported operating systems didn't change compared to 1.2.
It might be worth to revise if we still want to support the deprecated Debian 8 or want to introduce support for Debian 10.
The same goes for CentOS 8 and Ubuntu 20.04.

I also noted that the API still supports the deprecated Python 2 version. It might be worth to revise this as well.

To check the functionality properly it would require in-depth testing. I would assume 1-2 working days should be sufficient to validate the functionality. I unfortunately don't have any engineering cycles left in this sprint to do such testing. Therefore, I can't make any statements of the functional state of the data-adapters or api. I talked to one of my managers and they would be willing to consider it in our next sprint planning if required.

[1] https://github.com/mariadb-corporation/mariadb-columnstore-api/blob/MCOL-4101/spark-connector/python/docs/install-environment/docker-compose.yml#L70
[2] https://github.com/mariadb-corporation/mariadb-columnstore-api/blob/MCOL-4101/spark-connector/scala/docs/install-environment/docker-compose.yml#L70

Comment by Jens Röwekamp (Inactive) [ 2020-10-26 ]

Hi ben.thompson, I just found this ticket in my list.
I think the Jira processes differ between the CS and SkySQL team.
Do you expect me to do anything else, like to merge the PR or to move the ticket to test or something?

Comment by Jens Röwekamp (Inactive) [ 2020-10-26 ]

The same would apply to MCOL-4041

Comment by David Hall (Inactive) [ 2022-03-04 ]

Do we need this anymore? Seems this is passed up by events. Backup/Restore is a new project.

Generated at Thu Feb 08 02:47:48 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.