[MCOL-3654] Add option to input URL for Columnstore Exporter Created: 2019-12-07  Updated: 2023-07-02  Resolved: 2023-07-02

Status: Closed
Project: MariaDB ColumnStore
Component/s: N/A
Affects Version/s: 1.1.7, 1.2.4, 1.2.5
Fix Version/s: Icebox

Type: Task Priority: Major
Reporter: Aditya Assignee: Unassigned
Resolution: Won't Do Votes: 0
Labels: BulkApiInsert, ColumnstoreExporter
Environment:

Linux and Windows when using bulk data adapter to export data from spark to columnstore


Epic Link: Consolidate & Redevelop All Columnstore Tools (SDK, Adapters, Backup, Restore, mcsimport)

 Description   

I have been referring to the following links to enable export to columnstore tables.
[
https://mariadb.com/kb/en/library/mariadb-columnstore-with-spark/ |
https://mariadb.com/kb/en/library/installing-mariadb-ax-mariadb-columnstore-from-the-package-repositories-11x/#mariadb-columnstore-api-bulk-write-sdk-package]

I have been able to export the data to a columnstore table with spark dataframe as an input. However there currently seems to be a limitation that columnstore needs to be present on the same node where spark code is running. However there are multiple scenarios where application and database are on separate nodes and hence the Columnstore exporter throws errors in this case.

Need an enhancement where in the Columnstore exporter can take input URL on where the columnstore instance is running



 Comments   
Comment by Todd Stoffel (Inactive) [ 2023-07-02 ]

The "create date" on this ticket is pre-convergence with MariaDB server. If the issue still exists in a modern version of the engine/plugin please submit a new ticket.

Generated at Thu Feb 08 02:44:26 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.