[MXS-2709] ETL / Data Migration Service Created: 2019-10-02  Updated: 2023-02-21  Resolved: 2023-02-20

Status: Closed
Project: MariaDB MaxScale
Component/s: REST-API
Affects Version/s: None
Fix Version/s: 23.02.0

Type: New Feature Priority: Major
Reporter: Todd Stoffel (Inactive) Assignee: markus makela
Resolution: Fixed Votes: 1
Labels: Performance

Issue Links:
Blocks
is blocked by ODBC-369 Add option not to cache the whole res... Closed
is blocked by ODBC-374 SQL_C_FLOAT should be mapped to SQLRE... Closed
is blocked by ODBC-375 Connector can crash, if one of queire... Closed
is blocked by ODBC-380 Memory leak if connected with multist... Closed
Issue split
split to MXS-4430 ETL/Data Migration Service GUI Closed
split to MXS-4497 Allow ODBC connections to be used in ... Open
Relates
relates to MXS-3727 Table data compare and sync Stalled
relates to ODBC-153 Build rpm and deb packages for C/ODBC... Open
relates to ODBC-379 ODBC rejects DATETIME value 0-00-00 0... Open
relates to ODBC-381 SQLPrepare return SQL_SUCCESS for "as... Open
Sub-Tasks:
Key
 Summary
 Type
 Status
 Assignee
MXS-4310 Proof-of-Concept Sub-Task Closed markus makela  
MXS-4311 Design Document Sub-Task Closed markus makela  
MXS-4366 Allow async queries via the REST-API Sub-Task Closed markus makela  
MXS-4376 Add REST-API endpoint for importing data Sub-Task Closed markus makela  
MXS-4407 Implement MariaDB migration Sub-Task Closed markus makela  
MXS-4417 Document new REST-API endpoints Sub-Task Closed markus makela  
MXS-4424 Implement Postgres migration Sub-Task Closed markus makela  
MXS-4437 Implement generic ODBC migration Sub-Task Closed markus makela  
MXS-4468 Test MariaDB-to-MariaDB ETL implement... Sub-Task Closed markus makela  
MXS-4482 Test PostgreSQL-to-MariaDB ETL implem... Sub-Task Closed markus makela  
Sprint: MXS-SPRINT-166, MXS-SPRINT-167, MXS-SPRINT-168, MXS-SPRINT-169, MXS-SPRINT-170, MXS-SPRINT-171, MXS-SPRINT-172, MXS-SPRINT-173, MXS-SPRINT-174, MXS-SPRINT-175, MXS-SPRINT-176, MXS-SPRINT-177

 Description   

Plan a new feature to provide AWS DMS type service.
Details later.

 Comments   
Comment by markus makela [ 2020-10-19 ]

This could be a filter that delays the execution of autocommit INSERT statements and places them into a queue. Once either the queue fills up or a time limit is hit, the queries could be either executed by the next connection or by a separate connection (i.e. class LocalClient).

Comment by Naresh Chandra [ 2022-11-11 ]

Hi Markus,

Can we add compare/sync option to external servers as well? I mean if we don't add servers in the maxscale conf file, but we want to compare the data and table structures or sync data and structures for external servers would be a good feature for us.

EX: User should be able to add temporary source/destination db server's details in the GUI and then compare external database data/structures from source to destination in the GUI.

Comment by markus makela [ 2023-01-24 ]

ODBC-374, ODBC-379 and ODBC-381 are not really a blockers, we found workarounds for them.

Generated at Thu Feb 08 04:16:07 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.