[MDBF-501] Enhance MyDumper for MariaDB Created: 2022-11-22  Updated: 2022-12-02  Resolved: 2022-12-02

Status: Closed
Project: MariaDB Foundation Development
Component/s: None
Affects Version/s: None
Fix Version/s: N/A

Type: Task Priority: Major
Reporter: Andrew Hutchings Assignee: Andrew Hutchings
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: 0d
Time Spent: 2d
Original Estimate: Not Specified

Issue Links:
Issue split
split to MDBF-513 Mydumper: Add SEQUENCEs support Closed
split to MDBF-514 Mydumper: Add System Version Tables s... Open
split to MDBF-515 Mydumper: test DDL locking mechanism Open

 Description   

MyDumper is a multi-threaded database dumping tool and MyLoader is the complimentary database restore tool (https://github.com/mydumper/mydumper).

There are some enhancements that can be made to MyDumper / MyLoader specifically for MariaDB, we should work on those.

 Comments   
Comment by Andrew Hutchings [ 2022-11-22 ]

Note from Monty: Check sequences work.

Comment by Andrew Hutchings [ 2022-11-22 ]

Marko recommends implementing MDEV-515 using.

SET unique_checks=0,foreign_key_checks=0

Comment by Andrew Hutchings [ 2022-11-22 ]

My own notes so far:

  • CMake warning on GLIB2 find package needs fixing
  • Build docs ON even if Sphinx not found
  • Assumes libmysqlclient found when it isn't, needs a CMake check
  • CMake compatibility warning needs fixing
  • SSL options won't compile against MariaDB Connector/C
Comment by Andrew Hutchings [ 2022-11-23 ]

Set checks for MDEV-515 already exist in myloader.

Fixed a bunch of build issues with https://github.com/mydumper/mydumper/pull/914

Comment by Andrew Hutchings [ 2022-11-25 ]

Added ASAN and TSAN: https://github.com/mydumper/mydumper/pull/917 both currently fail with master.

Additionally myloader threads lock up: https://github.com/mydumper/mydumper/issues/915

Next steps for me:

  • Test / fix sequences
  • Try to diagnose myloader thread lockup
Comment by Andrew Hutchings [ 2022-12-02 ]

Added pull request to enhance debugging: https://github.com/mydumper/mydumper/pull/929

Closing this ticket and tracking the rest of the work in separate tickets.

Generated at Thu Feb 08 03:38:20 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.