[MDEV-26810] Incremental backup not compatible with compression Created: 2021-10-12  Updated: 2021-10-13

Status: Open
Project: MariaDB Server
Component/s: Backup
Fix Version/s: None

Type: Task Priority: Minor
Reporter: Jochen Assignee: Unassigned
Resolution: Unresolved Votes: 1
Labels: None


 Description   

The mariabackup option --compress was compatible with incremental backups. However it is deprecated, users should use streaming to 3rd-party tools. Such a compressed backup cannot be used as base-directory for an incremental backup.

Feature request: Incorporate compression tools like gzip / 7zip into mariabackup and remove "deprecated" marker, to make incremental backups compatible with compression again.



 Comments   
Comment by Vladislav Vaintroub [ 2021-10-12 ]

incremental backup needs to apply diffs to baseline backup, for prepare. It can't apply diffs to compressed files (.qp, .gz, or anything else), without decompression. If you were on Windows, you could use a transparently compressed directory for base, and/or incremental directories. Maybe you can have some luck with ZFS on Linux, according to google it can have transparently compressed directories, too.

Comment by Jochen [ 2021-10-13 ]

Thanks Vlad. This workaround might help some people, I don't really need it, I'd like to leave this feature request standing!

The old --compress option compresses file-by-file and automatically decompresses for the diff for incremental backups. Only it uses QuickLZ, and current gzip compression has ~40% smaller results! Having some programming background I think it's possible with a small workload to incorporate gzip into mariabackup the same way it uses QuickLZ.

Generated at Thu Feb 08 09:48:06 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.