[MCOL-4887] Background worker to automate on-disk data housekeeping Created: 2021-10-03  Updated: 2023-11-21  Resolved: 2022-04-06

Status: Closed
Project: MariaDB ColumnStore
Component/s: cpimport, ExeMgr, PrimProc, writeengine
Affects Version/s: None
Fix Version/s: Icebox

Type: New Feature Priority: Major
Reporter: Roman Assignee: Todd Stoffel (Inactive)
Resolution: Won't Do Votes: 0
Labels: None

Issue Links:
Relates
relates to MCOL-4889 Manual and automated vacuum cleaning ... Closed

 Description   

This is an umbrella issue for the related projects.
There are number of cases[1] described in the issue attached that calls for a background worker entity that will do a housekeeping for:

  1. empty values vacuum cleaning
  2. on-disk persistant data invariants, e.g. tables clustering key ordering.
  3. merging of multiple partitions made by separate bulk insertion operations.
  4. on-disk persistant data values locality preservation to reduce extents ranges thus increasing the effect of Extent Elimination.

The worker entity must take concurrency control into account. As of MCS 6.1.1 the concurrency control includes on-disk data logical blocks and Extent Map entries.

1. Vacuum cleaner is actual but others are future projects yet to be implemented


Generated at Thu Feb 08 02:53:46 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.