Rather than writing to use uint_t value as 1, treat the aux as a bitmap and use one of the bits. This allows for easier expansion in the future if needed.

toddstoffel Do we document a generic upgrade script that users have to run after they upgrade binary ?

toddstoffel We discussed two options
1. document the following command that customer must to run during upgrade
ALTER TABLE calpontsys.systable ADD COLUMN (auxcolumnoid INT NOT NULL DEFAULT 0);
2. if we already have a script that must be run during upgrades , then we can add the command above to it. From your response it seems that we have no such script. If you confirm , then option 1 is way to go

FastDelete = false => min/max are updated and state is valid
FastDelete = true => min/max are not set and state is invalid
Before this feature, expect min/max to be updated and state to be valid (assuming it was valid before the delete). This is a from MCOL-2044 in 6.1.1
Prior to 6.1.1, expect min/max to be not set and state = invalid.
The purpose of this flag is to allow the user to choose which behavior they would like.

A minor update:

To enable the FastDelete option, the .xml file should have a value 'y' or 'Y', instead of 'true':

        <WriteEngine>

                <BulkRoot>/var/lib/columnstore/data/bulk</BulkRoot>

                <BulkRollbackDir>/var/lib/columnstore/data1/systemFiles/bulkRollback</BulkRollbackDir>

                <MaxFileSystemDiskUsagePct>98</MaxFileSystemDiskUsagePct>

                <CompressedPaddingBlocks>1</CompressedPaddingBlocks> <!-- Number of blocks used to pad compressed chunks -->

                <FastDelete>y</FastDelete>

        </WriteEngine>

Build verified: 22.08-1 (#5312)

Feature implemented. Verified:

system catalog
delete functionality
Performance tests
MTR test suites

Closing this ticket. New tickets will be opened if issues are later.

Below are the final numbers on DELETE performance tests:

GCP VM:

16vcpus, 64GB memory, 128GB HDD
Dataset = 1,000,000 rows
Results are averaged over 10 runs.
OS: Ubuntu20.

Local Machine:

8vcpus, 24GB memory, 500GB SSD
Dataset = 1,000,000 rows
Results are averaged over 10 runs.
OS: Ubuntu20

jacob.moorman GeoffMontee

this is a significant performance improvement . You do make a reference to this in release notes.
Should you also mention the actual numbers? 2x to 30x ..