[MDEV-16330] Allow instant change of WITH SYSTEM VERSIONING column attribute Created: 2018-05-30 Updated: 2018-11-01 Resolved: 2018-06-20 |
|
| Status: | Closed |
| Project: | MariaDB Server |
| Component/s: | Storage Engine - InnoDB, Versioned Tables |
| Affects Version/s: | 10.3, 10.4 |
| Fix Version/s: | 10.3.8, 10.4.0 |
| Type: | Bug | Priority: | Major |
| Reporter: | Marko Mäkelä | Assignee: | Eugene Kosov (Inactive) |
| Resolution: | Fixed | Votes: | 1 |
| Labels: | ddl, instant, performance | ||
| Issue Links: |
|
||||||||
| Description |
|
An ALTER TABLE operation that specifies WITH SYSTEM VERSIONING or WITHOUT SYSTEM VERSIONING on a column will set the flag ALTER_COLUMN_UNVERSIONED, which currently causes the table to be rebuilt. As far as I can tell, the change should not require rebuilding anything. The data in the table remains the same. Enabling WITH SYSTEM VERSIONING for a column should be an instantaneous change, assuming that system versioning is already enabled on the table. This would only set some metadata so that future UPDATE on that column will cause the versioning information to be stored. Specifying WITHOUT SYSTEM VERSIONING might involve removing old history data for that column. That could be done by a table scan and update, which is cheaper than a full rebuild. We could also redefine the semantics of the operation, documenting that any old historical data for the column would survive. |
| Comments |
| Comment by Eugene Kosov (Inactive) [ 2018-06-06 ] | |||||||||||||||||
|
Specifying WITHOUT SYSTEM VERSIONING might involve removing old history data for that column. History is stored for rows, not columns. Thus it's not possible to remove history for some columns. And changing WITH/WITHOUT SYSTEM VERSIONING doens't need to read table data at all. | |||||||||||||||||
| Comment by Eugene Kosov (Inactive) [ 2018-06-06 ] | |||||||||||||||||
|
Apart from table rebuildint there is a related bug:
Here historical row is created on UPDATE. | |||||||||||||||||
| Comment by Marko Mäkelä [ 2018-06-06 ] | |||||||||||||||||
|
Yes, history is stored for rows, not columns. I meant that it would be technically possible to remove historical data for a particular column by updating the value of the column in the history rows to the current value. Come to think of it, if versioning is disabled for some columns, some historical values of non-versioned columns can be persisted in historical rows as ‘collateral damage’ if these historical rows are created due to updating versioned columns. So, I would guess that adding the WITHOUT SYSTEM VERSIONING attribute to a column could be an instantaneous operation, only affecting subsequent versioned operations. (SELECT should only report the current value of non-versioned columns, and treat any values in historical rows as garbage.) | |||||||||||||||||
| Comment by Marko Mäkelä [ 2018-06-11 ] | |||||||||||||||||
|
I posted my review comments, asking for some revision. | |||||||||||||||||
| Comment by Eugene Kosov (Inactive) [ 2018-06-19 ] | |||||||||||||||||
|
I improved PR and asking for another review round. | |||||||||||||||||
| Comment by Marko Mäkelä [ 2018-06-20 ] | |||||||||||||||||
|
Some minor improvements are still needed. | |||||||||||||||||
| Comment by Eugene Kosov (Inactive) [ 2018-06-20 ] | |||||||||||||||||
|
PR updated. |