[MCOL-1016] information_schema.columnstore_extents data_size calculation incorrect Created: 2017-11-07 Updated: 2017-11-08 Resolved: 2017-11-08 |
|
| Status: | Closed |
| Project: | MariaDB ColumnStore |
| Component/s: | MDB Plugin |
| Affects Version/s: | 1.0.11, 1.1.1 |
| Fix Version/s: | 1.0.12, 1.1.2 |
| Type: | Bug | Priority: | Major |
| Reporter: | Andrew Hutchings (Inactive) | Assignee: | Daniel Lee (Inactive) |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Sprint: | 2017-22 |
| Description |
|
The data_size column is calculated using (HWM+1-BLOCK_OFFSET)*BLOCK_SIZE. But for multi-segment files the HWM for the lower segments is 0. This means that the lower segment shows a size of 1 block and the last segment shows a size of one extent segment. This should probably show 0 for the lower segments and the entire usage for the upper segment if possible. |
| Comments |
| Comment by Andrew Hutchings (Inactive) [ 2017-11-07 ] |
|
Pull requests for 1.0 and 1.1 For QA: information_schema.columnstore_extents will now show data_size as 0 if HWM is 0 and the last segment in an extent file will contain the data_size (it will have a BLOCK_OFFSET > 0). In addition the compression_ratio calculation has been fixed. For a 10 column 80M row insert it has gone from calculating the compression ratio from 181% to 70% which is much more accurate (below 100% is compressed, above means the data files are bigger than the data). Also the total_data_size has gone from 2.25GB to 3.87GB. |
| Comment by Daniel Lee (Inactive) [ 2017-11-08 ] |
|
Builds verified: 1.0.12 and 1.1.2 Github source 1.0.12 /root/columnstore/mariadb-columnstore-server Merge pull request #69 from mariadb-corporation/ /root/columnstore/mariadb-columnstore-server/mariadb-columnstore-engine Merge pull request #310 from mariadb-corporation/ 1.1.2 /root/columnstore/mariadb-columnstore-server Update README.md updated version /root/columnstore/mariadb-columnstore-server/mariadb-columnstore-engine added new script to cmake I noticed the case where there is only one block of data for the column (HWM=0), the data size will also show 0. Confirmed with developer that this is the expected behavior. Also discovered another issue in 1.1.12 ( |