[MCOL-3629] Wrong calculated total_disk_usage by columnstore_info.total_usage() Created: 2019-11-26  Updated: 2023-10-26

Status: Closed
Project: MariaDB ColumnStore
Component/s: Build, ExeMgr, PrimProc, ProcMgr
Affects Version/s: 1.2.3
Fix Version/s: None

Type: Bug Priority: Major
Reporter: Ajay Assignee: Unassigned
Resolution: Unresolved Votes: 0
Labels: Columnstore
Environment:

Docker/ Ubuntu



 Description   

We have uploaded a CSV which is around 60MB after load infile it is showing the size of 1.5 GB. How can this happen?



 Comments   
Comment by Andrew Hutchings (Inactive) [ 2019-11-26 ]

ColumnStore is designed for very large amounts of data. The 1.2 series pre-allocates enough space for 8 million rows by default (there is a smaller sub-step but I'm simplifying for now). If you have a lot of columns (probably 180ish?) it is conceivable that 1.5GB is consumed.

Can you please confirm this is the case?

Generated at Thu Feb 08 02:44:15 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.