[MCOL-136] ColumnStore is 4x larger on disk than Infobright Community Edition Created: 2016-06-12 Updated: 2021-02-19 Resolved: 2021-02-19 |
|
| Status: | Closed |
| Project: | MariaDB ColumnStore |
| Component/s: | N/A |
| Affects Version/s: | None |
| Fix Version/s: | N/A |
| Type: | New Feature | Priority: | Minor |
| Reporter: | Justin Swanhart (Inactive) | Assignee: | Todd Stoffel (Inactive) |
| Resolution: | Won't Do | Votes: | 0 |
| Labels: | None | ||
| Epic Link: | ColumnStore Compression Improvements |
| Description |
|
ColumnStore does not compress very well. The KB suggests that 2:1 compression is about as good as you can get. ICE (which uses RLE) compresses much better. It averages 3:1 compression and can achieve 30:1 or even 50:1 in many cases. CS should use RLE (not snappy) compression. It should also use FOR encoding for substantial compression improvements (typically 5:1 for bigint) which is also compatible with RLE (for an additional 3:1 to 5:1 compression on top). |
| Comments |
| Comment by Justin Swanhart (Inactive) [ 2016-06-12 ] |
|
Star Schema Benchmark scale factor 5 |