Details
-
New Feature
-
Status: Closed (View Workflow)
-
Major
-
Resolution: Won't Do
-
None
Description
CS now has a very rudimentary query optimization capabilities and we want to improve the situtation. We consider to use Server's optimizer for the purpose but the Server needs statistics namely values distribution histograms and Number of Distinct Values distribution histograms.
There are different levels of complexity for the task:
- implement standalone segment files reader that in the end populates both mysql.column_stats and mysql.table_stats using out of band mariadb client connection
- implement ANALYZE TABLE functionality for Columnstore engine
- implement ANALYZE TABLE and Histograms with equal-width bins for values distribution histograms(similar to MDEV-12313) together with NDV histograms to decrease I/O
We expect to have both unit and regression tests but this is optional.
Attachments
Issue Links
- is duplicated by
-
MCOL-126 analyze table/independent stats do not work for CS tables
-
- Closed
-
Activity
| Field | Original Value | New Value |
|---|---|---|
| Labels | gsoc19 |
| Summary | Engine independant statistics for Columnstore | Engine independent statistics for Columnstore |
| Fix Version/s | N/A [ 22302 ] |
| Fix Version/s | 1.6 [ 23712 ] | |
| Fix Version/s | N/A [ 22302 ] |
| Rank | Ranked lower |
| Rank | Ranked lower |
| Labels | gsoc19 | gsoc19 gsoc20 |
| Fix Version/s | Icebox [ 22302 ] | |
| Fix Version/s | 1.6 [ 23712 ] |
| Rank | Ranked higher |
| Fix Version/s | 1.6 [ 24715 ] | |
| Fix Version/s | Icebox [ 22302 ] |
| Epic Link |
|
| Rank | Ranked higher |
| Fix Version/s | 1.5.4 [ 24413 ] | |
| Fix Version/s | 1.6 [ 24715 ] |
| Comment |
[ Hello,
I'm applying for GSoP, and this task got my attention. I've done a similar project in a big data search/analytics platform too. On that platform, I implemented 40+ search commands including calculating individual/cumulative statistical value for each line. I've heard about MariaDB for a long time and I hope to contribute to this community. Are there still any available spots for this position? If yes, I would like to know more about this task. My email is yitanze@gmail.com. ] |
| Labels | gsoc19 gsoc20 | Compatibility |
| Fix Version/s | 1.5.6 [ 24716 ] | |
| Fix Version/s | 1.5.4 [ 24413 ] |
| Fix Version/s | 1.5.4 [ 24413 ] | |
| Fix Version/s | 1.5.6 [ 24716 ] |
| Rank | Ranked lower |
| Fix Version/s | 1.5.5 [ 24414 ] | |
| Fix Version/s | 1.5.4 [ 24413 ] |
| Fix Version/s | 5.5.1 [ 25030 ] | |
| Fix Version/s | 5.5.1 [ 25030 ] | |
| Fix Version/s | 1.5.5 [ 24414 ] |
| Fix Version/s | 5.5.1 [ 25030 ] |
| Fix Version/s | Icebox [ 22302 ] |
| Rank | Ranked lower |
| Rank | Ranked higher |
| Rank | Ranked higher |
| Resolution | Won't Do [ 10201 ] | |
| Status | Open [ 1 ] | Closed [ 6 ] |