[MCOL-4917] Certain Extent Map operations doesn't scale well. Created: 2021-11-08 Updated: 2023-11-17 Resolved: 2022-05-16 |
|
| Status: | Closed |
| Project: | MariaDB ColumnStore |
| Component/s: | cpimport, ExeMgr, PrimProc |
| Affects Version/s: | 5.6.2, 5.6.3, 6.1.1 |
| Fix Version/s: | 5.6.5, 6.4.1 |
| Type: | New Feature | Priority: | Critical |
| Reporter: | Roman | Assignee: | Roman |
| Resolution: | Done | Votes: | 0 |
| Labels: | None | ||
| Issue Links: |
|
||||||||||||||||||||||||||||
| Sprint: | 2021-14, 2021-15, 2021-16, 2021-17 | ||||||||||||||||||||||||||||
| Description |
|
There is a major deficiency in parts of EM code that makes the operations slower. We need to profile and introduce lookup structures to speed up read/write ops in EM. ExtentMap::getDbRootHWMInfo() must be overloaded to serve multiple oids at a time. ExtentMap::setLocalHWM is called multiple times compacting journal into EM on MCS shutdown(save_brm presumably). setLocalHWM is utterly slow that forces systemd to kill save_brm on timeout. |
| Comments |
| Comment by Roman [ 2022-05-16 ] |
|
All future work about merging |