[MCOL-2205] cpimport - uneven dbroot data balancing Created: 2019-02-28 Updated: 2022-11-30 Resolved: 2019-05-28 |
|
| Status: | Closed |
| Project: | MariaDB ColumnStore |
| Component/s: | cpimport |
| Affects Version/s: | 1.2.2 |
| Fix Version/s: | Icebox |
| Type: | Bug | Priority: | Minor |
| Reporter: | David Hill (Inactive) | Assignee: | Andrew Hutchings (Inactive) |
| Resolution: | Not a Bug | Votes: | 0 |
| Labels: | None | ||
| Environment: |
1um 3pm |
||
| Description |
|
Customer reported Want to bring to your attention that uneven data distribution happen when a PM have uneven dbroot. Example 3PM 1 dbroot per PM, PM3 goes down dbroot3 got assigned to PM2, upload data mode1 and the dbroot3 will receive less data than it should have. |
| Comments |
| Comment by David Hall (Inactive) [ 2019-05-01 ] |
|
cpimport balances the input between PMs, not dbroots. Then, depending on the number of rows a PM receives, it might or might not balance the dbroots, filling up full segment files before moving to the next dbroot. This is designed behavior. |
| Comment by David Hall (Inactive) [ 2019-05-02 ] |
|
To deal with this situation would require quite a bit of re-design of the splitter logic. |
| Comment by Andrew Hutchings (Inactive) [ 2019-05-28 ] |
|
Closing as !Bug. Behaviour is currently by design. Any changes to this behaviour are likely to be a feature request. I think we already have one open for this. |