[MCOL-1192] Load data with cpimport and colxml Job is significantly slower than forcing in parallel cpimport Created: 2018-02-01 Updated: 2022-11-05 Resolved: 2022-11-05 |
|
| Status: | Closed |
| Project: | MariaDB ColumnStore |
| Component/s: | cpimport |
| Affects Version/s: | 1.1.2 |
| Fix Version/s: | Icebox |
| Type: | New Feature | Priority: | Major |
| Reporter: | Zdravelina Sokolovska (Inactive) | Assignee: | Todd Stoffel (Inactive) |
| Resolution: | Won't Do | Votes: | 0 |
| Labels: | None | ||
| Environment: |
MCS run on AWS, Multi Server ColumnStore System UM1-PM1 ;guest OS RHEL 7.4 |
||
| Description |
|
Load data with cpimport and colxml Job is significantly slower than forcing in parallel cpimport it's observed that load 1TB data with cpimport mode m1 and colxml Job id Actually when use cpimport with colxml job it's observed that tables are loaded one after another; achieved results from 1TB data load:
used scripts :
Updated with last load time results with Scale Factor 1000 [1TB data], obtained on Intel Packet with optane drives
|
| Comments |
| Comment by Zdravelina Sokolovska (Inactive) [ 2018-07-02 ] | ||||||
|
Updated: The slower load time with colxml job was observed again,
| ||||||
| Comment by Todd Stoffel (Inactive) [ 2022-11-05 ] | ||||||
|
This item is being closed because it was well passed the expiration date with no activity. If you suspect this was done in error please create a new ticket. |