[MCOL-388] Latency after cpimport job has been completed Created: 2016-11-04 Updated: 2016-11-11 Resolved: 2016-11-08 |
|
| Status: | Closed |
| Project: | MariaDB ColumnStore |
| Component/s: | cpimport |
| Affects Version/s: | 1.0.4 |
| Fix Version/s: | Icebox |
| Type: | Bug | Priority: | Major |
| Reporter: | Daniel Lee (Inactive) | Assignee: | David Thompson (Inactive) |
| Resolution: | Duplicate | Votes: | 0 |
| Labels: | None | ||
| Issue Links: |
|
||||||||
| Description |
|
Build used: 1.0.4-1 beta The issue was first identified by Stephane Varoqui working onsite with Believe, migrating to ColumnStore from InfiniDB. On a 1UM-4PM system, after cpimport returned the job has been completed, it took 16 seconds before returning back to the OS. I also confirmed similar latency on a 1UM-2PM stack, executing cpimport from the UM. time /usr/local/mariadb/columnstore/bin/cpimport tpch1c nation nation.tbl real 0m5.196s I verified by examining the log files in each PM that the PM did complete the job and reported a successful status back to the UM quickly. The time being printing the last line and actually return to the OS is 4 seconds on my tests. Stephane reported that as number of Pos increases, this latency multiplies. This issue affects customer who has large number of small files to import, as this latency is many times over the actually loading time. |
| Comments |
| Comment by David Thompson (Inactive) [ 2016-11-08 ] |
|
This is a duplicate of |
| Comment by Dipti Joshi (Inactive) [ 2016-11-11 ] |
|
What mode of cpimport is this happening in ? |
| Comment by Daniel Lee (Inactive) [ 2016-11-11 ] |
|
Mode 0 |