[MCOL-3791] cpimport crashes intermittantly Created: 2020-02-13 Updated: 2020-03-13 Resolved: 2020-02-19 |
|
| Status: | Closed |
| Project: | MariaDB ColumnStore |
| Component/s: | cpimport |
| Affects Version/s: | 1.4.2 |
| Fix Version/s: | 1.4.3 |
| Type: | Bug | Priority: | Critical |
| Reporter: | David Hall (Inactive) | Assignee: | Daniel Lee (Inactive) |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Sprint: | 2020-2, 2020-3 |
| Description |
|
running the regression test001, queries/working_tpch1_compareLogOnly/misc/bug4947.sql always fails with two cpimport crashes. For some reason, it won't fail if run independently. I've narrowed the cause down to the change from |
| Comments |
| Comment by David Hall (Inactive) [ 2020-02-13 ] |
|
I tried adding But it still breaks. Here's some debug logs 2020-02-13 17:42:59 (7800) INFO : PreProcessing check completed Notice that begByte (read HWM) is greater than endbyte (read filesize). This causes ColumnBufferManagerDctnry::rowsExtentCheck to calculate a negative number for rows that will fit (spaceRequired = -57344) and then everything goes downhill from there. I think for non-dictionary columns, this may not be a problem as ColumnBufferManager::rowsExtentCheck() is a no-op. |
| Comment by David Hall (Inactive) [ 2020-02-14 ] |
|
So the questions are:
|
| Comment by Roman [ 2020-02-14 ] |
|
1. Preallocation code adds extra block of EMPTY values in this particular case into non-compressed files. |
| Comment by Daniel Lee (Inactive) [ 2020-02-19 ] |
|
Build verified: 1.4.3-1 source engine commit: Executed regression test001 test. BUG4947 passed. |