[MCOL-3793] LDI with columnstore_use_import_for_batchinsert On failed Created: 2020-02-14  Updated: 2020-03-13  Resolved: 2020-02-18

Status: Closed
Project: MariaDB ColumnStore
Component/s: DMLProc
Affects Version/s: 1.4.3
Fix Version/s: 1.4.3

Type: Bug Priority: Blocker
Reporter: Daniel Lee (Inactive) Assignee: Daniel Lee (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Problem/Incident
is caused by MCOL-3718 Use MariaDB system instead of mysql-C... Closed
Sprint: 2020-2

 Description   

Build tested: 1.4.3-1 BB nightly

engine commit:
f843e98

LDI of 1gb orders or lineitem failed with the following error:

load data infile "/data/qa/source/dbt3/1g/orders.tbl" into table orders fields terminated by "|";
ERROR 1030 (HY000): Got error -1 "Internal error < 0 (Not system error)" from storage engine Columnstore

This occurred only when columnstore_use_import_for_batchinsert is set to ON.
cpimport itself for the same datasets also worked fine.

OAM showed the PM1 is in DEGRADED state. It is a single-node stack.

The tables has data compression on

mcsadmin> getsysteminfo
getsysteminfo Fri Feb 14 15:39:46 2020
System cols1umnstore-1
System and Module statuses
Component Status Last Status Change
------------ -------------------------- ------------------------
System ACTIVE Fri Feb 14 15:25:20 2020
Module pm1 DEGRADED Fri Feb 14 15:25:15 2020
MariaDB ColumnStore Process statuses
Process Module Status Last Status Change Process ID
------------------ ------ --------------- ------------------------ ----------
ProcessMonitor pm1 ACTIVE Fri Feb 14 15:24:39 2020 13023
ProcessManager pm1 ACTIVE Fri Feb 14 15:24:46 2020 13116
DBRMControllerNode pm1 ACTIVE Fri Feb 14 15:24:53 2020 13427
ServerMonitor pm1 ACTIVE Fri Feb 14 15:24:55 2020 13448
DBRMWorkerNode pm1 ACTIVE Fri Feb 14 15:24:56 2020 13468
PrimProc pm1 ACTIVE Fri Feb 14 15:24:59 2020 13515
ExeMgr pm1 ACTIVE Fri Feb 14 15:25:04 2020 13578
WriteEngineServer pm1 ACTIVE Fri Feb 14 15:25:08 2020 13650
DDLProc pm1 ACTIVE Fri Feb 14 15:25:12 2020 13688
DMLProc pm1 ACTIVE Fri Feb 14 15:25:20 2020 13728
mysqld pm1 ACTIVE Fri Feb 14 15:39:46 2020 13319

The same test on the build I downloaded from buildbot yesterday (engine commit: 8588678) did not have this issue.



 Comments   
Comment by Daniel Lee (Inactive) [ 2020-02-18 ]

Build verified: 1.4.3-1 BB nightly

engine commit:
1a65d34

Conducted the following tests:

Centos7
Debian8.5
single server
1um2pm
1g and 10g orders datasets
columnstore_use_import_for_batchinsert =0;
columnstore_use_import_for_batchinsert =1;

Generated at Thu Feb 08 02:45:29 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.