[MCOL-4573] cpimport loading source data from S3 caused Segmentation fault Created: 2021-03-02  Updated: 2021-04-06  Resolved: 2021-03-03

Status: Closed
Project: MariaDB ColumnStore
Component/s: cpimport
Affects Version/s: 5.5.2
Fix Version/s: 5.5.2

Type: Bug Priority: Blocker
Reporter: Daniel Lee (Inactive) Assignee: Daniel Lee (Inactive)
Resolution: Fixed Votes: 0
Labels: regression

Sprint: 2021-4

 Description   

Build tested: 5.52 (Drone #1787)

Tested on Centos 8, Debian 10, Ubuntu 20.04

/data/qa/installtest/sh/run/runDefaultTest.sh: line 18: 4680 Segmentation fault (core dumped) $MCSBINHOME/cpimport -H $MCS_S3_ENDPOINT -g $MCS_S3_REGION -y $MCS_S3_ACCESS_KEY_ID -K $MCS_S3_SECRET_ACCESS_KEY -t $MCS_S3_DATA_BUCKET mytest orders orders.tbl

No errors logged in /var/log/mariadb/columnstore

The same test worked fine in 5.5.1-1

 Comments   
Comment by Daniel Lee (Inactive) [ 2021-03-03 ]

Build verified: 5.5.2 (Drone #1805)

The mentioned command now works, as we as the same command having additional parameters:

$MCSBINHOME/cpimport -d 3 -e 1 -H $MCS_S3_ENDPOINT -g $MCS_S3_REGION -y $MCS_S3_ACCESS_KEY_ID -K $MCS_S3_SECRET_ACCESS_KEY -t $MCS_S3_DATA_BUCKET mytest orders orders.tbl

Locale = en_US.UTF-8
Debug level is set to 3

Using table OID 3004 as the default JOB ID
Input file will be read from S3 Bucket : dleeqadata, file/object : /var/log/mariadb/columnstore/data/bulk/tmpjob/3004_D20210303_T190252_S849522_Job_3004.xml
Job description file : /var/log/mariadb/columnstore/data/bulk/tmpjob/3004_D20210303_T190252_S849522_Job_3004.xml
Log file for this job: /var/log/mariadb/columnstore/cpimport/Job_3004.log
2021-03-03 19:02:52 (4856:140364937682368) INFO : successfully loaded job file /var/log/mariadb/columnstore/data/bulk/tmpjob/3004_D20210303_T190252_S849522_Job_3004.xml
2021-03-03 19:02:52 (4856:140364937682368) INFO : Job file loaded, run time for this step : 0.084245 seconds
2021-03-03 19:02:52 (4856:140364937682368) INFO : PreProcessing check starts
2021-03-03 19:02:59 (4856:140364937682368) INFO : PreProcessing check completed
2021-03-03 19:02:59 (4856:140364937682368) INFO : preProcess completed, run time for this step : 6.84597 seconds
2021-03-03 19:02:59 (4856:140364937682368) INFO : No of Read Threads Spawned = 1
2021-03-03 19:02:59 (4856:140364937682368) INFO : No of Parse Threads Spawned = 3
2021-03-03 19:03:10 (4856:140363711493888) INFO : Dictionary cache flush: 284672, 463968, 301058,

2021-03-03 19:03:10 (4856:140363711493888) INFO : For table mytest.orders: 1500000 rows processed and 1500000 rows inserted.
2021-03-03 19:03:10 (4856:140364937682368) INFO : Bulk load completed, total run time : 18.0989 seconds

Generated at Thu Feb 08 02:51:22 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.