[MCOL-4855] Cpimport is writing to STDERR even on success Created: 2021-09-01  Updated: 2022-04-14  Resolved: 2021-12-08

Status: Closed
Project: MariaDB ColumnStore
Component/s: None
Affects Version/s: None
Fix Version/s: 6.2.2

Type: Bug Priority: Minor
Reporter: Allen Herrera Assignee: Todd Stoffel (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Sprint: 2021-11, 2021-12, 2021-13, 2021-14, 2021-15, 2021-16

 Description   

Starting in CS 5.6, even on successful cpimports, some output is being sent to STDERR
Clients have some automation based on if anything gets written to STDERR then an error must have occurred and forks in logic. This bug was not present in CS 5.5 and below.

Expected result
Only when cpimport fails to complete should messages be written to STDERR

Reproduction in 5.6:

echo '"6",7800.18,0.18,"a"' > /tmp/test_table.csv2
mariadb  -e "create database test;"
mariadb test -e "CREATE TABLE test_table (group_name CHAR(2), number1 DECIMAL(12, 2), number2 DECIMAL(12, 2), var varchar(1)) ENGINE=COLUMNSTORE;"
 
RCT1-PIXID-CSX2/tmp[root]$ cpimport test test_table /tmp/test_table.csv2 -s "," -e "\"" 2> cperror.log 1> cpoutput.log
 
RCT1-PIXID-CSX2/tmp[root]$ cat cperror.log
writeenginesplit[7861]: 09.629445 |0|0|0| I 33 CAL0000: Send EOD message to All PMs
writeenginesplit[7861]: 09.813692 |0|0|0| I 33 CAL0098: Received a Cpimport Pass from PM2.
writeenginesplit[7861]: 09.820211 |0|0|0| I 33 CAL0098: Received a Cpimport Pass from PM1.
writeenginesplit[7861]: 09.843694 |0|0|0| I 33 CAL0098: Received a Cpimport Pass from PM3.
writeenginesplit[7861]: 09.859150 |0|0|0| I 33 CAL0000: Released Table Lock
 
RCT1-PIXID-CSX2/tmp[root]$ cat cpoutput.log
2021-09-01 15:43:09 (7861) INFO : Running distributed import (mode 1) on all PMs...
2021-09-01 15:43:09 (7861) INFO : For table test.test_table: 4 rows processed and 4 rows inserted.
2021-09-01 15:43:09 (7861) INFO : Bulk load completed, total run time : 0.326003 seconds

Reproduction in CS 6.1

[root@ip-172-31-2-231 tmp]# mariadb -e "SELECT PLUGIN_NAME,PLUGIN_VERSION,PLUGIN_STATUS,PLUGIN_TYPE FROM INFORMATION_SCHEMA.PLUGINS where PLUGIN_NAME like '%columnstore%';"
+---------------------+----------------+---------------+--------------------+
| PLUGIN_NAME         | PLUGIN_VERSION | PLUGIN_STATUS | PLUGIN_TYPE        |
+---------------------+----------------+---------------+--------------------+
| Columnstore         | 6.1            | ACTIVE        | STORAGE ENGINE     |
| COLUMNSTORE_COLUMNS | 6.1            | ACTIVE        | INFORMATION SCHEMA |
| COLUMNSTORE_TABLES  | 6.1            | ACTIVE        | INFORMATION SCHEMA |
| COLUMNSTORE_FILES   | 6.1            | ACTIVE        | INFORMATION SCHEMA |
| COLUMNSTORE_EXTENTS | 6.1            | ACTIVE        | INFORMATION SCHEMA |
+---------------------+----------------+---------------+--------------------+
[root@ip-172-31-2-231 tmp]#
[root@ip-172-31-2-231 tmp]# cpimport test test_table /tmp/test_table.csv -s "," -e "\"" 2> cperror.log 1> cpoutput.log
[root@ip-172-31-2-231 tmp]#
[root@ip-172-31-2-231 tmp]# cat cperror.log
cpimport.bin[1625]: 07.707010 |0|0|0| I 34 CAL0086: Initiating BulkLoad: -L /var/log/mariadb/columnstore/cpimport/ -e 0 -s , -P pm1-1625 -T SYSTEM -u1336a461-38fb-4298-a062-9f992cd1166e test test_table /tmp/test_table.csv
cpimport.bin[1625]: 07.759935 |0|0|0| I 34 CAL0081: Start BulkLoad: JobId-3000; db-test
cpimport.bin[1625]: 07.799906 |0|0|0| I 34 CAL0083: BulkLoad: JobId-3000; finished loading table test.test_table; 10 rows inserted
writeengine[1625]: 07.799998 |0|0|0| I 19 CAL0008: Bulkload |Job: /var/log/mariadb/columnstore/data/bulk/tmpjob/3000_D20210901_T162807_S747327_Job_3000.xml |For table test.test_table: 10 rows processed and 10 rows inserted.
cpimport.bin[1625]: 08.779688 |0|0|0| I 34 CAL0082: End BulkLoad: JobId-3000; status-SUCCESS
[root@ip-172-31-2-231 tmp]#



 Comments   
Comment by Daniel Lee (Inactive) [ 2021-12-08 ]

Build verified: 6.2.2-1 (#3463)

Reproduced the issue in 5.6.1-1 and verified the fix.

Generated at Thu Feb 08 02:53:31 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.