Details
-
Bug
-
Status: Closed (View Workflow)
-
Minor
-
Resolution: Fixed
-
None
-
None
-
None
-
2021-11, 2021-12, 2021-13, 2021-14, 2021-15, 2021-16
Description
Starting in CS 5.6, even on successful cpimports, some output is being sent to STDERR
Clients have some automation based on if anything gets written to STDERR then an error must have occurred and forks in logic. This bug was not present in CS 5.5 and below.
Expected result
Only when cpimport fails to complete should messages be written to STDERR
Reproduction in 5.6:
echo '"6",7800.18,0.18,"a"' > /tmp/test_table.csv2 |
mariadb -e "create database test;" |
mariadb test -e "CREATE TABLE test_table (group_name CHAR(2), number1 DECIMAL(12, 2), number2 DECIMAL(12, 2), var varchar(1)) ENGINE=COLUMNSTORE;" |
|
|
RCT1-PIXID-CSX2/tmp[root]$ cpimport test test_table /tmp/test_table.csv2 -s "," -e "\"" 2> cperror.log 1> cpoutput.log |
|
|
RCT1-PIXID-CSX2/tmp[root]$ cat cperror.log
|
writeenginesplit[7861]: 09.629445 |0|0|0| I 33 CAL0000: Send EOD message to All PMs |
writeenginesplit[7861]: 09.813692 |0|0|0| I 33 CAL0098: Received a Cpimport Pass from PM2. |
writeenginesplit[7861]: 09.820211 |0|0|0| I 33 CAL0098: Received a Cpimport Pass from PM1. |
writeenginesplit[7861]: 09.843694 |0|0|0| I 33 CAL0098: Received a Cpimport Pass from PM3. |
writeenginesplit[7861]: 09.859150 |0|0|0| I 33 CAL0000: Released Table Lock |
|
|
RCT1-PIXID-CSX2/tmp[root]$ cat cpoutput.log
|
2021-09-01 15:43:09 (7861) INFO : Running distributed import (mode 1) on all PMs... |
2021-09-01 15:43:09 (7861) INFO : For table test.test_table: 4 rows processed and 4 rows inserted. |
2021-09-01 15:43:09 (7861) INFO : Bulk load completed, total run time : 0.326003 seconds |
Reproduction in CS 6.1
[root@ip-172-31-2-231 tmp]# mariadb -e "SELECT PLUGIN_NAME,PLUGIN_VERSION,PLUGIN_STATUS,PLUGIN_TYPE FROM INFORMATION_SCHEMA.PLUGINS where PLUGIN_NAME like '%columnstore%';" |
+---------------------+----------------+---------------+--------------------+
|
| PLUGIN_NAME | PLUGIN_VERSION | PLUGIN_STATUS | PLUGIN_TYPE |
|
+---------------------+----------------+---------------+--------------------+
|
| Columnstore | 6.1 | ACTIVE | STORAGE ENGINE | |
| COLUMNSTORE_COLUMNS | 6.1 | ACTIVE | INFORMATION SCHEMA | |
| COLUMNSTORE_TABLES | 6.1 | ACTIVE | INFORMATION SCHEMA | |
| COLUMNSTORE_FILES | 6.1 | ACTIVE | INFORMATION SCHEMA | |
| COLUMNSTORE_EXTENTS | 6.1 | ACTIVE | INFORMATION SCHEMA | |
+---------------------+----------------+---------------+--------------------+
|
[root@ip-172-31-2-231 tmp]# |
[root@ip-172-31-2-231 tmp]# cpimport test test_table /tmp/test_table.csv -s "," -e "\"" 2> cperror.log 1> cpoutput.log |
[root@ip-172-31-2-231 tmp]# |
[root@ip-172-31-2-231 tmp]# cat cperror.log |
cpimport.bin[1625]: 07.707010 |0|0|0| I 34 CAL0086: Initiating BulkLoad: -L /var/log/mariadb/columnstore/cpimport/ -e 0 -s , -P pm1-1625 -T SYSTEM -u1336a461-38fb-4298-a062-9f992cd1166e test test_table /tmp/test_table.csv |
cpimport.bin[1625]: 07.759935 |0|0|0| I 34 CAL0081: Start BulkLoad: JobId-3000; db-test |
cpimport.bin[1625]: 07.799906 |0|0|0| I 34 CAL0083: BulkLoad: JobId-3000; finished loading table test.test_table; 10 rows inserted |
writeengine[1625]: 07.799998 |0|0|0| I 19 CAL0008: Bulkload |Job: /var/log/mariadb/columnstore/data/bulk/tmpjob/3000_D20210901_T162807_S747327_Job_3000.xml |For table test.test_table: 10 rows processed and 10 rows inserted. |
cpimport.bin[1625]: 08.779688 |0|0|0| I 34 CAL0082: End BulkLoad: JobId-3000; status-SUCCESS |
[root@ip-172-31-2-231 tmp]# |