Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-4855

Cpimport is writing to STDERR even on success

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 6.2.2
    • Component/s: None
    • Labels:
      None
    • Sprint:
      2021-11, 2021-12, 2021-13, 2021-14, 2021-15, 2021-16

      Description

      Starting in CS 5.6, even on successful cpimports, some output is being sent to STDERR
      Clients have some automation based on if anything gets written to STDERR then an error must have occurred and forks in logic. This bug was not present in CS 5.5 and below.

      Expected result
      Only when cpimport fails to complete should messages be written to STDERR

      Reproduction in 5.6:

      echo '"6",7800.18,0.18,"a"' > /tmp/test_table.csv2
      mariadb  -e "create database test;"
      mariadb test -e "CREATE TABLE test_table (group_name CHAR(2), number1 DECIMAL(12, 2), number2 DECIMAL(12, 2), var varchar(1)) ENGINE=COLUMNSTORE;"
       
      RCT1-PIXID-CSX2/tmp[root]$ cpimport test test_table /tmp/test_table.csv2 -s "," -e "\"" 2> cperror.log 1> cpoutput.log
       
      RCT1-PIXID-CSX2/tmp[root]$ cat cperror.log
      writeenginesplit[7861]: 09.629445 |0|0|0| I 33 CAL0000: Send EOD message to All PMs
      writeenginesplit[7861]: 09.813692 |0|0|0| I 33 CAL0098: Received a Cpimport Pass from PM2.
      writeenginesplit[7861]: 09.820211 |0|0|0| I 33 CAL0098: Received a Cpimport Pass from PM1.
      writeenginesplit[7861]: 09.843694 |0|0|0| I 33 CAL0098: Received a Cpimport Pass from PM3.
      writeenginesplit[7861]: 09.859150 |0|0|0| I 33 CAL0000: Released Table Lock
       
      RCT1-PIXID-CSX2/tmp[root]$ cat cpoutput.log
      2021-09-01 15:43:09 (7861) INFO : Running distributed import (mode 1) on all PMs...
      2021-09-01 15:43:09 (7861) INFO : For table test.test_table: 4 rows processed and 4 rows inserted.
      2021-09-01 15:43:09 (7861) INFO : Bulk load completed, total run time : 0.326003 seconds
      

      Reproduction in CS 6.1

      [root@ip-172-31-2-231 tmp]# mariadb -e "SELECT PLUGIN_NAME,PLUGIN_VERSION,PLUGIN_STATUS,PLUGIN_TYPE FROM INFORMATION_SCHEMA.PLUGINS where PLUGIN_NAME like '%columnstore%';"
      +---------------------+----------------+---------------+--------------------+
      | PLUGIN_NAME         | PLUGIN_VERSION | PLUGIN_STATUS | PLUGIN_TYPE        |
      +---------------------+----------------+---------------+--------------------+
      | Columnstore         | 6.1            | ACTIVE        | STORAGE ENGINE     |
      | COLUMNSTORE_COLUMNS | 6.1            | ACTIVE        | INFORMATION SCHEMA |
      | COLUMNSTORE_TABLES  | 6.1            | ACTIVE        | INFORMATION SCHEMA |
      | COLUMNSTORE_FILES   | 6.1            | ACTIVE        | INFORMATION SCHEMA |
      | COLUMNSTORE_EXTENTS | 6.1            | ACTIVE        | INFORMATION SCHEMA |
      +---------------------+----------------+---------------+--------------------+
      [root@ip-172-31-2-231 tmp]#
      [root@ip-172-31-2-231 tmp]# cpimport test test_table /tmp/test_table.csv -s "," -e "\"" 2> cperror.log 1> cpoutput.log
      [root@ip-172-31-2-231 tmp]#
      [root@ip-172-31-2-231 tmp]# cat cperror.log
      cpimport.bin[1625]: 07.707010 |0|0|0| I 34 CAL0086: Initiating BulkLoad: -L /var/log/mariadb/columnstore/cpimport/ -e 0 -s , -P pm1-1625 -T SYSTEM -u1336a461-38fb-4298-a062-9f992cd1166e test test_table /tmp/test_table.csv
      cpimport.bin[1625]: 07.759935 |0|0|0| I 34 CAL0081: Start BulkLoad: JobId-3000; db-test
      cpimport.bin[1625]: 07.799906 |0|0|0| I 34 CAL0083: BulkLoad: JobId-3000; finished loading table test.test_table; 10 rows inserted
      writeengine[1625]: 07.799998 |0|0|0| I 19 CAL0008: Bulkload |Job: /var/log/mariadb/columnstore/data/bulk/tmpjob/3000_D20210901_T162807_S747327_Job_3000.xml |For table test.test_table: 10 rows processed and 10 rows inserted.
      cpimport.bin[1625]: 08.779688 |0|0|0| I 34 CAL0082: End BulkLoad: JobId-3000; status-SUCCESS
      [root@ip-172-31-2-231 tmp]#
      

        Attachments

          Activity

            People

            Assignee:
            toddstoffel Todd Stoffel
            Reporter:
            allen.herrera Allen Herrera
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.