Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-1381

cpimport for batch insert (INSERT INTO SELECT FROM) does not work

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Minor
    • Resolution: Not a Bug
    • 1.1.3
    • Icebox
    • MariaDB Server
    • None
    • CentOS 7.4
      SoftwareVersion = 1.1.3
      SoftwareRelease = 1

    Description

      However the infinidb_use_import_for_batchinsert is ON the INSERT INTO SELECT FROM statement inserts the rows into the table individually with 10 -
      12 sec/row speed.
      Based o the ColumnStore Batch Insert Mode description I expected that it would work at same speed as the cpimport

      MariaDB [data_warehouse]> show variables like '%infinidb_use_import_for_batchinsert%';
      +-------------------------------------+-------+
      | Variable_name                       | Value |
      +-------------------------------------+-------+
      | infinidb_use_import_for_batchinsert | ON    |
      +-------------------------------------+-------+
      1 row in set (0.01 sec)
      

      SQL statement (changed removing sensitive information):

      insert into target_db.target_table select * from test_view where d_date = '2018.04.29';
      

      tail -f /var/log/mariadb/columnstore/debug.log (changed removing the sensitive information)

      May  3 12:43:57 COLUMNSTORE_UM dmlpackageproc[5861]: 57.110912 |16|9458|0| D 21 CAL0001: Start SQL statement:  insert into test_table select col1, col2, ...coln  from infinidb_vtable.$vtable_16; |target_db|
      May  3 12:44:10 COLUMNSTORE_UM dmlpackageproc[5861]: 10.184041 |16|9458|0| D 21 CAL0001: End SQL statement
      May  3 12:44:10 COLUMNSTORE_UM dmlpackageproc[5861]: 10.184187 |0|0|0| W 21 CAL0001: IDB-2025: Data truncated for column 'col1'
      May  3 12:44:10 COLUMNSTORE_UM dmlpackageproc[5861]: 10.253820 |16|9458|0| D 21 CAL0001: Start SQL statement:  COMMIT
      May  3 12:44:11 COLUMNSTORE_UM dmlpackageproc[5861]: 11.453470 |16|9458|0| D 21 CAL0001: End SQL statement
      May  3 12:44:11 COLUMNSTORE_UM dmlpackageproc[5861]: 11.519823 |16|9459|0| D 21 CAL0001: Start SQL statement:  insert into test_table select col1, col2, ...coln  from infinidb_vtable.$vtable_16; |target_db|
      May  3 12:44:24 COLUMNSTORE_UM dmlpackageproc[5861]: 24.335447 |16|9459|0| D 21 CAL0001: End SQL statement
      May  3 12:44:24 COLUMNSTORE_UM dmlpackageproc[5861]: 24.444194 |16|9459|0| D 21 CAL0001: Start SQL statement:  COMMIT
      May  3 12:44:25 COLUMNSTORE_UM dmlpackageproc[5861]: 25.834371 |16|9459|0| D 21 CAL0001: End SQL statement
      May  3 12:44:25 COLUMNSTORE_UM dmlpackageproc[5861]: 25.947407 |16|9460|0| D 21 CAL0001: Start SQL statement:  insert into test_table select col1, col2, ...coln  from infinidb_vtable.$vtable_16; |target_db|
      May  3 12:44:37 COLUMNSTORE_UM dmlpackageproc[5861]: 37.863515 |16|9460|0| D 21 CAL0001: End SQL statement
      May  3 12:44:37 COLUMNSTORE_UM dmlpackageproc[5861]: 37.966467 |16|9460|0| D 21 CAL0001: Start SQL statement:  COMMIT
      May  3 12:44:39 COLUMNSTORE_UM dmlpackageproc[5861]: 39.198694 |16|9460|0| D 21 CAL0001: End SQL statement
      May  3 12:44:39 COLUMNSTORE_UM dmlpackageproc[5861]: 39.313278 |16|9461|0| D 21 CAL0001: Start SQL statement:  insert into test_table select col1, col2, ...coln  from infinidb_vtable.$vtable_16; |target_db|
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            misi Mihaly Hazag
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.