Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-659

cpimport failure for > 1k col wide table = 300k csv lines

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Not a Bug
    • 1.0.7
    • Icebox
    • cpimport
    • None

    Description

      200k or less csv lines works ok

      300k or more always fails for me and leaves the draws table locked ... i restarted the server after that and it was ok until i locked it up again

      root@columnstore-testing-d01:/home/techteamdbdev/draws# cpimport -s ',' -E '"' draws draws draws.csv
      Locale is : C
      Column delimiter : ,
      Enclosed by Character : "

      Using table OID 20879 as the default JOB ID
      Input file(s) will be read from : /home/techteamdbdev/draws
      Job description file : /usr/local/mariadb/columnstore/data/bulk/tmpjob/20879_D20170410_T181326_S307847_Job_20879.xml
      Log file for this job: /usr/local/mariadb/columnstore/data/bulk/log/Job_20879.log
      2017-04-10 18:13:26 (55594) INFO : successfully loaded job file /usr/local/mariadb/columnstore/data/bulk/tmpjob/20879_D20170410_T181326_S307847_Job_20879.xml
      2017-04-10 18:13:26 (55594) INFO : Job file loaded, run time for this step : 0.165293 seconds
      2017-04-10 18:13:26 (55594) INFO : PreProcessing check starts
      2017-04-10 18:13:26 (55594) INFO : input data file /home/techteamdbdev/draws/draws.csv
      2017-04-10 18:13:34 (55594) INFO : PreProcessing check completed
      2017-04-10 18:13:34 (55594) INFO : preProcess completed, run time for this step : 8.17341 seconds
      2017-04-10 18:13:34 (55594) INFO : No of Read Threads Spawned = 1
      2017-04-10 18:13:34 (55594) INFO : No of Parse Threads Spawned = 3
      Killed

      -----------------

      root@columnstore-testing-d01:/home/techteamdbdev/draws# cpimport -s ',' -E '"' draws draws draws.csv
      Locale is : C
      Column delimiter : ,
      Enclosed by Character : "

      Using table OID 20879 as the default JOB ID
      Input file(s) will be read from : /home/techteamdbdev/draws
      Job description file : /usr/local/mariadb/columnstore/data/bulk/tmpjob/20879_D20170410_T181526_S254449_Job_20879.xml
      Log file for this job: /usr/local/mariadb/columnstore/data/bulk/log/Job_20879.log
      2017-04-10 18:15:26 (56061) INFO : successfully loaded job file /usr/local/mariadb/columnstore/data/bulk/tmpjob/20879_D20170410_T181526_S254449_Job_20879.xml
      2017-04-10 18:15:26 (56061) INFO : Job file loaded, run time for this step : 0.174996 seconds
      2017-04-10 18:15:26 (56061) INFO : PreProcessing check starts
      2017-04-10 18:15:26 (56061) INFO : input data file /home/techteamdbdev/draws/draws.csv
      2017-04-10 18:15:36 (56061) ERR : Unable to acquire lock for table draws.draws; OID-20879; table currently locked by process-cpimport.bin (pm1); pid-55594; session-1; txn-1 [1203]

      Error in loading job data

      Attachments

        Activity

          People

            dthompson David Thompson (Inactive)
            hill David Hill (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.