Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-5510

columnstore_info.load_from_s3 | Connection forever hangs if cpimport fails

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • None
    • 23.02.4
    • None
    • None

    Description

      Reproduction

       
      CREATE DATABASE db1;
       
      CREATE TABLE db1.tab1 (
         id INT,
         color varchar(50),
         quantity INT
      ) ENGINE=ColumnStore;
       
      # See developer comments for key/secret
      SET columnstore_s3_region='us-west-2';
      SET columnstore_s3_key='x';
      SET columnstore_s3_secret='x';
      CALL columnstore_info.load_from_s3('s3://allens-spark-test-bucket/','wrong_junk_data.csv','db1', 'tab1', ',', '', '');
      
      

      Notice in your docker container when you tail /var/log/messages

      Jun  7 22:43:48 mcs1 writeengine[2098]: 48.894326 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile    for table db1.tab1 (OID-3003), column 3008. HWM compressed column file: dbRoot-1; part#-0; seg#-0; rawFreeBlks-30 (abbrev); restoredChunk-24576 bytes; truncated to 32768 bytes
      Jun  7 22:43:48 mcs1 writeengine[2098]: 48.899023 |0|0|0| I 19 CAL0085: ClearTableLock: Ending bulk rollback for table db1.tab1 (OID-3003); lock-19; initiated by cpimport.bin.
      Jun  7 22:43:48 mcs1 cpimport.bin[2098]: 48.901176 |0|0|0| I 34 CAL0082: End BulkLoad: JobId-3003; status-FAILED
      

      This is extra bad for SkySQL because users cant see these logs and their connection just hangs there forever until a connection timeout is hit

      Attachments

        Issue Links

          Activity

            People

              leonid.fedorov Leonid Fedorov
              allen.herrera Allen Herrera
              Daniel Lee Daniel Lee (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.