Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-2092

Cannot reconnect mcsapi after mcs restart Error during mcsapi bulk operation: Backup error for dictionary file for OID-26311; DBRoot-1;; not in hdrPtrs

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open (View Workflow)
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.1.7
    • Fix Version/s: Icebox
    • Component/s: mcsapi, mcsimport
    • Labels:
      None
    • Environment:
      mcs single server, mcsapi tool

      Description

      Cannot reconnect mcsapi after mcs restart
      Error during mcsapi bulk operation: Backup error for dictionary file for OID-26311; DBRoot-1; partition-0; segment-0; hwm-2740; chunkIdx-5; numPtrs-5; not in hdrPtrs; Error searching for compressed chunk in db file being backed up.
      Rollback performed.

      A.
      initiate mcs restart
      restart requires additional Force or Wait commands due to 3 table locks from mcsapi
      start new transaction before forcing restart
      force restarting
      try to restart last mcsapi transaction - it fails

      B. Simplified how to repeat
      Start insert transaction with mcsapi
      Restart mcs with Force command
      Start attempts to restart mcsapi transaction

      B.

      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
      
      

      [root@pm1 ~]# mcsadmin restart
      restartsystem   Fri Jan 18 14:29:39 2019
      The following tables are locked:
      LockID Name            Process PID  Session CreationTime           State    DBRoots
      39     mytest.lineitem mcsapi  1431 102249  2019-01-18 02:28:31 PM Abandoned1
       
      There are active transactions being processed
      Your options are:
          Cancel    -- Cancel the restart request
          Wait      -- Wait for write operations to end and then restart
          Force     -- Force a restart
      What would you like to do: [Cancel]: Force
      
      

      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
       
       
       
      Error during mcsapi bulk operation: Backup error for dictionary file for OID-26331; DBRoot-1; partition-0; segment-0; hwm-8222; chunkIdx-16; numPtrs-16; not in hdrPtrs;  Error searching for compressed chunk in db file being backed up.
      Rollback performed.
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi bulk operation: Backup error for dictionary file for OID-26331; DBRoot-1; partition-0; segment-0; hwm-8222; chunkIdx-16; numPtrs-16; not in hdrPtrs;  Error searching for compressed chunk in db file being backed up.
      Rollback performed.
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi bulk operation: Backup error for dictionary file for OID-26331; DBRoot-1; partition-0; segment-0; hwm-8222; chunkIdx-16; numPtrs-16; not in hdrPtrs;  Error searching for compressed chunk in db file being backed up.
      Rollback performed.
      
      

      A.

      [root@pm1 ~]# mcsadmin shutdown
      shutdownsystem   Fri Jan 18 12:53:53 2019
       
      This command stops the processing of applications on all Modules within the MariaDB ColumnStore System
       
         Checking for active transactions
      The following tables are locked:
      LockID Name             Process PID   Session CreationTime           State    DBRoots
      76     mytest.lineitem  mcsapi  7336  68930   2019-01-18 12:25:59 PM Abandoned1
      79     mytest.a         mcsapi  12697 95330   2019-01-18 12:37:14 PM Abandoned1
      84     mytest.lineitem1 mcsapi  15082 123977  2019-01-18 12:42:10 PM Abandoned1
       
         There are active transactions being processed
      Your options are:
          Cancel    -- Cancel the shutdown request
          Wait      -- Wait for write operations to end and then shutdown
          Force     -- Force a shutdown
      What would you like to do: [Cancel]: 
      

      start new transaction from mcsapi

      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      
      

      Force mcs restart

      Force
       
         Stopping System...
         Successful stop of System
       
         Shutting Down System...
         Successful shutdown of System
       
      [root@pm1 ~]# mcsadmin start
      startsystem   Fri Jan 18 13:00:40 2019
      startSystem command, 'columnstore' service is down, sending command to
      start the 'columnstore' service on all modules
       
       
         System being started, please wait.........
         Successful start of System
       
      
      

      start attempting transaction from mcsapi

      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Connection failure: ECONNREFUSED
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi initialization: Table already locked by PID: 23382 'mcsapi' session ID: 118221 txn ID: 7512
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi bulk operation: Backup error for dictionary file for OID-26311; DBRoot-1; partition-0; segment-0; hwm-2740; chunkIdx-5; numPtrs-5; not in hdrPtrs;  Error searching for compressed chunk in db file being backed up.
      Rollback performed.
      [root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
      Error during mcsapi bulk operation: Backup error for dictionary file for OID-26311; DBRoot-1; partition-0; segment-0; hwm-2740; chunkIdx-5; numPtrs-5; not in hdrPtrs;  Error searching for compressed chunk in db file being backed up.
      Rollback performed.
      [root@cps autopilot23]#
      
      

        Attachments

          Activity

            People

            Assignee:
            ben.thompson Ben Thompson
            Reporter:
            winstone Zdravelina Sokolovska (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:

                Git Integration