[MCOL-2092] Cannot reconnect mcsapi after mcs restart Error during mcsapi bulk operation: Backup error for dictionary file for OID-26311; DBRoot-1;; not in hdrPtrs Created: 2019-01-18  Updated: 2023-10-26  Resolved: 2023-03-06

Status: Closed
Project: MariaDB ColumnStore
Component/s: None
Affects Version/s: 1.1.7
Fix Version/s: Icebox

Type: Bug Priority: Major
Reporter: Zdravelina Sokolovska (Inactive) Assignee: Unassigned
Resolution: Won't Do Votes: 0
Labels: None
Environment:

mcs single server, mcsapi tool


Attachments: Text File mcs_logs.txt     Text File mcs_logs_B.txt    
Epic Link: Consolidate & Redevelop All Columnstore Tools (SDK, Adapters, Backup, Restore, mcsimport)
Epic/Theme: MCOL-4571

 Description   

Cannot reconnect mcsapi after mcs restart
Error during mcsapi bulk operation: Backup error for dictionary file for OID-26311; DBRoot-1; partition-0; segment-0; hwm-2740; chunkIdx-5; numPtrs-5; not in hdrPtrs; Error searching for compressed chunk in db file being backed up.
Rollback performed.

A.
initiate mcs restart
restart requires additional Force or Wait commands due to 3 table locks from mcsapi
start new transaction before forcing restart
force restarting
try to restart last mcsapi transaction - it fails

B. Simplified how to repeat
Start insert transaction with mcsapi
Restart mcs with Force command
Start attempts to restart mcsapi transaction

B.

[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
 



[root@pm1 ~]# mcsadmin restart
 
restartsystem   Fri Jan 18 14:29:39 2019
 
The following tables are locked:
 
LockID Name            Process PID  Session CreationTime           State    DBRoots
 
39     mytest.lineitem mcsapi  1431 102249  2019-01-18 02:28:31 PM Abandoned1
 
 
 
There are active transactions being processed
 
Your options are:
 
    Cancel    -- Cancel the restart request
 
    Wait      -- Wait for write operations to end and then restart
 
    Force     -- Force a restart
 
What would you like to do: [Cancel]: Force
 



[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
 
 
 
 
 
 
 
Error during mcsapi bulk operation: Backup error for dictionary file for OID-26331; DBRoot-1; partition-0; segment-0; hwm-8222; chunkIdx-16; numPtrs-16; not in hdrPtrs;  Error searching for compressed chunk in db file being backed up.
 
Rollback performed.
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi bulk operation: Backup error for dictionary file for OID-26331; DBRoot-1; partition-0; segment-0; hwm-8222; chunkIdx-16; numPtrs-16; not in hdrPtrs;  Error searching for compressed chunk in db file being backed up.
 
Rollback performed.
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi bulk operation: Backup error for dictionary file for OID-26331; DBRoot-1; partition-0; segment-0; hwm-8222; chunkIdx-16; numPtrs-16; not in hdrPtrs;  Error searching for compressed chunk in db file being backed up.
 
Rollback performed.

A.

[root@pm1 ~]# mcsadmin shutdown
 
shutdownsystem   Fri Jan 18 12:53:53 2019
 
 
 
This command stops the processing of applications on all Modules within the MariaDB ColumnStore System
 
 
 
   Checking for active transactions
 
The following tables are locked:
 
LockID Name             Process PID   Session CreationTime           State    DBRoots
 
76     mytest.lineitem  mcsapi  7336  68930   2019-01-18 12:25:59 PM Abandoned1
 
79     mytest.a         mcsapi  12697 95330   2019-01-18 12:37:14 PM Abandoned1
 
84     mytest.lineitem1 mcsapi  15082 123977  2019-01-18 12:42:10 PM Abandoned1
 
 
 
   There are active transactions being processed
 
Your options are:
 
    Cancel    -- Cancel the shutdown request
 
    Wait      -- Wait for write operations to end and then shutdown
 
    Force     -- Force a shutdown
 
What would you like to do: [Cancel]:

start new transaction from mcsapi

[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"

Force mcs restart

Force
 
 
 
   Stopping System...
 
   Successful stop of System
 
 
 
   Shutting Down System...
 
   Successful shutdown of System
 
 
 
[root@pm1 ~]# mcsadmin start
 
startsystem   Fri Jan 18 13:00:40 2019
 
startSystem command, 'columnstore' service is down, sending command to
 
start the 'columnstore' service on all modules
 
 
 
 
 
   System being started, please wait.........
 
   Successful start of System
 
 

start attempting transaction from mcsapi

[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Connection failure: ECONNREFUSED
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi initialization: Table already locked by PID: 23382 'mcsapi' session ID: 118221 txn ID: 7512
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi bulk operation: Backup error for dictionary file for OID-26311; DBRoot-1; partition-0; segment-0; hwm-2740; chunkIdx-5; numPtrs-5; not in hdrPtrs;  Error searching for compressed chunk in db file being backed up.
 
Rollback performed.
 
[root@cps autopilot23]# /usr/local/mariadb/columnstore/tools/mcsimport/mcsimport mytest lineitem2  tests/tests_2019-01-17--16-44-30_LOAD_DATA_IN_FILE/features/cpimportLineitem/lineitem2.tbl  -c Columnstore.xml -d "|"
 
Error during mcsapi bulk operation: Backup error for dictionary file for OID-26311; DBRoot-1; partition-0; segment-0; hwm-2740; chunkIdx-5; numPtrs-5; not in hdrPtrs;  Error searching for compressed chunk in db file being backed up.
 
Rollback performed.
 
[root@cps autopilot23]#



 Comments   
Comment by Todd Stoffel (Inactive) [ 2023-03-06 ]

This ticket was created prior to convergence with the server and may be obsolete. If you find this issue still exists in a modern version, please open a new ticket.

Generated at Thu Feb 08 02:33:40 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.