[MCOL-3366] Backup error for dictionary file for OID-3904 Created: 2019-06-05  Updated: 2023-10-26  Resolved: 2023-03-06

Status: Closed
Project: MariaDB ColumnStore
Component/s: DDLProc, DMLProc, ExeMgr
Affects Version/s: 1.2.4
Fix Version/s: Icebox

Type: Bug Priority: Major
Reporter: Nicola Assignee: Unassigned
Resolution: Won't Do Votes: 0
Labels: None
Environment:

3 PM and 2 UM

Epic Link: Consolidate & Redevelop All Columnstore Tools (SDK, Adapters, Backup, Restore, mcsimport)

 Description   

Hi,
My job with Pentaho today crash for this error:

2019/06/05 12:36:37 - MariaDB ColumnStore Bulk Loader.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : couldn't commit bulk insert to ColumnStore - rollback
2019/06/05 12:36:37 - MariaDB ColumnStore Bulk Loader.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : com.mariadb.columnstore.api.ColumnStoreException: Backup error for dictionary file for OID-3904; DBRoot-1; partition-23; segment-0; hwm-61180; chunkIdx-119; numPtrs-119; not in hdrPtrs; Error searching for compressed chunk in db file being backed up.

This job has been running for months without ever having given problems.
There was no kind of crash or inconsistency at the data level.
Finally this job only makes inserts, so no update, delete.

Can you help me understand what is happening to the system?

 Comments   
Comment by Andrew Hutchings (Inactive) [ 2019-06-10 ]

This happens when the block backup code tries to access the HWM block, does a chunk lookup and gets a chunk that doesn't exist (chunkIdx should be less than numPtrs).

Not sure how it gets into that state yet.

Comment by Nicola [ 2019-06-10 ]

I remember that when I had the same problem, with a redistribute data (from mcsadmin) I solved the problem.
Now the redistribute command tells me that it has nothing to distribute and therefore I cannot solve the problem.

Actually on pm1,pm2,pm3 :
/dev/mapper/glusterfs_dbroot1-brick1 400G 223G 177G 56% /usr/local/mariadb/columnstore/gluster/brick1
/dev/mapper/glusterfs_dbroot3-brick3 400G 91G 309G 23% /usr/local/mariadb/columnstore/gluster/brick3
/dev/mapper/glusterfs_dbroot2-brick2 400G 96G 305G 24% /usr/local/mariadb/columnstore/gluster/brick2

why is space consumption so unbalanced on brick1 compared to brick2 and brick3?

Comment by Nicola [ 2019-06-19 ]

Hi,
Any news?

Thanks,
Regards
Nicola Battista

Comment by Roman [ 2019-06-19 ]

Greetings nbattista89

The error you got usually caused by data corruption in a data file. There is a header section in a data file that contains offsets in this data file to places where compressed chunks of data blocks start. This header entry #119 contains non-existant offset. That could happens when other facility partially rewrites the data file. Given that you use Gluster it might be either gluster related bug in CS or someone/something rewrited the CS data file.

Do you have any relevanted entries in error.log close to the period when the original problem happened first?

Comment by Nicola [ 2019-06-20 ]

Hi,
This is the log :

Jun 20 13:40:18 cstore-pm01 ProcessMonitor[11647]: 18.460303 |0|0|0| I 18 CAL0000: MSG RECEIVED: Get Calpont Software Info
Jun 20 13:40:18 cstore-pm01 ProcessMonitor[11647]: 18.460441 |0|0|0| I 18 CAL0000: GETSOFTWAREINFO: ACK back to ProcMgr with 1.2.41
Jun 20 13:40:20 cstore-pm01 writeengine[48194]: 20.740227 |0|0|0| I 19 CAL0084: ClearTableLock: Starting bulk rollback for table c6msg.c6_messaggio_in (OID-3885); lock-6; initiated by BatchInsert.
Jun 20 13:40:20 cstore-pm01 writeengine[48194]: 20.740465 |0|0|0| I 19 CAL0072: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885).
Jun 20 13:40:20 cstore-pm01 writeengine[48194]: 20.742273 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3886. DBRoot-1 (column extent)
Jun 20 13:40:20 cstore-pm01 writeengine[48194]: 20.742337 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3886. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-3959
Jun 20 13:40:20 cstore-pm01 writeengine[48194]: 20.765752 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3886. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-32440320; rawFreeBlks-4232
Jun 20 13:40:20 cstore-pm01 writeengine[48194]: 20.784191 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3886. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-1581056 bytes; truncated to 67117056 bytes
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.054712 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3887. DBRoot-1 (column extent)
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.054798 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3887. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-494
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.060499 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3887. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-4055040; rawFreeBlks-529
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.082377 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3887. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-2375680 bytes; truncated to 8396800 bytes
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.131266 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3888. DBRoot-1 (column extent)
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.131366 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3888. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-494
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.135829 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3888. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-4055040; rawFreeBlks-529
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.141355 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3888. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-212992 bytes; truncated to 8396800 bytes
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.194353 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3889. DBRoot-1 (column extent)
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.194445 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3889. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-3959
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.198805 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3889. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-32440320; rawFreeBlks-4232
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.215666 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3889. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-1581056 bytes; truncated to 67117056 bytes
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.457525 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3904. DBRoot-1 (dictionary extent)
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.457652 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3904. Restoring HWM dictionary store extents: dbRoot-1; part#-23; HWM(s): 61180
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.461410 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3904. Reinit HWM compressed dictionary store extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-501194752; rawFreeBlks-4355
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.466117 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3890. DBRoot-1 (column extent)
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.466175 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3890. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-3959
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.470392 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3890. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-32440320; rawFreeBlks-4232
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.480884 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3890. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-688128 bytes; truncated to 67117056 bytes
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.765637 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3891. DBRoot-1 (column extent)
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.765738 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3891. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-3959
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.770983 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3891. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-32440320; rawFreeBlks-4232
Jun 20 13:40:21 cstore-pm01 writeengine[48194]: 21.782641 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3891. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-704512 bytes; truncated to 67117056 bytes
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.083561 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3905. DBRoot-1 (dictionary extent)
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.083655 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3905. Restoring HWM dictionary store extents: dbRoot-1; part#-23; HWM(s): 0
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.087160 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3905. Reinit HWM compressed dictionary store extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-8192; rawFreeBlks-8191
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.091935 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3905. No restore needed to Compressed dictionary file: dbRoot-1; part#-23; seg#-0
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.093724 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3892. DBRoot-1 (column extent)
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.093783 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3892. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-3959
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.097915 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3892. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-32440320; rawFreeBlks-4232
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.114072 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3892. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-1581056 bytes; truncated to 67117056 bytes
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.380128 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3906. DBRoot-1 (dictionary extent)
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.380227 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3906. Restoring HWM dictionary store extents: dbRoot-1; part#-23; HWM(s): 8456
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.383992 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3906. Reinit HWM compressed dictionary store extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-69279744; rawFreeBlks-7927
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.387767 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3906. No restore needed to Compressed dictionary file: dbRoot-1; part#-23; seg#-0
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.389585 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3893. DBRoot-1 (column extent)
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.389642 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3893. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-3959
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.393900 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3893. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-32440320; rawFreeBlks-4232
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.406612 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3893. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-884736 bytes; truncated to 67117056 bytes
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.701243 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3907. DBRoot-1 (dictionary extent)
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.701361 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3907. Restoring HWM dictionary store extents: dbRoot-1; part#-23; HWM(s): 23839
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.705819 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3907. Reinit HWM compressed dictionary store extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-195297280; rawFreeBlks-736
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.711672 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3894. DBRoot-1 (column extent)
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.711732 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3894. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-989
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.717078 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3894. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-8110080; rawFreeBlks-1058
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.722753 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3894. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-212992 bytes; truncated to 16785408 bytes
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.835063 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3895. DBRoot-1 (column extent)
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.835156 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3895. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-989
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.840379 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3895. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-8110080; rawFreeBlks-1058
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.846438 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3895. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-212992 bytes; truncated to 16785408 bytes
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.963762 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3896. DBRoot-1 (column extent)
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.963869 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3896. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-3959
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.969493 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3896. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-32440320; rawFreeBlks-4232
Jun 20 13:40:22 cstore-pm01 writeengine[48194]: 22.980445 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3896. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-688128 bytes; truncated to 67117056 bytes
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.337206 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3897. DBRoot-1 (column extent)
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.337305 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3897. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-989
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.344603 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3897. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-8110080; rawFreeBlks-1058
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.350102 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3897. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-212992 bytes; truncated to 16785408 bytes
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.461875 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3898. DBRoot-1 (column extent)
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.461969 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3898. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-3959
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.467324 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3898. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-32440320; rawFreeBlks-4232
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.479653 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3898. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-917504 bytes; truncated to 67117056 bytes
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.794568 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3899. DBRoot-1 (column extent)
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.794664 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3899. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-989
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.798916 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3899. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-8110080; rawFreeBlks-1058
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.804525 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3899. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-212992 bytes; truncated to 16785408 bytes
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.959365 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3900. DBRoot-1 (column extent)
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.959460 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3900. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-3959
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.964036 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3900. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-32440320; rawFreeBlks-4232
Jun 20 13:40:23 cstore-pm01 writeengine[48194]: 23.970796 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3900. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-212992 bytes; truncated to 67117056 bytes
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.349063 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3901. DBRoot-1 (column extent)
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.349154 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3901. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-989
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.355084 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3901. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-8110080; rawFreeBlks-1058
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.369312 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3901. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-1212416 bytes; truncated to 16785408 bytes
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.477346 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3902. DBRoot-1 (column extent)
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.477450 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3902. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-3959
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.481800 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3902. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-32440320; rawFreeBlks-4232
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.493209 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3902. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-729088 bytes; truncated to 67117056 bytes
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.875263 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3908. DBRoot-1 (dictionary extent)
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.875361 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3908. Restoring HWM dictionary store extents: dbRoot-1; part#-23; HWM(s): 1857
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.879243 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3908. Reinit HWM compressed dictionary store extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-15220736; rawFreeBlks-6334
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.883111 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3908. No restore needed to Compressed dictionary file: dbRoot-1; part#-23; seg#-0
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.885150 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3903. DBRoot-1 (column extent)
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.885208 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3903. Restoring HWM column extent: dbRoot-1; part#-23; seg#-0; hwm-3959
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.889756 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3903. Reinit HWM compressed column extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-32440320; rawFreeBlks-4232
Jun 20 13:40:24 cstore-pm01 writeengine[48194]: 24.899722 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3903. HWM compressed column file: dbRoot-1; part#-23; seg#-0; restoredChunk-499712 bytes; truncated to 67117056 bytes
Jun 20 13:40:25 cstore-pm01 writeengine[48194]: 25.246991 |0|0|0| I 19 CAL0073: ClearTableLock: Rollback extents for table c6msg.c6_messaggio_in (OID-3885), column 3909. DBRoot-1 (dictionary extent)
Jun 20 13:40:25 cstore-pm01 writeengine[48194]: 25.247077 |0|0|0| I 19 CAL0074: ClearTableLock: Rollback extentMap for table c6msg.c6_messaggio_in (OID-3885), column 3909. Restoring HWM dictionary store extents: dbRoot-1; part#-23; HWM(s): 1423
Jun 20 13:40:25 cstore-pm01 writeengine[48194]: 25.252874 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3909. Reinit HWM compressed dictionary store extent in db file: dbRoot-1; part#-23; seg#-0; rawOffset(bytes)-11665408; rawFreeBlks-6768
Jun 20 13:40:25 cstore-pm01 writeengine[48194]: 25.256631 |0|0|0| I 19 CAL0075: ClearTableLock: Rollback dbfile for table c6msg.c6_messaggio_in (OID-3885), column 3909. No restore needed to Compressed dictionary file: dbRoot-1; part#-23; seg#-0
Jun 20 13:40:25 cstore-pm01 writeengine[48194]: 25.887789 |0|0|0| I 19 CAL0085: ClearTableLock: Ending bulk rollback for table c6msg.c6_messaggio_in (OID-3885); lock-6; initiated by BatchInsert.

Comment by Roman [ 2019-06-20 ]

Could you fetch me batch inserting job log? They leave in $INSTALL_DIR/data/bulk/log. The name of the file must contain job id that could be found in the log.

Comment by Nicola [ 2019-06-24 ]

I've found the log but the last usage is too old.

rw-rr- 1 root root 0 Jan 10 06:00 Job_3483.err
rw-rr- 1 root root 0 Jan 10 10:45 Job_3378.err
rw-rr- 1 root root 39K Jan 10 13:34 Job_3378.log
rw-rr- 1 root root 131K Jan 16 06:01 Job_3483.log

I use the pentaho kettle columnstore plugin for insert data.

Comment by Nicola [ 2019-08-23 ]

Hi,
Any news?

Thanks,
Regards
Nicola Battista

Comment by Todd Stoffel (Inactive) [ 2023-03-06 ]

This ticket was created prior to convergence with the server and may be obsolete. If you find this issue still exists in a modern version, please open a new ticket.

Generated at Thu Feb 08 02:42:12 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.