[MCOL-3261] Contradiction messages with the Error version buffer overflowed Created: 2019-04-16  Updated: 2023-03-06

Status: Closed
Project: MariaDB ColumnStore
Component/s: DDLProc
Affects Version/s: 1.2.4
Fix Version/s: Icebox

Type: Bug Priority: Major
Reporter: Zdravelina Sokolovska (Inactive) Assignee: Unassigned
Resolution: Unresolved Votes: 0
Labels: None
Environment:

mcs single server; CentOS7


 Description   

Contradiction messages with the Error version buffer overflowed

delete 6000000 rows from table failed with Error
Delete Failed: IDB-2008: The version buffer overflowed. Increase VersionBufferFileSize or limit the rows to be processed
but afterwards were deleted successfully more rows from the same table without changing the VersionBufferFileSize;

It does not become clear what number of rows have to be set under 1 delete operation

MariaDB [mytest]> show create table lineitem ;
 
+----------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
 
| Table    | Create Table                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 |
 
+----------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
 
| lineitem | CREATE TABLE `lineitem` (
 
  `l_orderkey` int(11) DEFAULT NULL,
 
  `l_partkey` int(11) DEFAULT NULL,
 
  `l_suppkey` int(11) DEFAULT NULL,
 
  `l_linenumber` bigint(20) DEFAULT NULL,
 
  `l_quantity` decimal(12,2) DEFAULT NULL,
 
  `l_extendedprice` decimal(12,2) DEFAULT NULL,
 
  `l_discount` decimal(12,2) DEFAULT NULL,
 
  `l_tax` decimal(12,2) DEFAULT NULL,
 
  `l_returnflag` char(1) DEFAULT NULL,
 
  `l_linestatus` char(1) DEFAULT NULL,
 
  `l_shipdate` date DEFAULT NULL,
 
  `l_commitdate` date DEFAULT NULL,
 
  `l_receiptdate` date DEFAULT NULL,
 
  `l_shipinstruct` char(25) DEFAULT NULL,
 
  `l_shipmode` char(10) DEFAULT NULL,
 
  `l_comment` varchar(44) DEFAULT NULL
 
) ENGINE=Columnstore DEFAULT CHARSET=latin1 |
 
+----------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
 
1 row in set (0.000 sec)
 



 
 
MariaDB [mytest]> select count(*) from  lineitem ;
 
+----------+
 
| count(*) |
 
+----------+
 
| 59986053 |
 
+----------+
 
1 row in set (0.345 sec)
 



delete from lineitem where l_orderkey >= 1 and l_orderkey <= 6000000 ;
 
ERROR 1815 (HY000): Internal error: CAL0002: Delete Failed:  IDB-2008: The version buffer overflowed. Increase VersionBufferFileSize or limit the rows to be processed.
 



MariaDB [mytest]> delete from lineitem where l_orderkey >= 24000001 and l_orderkey <= 30000000 ;
 
Query OK, 6003191 rows affected (1 min 46.656 sec)


Apr 16 20:24:27 cps1 dmlpackageproc[11460]: 27.345877 |23468|13561|0| D 21 CAL0041: Start SQL statement: delete from lineitem where l_orderkey >= 24000001 and l_orderkey <= 30000000;|mytest|
 
Apr 16 20:24:27 cps1 ExeMgr[11236]: 27.367614 |23468|0|0| D 16 CAL0041: Start SQL statement: delete from lineitem where l_orderkey >= 24000001 and l_orderkey <= 30000000; ||
 
Apr 16 20:25:16 cps1 writeengine[11318]: 16.720929 |0|13561|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/006.dir/000.dir/FILE000.cdf, chunkId:2 data size:639498/available:638976 -- shifting SUCCESS
 
Apr 16 20:25:24 cps1 writeengine[11318]: 24.665900 |0|13561|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE000.cdf, chunkId:2 data size:600639/available:598016 -- shifting SUCCESS
 
Apr 16 20:25:38 cps1 writeengine[11318]: 38.715190 |0|13561|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/006.dir/000.dir/FILE000.cdf, chunkId:2 data size:656427/available:655360 -- shifting SUCCESS
 
Apr 16 20:25:48 cps1 writeengine[11318]: 48.504186 |0|13561|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE000.cdf, chunkId:2 data size:620393/available:614400 -- shifting SUCCESS
 
Apr 16 20:26:12 cps1 dmlpackageproc[11460]: 12.090289 |23468|13561|0| D 21 CAL0042: End SQL statement
 
Apr 16 20:26:13 cps1 ExeMgr[11236]: 13.915294 |23468|0|0| D 16 CAL0042: End SQL statement
 
Apr 16 20:26:13 cps1 dmlpackageproc[11460]: 13.923313 |23468|13561|0| D 21 CAL0001: Start SQL statement:  COMMIT
 
Apr 16 20:26:13 cps1 dmlpackageproc[11460]: 13.972432 |23468|13561|0| D 21 CAL0001: End SQL statement
 



MariaDB [mytest]>  delete from lineitem where l_orderkey >= 1 and l_orderkey <= 6000000;
 
ERROR 1815 (HY000): Internal error: CAL0002: Delete Failed:  IDB-2008: The version buffer overflowed. Increase VersionBufferFileSize or limito be processed.
 



Apr 16 20:30:44 cps1 dmlpackageproc[11460]: 44.725517 |23468|13562|0| D 21 CAL0041: Start SQL statement: delete from lineitem where l_orderkey >= 1 and l_orderkey <= 6000000;|mytest|
 
Apr 16 20:30:44 cps1 ExeMgr[11236]: 44.747174 |23468|0|0| D 16 CAL0041: Start SQL statement: delete from lineitem where l_orderkey >= 1 and l_orderkey <= 6000000; ||
 
Apr 16 20:32:52 cps1 writeengine[11318]: 52.291845 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:0 data size:377440/available:376832 -- shifting SUCCESS
 
Apr 16 20:32:58 cps1 writeengine[11318]: 58.937289 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:0 data size:297615/available:294912 -- shifting SUCCESS
 
Apr 16 20:33:10 cps1 writeengine[11318]: 10.835497 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:259683/available:253952 -- shifting SUCCESS
 
Apr 16 20:33:26 cps1 writeengine[11318]: 26.869748 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:0 data size:312008/available:311296 -- shifting SUCCESS
 
Apr 16 20:33:29 cps1 writeengine[11318]: 29.917197 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:272141/available:270336 -- shifting SUCCESS
 
Apr 16 20:33:46 cps1 writeengine[11318]: 46.662219 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:225611/available:221184 -- shifting SUCCESS
 
Apr 16 20:33:59 cps1 writeengine[11318]: 59.599198 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:239994/available:237568 -- shifting SUCCESS
 
Apr 16 20:34:00 cps1 writeengine[11318]: 00.194218 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:286784/available:286720 -- shifting SUCCESS
 
Apr 16 20:34:17 cps1 writeengine[11318]: 17.558102 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:255212/available:253952 -- shifting SUCCESS
 
Apr 16 20:34:32 cps1 writeengine[11318]: 32.025025 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:303487/available:303104 -- shifting SUCCESS
 
Apr 16 20:34:46 cps1 writeengine[11318]: 46.995680 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:271685/available:270336 -- shifting SUCCESS
 
Apr 16 20:35:11 cps1 writeengine[11318]: 11.990254 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:287986/available:286720 -- shifting SUCCESS
 
Apr 16 20:35:28 cps1 writeengine[11318]: 28.321733 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:0 data size:344371/available:344064 -- shifting SUCCESS
 
Apr 16 20:35:31 cps1 writeengine[11318]: 31.693643 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:319644/available:319488 -- shifting SUCCESS
 
Apr 16 20:35:51 cps1 writeengine[11318]: 51.372622 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:0 data size:393744/available:393216 -- shifting SUCCESS
 
Apr 16 20:36:12 cps1 writeengine[11318]: 12.476238 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:337303/available:335872 -- shifting SUCCESS
 
Apr 16 20:36:15 cps1 writeengine[11318]: 15.706884 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/006.dir/000.dir/FILE002.cdf, chunkId:1 data size:1695961/available:1695744 -- shifting SUCCESS
 
Apr 16 20:36:15 cps1 writeengine[11318]: 15.756083 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:312871/available:311296 -- shifting SUCCESS
 
Apr 16 20:36:40 cps1 writeengine[11318]: 40.793634 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:328870/available:327680 -- shifting SUCCESS
 
Apr 16 20:37:02 cps1 writeengine[11318]: 02.870800 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:347325/available:344064 -- shifting SUCCESS
 
Apr 16 20:37:32 cps1 writeengine[11318]: 32.707776 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:352501/available:352256 -- shifting SUCCESS
 
Apr 16 20:37:35 cps1 writeengine[11318]: 35.965251 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:360676/available:360448 -- shifting SUCCESS
 
Apr 16 20:37:59 cps1 workernode[11098]: 59.384108 |0|0|0| C 30 CAL0000: VBBM::getBlocks(): version buffer overflow. Increase VersionBufferFileSize. Overflow occured in aged blocks. Requested NumBlocks:VbOid:vbFBO:lastFBO = 90:0:121200:121299 lbid locked is 34161668
 
Apr 16 20:37:59 cps1 dmlpackageproc[11460]: 59.384748 |23468|13562|0| D 21 CAL0042: End SQL statement
 
Apr 16 20:37:59 cps1 dmlpackageproc[11460]: 59.446020 |0|0|0| E 21 CAL0002: Delete Failed:  IDB-2008: The version buffer overflowed. Increase VersionBufferFileSize or limit the rows to be processed.
 
Apr 16 20:37:59 cps1 ExeMgr[11236]: 59.455526 |23468|0|0| D 16 CAL0042: End SQL statement
 
Apr 16 20:37:59 cps1 dmlpackageproc[11460]: 59.456124 |23468|13562|0| D 21 CAL0001: Start SQL statement:  ROLLBACK
 
Apr 16 20:38:54 cps1 dmlpackageproc[11460]: 54.922957 |23468|13562|0| D 21 CAL0001: End SQL statement


Generated at Thu Feb 08 02:41:25 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.