[MCOL-3261] Contradiction messages with the Error version buffer overflowed - Jira

XML

Word

Printable

Details

Type: Bug
Status: Closed (View Workflow)
Priority: Major
Resolution: Unresolved
Affects Version/s: 1.2.4
Fix Version/s: Icebox
Component/s: DDLProc
Labels:
None
Environment:
mcs single server; CentOS7

Description

Contradiction messages with the Error version buffer overflowed

delete 6000000 rows from table failed with Error
Delete Failed: IDB-2008: The version buffer overflowed. Increase VersionBufferFileSize or limit the rows to be processed
but afterwards were deleted successfully more rows from the same table without changing the VersionBufferFileSize;

It does not become clear what number of rows have to be set under 1 delete operation

MariaDB [mytest]> show create table lineitem ;

+----------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

| Table    | Create Table                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 |

+----------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

| lineitem | CREATE TABLE `lineitem` (

  `l_orderkey` int(11) DEFAULT NULL,

  `l_partkey` int(11) DEFAULT NULL,

  `l_suppkey` int(11) DEFAULT NULL,

  `l_linenumber` bigint(20) DEFAULT NULL,

  `l_quantity` decimal(12,2) DEFAULT NULL,

  `l_extendedprice` decimal(12,2) DEFAULT NULL,

  `l_discount` decimal(12,2) DEFAULT NULL,

  `l_tax` decimal(12,2) DEFAULT NULL,

  `l_returnflag` char(1) DEFAULT NULL,

  `l_linestatus` char(1) DEFAULT NULL,

  `l_shipdate` date DEFAULT NULL,

  `l_commitdate` date DEFAULT NULL,

  `l_receiptdate` date DEFAULT NULL,

  `l_shipinstruct` char(25) DEFAULT NULL,

  `l_shipmode` char(10) DEFAULT NULL,

  `l_comment` varchar(44) DEFAULT NULL

) ENGINE=Columnstore DEFAULT CHARSET=latin1 |

+----------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

1 row in set (0.000 sec)

MariaDB [mytest]> select count(*) from  lineitem ;

+----------+

| count(*) |

+----------+

| 59986053 |

+----------+

1 row in set (0.345 sec)

delete from lineitem where l_orderkey >= 1 and l_orderkey <= 6000000 ;

ERROR 1815 (HY000): Internal error: CAL0002: Delete Failed:  IDB-2008: The version buffer overflowed. Increase VersionBufferFileSize or limit the rows to be processed.

MariaDB [mytest]> delete from lineitem where l_orderkey >= 24000001 and l_orderkey <= 30000000 ;

Query OK, 6003191 rows affected (1 min 46.656 sec)

Apr 16 20:24:27 cps1 dmlpackageproc[11460]: 27.345877 |23468|13561|0| D 21 CAL0041: Start SQL statement: delete from lineitem where l_orderkey >= 24000001 and l_orderkey <= 30000000;|mytest|

Apr 16 20:24:27 cps1 ExeMgr[11236]: 27.367614 |23468|0|0| D 16 CAL0041: Start SQL statement: delete from lineitem where l_orderkey >= 24000001 and l_orderkey <= 30000000; ||

Apr 16 20:25:16 cps1 writeengine[11318]: 16.720929 |0|13561|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/006.dir/000.dir/FILE000.cdf, chunkId:2 data size:639498/available:638976 -- shifting SUCCESS

Apr 16 20:25:24 cps1 writeengine[11318]: 24.665900 |0|13561|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE000.cdf, chunkId:2 data size:600639/available:598016 -- shifting SUCCESS

Apr 16 20:25:38 cps1 writeengine[11318]: 38.715190 |0|13561|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/006.dir/000.dir/FILE000.cdf, chunkId:2 data size:656427/available:655360 -- shifting SUCCESS

Apr 16 20:25:48 cps1 writeengine[11318]: 48.504186 |0|13561|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE000.cdf, chunkId:2 data size:620393/available:614400 -- shifting SUCCESS

Apr 16 20:26:12 cps1 dmlpackageproc[11460]: 12.090289 |23468|13561|0| D 21 CAL0042: End SQL statement

Apr 16 20:26:13 cps1 ExeMgr[11236]: 13.915294 |23468|0|0| D 16 CAL0042: End SQL statement

Apr 16 20:26:13 cps1 dmlpackageproc[11460]: 13.923313 |23468|13561|0| D 21 CAL0001: Start SQL statement:  COMMIT

Apr 16 20:26:13 cps1 dmlpackageproc[11460]: 13.972432 |23468|13561|0| D 21 CAL0001: End SQL statement

MariaDB [mytest]>  delete from lineitem where l_orderkey >= 1 and l_orderkey <= 6000000;

ERROR 1815 (HY000): Internal error: CAL0002: Delete Failed:  IDB-2008: The version buffer overflowed. Increase VersionBufferFileSize or limito be processed.

Apr 16 20:30:44 cps1 dmlpackageproc[11460]: 44.725517 |23468|13562|0| D 21 CAL0041: Start SQL statement: delete from lineitem where l_orderkey >= 1 and l_orderkey <= 6000000;|mytest|

Apr 16 20:30:44 cps1 ExeMgr[11236]: 44.747174 |23468|0|0| D 16 CAL0041: Start SQL statement: delete from lineitem where l_orderkey >= 1 and l_orderkey <= 6000000; ||

Apr 16 20:32:52 cps1 writeengine[11318]: 52.291845 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:0 data size:377440/available:376832 -- shifting SUCCESS

Apr 16 20:32:58 cps1 writeengine[11318]: 58.937289 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:0 data size:297615/available:294912 -- shifting SUCCESS

Apr 16 20:33:10 cps1 writeengine[11318]: 10.835497 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:259683/available:253952 -- shifting SUCCESS

Apr 16 20:33:26 cps1 writeengine[11318]: 26.869748 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:0 data size:312008/available:311296 -- shifting SUCCESS

Apr 16 20:33:29 cps1 writeengine[11318]: 29.917197 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:272141/available:270336 -- shifting SUCCESS

Apr 16 20:33:46 cps1 writeengine[11318]: 46.662219 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:225611/available:221184 -- shifting SUCCESS

Apr 16 20:33:59 cps1 writeengine[11318]: 59.599198 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:239994/available:237568 -- shifting SUCCESS

Apr 16 20:34:00 cps1 writeengine[11318]: 00.194218 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:286784/available:286720 -- shifting SUCCESS

Apr 16 20:34:17 cps1 writeengine[11318]: 17.558102 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:255212/available:253952 -- shifting SUCCESS

Apr 16 20:34:32 cps1 writeengine[11318]: 32.025025 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:303487/available:303104 -- shifting SUCCESS

Apr 16 20:34:46 cps1 writeengine[11318]: 46.995680 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:271685/available:270336 -- shifting SUCCESS

Apr 16 20:35:11 cps1 writeengine[11318]: 11.990254 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:287986/available:286720 -- shifting SUCCESS

Apr 16 20:35:28 cps1 writeengine[11318]: 28.321733 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:0 data size:344371/available:344064 -- shifting SUCCESS

Apr 16 20:35:31 cps1 writeengine[11318]: 31.693643 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:319644/available:319488 -- shifting SUCCESS

Apr 16 20:35:51 cps1 writeengine[11318]: 51.372622 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:0 data size:393744/available:393216 -- shifting SUCCESS

Apr 16 20:36:12 cps1 writeengine[11318]: 12.476238 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:337303/available:335872 -- shifting SUCCESS

Apr 16 20:36:15 cps1 writeengine[11318]: 15.706884 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/006.dir/000.dir/FILE002.cdf, chunkId:1 data size:1695961/available:1695744 -- shifting SUCCESS

Apr 16 20:36:15 cps1 writeengine[11318]: 15.756083 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:312871/available:311296 -- shifting SUCCESS

Apr 16 20:36:40 cps1 writeengine[11318]: 40.793634 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:328870/available:327680 -- shifting SUCCESS

Apr 16 20:37:02 cps1 writeengine[11318]: 02.870800 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:347325/available:344064 -- shifting SUCCESS

Apr 16 20:37:32 cps1 writeengine[11318]: 32.707776 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:352501/available:352256 -- shifting SUCCESS

Apr 16 20:37:35 cps1 writeengine[11318]: 35.965251 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:360676/available:360448 -- shifting SUCCESS

Apr 16 20:37:59 cps1 workernode[11098]: 59.384108 |0|0|0| C 30 CAL0000: VBBM::getBlocks(): version buffer overflow. Increase VersionBufferFileSize. Overflow occured in aged blocks. Requested NumBlocks:VbOid:vbFBO:lastFBO = 90:0:121200:121299 lbid locked is 34161668

Apr 16 20:37:59 cps1 dmlpackageproc[11460]: 59.384748 |23468|13562|0| D 21 CAL0042: End SQL statement

Apr 16 20:37:59 cps1 dmlpackageproc[11460]: 59.446020 |0|0|0| E 21 CAL0002: Delete Failed:  IDB-2008: The version buffer overflowed. Increase VersionBufferFileSize or limit the rows to be processed.

Apr 16 20:37:59 cps1 ExeMgr[11236]: 59.455526 |23468|0|0| D 16 CAL0042: End SQL statement

Apr 16 20:37:59 cps1 dmlpackageproc[11460]: 59.456124 |23468|13562|0| D 21 CAL0001: Start SQL statement:  ROLLBACK

Apr 16 20:38:54 cps1 dmlpackageproc[11460]: 54.922957 |23468|13562|0| D 21 CAL0001: End SQL statement

Attachments

Activity

People

Assignee:: Unassigned

Reporter:: Zdravelina Sokolovska (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 2019-04-16 17:52

Updated:: 2023-03-06 06:11

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.