Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-3261

Contradiction messages with the Error version buffer overflowed

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open (View Workflow)
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.2.4
    • Fix Version/s: Icebox
    • Component/s: DDLProc
    • Labels:
      None
    • Environment:
      mcs single server; CentOS7

      Description

      Contradiction messages with the Error version buffer overflowed

      delete 6000000 rows from table failed with Error
      Delete Failed: IDB-2008: The version buffer overflowed. Increase VersionBufferFileSize or limit the rows to be processed
      but afterwards were deleted successfully more rows from the same table without changing the VersionBufferFileSize;

      It does not become clear what number of rows have to be set under 1 delete operation

      MariaDB [mytest]> show create table lineitem ;
      +----------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | Table    | Create Table                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 |
      +----------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | lineitem | CREATE TABLE `lineitem` (
        `l_orderkey` int(11) DEFAULT NULL,
        `l_partkey` int(11) DEFAULT NULL,
        `l_suppkey` int(11) DEFAULT NULL,
        `l_linenumber` bigint(20) DEFAULT NULL,
        `l_quantity` decimal(12,2) DEFAULT NULL,
        `l_extendedprice` decimal(12,2) DEFAULT NULL,
        `l_discount` decimal(12,2) DEFAULT NULL,
        `l_tax` decimal(12,2) DEFAULT NULL,
        `l_returnflag` char(1) DEFAULT NULL,
        `l_linestatus` char(1) DEFAULT NULL,
        `l_shipdate` date DEFAULT NULL,
        `l_commitdate` date DEFAULT NULL,
        `l_receiptdate` date DEFAULT NULL,
        `l_shipinstruct` char(25) DEFAULT NULL,
        `l_shipmode` char(10) DEFAULT NULL,
        `l_comment` varchar(44) DEFAULT NULL
      ) ENGINE=Columnstore DEFAULT CHARSET=latin1 |
      +----------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
      1 row in set (0.000 sec)
      
      

       
      MariaDB [mytest]> select count(*) from  lineitem ;
      +----------+
      | count(*) |
      +----------+
      | 59986053 |
      +----------+
      1 row in set (0.345 sec)
      
      

      delete from lineitem where l_orderkey >= 1 and l_orderkey <= 6000000 ;
      ERROR 1815 (HY000): Internal error: CAL0002: Delete Failed:  IDB-2008: The version buffer overflowed. Increase VersionBufferFileSize or limit the rows to be processed.
      
      

      MariaDB [mytest]> delete from lineitem where l_orderkey >= 24000001 and l_orderkey <= 30000000 ;
      Query OK, 6003191 rows affected (1 min 46.656 sec)
      

      Apr 16 20:24:27 cps1 dmlpackageproc[11460]: 27.345877 |23468|13561|0| D 21 CAL0041: Start SQL statement: delete from lineitem where l_orderkey >= 24000001 and l_orderkey <= 30000000;|mytest|
      Apr 16 20:24:27 cps1 ExeMgr[11236]: 27.367614 |23468|0|0| D 16 CAL0041: Start SQL statement: delete from lineitem where l_orderkey >= 24000001 and l_orderkey <= 30000000; ||
      Apr 16 20:25:16 cps1 writeengine[11318]: 16.720929 |0|13561|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/006.dir/000.dir/FILE000.cdf, chunkId:2 data size:639498/available:638976 -- shifting SUCCESS
      Apr 16 20:25:24 cps1 writeengine[11318]: 24.665900 |0|13561|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE000.cdf, chunkId:2 data size:600639/available:598016 -- shifting SUCCESS
      Apr 16 20:25:38 cps1 writeengine[11318]: 38.715190 |0|13561|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/006.dir/000.dir/FILE000.cdf, chunkId:2 data size:656427/available:655360 -- shifting SUCCESS
      Apr 16 20:25:48 cps1 writeengine[11318]: 48.504186 |0|13561|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE000.cdf, chunkId:2 data size:620393/available:614400 -- shifting SUCCESS
      Apr 16 20:26:12 cps1 dmlpackageproc[11460]: 12.090289 |23468|13561|0| D 21 CAL0042: End SQL statement
      Apr 16 20:26:13 cps1 ExeMgr[11236]: 13.915294 |23468|0|0| D 16 CAL0042: End SQL statement
      Apr 16 20:26:13 cps1 dmlpackageproc[11460]: 13.923313 |23468|13561|0| D 21 CAL0001: Start SQL statement:  COMMIT
      Apr 16 20:26:13 cps1 dmlpackageproc[11460]: 13.972432 |23468|13561|0| D 21 CAL0001: End SQL statement
      
      

      MariaDB [mytest]>  delete from lineitem where l_orderkey >= 1 and l_orderkey <= 6000000;
      ERROR 1815 (HY000): Internal error: CAL0002: Delete Failed:  IDB-2008: The version buffer overflowed. Increase VersionBufferFileSize or limito be processed.
      
      

      Apr 16 20:30:44 cps1 dmlpackageproc[11460]: 44.725517 |23468|13562|0| D 21 CAL0041: Start SQL statement: delete from lineitem where l_orderkey >= 1 and l_orderkey <= 6000000;|mytest|
      Apr 16 20:30:44 cps1 ExeMgr[11236]: 44.747174 |23468|0|0| D 16 CAL0041: Start SQL statement: delete from lineitem where l_orderkey >= 1 and l_orderkey <= 6000000; ||
      Apr 16 20:32:52 cps1 writeengine[11318]: 52.291845 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:0 data size:377440/available:376832 -- shifting SUCCESS
      Apr 16 20:32:58 cps1 writeengine[11318]: 58.937289 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:0 data size:297615/available:294912 -- shifting SUCCESS
      Apr 16 20:33:10 cps1 writeengine[11318]: 10.835497 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:259683/available:253952 -- shifting SUCCESS
      Apr 16 20:33:26 cps1 writeengine[11318]: 26.869748 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:0 data size:312008/available:311296 -- shifting SUCCESS
      Apr 16 20:33:29 cps1 writeengine[11318]: 29.917197 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:272141/available:270336 -- shifting SUCCESS
      Apr 16 20:33:46 cps1 writeengine[11318]: 46.662219 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:225611/available:221184 -- shifting SUCCESS
      Apr 16 20:33:59 cps1 writeengine[11318]: 59.599198 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:239994/available:237568 -- shifting SUCCESS
      Apr 16 20:34:00 cps1 writeengine[11318]: 00.194218 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:286784/available:286720 -- shifting SUCCESS
      Apr 16 20:34:17 cps1 writeengine[11318]: 17.558102 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:255212/available:253952 -- shifting SUCCESS
      Apr 16 20:34:32 cps1 writeengine[11318]: 32.025025 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:303487/available:303104 -- shifting SUCCESS
      Apr 16 20:34:46 cps1 writeengine[11318]: 46.995680 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:271685/available:270336 -- shifting SUCCESS
      Apr 16 20:35:11 cps1 writeengine[11318]: 11.990254 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:287986/available:286720 -- shifting SUCCESS
      Apr 16 20:35:28 cps1 writeengine[11318]: 28.321733 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:0 data size:344371/available:344064 -- shifting SUCCESS
      Apr 16 20:35:31 cps1 writeengine[11318]: 31.693643 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:319644/available:319488 -- shifting SUCCESS
      Apr 16 20:35:51 cps1 writeengine[11318]: 51.372622 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:0 data size:393744/available:393216 -- shifting SUCCESS
      Apr 16 20:36:12 cps1 writeengine[11318]: 12.476238 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:337303/available:335872 -- shifting SUCCESS
      Apr 16 20:36:15 cps1 writeengine[11318]: 15.706884 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/006.dir/000.dir/FILE002.cdf, chunkId:1 data size:1695961/available:1695744 -- shifting SUCCESS
      Apr 16 20:36:15 cps1 writeengine[11318]: 15.756083 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:312871/available:311296 -- shifting SUCCESS
      Apr 16 20:36:40 cps1 writeengine[11318]: 40.793634 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:328870/available:327680 -- shifting SUCCESS
      Apr 16 20:37:02 cps1 writeengine[11318]: 02.870800 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:347325/available:344064 -- shifting SUCCESS
      Apr 16 20:37:32 cps1 writeengine[11318]: 32.707776 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE001.cdf, chunkId:1 data size:352501/available:352256 -- shifting SUCCESS
      Apr 16 20:37:35 cps1 writeengine[11318]: 35.965251 |0|13562|0| I 19 CAL0080: Compression Handling: Compressed data does not fit, caused a chunk shifting @line:976 filename:/usr/local/mariadb/columnstore/data1/000.dir/000.dir/179.dir/007.dir/000.dir/FILE002.cdf, chunkId:1 data size:360676/available:360448 -- shifting SUCCESS
      Apr 16 20:37:59 cps1 workernode[11098]: 59.384108 |0|0|0| C 30 CAL0000: VBBM::getBlocks(): version buffer overflow. Increase VersionBufferFileSize. Overflow occured in aged blocks. Requested NumBlocks:VbOid:vbFBO:lastFBO = 90:0:121200:121299 lbid locked is 34161668
      Apr 16 20:37:59 cps1 dmlpackageproc[11460]: 59.384748 |23468|13562|0| D 21 CAL0042: End SQL statement
      Apr 16 20:37:59 cps1 dmlpackageproc[11460]: 59.446020 |0|0|0| E 21 CAL0002: Delete Failed:  IDB-2008: The version buffer overflowed. Increase VersionBufferFileSize or limit the rows to be processed.
      Apr 16 20:37:59 cps1 ExeMgr[11236]: 59.455526 |23468|0|0| D 16 CAL0042: End SQL statement
      Apr 16 20:37:59 cps1 dmlpackageproc[11460]: 59.456124 |23468|13562|0| D 21 CAL0001: Start SQL statement:  ROLLBACK
      Apr 16 20:38:54 cps1 dmlpackageproc[11460]: 54.922957 |23468|13562|0| D 21 CAL0001: End SQL statement
      
      

        Attachments

          Activity

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            winstone Zdravelina Sokolovska (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:

                Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.