Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-6243

MariaDB: Columnstore crashes with "Broken pipe" when a long geometry is stored via bulk loader into a longtext

    XMLWordPrintable

Details

    Description

      EBI07 11.8.5-MariaDB MariaDB Server (CS 25.10.1-1)

      Columnstore crashes with "Broken pipe" when a long geometry is stored via bulk loader into a longtext.
      Needs restart of MariaDB server, otherwise the lock on the table is not released.

      InnoDB works without any problems for this single geometry.

      ERROR 1815 (HY000) at line 8: Internal error: load failed. The detailed error information is listed in err.log.

      2025-11-19 09:07:33 (3146) INFO : successfully loaded job file /var/log/mariadb/columnstore/data/bulk/tmpjob/3012_D20251119_T090733_S572538_Job_3012.xml
      2025-11-19 09:07:33 (3146) INFO2 : Command line options: -L /var/log/mariadb/columnstore/cpimport/ -e 0 -s ^G -E ^Q -C \ -R /tmp/columnstore_tmp_files/BrmRpt10190907333123.rpt -m 1 -P pm1-3123 -T SYSTEM -u439ee861-edbb-41b7-952d-333e56d66c14 ebi_data ebi2796
      2025-11-19 09:07:33 (3146) INFO : Job file loaded, run time for this step : 0.030283 seconds
      2025-11-19 09:07:33 (3146) INFO2 : XMLJobFile: Delim(|); EnclosedBy(n/a); EscapeChar(\); ReadBufs(5); ReadBufSize(1048576); setvbufSize(10485760); SkipRows(0)
      2025-11-19 09:07:33 (3146) INFO2 :   Table(ebi_data.ebi2796); OID(3012); MaxErrNum(10)
      2025-11-19 09:07:33 (3146) INFO2 :     Column(area_id); OID(3013); Type(varchar); Width(144); Comp(2); DctnryOid(3015)
      2025-11-19 09:07:33 (3146) INFO2 :     Column(area_extent_wkt_coos); OID(3014); Type(text); Width(16777215); Comp(2); DctnryOid(3016)
      2025-11-19 09:07:33 (3146) INFO2 :     DefaultColumn(aux); OID(3017); Type(unsigned-tinyint); Width(1); Comp(2); WithDefault
      2025-11-19 09:07:33 (3146) INFO : PreProcessing check starts
      2025-11-19 09:07:33 (3146) INFO2 : Using STDIN for input data
      2025-11-19 09:07:33 (3146) INFO2 : Starting DBRoot info for OID 3013
        DBRoot-1, part/seg/hwm/LBID/totBlks/state: 0/0/0/242688/1/PartialExtent
      2025-11-19 09:07:33 (3146) INFO2 : Selecting existing segFile to begin adding rows: oid-3013; DBRoot-1, part/seg/hwm/LBID/totBlks/state: 0/0/0/242688/1/PartialExtent
      2025-11-19 09:07:33 (3146) INFO2 : Starting DBRoot info for OID 3014
        DBRoot-1, part/seg/hwm/LBID/totBlks/state: 0/0/0/250880/1/PartialExtent
      2025-11-19 09:07:33 (3146) INFO2 : Selecting existing segFile to begin adding rows: oid-3014; DBRoot-1, part/seg/hwm/LBID/totBlks/state: 0/0/0/250880/1/PartialExtent
      2025-11-19 09:07:33 (3146) INFO2 : Starting DBRoot info for OID 3017
        DBRoot-1, part/seg/hwm/LBID/totBlks/state: 0/0/0/259072/1/PartialExtent
      2025-11-19 09:07:33 (3146) INFO2 : Selecting existing segFile to begin adding rows: oid-3017; DBRoot-1, part/seg/hwm/LBID/totBlks/state: 0/0/0/259072/1/PartialExtent
      2025-11-19 09:07:33 (3146) INFO2 : Initializing import: Table-ebi_data.ebi2796...
      2025-11-19 09:07:33 (3146) INFO2 : Backing up HWM chunk for column OID-3013; file-/var/lib/columnstore/data1/bulkRollback/3012_data/3013.p0.s0.tmp; HWM-0; bytes-114688; fileSize-122880
      2025-11-19 09:07:33 (3146) INFO2 : Backing up HWM chunk for column OID-3014; file-/var/lib/columnstore/data1/bulkRollback/3012_data/3014.p0.s0.tmp; HWM-0; bytes-114688; fileSize-122880
      2025-11-19 09:07:33 (3146) INFO2 : Backing up HWM chunk for column OID-3017; file-/var/lib/columnstore/data1/bulkRollback/3012_data/3017.p0.s0.tmp; HWM-0; bytes-24576; fileSize-32768
      2025-11-19 09:07:33 (3146) INFO2 : Initializing import: Table-ebi_data.ebi2796; Col-area_id (compressed); OID-3013; hwm-8; file-/var/lib/columnstore/data1/000.dir/000.dir/011.dir/197.dir/000.dir/FILE000.cdf
      2025-11-19 09:07:33 (3146) INFO2 : Backing up HWM chunk for dictionary OID-3015; file-/var/lib/columnstore/data1/bulkRollback/3012_data/3015.p0.s0.tmp; HWM-0; bytes-212992; fileSize-229376
      2025-11-19 09:07:33 (3146) INFO2 : Opening existing store file for area_id; OID-3015; DBRoot-1; part-0; seg-0; hwm-0; file-/var/lib/columnstore/data1/000.dir/000.dir/011.dir/199.dir/000.dir/FILE000.cdf
      2025-11-19 09:07:33 (3146) INFO2 : Initializing import: Table-ebi_data.ebi2796; Col-area_extent_wkt_coos (compressed); OID-3014; hwm-8; file-/var/lib/columnstore/data1/000.dir/000.dir/011.dir/198.dir/000.dir/FILE000.cdf
      2025-11-19 09:07:33 (3146) INFO2 : Backing up HWM chunk for dictionary OID-3016; file-/var/lib/columnstore/data1/bulkRollback/3012_data/3016.p0.s0.tmp; HWM-0; bytes-212992; fileSize-483328
      2025-11-19 09:07:33 (3146) INFO2 : Opening existing store file for area_extent_wkt_coos; OID-3016; DBRoot-1; part-0; seg-0; hwm-0; file-/var/lib/columnstore/data1/000.dir/000.dir/011.dir/200.dir/000.dir/FILE000.cdf
      2025-11-19 09:07:33 (3146) INFO2 : Initializing import: Table-ebi_data.ebi2796; Col-aux (compressed); OID-3017; hwm-1; file-/var/lib/columnstore/data1/000.dir/000.dir/011.dir/201.dir/000.dir/FILE000.cdf
      2025-11-19 09:07:33 (3146) INFO : PreProcessing check completed
      2025-11-19 09:07:33 (3146) INFO : preProcess completed, run time for this step : 0.0219638 seconds
      2025-11-19 09:07:33 (3146) INFO : No of Read Threads Spawned = 1
      2025-11-19 09:07:33 (3146) INFO : ^[[0;1mReading input from STDIN to import into table ebi_data.ebi2796...^[[0;39m
      2025-11-19 09:07:33 (3146) INFO : No of Parse Threads Spawned = 3
      2025-11-19 09:07:33 (3146) INFO2 : Start reading and loading table ebi_data.ebi2796
      2025-11-19 09:07:33 (3146) INFO2 : Finished loading ebi_data.ebi2796 from STDIN, Time taken = 0 seconds
      2025-11-19 09:07:33 (3146) INFO2 : BulkLoad::ReadOperation No more tables available for processing. Read thread 0 exiting...
      2025-11-19 09:07:33 (3146) INFO : For table ebi_data.ebi2796: 0 rows processed and 0 rows inserted.
      2025-11-19 09:07:33 (3146) INFO2 : For table ebi_data.ebi2796: Elapsed time to load this table: 0.372373 secs
      2025-11-19 09:07:33 (3146) INFO : Bulk load completed, total run time : 0.425409 seconds
      
      

      Attachments

        1. debug_2.log
          4 kB
          andreas eschbacher

        Activity

          People

            allen.herrera Allen Herrera
            aeae81 andreas eschbacher
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.