Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-635

Add DML cpimport configurable row limit

    XMLWordPrintable

Details

    • 2017-7, 2017-8

    Description

      At the moment for INSERT_SELECT and LDI we turn the row format into csv and pipe into cpimport. This piping only has a 1MB csv row buffer. BLOB lengths are doubled due to hexing so at most you can fit a single 512KB BLOB in a row before things error.

      The DML commands don't realise something is wrong until the end of the bulk import. The table remains locked afterwards and needs manual unlocking.

      I believe the best way to fix this is to have a row length counter which spots this and errors appropriately as well as having a configurable buffers size for the row.

      Alternatively it might be possible to make the row buffer grow with the content.

      Attachments

        Issue Links

          Activity

            People

              LinuxJedi Andrew Hutchings (Inactive)
              LinuxJedi Andrew Hutchings (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.