Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-4888

improve cpimport operating on wide tables

    XMLWordPrintable

Details

    • New Feature
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Won't Fix
    • None
    • 23.10.0
    • PrimProc
    • None
    • 2021-11, 2021-12, 2021-13, 2021-14, 2021-15

    Description

      drrtuy speaking:

      make a cpimport optimization that will benefit bulk insertion for tables with many columns. In short cpimport saves some extra data to be able to rollback. It is about 200kB per column file so for 200 column table this is 40MB that is not so big for the modern disks but slows down the operation. I recall a prospect who tolld that ClickHouse ingests data faster then MCS and this metadata was the reason why MCS was slow ingesting.

      Attachments

        Activity

          People

            drrtuy Roman
            gdorman Gregory Dorman (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.