Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-3460

experiment with larger recv buffers in writetask/appendtask

Details

    • Task
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Done
    • None
    • 1.4.0
    • ?
    • None

    Description

      Noticed that writetask and appendtask are breaking incoming data into 1MB chunks to write. That made sense for milestone 1 when those were written, but might make sense now to try to do the whole write op in one IOC call rather than break it up. Need to experiment and see if it's worth the extra mem usage.

      Attachments

        Activity

          pleblanc Patrick LeBlanc (Inactive) added a comment -

          Found that this was worth doing. Locally using test000 as the benchmark, got an end-to-end gain of ~7%. Raised the cap to 100MB for safety. Should be 1/100th the impediment it was, and keep ridiculous things from happening.

          pleblanc Patrick LeBlanc (Inactive) added a comment - Found that this was worth doing. Locally using test000 as the benchmark, got an end-to-end gain of ~7%. Raised the cap to 100MB for safety. Should be 1/100th the impediment it was, and keep ridiculous things from happening.

          People

            ben.thompson Ben Thompson (Inactive)
            pleblanc Patrick LeBlanc (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.