Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-5466

In place upgrades across major versions - support large columnstore deployment upgrades

Details

    • New Feature
    • Status: Open (View Workflow)
    • Critical
    • Resolution: Unresolved
    • 5.6.5, 6.4.6
    • Icebox
    • None

    Description

      5.6.2 -> 23.02.x
      Customers on prem with large deployments of columnstore can NOT afford exporting and importing data from columnstore to upgrade major versions. In one specific case, exporting their 20TB of compressed data is estimated to take over 25 days and consume 60-80TB uncompressed.

      The ask is to mature the product with a migration script/tool that can bridge the engineering deltas from one version to the next. be it the extent map or data files to enable in place upgrades to be supported, certified and work.

      Attachments

        Issue Links

          includes

          New Feature - A new feature of the product, which has yet to be developed. MCOL-5122 Enable the AUX column (DELETE optimization) for existing tables

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MCOL-5810 Pre-Upgrade Sanity Check Tool

          • Major - Major loss of function.
          • Open
          is blocked by

          Task - A task that needs to be done. MCOL-5735 Create test multi-node Columstore config

          • Major - Major loss of function.
          • Stalled

          Sub-Task - The sub-task of the issue MCOL-5736 upgrade test for Columnstore cluster

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MCOL-5760 Dump failing with "Internal error: Lost connection to ExeMgr. Please contact your administrator (1815)" after upgrading to version 23.10.1

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MCOL-5816 Upgrade 23.02.10 -> 23.10.2 Failing @ Customer

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            Ascending order - Click to sort in descending order
            alexey.vorovich alexey vorovich (Inactive) added a comment -

            This should also support containers..

            alexey.vorovich alexey vorovich (Inactive) added a comment - This should also support containers..
            tturenko Timofey Turenko added a comment -

            The BuildBot task https://mdbe-buildbot.mariadb.net/#/builders/567 can test Columstore cluster upgrade. The "version" in this task means "server version". So, we need to know the server version with needed version of Columnstore plugin packages.

            tturenko Timofey Turenko added a comment - The BuildBot task https://mdbe-buildbot.mariadb.net/#/builders/567 can test Columstore cluster upgrade. The "version" in this task means "server version". So, we need to know the server version with needed version of Columnstore plugin packages.

            People

              leonid.fedorov Leonid Fedorov
              allen.herrera Allen Herrera
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.