Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-3531

columnStorebackup Should Support Non-Locking Backups

Details

    • New Feature
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Won't Do
    • None
    • Icebox
    • N/A

    Description

      Find a way to improve columnStorebackup to provide a non-locking mechanism or at least more granular locking. Suspending all writes during the duration of rsync is time consuming and causes a 'write' outage.

      Attachments

        Activity

          toddstoffel Todd Stoffel (Inactive) created issue -
          toddstoffel Todd Stoffel (Inactive) made changes -
          Field Original Value New Value
          Epic Link MCOL-3521 [ 79331 ]
          toddstoffel Todd Stoffel (Inactive) made changes -
          Component/s advanced tools [ 13515 ]
          toddstoffel Todd Stoffel (Inactive) made changes -
          Description Find a way to improve columnStorebackup to provide a non-locking mechanism. Suspending writes during the duration of rsync is time consuming and causes a 'write' outage. Find a way to improve columnStorebackup to provide a non-locking mechanism or at least more granular locking. Suspending writes during the duration of rsync is time consuming and causes a 'write' outage.
          toddstoffel Todd Stoffel (Inactive) made changes -
          Description Find a way to improve columnStorebackup to provide a non-locking mechanism or at least more granular locking. Suspending writes during the duration of rsync is time consuming and causes a 'write' outage. Find a way to improve columnStorebackup to provide a non-locking mechanism or at least more granular locking. Suspending all writes during the duration of rsync is time consuming and causes a 'write' outage.

          With today's streaming technologies applying updates to CS continuous it is not possible to just stop all streams of input while backup is running. People can have in the 100's of data streams and pausing for an update is not always possible. Must have no blocking HOT backups.

          adinsmor Alton J Dinsmore (Inactive) added a comment - With today's streaming technologies applying updates to CS continuous it is not possible to just stop all streams of input while backup is running. People can have in the 100's of data streams and pausing for an update is not always possible. Must have no blocking HOT backups.
          gferwani Girish added a comment -

          Need this asap or we may consider other solutions

          gferwani Girish added a comment - Need this asap or we may consider other solutions
          toddstoffel Todd Stoffel (Inactive) made changes -
          Fix Version/s 1.5 [ 22800 ]
          toddstoffel Todd Stoffel (Inactive) made changes -
          Rank Ranked higher

          Todd brought up what is likely the quickest-to-impl sol'n. We could accept a dirty initial backup, then lock for writing and do an incremental backup. It would still block writes but for a shorter duration, and we'd get a consistent snapshot. That or something similar might be acceptable in the short term.

          pleblanc Patrick LeBlanc (Inactive) added a comment - Todd brought up what is likely the quickest-to-impl sol'n. We could accept a dirty initial backup, then lock for writing and do an incremental backup. It would still block writes but for a shorter duration, and we'd get a consistent snapshot. That or something similar might be acceptable in the short term.
          toddstoffel Todd Stoffel (Inactive) made changes -
          Rank Ranked lower
          julien.fritsch Julien Fritsch made changes -
          Status Open [ 1 ] Confirmed [ 10101 ]
          toddstoffel Todd Stoffel (Inactive) made changes -
          Rank Ranked higher
          toddstoffel Todd Stoffel (Inactive) made changes -
          Rank Ranked lower
          toddstoffel Todd Stoffel (Inactive) made changes -
          Rank Ranked higher
          toddstoffel Todd Stoffel (Inactive) made changes -
          Rank Ranked higher
          toddstoffel Todd Stoffel (Inactive) made changes -
          Team ColumnStore Team
          toddstoffel Todd Stoffel (Inactive) made changes -
          Rank Ranked higher
          toddstoffel Todd Stoffel (Inactive) made changes -
          Rank Ranked higher
          toddstoffel Todd Stoffel (Inactive) made changes -
          Fix Version/s 1.5.5 [ 24414 ]
          Fix Version/s 1.5 [ 22800 ]
          toddstoffel Todd Stoffel (Inactive) made changes -
          Labels Backup
          toddstoffel Todd Stoffel (Inactive) made changes -
          Fix Version/s 5.5.1 [ 25030 ]
          Fix Version/s 5.5.1 [ 25030 ]
          Fix Version/s 1.5.5 [ 24414 ]
          toddstoffel Todd Stoffel (Inactive) made changes -
          Fix Version/s Icebox [ 22302 ]
          Fix Version/s 5.5.1 [ 25030 ]
          toddstoffel Todd Stoffel (Inactive) made changes -
          Rank Ranked lower
          toddstoffel Todd Stoffel (Inactive) made changes -
          Rank Ranked higher
          toddstoffel Todd Stoffel (Inactive) made changes -
          Rank Ranked higher
          toddstoffel Todd Stoffel (Inactive) made changes -
          Rank Ranked lower
          toddstoffel Todd Stoffel (Inactive) made changes -
          Status Confirmed [ 10101 ] Open [ 1 ]
          toddstoffel Todd Stoffel (Inactive) made changes -
          Epic Link MCOL-3521 [ 79331 ] MCOL-4571 [ 97529 ]
          toddstoffel Todd Stoffel (Inactive) made changes -
          Assignee Todd Stoffel [ toddstoffel ] Ben Thompson [ ben.thompson ]
          toddstoffel Todd Stoffel (Inactive) made changes -
          Assignee Ben Thompson [ ben.thompson ]
          toddstoffel Todd Stoffel (Inactive) made changes -
          Assignee Todd Stoffel [ toddstoffel ]

          The "create date" on this ticket is pre-convergence with MariaDB server. If the issue still exists in a modern version of the engine/plugin please submit a new ticket.

          toddstoffel Todd Stoffel (Inactive) added a comment - The "create date" on this ticket is pre-convergence with MariaDB server. If the issue still exists in a modern version of the engine/plugin please submit a new ticket.
          toddstoffel Todd Stoffel (Inactive) made changes -
          Component/s N/A [ 15201 ]
          Component/s advanced tools [ 13515 ]
          Resolution Won't Do [ 10201 ]
          Status Open [ 1 ] Closed [ 6 ]
          mariadb-jira-automation Jira Automation (IT) made changes -
          Zendesk Related Tickets 181814

          People

            toddstoffel Todd Stoffel (Inactive)
            toddstoffel Todd Stoffel (Inactive)
            Votes:
            4 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.