Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-5555

Add support for readonly command which waits until all active cpimport jobs finished before putting system in readonly

Details

    • Task
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • 2023-8, 2023-10, 2023-11, 2023-12, 2024-1

    Description

      Add support for readonly command which waits until all active cpimport jobs finished before putting system in readonly

      Attachments

        Issue Links

          Activity

            denis0x0D Denis Khalikov (Inactive) created issue -
            denis0x0D Denis Khalikov (Inactive) made changes -
            Field Original Value New Value
            denis0x0D Denis Khalikov (Inactive) made changes -
            alexey.vorovich alexey vorovich (Inactive) made changes -
            Sprint 2023-8 [ 728 ]
            toddstoffel Todd Stoffel (Inactive) made changes -
            Sprint 2023-8 [ 728 ] 2023-8, 2023-9 [ 728, 733 ]
            toddstoffel Todd Stoffel (Inactive) made changes -
            Sprint 2023-8, 2023-9 [ 728, 733 ] 2023-8, 2023-10 [ 728, 734 ]
            toddstoffel Todd Stoffel (Inactive) made changes -
            Sprint 2023-8, 2023-10 [ 728, 734 ] 2023-8, 2023-10, 2023-11 [ 728, 734, 737 ]
            alexey.vorovich alexey vorovich (Inactive) made changes -
            Fix Version/s 23.10 [ 28540 ]
            denis0x0D Denis Khalikov (Inactive) made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            denis0x0D Denis Khalikov (Inactive) made changes -
            Status In Progress [ 3 ] In Review [ 10002 ]
            denis0x0D Denis Khalikov (Inactive) made changes -
            Assigned for Review Roman [ drrtuy ]
            alexey.vorovich alexey vorovich (Inactive) made changes -
            Fix Version/s 23.10.1 [ 29105 ]
            Fix Version/s 23.10 [ 28540 ]
            denis0x0D Denis Khalikov (Inactive) made changes -
            Summary Eliminate inconsistent state between BRM and S3 storage after node fail. Add support for readonly command which waits until all active cpimport jobs finished before putting system in readonly
            denis0x0D Denis Khalikov (Inactive) made changes -
            Description For some reasons BRM and S3 storage could be in inconsistent state after fail on a node.
            This could happen because of the current approach how Storage Manager puts objects on S3 - before put new/changed object on s3 it write the data into journal than we have a background thread which periodically puts those objects on S3, in case of fail we could have inconsistent state between BRM and S3 storage.
            To solve this problem we have 2 ways:
            1. Implement a sync approach of putting objects on s3.
            2. Implement a periodic backup, lock worker nodes on writes, save meta and put that meta on s3, having this we could rollback to one of the consistent state.
            denis0x0D Denis Khalikov (Inactive) made changes -
            Description Add support for readonly command which waits until all active cpimport jobs finished before putting system in readonly
            denis0x0D Denis Khalikov (Inactive) made changes -
            denis0x0D Denis Khalikov (Inactive) made changes -
            Status In Review [ 10002 ] In Testing [ 10301 ]
            denis0x0D Denis Khalikov (Inactive) made changes -
            Assigned for Testing Allen Herrera [ JIRAUSER48651 ]
            denis0x0D Denis Khalikov (Inactive) made changes -
            Fix Version/s 23.10.1 [ 29105 ]
            leonid.fedorov Leonid Fedorov made changes -
            Sprint 2023-8, 2023-10, 2023-11 [ 728, 734, 737 ] 2023-8, 2023-10, 2023-11, 2023-13 [ 728, 734, 737, 748 ]
            julien.fritsch Julien Fritsch made changes -
            Sprint 2023-8, 2023-10, 2023-11, 2023-12 [ 728, 734, 737, 748 ] 2023-8, 2023-10, 2023-11, 2023-12, 2023-13 [ 728, 734, 737, 748, 755 ]
            kirill.perov@mariadb.com Kirill Perov (Inactive) made changes -
            Assigned for Testing Allen Herrera [ JIRAUSER48651 ] Kirill Perov [ JIRAUSER51446 ]
            julien.fritsch Julien Fritsch made changes -
            Assignee Denis Khalikov [ JIRAUSER48434 ] Allen Herrera [ JIRAUSER48651 ]
            julien.fritsch Julien Fritsch made changes -
            Assignee Allen Herrera [ JIRAUSER48651 ] Denis Khalikov [ JIRAUSER48434 ]
            julien.fritsch Julien Fritsch made changes -
            Assignee Denis Khalikov [ JIRAUSER48434 ] Allen Herrera [ JIRAUSER48651 ]
            julien.fritsch Julien Fritsch made changes -
            Resolution Fixed [ 1 ]
            Status In Testing [ 10301 ] Closed [ 6 ]

            People

              allen.herrera Allen Herrera
              denis0x0D Denis Khalikov (Inactive)
              Roman Roman
              Kirill Perov Kirill Perov (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.