Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-4218 Remove NFS/EFS/ Filestore prereq for S3 storage
  3. MCOL-5724

Move journal from files into FoundationDB

Details

    • Sub-Task
    • Status: In Review (View Workflow)
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None
    • 2021-3, 2021-4, 2021-5, 2021-6, 2021-7, 2021-8, 2021-9, 2021-10, 2021-11, 2021-12, 2021-16, 2021-17, 2022-22, 2022-23, 2023-4, 2023-5, 2023-6, 2023-7, 2023-8, 2023-10, 2023-11, 2023-12, 2024-2

    Attachments

      Activity

        drrtuy Roman added a comment -

        SM asynchronously uploads S3 object files changes into S3 provider.
        There is a concept of a journal to store changes for async upload.
        Currently a journal is JSON doc that contains a list of offset/value pairs where value is a hexdecimal string representing a byte array.
        This subtask describes how to replace file-based JSON journaling with FoundationDB dKVS.
        There is a Replicator class that controls journaling behavior. Its code must be refactored to leverage FDB.

        drrtuy Roman added a comment - SM asynchronously uploads S3 object files changes into S3 provider. There is a concept of a journal to store changes for async upload. Currently a journal is JSON doc that contains a list of offset/value pairs where value is a hexdecimal string representing a byte array. This subtask describes how to replace file-based JSON journaling with FoundationDB dKVS. There is a Replicator class that controls journaling behavior. Its code must be refactored to leverage FDB.

        People

          denis0x0D Denis Khalikov (Inactive)
          julien.fritsch Julien Fritsch
          Roman Roman
          Votes:
          0 Vote for this issue
          Watchers:
          2 Start watching this issue

          Dates

            Created:
            Updated:

            Git Integration

              Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.