Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-4218 Remove NFS/EFS/ Filestore prereq for S3 storage
  3. MCOL-5720

Move S3 metadata into FoundationDB

Details

    • Sub-Task
    • Status: In Review (View Workflow)
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None
    • 2021-3, 2021-4, 2021-5, 2021-6, 2021-7, 2021-8, 2021-9, 2021-10, 2021-11, 2021-12, 2021-16, 2021-17, 2022-22, 2022-23, 2023-4, 2023-5, 2023-6, 2023-7, 2023-8, 2023-10, 2023-11, 2023-12, 2024-2

    Attachments

      Activity

        Ascending order - Click to sort in descending order
        julien.fritsch Julien Fritsch created issue -
        drrtuy Roman added a comment - - edited

        MCS data segment, dict and misc files are made of S3 object files.
        StorageManager metadata is a JSON file that contains the list of the actual S3 object files that are parts of the requested data file.
        This subtask is dedicated in renaming/refactoring `MetadataFile` class in the SM code. The final solution must use FoundationDB instead of shared storage files to store JSON.
        There is internal cache for JSON docs in SM that might become obsolete with migration to FDB. To future research this one has to remove the cache and measure the timings.

        drrtuy Roman added a comment - - edited MCS data segment, dict and misc files are made of S3 object files. StorageManager metadata is a JSON file that contains the list of the actual S3 object files that are parts of the requested data file. This subtask is dedicated in renaming/refactoring `MetadataFile` class in the SM code. The final solution must use FoundationDB instead of shared storage files to store JSON. There is internal cache for JSON docs in SM that might become obsolete with migration to FDB. To future research this one has to remove the cache and measure the timings.
        denis0x0D Denis Khalikov (Inactive) made changes -
        Field Original Value New Value
        Assignee Denis Khalikov [ JIRAUSER48434 ]
        denis0x0D Denis Khalikov (Inactive) made changes -
        Status Open [ 1 ] In Progress [ 3 ]
        JIraAutomate JiraAutomate made changes -
        Status In Progress [ 3 ] Stalled [ 10000 ]
        denis0x0D Denis Khalikov (Inactive) made changes -
        Status Stalled [ 10000 ] In Progress [ 3 ]
        denis0x0D Denis Khalikov (Inactive) made changes -
        Status In Progress [ 3 ] In Review [ 10002 ]
        denis0x0D Denis Khalikov (Inactive) made changes -
        Assigned for Review Roman [ drrtuy ]

        People

          denis0x0D Denis Khalikov (Inactive)
          julien.fritsch Julien Fritsch
          Roman Roman
          Votes:
          0 Vote for this issue
          Watchers:
          2 Start watching this issue

          Dates

            Created:
            Updated:

            Git Integration

              Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.