MCS data segment, dict and misc files are made of S3 object files.
StorageManager metadata is a JSON file that contains the list of the actual S3 object files that are parts of the requested data file.
This subtask is dedicated in renaming/refactoring `MetadataFile` class in the SM code. The final solution must use FoundationDB instead of shared storage files to store JSON.
There is internal cache for JSON docs in SM that might become obsolete with migration to FDB. To future research this one has to remove the cache and measure the timings.
Roman
added a comment - - edited MCS data segment, dict and misc files are made of S3 object files.
StorageManager metadata is a JSON file that contains the list of the actual S3 object files that are parts of the requested data file.
This subtask is dedicated in renaming/refactoring `MetadataFile` class in the SM code. The final solution must use FoundationDB instead of shared storage files to store JSON.
There is internal cache for JSON docs in SM that might become obsolete with migration to FDB. To future research this one has to remove the cache and measure the timings.
People
Denis Khalikov (Inactive)
Julien Fritsch
Roman
Votes:
0Vote for this issue
Watchers:
2Start watching this issue
Dates
Created:
Updated:
Git Integration
Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.
{"report":{"fcp":852.5,"ttfb":186.7000002861023,"pageVisibility":"visible","entityId":128765,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":1,"journeyId":"dfb1cddb-fd3c-4b03-9239-ec2954c3dc6e","navigationType":0,"readyForUser":911.2000002861023,"redirectCount":0,"resourceLoadedEnd":846.3000001907349,"resourceLoadedStart":192.5,"resourceTiming":[{"duration":10.5,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":192.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":192.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":203,"responseStart":0,"secureConnectionStart":0},{"duration":11,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":192.80000019073486,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":192.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":203.80000019073486,"responseStart":0,"secureConnectionStart":0},{"duration":69.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":193,"connectEnd":193,"connectStart":193,"domainLookupEnd":193,"domainLookupStart":193,"fetchStart":193,"redirectEnd":0,"redirectStart":0,"requestStart":193,"responseEnd":262.5,"responseStart":262.5,"secureConnectionStart":193},{"duration":201.89999961853027,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":193.2000002861023,"connectEnd":193.2000002861023,"connectStart":193.2000002861023,"domainLookupEnd":193.2000002861023,"domainLookupStart":193.2000002861023,"fetchStart":193.2000002861023,"redirectEnd":0,"redirectStart":0,"requestStart":193.2000002861023,"responseEnd":395.09999990463257,"responseStart":395.09999990463257,"secureConnectionStart":193.2000002861023},{"duration":206.09999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":193.5,"connectEnd":193.5,"connectStart":193.5,"domainLookupEnd":193.5,"domainLookupStart":193.5,"fetchStart":193.5,"redirectEnd":0,"redirectStart":0,"requestStart":193.5,"responseEnd":399.59999990463257,"responseStart":399.59999990463257,"secureConnectionStart":193.5},{"duration":207.80000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":193.59999990463257,"connectEnd":193.59999990463257,"connectStart":193.59999990463257,"domainLookupEnd":193.59999990463257,"domainLookupStart":193.59999990463257,"fetchStart":193.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":193.59999990463257,"responseEnd":401.40000009536743,"responseStart":401.40000009536743,"secureConnectionStart":193.59999990463257},{"duration":208.19999980926514,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":193.80000019073486,"connectEnd":193.80000019073486,"connectStart":193.80000019073486,"domainLookupEnd":193.80000019073486,"domainLookupStart":193.80000019073486,"fetchStart":193.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":193.80000019073486,"responseEnd":402,"responseStart":402,"secureConnectionStart":193.80000019073486},{"duration":243,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":194,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":194,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":437,"responseStart":0,"secureConnectionStart":0},{"duration":208.40000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":194.09999990463257,"connectEnd":194.09999990463257,"connectStart":194.09999990463257,"domainLookupEnd":194.09999990463257,"domainLookupStart":194.09999990463257,"fetchStart":194.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":194.09999990463257,"responseEnd":402.5,"responseStart":402.5,"secureConnectionStart":194.09999990463257},{"duration":242.7999997138977,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":194.30000019073486,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":194.30000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":437.09999990463257,"responseStart":0,"secureConnectionStart":0},{"duration":208.69999980926514,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":194.40000009536743,"connectEnd":194.40000009536743,"connectStart":194.40000009536743,"domainLookupEnd":194.40000009536743,"domainLookupStart":194.40000009536743,"fetchStart":194.40000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":194.40000009536743,"responseEnd":403.09999990463257,"responseStart":403.09999990463257,"secureConnectionStart":194.40000009536743},{"duration":615.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":195.40000009536743,"connectEnd":195.40000009536743,"connectStart":195.40000009536743,"domainLookupEnd":195.40000009536743,"domainLookupStart":195.40000009536743,"fetchStart":195.40000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":195.40000009536743,"responseEnd":810.9000000953674,"responseStart":810.9000000953674,"secureConnectionStart":195.40000009536743},{"duration":615.7000002861023,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":195.59999990463257,"connectEnd":195.59999990463257,"connectStart":195.59999990463257,"domainLookupEnd":195.59999990463257,"domainLookupStart":195.59999990463257,"fetchStart":195.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":195.59999990463257,"responseEnd":811.3000001907349,"responseStart":811.3000001907349,"secureConnectionStart":195.59999990463257},{"duration":265.2000002861023,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":449.59999990463257,"connectEnd":449.59999990463257,"connectStart":449.59999990463257,"domainLookupEnd":449.59999990463257,"domainLookupStart":449.59999990463257,"fetchStart":449.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":449.59999990463257,"responseEnd":714.8000001907349,"responseStart":714.8000001907349,"secureConnectionStart":449.59999990463257},{"duration":119.40000009536743,"initiatorType":"link","name":"https://jira.mariadb.org/s/d5715adaadd168a9002b108b2b039b50-CDN/lu2cib/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/css/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":726.9000000953674,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":726.9000000953674,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":846.3000001907349,"responseStart":0,"secureConnectionStart":0},{"duration":259.30000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/e65b778d185daf5aee24936755b43da6/_/download/contextbatch/js/browser-metrics-plugin.contrib,-_super,-project.issue.navigator,-jira.view.issue,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":727.9000000953674,"connectEnd":727.9000000953674,"connectStart":727.9000000953674,"domainLookupEnd":727.9000000953674,"domainLookupStart":727.9000000953674,"fetchStart":727.9000000953674,"redirectEnd":0,"redirectStart":0,"requestStart":727.9000000953674,"responseEnd":987.2000002861023,"responseStart":987.2000002861023,"secureConnectionStart":727.9000000953674},{"duration":265.40000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/097ae97cb8fbec7d6ea4bbb1f26955b9-CDN/lu2cib/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/js/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":728.4000000953674,"connectEnd":728.4000000953674,"connectStart":728.4000000953674,"domainLookupEnd":728.4000000953674,"domainLookupStart":728.4000000953674,"fetchStart":728.4000000953674,"redirectEnd":0,"redirectStart":0,"requestStart":728.4000000953674,"responseEnd":993.8000001907349,"responseStart":993.8000001907349,"secureConnectionStart":728.4000000953674}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":38,"responseStart":187,"responseEnd":188,"domLoading":191,"domInteractive":972,"domContentLoadedEventStart":972,"domContentLoadedEventEnd":1021,"domComplete":1251,"loadEventStart":1251,"loadEventEnd":1251,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":953.7000002861023},{"name":"bigPipe.sidebar-id.end","time":954.5999999046326},{"name":"bigPipe.activity-panel-pipe-id.start","time":954.7000002861023},{"name":"bigPipe.activity-panel-pipe-id.end","time":955.7000002861023},{"name":"activityTabFullyLoaded","time":1036}],"measures":[],"correlationId":"6180dc7d5488d9","effectiveType":"4g","downlink":9,"rtt":0,"serverDuration":88,"dbReadsTimeInMs":14,"dbConnsTimeInMs":23,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Sub-Task
Major
MCS data segment, dict and misc files are made of S3 object files.
StorageManager metadata is a JSON file that contains the list of the actual S3 object files that are parts of the requested data file.
This subtask is dedicated in renaming/refactoring `MetadataFile` class in the SM code. The final solution must use FoundationDB instead of shared storage files to store JSON.
There is internal cache for JSON docs in SM that might become obsolete with migration to FDB. To future research this one has to remove the cache and measure the timings.