MCS data segment, dict and misc files are made of S3 object files.
The ownership mechanism is a relative slow file lock that syncs MCS data file operations races in SM. To change a value in a column, WE opens a file, that triggers open op in SM. SM checks or requests ownership using the mentioned file locks.
The mechanism must be transferred into FoundationDB.
The granularity must be reduced from MCS data file path to dbroot file path to reduce a number of kv pairs stored in FDB to implement ownership.
Roman
added a comment - MCS data segment, dict and misc files are made of S3 object files.
The ownership mechanism is a relative slow file lock that syncs MCS data file operations races in SM. To change a value in a column, WE opens a file, that triggers open op in SM. SM checks or requests ownership using the mentioned file locks.
The mechanism must be transferred into FoundationDB.
The granularity must be reduced from MCS data file path to dbroot file path to reduce a number of kv pairs stored in FDB to implement ownership.
People
Denis Khalikov (Inactive)
Julien Fritsch
Roman
Votes:
0Vote for this issue
Watchers:
3Start watching this issue
Dates
Created:
Updated:
Git Integration
Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.
{"report":{"fcp":3966.0999999046326,"ttfb":398.59999990463257,"pageVisibility":"visible","entityId":128764,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"1031ee71-bfc7-4405-90d8-db1fc6b34d4e","navigationType":0,"readyForUser":3646.199999809265,"redirectCount":0,"resourceLoadedEnd":3856.199999809265,"resourceLoadedStart":1018.9000000953674,"resourceTiming":[{"duration":1978.1999998092651,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":1018.9000000953674,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":1018.9000000953674,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":2997.0999999046326,"responseStart":0,"secureConnectionStart":0},{"duration":1978.2000002861023,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":1019.1999998092651,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":1019.1999998092651,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":2997.4000000953674,"responseStart":0,"secureConnectionStart":0},{"duration":1988.5999999046326,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":1019.4000000953674,"connectEnd":1019.4000000953674,"connectStart":1019.4000000953674,"domainLookupEnd":1019.4000000953674,"domainLookupStart":1019.4000000953674,"fetchStart":1019.4000000953674,"redirectEnd":0,"redirectStart":0,"requestStart":1019.4000000953674,"responseEnd":3008,"responseStart":3008,"secureConnectionStart":1019.4000000953674},{"duration":2232.4000000953674,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":1019.5,"connectEnd":1019.5,"connectStart":1019.5,"domainLookupEnd":1019.5,"domainLookupStart":1019.5,"fetchStart":1019.5,"redirectEnd":0,"redirectStart":0,"requestStart":3029.4000000953674,"responseEnd":3251.9000000953674,"responseStart":3042,"secureConnectionStart":1019.5},{"duration":2008.1000003814697,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":1019.6999998092651,"connectEnd":1019.6999998092651,"connectStart":1019.6999998092651,"domainLookupEnd":1019.6999998092651,"domainLookupStart":1019.6999998092651,"fetchStart":1019.6999998092651,"redirectEnd":0,"redirectStart":0,"requestStart":1019.6999998092651,"responseEnd":3027.800000190735,"responseStart":3027.800000190735,"secureConnectionStart":1019.6999998092651},{"duration":2009.2999997138977,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":1019.9000000953674,"connectEnd":1019.9000000953674,"connectStart":1019.9000000953674,"domainLookupEnd":1019.9000000953674,"domainLookupStart":1019.9000000953674,"fetchStart":1019.9000000953674,"redirectEnd":0,"redirectStart":0,"requestStart":1019.9000000953674,"responseEnd":3029.199999809265,"responseStart":3029.199999809265,"secureConnectionStart":1019.9000000953674},{"duration":2023.3000001907349,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":1020,"connectEnd":1020,"connectStart":1020,"domainLookupEnd":1020,"domainLookupStart":1020,"fetchStart":1020,"redirectEnd":0,"redirectStart":0,"requestStart":1020,"responseEnd":3043.300000190735,"responseStart":3043.300000190735,"secureConnectionStart":1020},{"duration":2028.3000001907349,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":1020.1999998092651,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":1020.1999998092651,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":3048.5,"responseStart":0,"secureConnectionStart":0},{"duration":2023.5999999046326,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":1020.4000000953674,"connectEnd":1020.4000000953674,"connectStart":1020.4000000953674,"domainLookupEnd":1020.4000000953674,"domainLookupStart":1020.4000000953674,"fetchStart":1020.4000000953674,"redirectEnd":0,"redirectStart":0,"requestStart":1020.4000000953674,"responseEnd":3044,"responseStart":3044,"secureConnectionStart":1020.4000000953674},{"duration":2035.5,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":1020.5999999046326,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":1020.5999999046326,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":3056.0999999046326,"responseStart":0,"secureConnectionStart":0},{"duration":2065.0999999046326,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":1020.8000001907349,"connectEnd":1020.8000001907349,"connectStart":1020.8000001907349,"domainLookupEnd":1020.8000001907349,"domainLookupStart":1020.8000001907349,"fetchStart":1020.8000001907349,"redirectEnd":0,"redirectStart":0,"requestStart":3055.4000000953674,"responseEnd":3085.9000000953674,"responseStart":3069.699999809265,"secureConnectionStart":1020.8000001907349},{"duration":2808.300000190735,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":1021.5999999046326,"connectEnd":1021.5999999046326,"connectStart":1021.5999999046326,"domainLookupEnd":1021.5999999046326,"domainLookupStart":1021.5999999046326,"fetchStart":1021.5999999046326,"redirectEnd":0,"redirectStart":0,"requestStart":1021.5999999046326,"responseEnd":3829.9000000953674,"responseStart":3829.9000000953674,"secureConnectionStart":1021.5999999046326},{"duration":2809,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":1021.8000001907349,"connectEnd":1021.8000001907349,"connectStart":1021.8000001907349,"domainLookupEnd":1021.8000001907349,"domainLookupStart":1021.8000001907349,"fetchStart":1021.8000001907349,"redirectEnd":0,"redirectStart":0,"requestStart":1021.8000001907349,"responseEnd":3830.800000190735,"responseStart":3830.800000190735,"secureConnectionStart":1021.8000001907349},{"duration":198.5,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":3213.800000190735,"connectEnd":3213.800000190735,"connectStart":3213.800000190735,"domainLookupEnd":3213.800000190735,"domainLookupStart":3213.800000190735,"fetchStart":3213.800000190735,"redirectEnd":0,"redirectStart":0,"requestStart":3213.800000190735,"responseEnd":3412.300000190735,"responseStart":3412.300000190735,"secureConnectionStart":3213.800000190735},{"duration":346.8999996185303,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/e65b778d185daf5aee24936755b43da6/_/download/contextbatch/js/browser-metrics-plugin.contrib,-_super,-jira.view.issue,-jira.navigator.kickass,-viewissue.standalone,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":3509.300000190735,"connectEnd":3509.300000190735,"connectStart":3509.300000190735,"domainLookupEnd":3509.300000190735,"domainLookupStart":3509.300000190735,"fetchStart":3509.300000190735,"redirectEnd":0,"redirectStart":0,"requestStart":3509.300000190735,"responseEnd":3856.199999809265,"responseStart":3856.199999809265,"secureConnectionStart":3509.300000190735}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":53,"responseStart":399,"responseEnd":464,"domLoading":934,"domInteractive":3937,"domContentLoadedEventStart":3937,"domContentLoadedEventEnd":3984,"domComplete":4669,"loadEventStart":4669,"loadEventEnd":4669,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":3923.0999999046326},{"name":"bigPipe.sidebar-id.end","time":3923.9000000953674},{"name":"bigPipe.activity-panel-pipe-id.start","time":3924.199999809265},{"name":"bigPipe.activity-panel-pipe-id.end","time":3925.0999999046326},{"name":"activityTabFullyLoaded","time":3997}],"measures":[],"correlationId":"6731334e42e411","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":85,"dbReadsTimeInMs":10,"dbConnsTimeInMs":19,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Sub-Task
Major
MCS data segment, dict and misc files are made of S3 object files.
The ownership mechanism is a relative slow file lock that syncs MCS data file operations races in SM. To change a value in a column, WE opens a file, that triggers open op in SM. SM checks or requests ownership using the mentioned file locks.
The mechanism must be transferred into FoundationDB.
The granularity must be reduced from MCS data file path to dbroot file path to reduce a number of kv pairs stored in FDB to implement ownership.