Type:
Task
Priority:
Major
Resolution:
Fixed
Affects Version/s:
None
Parsing metadata names is very costly, to give an idea, for a resultset like a query selecting 100 int, here are some benchmarks :
solution A : parsing metadata string (table name, table alias, ...) : 6,677.3 operation per second
solution B : coping buffer metadata part: 8,014.3 ops/s
solution C : keeping buffer : 8,781.6 operation per seconds.
Most of the time, depending on option, either 0 or 1 of these metadata is needed.
Current implementation is using implementation B, since the report of CONJS-223 (metadata sporadic corruption)
Goal of this task is to investigate better the CONJS-233 issue, in order to permit using solution C.
Diego Dupin
made changes -
2024-05-16 15:01
Field
Original Value
New Value
Description
Parsing metadata names is very costly, to give an idea, for a resultset like a query selecting 100 int, here are some benchmarks :
* solution A : parsing metadata string (table name, table alias, ...) : 6,677.3 operation per second
* solution B : coping buffer metadata part: 8,014.3 ops/s
* solution C : keeping buffer : 8,781.6 operation per seconds.
Most of the time, depending on option, either 0 or 1 of these metadata is needed.
Current implementation is using implementation B, since the report of CONJS-223 (metadata sporadic corruption)
Goal of this task is to investigate node pool buffer implementation because buffer is normally not reused, that would permit using solution C.
Parsing metadata names is very costly, to give an idea, for a resultset like a query selecting 100 int, here are some benchmarks :
* solution A : parsing metadata string (table name, table alias, ...) : 6,677.3 operation per second
* solution B : coping buffer metadata part: 8,014.3 ops/s
* solution C : keeping buffer : 8,781.6 operation per seconds.
Most of the time, depending on option, either 0 or 1 of these metadata is needed.
Current implementation is using implementation B, since the report of CONJS-223 (metadata sporadic corruption)
Goal of this task is to investigate better the CONJS-233 issue, in order to permit using solution C.
Diego Dupin
made changes -
2024-05-16 15:10
Fix Version/s
3.3.1
[ 29822
]
Fix Version/s
3.3
[ 29406
]
Diego Dupin
made changes -
2024-05-17 12:47
Component/s
performance
[ 15307
]
Resolution
Fixed
[ 1
]
Status
Open
[ 1
]
Closed
[ 6
]
{"report":{"fcp":775.8999999761581,"ttfb":178.80000001192093,"pageVisibility":"visible","entityId":129178,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":1,"journeyId":"c87c635b-5df2-4b15-8cba-bbc8d5eef5a8","navigationType":0,"readyForUser":847.6000000238419,"redirectCount":0,"resourceLoadedEnd":867.5,"resourceLoadedStart":187.10000002384186,"resourceTiming":[{"duration":15.799999952316284,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":187.10000002384186,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":187.10000002384186,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":202.89999997615814,"responseStart":0,"secureConnectionStart":0},{"duration":15.900000035762787,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":187.39999997615814,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":187.39999997615814,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":203.30000001192093,"responseStart":0,"secureConnectionStart":0},{"duration":70.89999997615814,"initiatorType":"script","name":"https://jira.mariadb.org/s/fbf975c0cce4b1abf04784eeae9ba1f4-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":187.60000002384186,"connectEnd":187.60000002384186,"connectStart":187.60000002384186,"domainLookupEnd":187.60000002384186,"domainLookupStart":187.60000002384186,"fetchStart":187.60000002384186,"redirectEnd":0,"redirectStart":0,"requestStart":187.60000002384186,"responseEnd":258.5,"responseStart":258.5,"secureConnectionStart":187.60000002384186},{"duration":111.40000003576279,"initiatorType":"script","name":"https://jira.mariadb.org/s/099b33461394b8015fc36c0a4b96e19f-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":188.19999998807907,"connectEnd":188.19999998807907,"connectStart":188.19999998807907,"domainLookupEnd":188.19999998807907,"domainLookupStart":188.19999998807907,"fetchStart":188.19999998807907,"redirectEnd":0,"redirectStart":0,"requestStart":188.19999998807907,"responseEnd":299.60000002384186,"responseStart":299.60000002384186,"secureConnectionStart":188.19999998807907},{"duration":114.70000004768372,"initiatorType":"script","name":"https://jira.mariadb.org/s/94c15bff32baef80f4096a08aceae8bc-CDN/lu2bu7/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":188.39999997615814,"connectEnd":188.39999997615814,"connectStart":188.39999997615814,"domainLookupEnd":188.39999997615814,"domainLookupStart":188.39999997615814,"fetchStart":188.39999997615814,"redirectEnd":0,"redirectStart":0,"requestStart":188.39999997615814,"responseEnd":303.10000002384186,"responseStart":303.10000002384186,"secureConnectionStart":188.39999997615814},{"duration":114.89999997615814,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":188.60000002384186,"connectEnd":188.60000002384186,"connectStart":188.60000002384186,"domainLookupEnd":188.60000002384186,"domainLookupStart":188.60000002384186,"fetchStart":188.60000002384186,"redirectEnd":0,"redirectStart":0,"requestStart":188.60000002384186,"responseEnd":303.5,"responseStart":303.5,"secureConnectionStart":188.60000002384186},{"duration":115.09999996423721,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":188.80000001192093,"connectEnd":188.80000001192093,"connectStart":188.80000001192093,"domainLookupEnd":188.80000001192093,"domainLookupStart":188.80000001192093,"fetchStart":188.80000001192093,"redirectEnd":0,"redirectStart":0,"requestStart":188.80000001192093,"responseEnd":303.89999997615814,"responseStart":303.89999997615814,"secureConnectionStart":188.80000001192093},{"duration":212.10000002384186,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bu7/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":189,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":189,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":401.10000002384186,"responseStart":0,"secureConnectionStart":0},{"duration":115.39999997615814,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":189.10000002384186,"connectEnd":189.10000002384186,"connectStart":189.10000002384186,"domainLookupEnd":189.10000002384186,"domainLookupStart":189.10000002384186,"fetchStart":189.10000002384186,"redirectEnd":0,"redirectStart":0,"requestStart":189.10000002384186,"responseEnd":304.5,"responseStart":304.5,"secureConnectionStart":189.10000002384186},{"duration":211.89999997615814,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":189.30000001192093,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":189.30000001192093,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":401.19999998807907,"responseStart":0,"secureConnectionStart":0},{"duration":115.60000002384186,"initiatorType":"script","name":"https://jira.mariadb.org/s/3339d87fa2538a859872f2df449bf8d0-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":189.39999997615814,"connectEnd":189.39999997615814,"connectStart":189.39999997615814,"domainLookupEnd":189.39999997615814,"domainLookupStart":189.39999997615814,"fetchStart":189.39999997615814,"redirectEnd":0,"redirectStart":0,"requestStart":189.39999997615814,"responseEnd":305,"responseStart":305,"secureConnectionStart":189.39999997615814},{"duration":294.39999997615814,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":193.60000002384186,"connectEnd":193.60000002384186,"connectStart":193.60000002384186,"domainLookupEnd":193.60000002384186,"domainLookupStart":193.60000002384186,"fetchStart":193.60000002384186,"redirectEnd":0,"redirectStart":0,"requestStart":193.60000002384186,"responseEnd":488,"responseStart":488,"secureConnectionStart":193.60000002384186},{"duration":505.5999999642372,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":195.80000001192093,"connectEnd":195.80000001192093,"connectStart":195.80000001192093,"domainLookupEnd":195.80000001192093,"domainLookupStart":195.80000001192093,"fetchStart":195.80000001192093,"redirectEnd":0,"redirectStart":0,"requestStart":195.80000001192093,"responseEnd":701.3999999761581,"responseStart":701.3999999761581,"secureConnectionStart":195.80000001192093},{"duration":75.19999998807907,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":413.30000001192093,"connectEnd":413.30000001192093,"connectStart":413.30000001192093,"domainLookupEnd":413.30000001192093,"domainLookupStart":413.30000001192093,"fetchStart":413.30000001192093,"redirectEnd":0,"redirectStart":0,"requestStart":413.30000001192093,"responseEnd":488.5,"responseStart":488.5,"secureConnectionStart":413.30000001192093},{"duration":40.10000002384186,"initiatorType":"link","name":"https://jira.mariadb.org/s/d5715adaadd168a9002b108b2b039b50-CDN/lu2bu7/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/css/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":687.3999999761581,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":687.3999999761581,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":727.5,"responseStart":0,"secureConnectionStart":0},{"duration":39.69999998807907,"initiatorType":"link","name":"https://jira.mariadb.org/s/50bc9be5bfead1a25e72c1a9338c94f6-CDN/lu2bu7/820016/12ta74/e108c7645258ccb43280ed3404e3e949/_/download/contextbatch/css/com.atlassian.jira.plugins.jira-development-integration-plugin:0,-_super,-jira.view.issue,-jira.global,-jira.general,-jira.browse.project,-project.issue.navigator,-atl.general/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":688,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":688,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":727.6999999880791,"responseStart":0,"secureConnectionStart":0},{"duration":169.9000000357628,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/e65b778d185daf5aee24936755b43da6/_/download/contextbatch/js/browser-metrics-plugin.contrib,-_super,-project.issue.navigator,-jira.view.issue,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":688.8999999761581,"connectEnd":688.8999999761581,"connectStart":688.8999999761581,"domainLookupEnd":688.8999999761581,"domainLookupStart":688.8999999761581,"fetchStart":688.8999999761581,"redirectEnd":0,"redirectStart":0,"requestStart":688.8999999761581,"responseEnd":858.8000000119209,"responseStart":858.8000000119209,"secureConnectionStart":688.8999999761581},{"duration":176.89999997615814,"initiatorType":"script","name":"https://jira.mariadb.org/s/f51ef5507eea4c158f257c66c93b2a3f-CDN/lu2bu7/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/js/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":689.3000000119209,"connectEnd":689.3000000119209,"connectStart":689.3000000119209,"domainLookupEnd":689.3000000119209,"domainLookupStart":689.3000000119209,"fetchStart":689.3000000119209,"redirectEnd":0,"redirectStart":0,"requestStart":689.3000000119209,"responseEnd":866.1999999880791,"responseStart":866.1999999880791,"secureConnectionStart":689.3000000119209},{"duration":177.80000001192093,"initiatorType":"script","name":"https://jira.mariadb.org/s/86ee9bbc76cd1bcd8556fcdcf46241c9-CDN/lu2bu7/820016/12ta74/e108c7645258ccb43280ed3404e3e949/_/download/contextbatch/js/com.atlassian.jira.plugins.jira-development-integration-plugin:0,-_super,-jira.view.issue,-jira.global,-jira.general,-jira.browse.project,-project.issue.navigator,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":689.6999999880791,"connectEnd":689.6999999880791,"connectStart":689.6999999880791,"domainLookupEnd":689.6999999880791,"domainLookupStart":689.6999999880791,"fetchStart":689.6999999880791,"redirectEnd":0,"redirectStart":0,"requestStart":689.6999999880791,"responseEnd":867.5,"responseStart":867.5,"secureConnectionStart":689.6999999880791},{"duration":112.30000001192093,"initiatorType":"script","name":"https://www.google-analytics.com/analytics.js","startTime":769.8000000119209,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":769.8000000119209,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":882.1000000238419,"responseStart":0,"secureConnectionStart":0},{"duration":158.69999998807907,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":790.6999999880791,"connectEnd":790.6999999880791,"connectStart":790.6999999880791,"domainLookupEnd":790.6999999880791,"domainLookupStart":790.6999999880791,"fetchStart":790.6999999880791,"redirectEnd":0,"redirectStart":0,"requestStart":790.6999999880791,"responseEnd":949.3999999761581,"responseStart":949.3999999761581,"secureConnectionStart":790.6999999880791}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":9,"responseStart":179,"responseEnd":195,"domLoading":182,"domInteractive":924,"domContentLoadedEventStart":924,"domContentLoadedEventEnd":968,"domComplete":1111,"loadEventStart":1111,"loadEventEnd":1111,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":884.1999999880791},{"name":"bigPipe.sidebar-id.end","time":885},{"name":"bigPipe.activity-panel-pipe-id.start","time":885.1999999880791},{"name":"bigPipe.activity-panel-pipe-id.end","time":886.8999999761581},{"name":"activityTabFullyLoaded","time":986.3000000119209}],"measures":[],"correlationId":"e4ea1ae79b1c90","effectiveType":"4g","downlink":9.8,"rtt":0,"serverDuration":109,"dbReadsTimeInMs":18,"dbConnsTimeInMs":26,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}