Noticed that writetask and appendtask are breaking incoming data into 1MB chunks to write. That made sense for milestone 1 when those were written, but might make sense now to try to do the whole write op in one IOC call rather than break it up. Need to experiment and see if it's worth the extra mem usage.
Found that this was worth doing. Locally using test000 as the benchmark, got an end-to-end gain of ~7%. Raised the cap to 100MB for safety. Should be 1/100th the impediment it was, and keep ridiculous things from happening.
Patrick LeBlanc (Inactive)
added a comment - Found that this was worth doing. Locally using test000 as the benchmark, got an end-to-end gain of ~7%. Raised the cap to 100MB for safety. Should be 1/100th the impediment it was, and keep ridiculous things from happening.
People
Ben Thompson (Inactive)
Patrick LeBlanc (Inactive)
Votes:
0Vote for this issue
Watchers:
1Start watching this issue
Dates
Created:
Updated:
Resolved:
Git Integration
Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.
{"report":{"fcp":1740.6999998092651,"ttfb":346.2999997138977,"pageVisibility":"visible","entityId":78540,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"0edca9eb-2974-43fe-8840-b9db94f0a64b","navigationType":0,"readyForUser":1816.3999996185303,"redirectCount":0,"resourceLoadedEnd":1373.3999996185303,"resourceLoadedStart":352.59999990463257,"resourceTiming":[{"duration":630.2999997138977,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":352.59999990463257,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":352.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":982.8999996185303,"responseStart":0,"secureConnectionStart":0},{"duration":632.2000002861023,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":352.8999996185303,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":352.8999996185303,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":985.0999999046326,"responseStart":0,"secureConnectionStart":0},{"duration":838.5999999046326,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":355.59999990463257,"connectEnd":355.59999990463257,"connectStart":355.59999990463257,"domainLookupEnd":355.59999990463257,"domainLookupStart":355.59999990463257,"fetchStart":355.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":986.1999998092651,"responseEnd":1194.1999998092651,"responseStart":1002.2999997138977,"secureConnectionStart":355.59999990463257},{"duration":987.5999999046326,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":355.7999997138977,"connectEnd":355.7999997138977,"connectStart":355.7999997138977,"domainLookupEnd":355.7999997138977,"domainLookupStart":355.7999997138977,"fetchStart":355.7999997138977,"redirectEnd":0,"redirectStart":0,"requestStart":986.3999996185303,"responseEnd":1343.3999996185303,"responseStart":1004.3999996185303,"secureConnectionStart":355.7999997138977},{"duration":653.6999998092651,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":356,"connectEnd":356,"connectStart":356,"domainLookupEnd":356,"domainLookupStart":356,"fetchStart":356,"redirectEnd":0,"redirectStart":0,"requestStart":986.5,"responseEnd":1009.6999998092651,"responseStart":1006.0999999046326,"secureConnectionStart":356},{"duration":653.7999997138977,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":356.09999990463257,"connectEnd":356.09999990463257,"connectStart":356.09999990463257,"domainLookupEnd":356.09999990463257,"domainLookupStart":356.09999990463257,"fetchStart":356.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":986.5999999046326,"responseEnd":1009.8999996185303,"responseStart":1007.2999997138977,"secureConnectionStart":356.09999990463257},{"duration":654.3000001907349,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":356.2999997138977,"connectEnd":356.2999997138977,"connectStart":356.2999997138977,"domainLookupEnd":356.2999997138977,"domainLookupStart":356.2999997138977,"fetchStart":356.2999997138977,"redirectEnd":0,"redirectStart":0,"requestStart":987,"responseEnd":1010.5999999046326,"responseStart":1008.1999998092651,"secureConnectionStart":356.2999997138977},{"duration":636.8999996185303,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":356.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":356.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":993.3999996185303,"responseStart":0,"secureConnectionStart":0},{"duration":664.9000000953674,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":356.69999980926514,"connectEnd":356.69999980926514,"connectStart":356.69999980926514,"domainLookupEnd":356.69999980926514,"domainLookupStart":356.69999980926514,"fetchStart":356.69999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":997.5,"responseEnd":1021.5999999046326,"responseStart":1017.6999998092651,"secureConnectionStart":356.69999980926514},{"duration":637,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":356.7999997138977,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":356.7999997138977,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":993.7999997138977,"responseStart":0,"secureConnectionStart":0},{"duration":664.0999999046326,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":357.69999980926514,"connectEnd":357.69999980926514,"connectStart":357.69999980926514,"domainLookupEnd":357.69999980926514,"domainLookupStart":357.69999980926514,"fetchStart":357.69999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":997.8999996185303,"responseEnd":1021.7999997138977,"responseStart":1019.0999999046326,"secureConnectionStart":357.69999980926514},{"duration":1006.3999996185303,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":367,"connectEnd":367,"connectStart":367,"domainLookupEnd":367,"domainLookupStart":367,"fetchStart":367,"redirectEnd":0,"redirectStart":0,"requestStart":1175.3999996185303,"responseEnd":1373.3999996185303,"responseStart":1356.8999996185303,"secureConnectionStart":367},{"duration":1002.1999998092651,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":367.19999980926514,"connectEnd":367.19999980926514,"connectStart":367.19999980926514,"domainLookupEnd":367.19999980926514,"domainLookupStart":367.19999980926514,"fetchStart":367.19999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":1308.7999997138977,"responseEnd":1369.3999996185303,"responseStart":1349.1999998092651,"secureConnectionStart":367.19999980926514},{"duration":320.2999997138977,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":1367.5999999046326,"connectEnd":1367.5999999046326,"connectStart":1367.5999999046326,"domainLookupEnd":1367.5999999046326,"domainLookupStart":1367.5999999046326,"fetchStart":1367.5999999046326,"redirectEnd":0,"redirectStart":0,"requestStart":1655.5,"responseEnd":1687.8999996185303,"responseStart":1686.6999998092651,"secureConnectionStart":1367.5999999046326}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":201,"responseStart":346,"responseEnd":354,"domLoading":351,"domInteractive":1876,"domContentLoadedEventStart":1876,"domContentLoadedEventEnd":1928,"domComplete":3019,"loadEventStart":3019,"loadEventEnd":3019,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1850.5},{"name":"bigPipe.sidebar-id.end","time":1851.3999996185303},{"name":"bigPipe.activity-panel-pipe-id.start","time":1851.5999999046326},{"name":"bigPipe.activity-panel-pipe-id.end","time":1852.3999996185303},{"name":"activityTabFullyLoaded","time":1941.7999997138977}],"measures":[],"correlationId":"c9db2807d875de","effectiveType":"4g","downlink":9.1,"rtt":0,"serverDuration":76,"dbReadsTimeInMs":7,"dbConnsTimeInMs":16,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Task
Major
Found that this was worth doing. Locally using test000 as the benchmark, got an end-to-end gain of ~7%. Raised the cap to 100MB for safety. Should be 1/100th the impediment it was, and keep ridiculous things from happening.