Starting with MDEV-18115 in MariaDB Server 10.5.1, the counter Innodb_data_written no longer includes writes to the redo log file ib_logfile0, which will continue to be counted by Innodb_os_log_written.
When the asynchronous doublewrite was implemented in MDEV-23855, the writes via the doublewrite buffer started to be counted incorrectly, without multiplying them by innodb_page_size. The code has since then been refactored, but the error has been preserved.
While we are at it, it looks like we can remove the separate counter buf_dblwr.pages_submitted (initiated writes) and only report buf_dblwr.pages_written (completed writes).
A work-around for the error could be the following formulae:
real_data_written = Innodb_data_written + (innodb_page_size - 1) * Innodb_dblwr_pages_written
innodb_written = real_data_written + Innodb_os_log_written
Attachments
Issue Links
is caused by
MDEV-23855InnoDB log checkpointing causes regression for write-heavy OLTP
Closed
relates to
MDEV-18115Remove dummy tablespace for the redo log
With the proposed fix the numbers for Innodb_data_written + Innodb_os_log_written match the disk write rate as reported by iostat much better. The fix is ok to push.
Axel Schwenke
added a comment - With the proposed fix the numbers for Innodb_data_written + Innodb_os_log_written match the disk write rate as reported by iostat much better. The fix is ok to push.
People
Marko Mäkelä
Marko Mäkelä
Votes:
0Vote for this issue
Watchers:
2Start watching this issue
Dates
Created:
Updated:
Resolved:
Git Integration
Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.
{"report":{"fcp":783.3000001907349,"ttfb":191.70000004768372,"pageVisibility":"visible","entityId":121354,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":1,"journeyId":"22fbc42a-4861-443d-a02c-656603827fb0","navigationType":0,"readyForUser":852.6000001430511,"redirectCount":0,"resourceLoadedEnd":525.8000001907349,"resourceLoadedStart":199.5,"resourceTiming":[{"duration":13,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":199.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":199.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":212.5,"responseStart":0,"secureConnectionStart":0},{"duration":13.700000047683716,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":199.70000004768372,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":199.70000004768372,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":213.40000009536743,"responseStart":0,"secureConnectionStart":0},{"duration":109.89999985694885,"initiatorType":"script","name":"https://jira.mariadb.org/s/fbf975c0cce4b1abf04784eeae9ba1f4-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":199.80000019073486,"connectEnd":199.80000019073486,"connectStart":199.80000019073486,"domainLookupEnd":199.80000019073486,"domainLookupStart":199.80000019073486,"fetchStart":199.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":216.60000014305115,"responseEnd":309.7000000476837,"responseStart":230.90000009536743,"secureConnectionStart":199.80000019073486},{"duration":291.7000000476837,"initiatorType":"script","name":"https://jira.mariadb.org/s/099b33461394b8015fc36c0a4b96e19f-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":199.90000009536743,"connectEnd":199.90000009536743,"connectStart":199.90000009536743,"domainLookupEnd":199.90000009536743,"domainLookupStart":199.90000009536743,"fetchStart":199.90000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":219.30000019073486,"responseEnd":491.60000014305115,"responseStart":232.60000014305115,"secureConnectionStart":199.90000009536743},{"duration":35.30000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/94c15bff32baef80f4096a08aceae8bc-CDN/lu2bu7/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":200,"connectEnd":200,"connectStart":200,"domainLookupEnd":200,"domainLookupStart":200,"fetchStart":200,"redirectEnd":0,"redirectStart":0,"requestStart":220.20000004768372,"responseEnd":235.30000019073486,"responseStart":233.80000019073486,"secureConnectionStart":200},{"duration":48.09999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":200.10000014305115,"connectEnd":200.10000014305115,"connectStart":200.10000014305115,"domainLookupEnd":200.10000014305115,"domainLookupStart":200.10000014305115,"fetchStart":200.10000014305115,"redirectEnd":0,"redirectStart":0,"requestStart":221.20000004768372,"responseEnd":248.20000004768372,"responseStart":246.20000004768372,"secureConnectionStart":200.10000014305115},{"duration":52.90000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":200.20000004768372,"connectEnd":200.20000004768372,"connectStart":200.20000004768372,"domainLookupEnd":200.20000004768372,"domainLookupStart":200.20000004768372,"fetchStart":200.20000004768372,"redirectEnd":0,"redirectStart":0,"requestStart":223.10000014305115,"responseEnd":253.10000014305115,"responseStart":249.90000009536743,"secureConnectionStart":200.20000004768372},{"duration":20.899999856948853,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bu7/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":200.30000019073486,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":200.30000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":221.20000004768372,"responseStart":0,"secureConnectionStart":0},{"duration":53.09999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":200.30000019073486,"connectEnd":200.30000019073486,"connectStart":200.30000019073486,"domainLookupEnd":200.30000019073486,"domainLookupStart":200.30000019073486,"fetchStart":200.30000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":224.30000019073486,"responseEnd":253.40000009536743,"responseStart":251,"secureConnectionStart":200.30000019073486},{"duration":23.200000047683716,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":200.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":200.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":223.70000004768372,"responseStart":0,"secureConnectionStart":0},{"duration":53.09999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/s/3339d87fa2538a859872f2df449bf8d0-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":200.60000014305115,"connectEnd":200.60000014305115,"connectStart":200.60000014305115,"domainLookupEnd":200.60000014305115,"domainLookupStart":200.60000014305115,"fetchStart":200.60000014305115,"redirectEnd":0,"redirectStart":0,"requestStart":228.90000009536743,"responseEnd":253.70000004768372,"responseStart":251.70000004768372,"secureConnectionStart":200.60000014305115},{"duration":316.90000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":208.40000009536743,"connectEnd":208.40000009536743,"connectStart":208.40000009536743,"domainLookupEnd":208.40000009536743,"domainLookupStart":208.40000009536743,"fetchStart":208.40000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":245.60000014305115,"responseEnd":525.3000001907349,"responseStart":521.5,"secureConnectionStart":208.40000009536743},{"duration":317.40000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":208.40000009536743,"connectEnd":208.40000009536743,"connectStart":208.40000009536743,"domainLookupEnd":208.40000009536743,"domainLookupStart":208.40000009536743,"fetchStart":208.40000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":249.70000004768372,"responseEnd":525.8000001907349,"responseStart":523.7000000476837,"secureConnectionStart":208.40000009536743},{"duration":101,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":453.5,"connectEnd":453.5,"connectStart":453.5,"domainLookupEnd":453.5,"domainLookupStart":453.5,"fetchStart":453.5,"redirectEnd":0,"redirectStart":0,"requestStart":525.6000001430511,"responseEnd":554.5,"responseStart":553.6000001430511,"secureConnectionStart":453.5},{"duration":115.89999985694885,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":704.8000001907349,"connectEnd":704.8000001907349,"connectStart":704.8000001907349,"domainLookupEnd":704.8000001907349,"domainLookupStart":704.8000001907349,"fetchStart":704.8000001907349,"redirectEnd":0,"redirectStart":0,"requestStart":704.8000001907349,"responseEnd":820.7000000476837,"responseStart":820.7000000476837,"secureConnectionStart":704.8000001907349},{"duration":89.5,"initiatorType":"script","name":"https://www.google-analytics.com/analytics.js","startTime":776.3000001907349,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":776.3000001907349,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":865.8000001907349,"responseStart":0,"secureConnectionStart":0}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":60,"responseStart":191,"responseEnd":207,"domLoading":195,"domInteractive":903,"domContentLoadedEventStart":903,"domContentLoadedEventEnd":950,"domComplete":1173,"loadEventStart":1173,"loadEventEnd":1174,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":887.2000000476837},{"name":"bigPipe.sidebar-id.end","time":887.9000000953674},{"name":"bigPipe.activity-panel-pipe-id.start","time":888},{"name":"bigPipe.activity-panel-pipe-id.end","time":889},{"name":"activityTabFullyLoaded","time":961.4000000953674}],"measures":[],"correlationId":"a21509c580f65c","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":76,"dbReadsTimeInMs":13,"dbConnsTimeInMs":21,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Bug
Critical
MDEV-18115 Remove dummy tablespace for the redo log
With the proposed fix the numbers for Innodb_data_written + Innodb_os_log_written match the disk write rate as reported by iostat much better. The fix is ok to push.