Type:
Priority:
Resolution:
Fixed
Affects Version/s:
10.1.4 , 10.2.0 , 10.3.0 , 10.4.0 , 10.5.0
Sprint:
10.1.6-1, 10.1.6-2, 10.1.21
Scrubbing tests somehow got encryption enabled in their opt files. After removing --innodb-encrypt-tables=ON and --innodb-encrypt-log=ON from innodb_scrub.opt , innodb_scrub_background.opt , innodb_scrub_compressed.opt , these tests start to fail.
Now that the problematic ‘background scrubbing’ and all scrubbing code that incorrectly skipped redo logging has been removed from MariaDB Server 10.5.2, we should continue where MDEV-15528
Remove the invalidate parameter of btr_free_root()
Introduce a data structure that allows us to mark a range of data pages of a tablespace as freed, even when those pages are not in the buffer pool. This could be attached to fil_space_t .
Ensure that crash recovery will replay the FREE_PAGE records (extend the above mentioned ranges of freed pages), and punch holes in page_compressed tables, or overwrite blocks with zeroes if innodb_immediate_scrub_data_uncompressed is set.
On page flush, try to combine large punch_hole or zero-initialization requests to a small one.
Optional: when freeing the last pages of a tablespace, write a TRIM_PAGES record, and on page flush, invoke ftruncate() to shrink the file. (Do this on any file, when neither scrubbing nor page_compressed is being used.)
{"report":{"fcp":1017.2999997138977,"ttfb":272.69999980926514,"pageVisibility":"visible","entityId":51308,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"8b5e17a7-139d-4445-8fbf-e17261e86b9f","navigationType":0,"readyForUser":1114.2999997138977,"redirectCount":0,"resourceLoadedEnd":1631.5,"resourceLoadedStart":278.40000009536743,"resourceTiming":[{"duration":247.7999997138977,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":278.40000009536743,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":278.40000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":526.1999998092651,"responseStart":0,"secureConnectionStart":0},{"duration":247.7000002861023,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":278.7999997138977,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":278.7999997138977,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":526.5,"responseStart":0,"secureConnectionStart":0},{"duration":256.7999997138977,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":279,"connectEnd":279,"connectStart":279,"domainLookupEnd":279,"domainLookupStart":279,"fetchStart":279,"redirectEnd":0,"redirectStart":0,"requestStart":279,"responseEnd":535.7999997138977,"responseStart":535.7999997138977,"secureConnectionStart":279},{"duration":328.90000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":279.09999990463257,"connectEnd":279.09999990463257,"connectStart":279.09999990463257,"domainLookupEnd":279.09999990463257,"domainLookupStart":279.09999990463257,"fetchStart":279.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":279.09999990463257,"responseEnd":608,"responseStart":608,"secureConnectionStart":279.09999990463257},{"duration":333.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":279.2999997138977,"connectEnd":279.2999997138977,"connectStart":279.2999997138977,"domainLookupEnd":279.2999997138977,"domainLookupStart":279.2999997138977,"fetchStart":279.2999997138977,"redirectEnd":0,"redirectStart":0,"requestStart":279.2999997138977,"responseEnd":612.7999997138977,"responseStart":612.7999997138977,"secureConnectionStart":279.2999997138977},{"duration":333.90000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":279.5,"connectEnd":279.5,"connectStart":279.5,"domainLookupEnd":279.5,"domainLookupStart":279.5,"fetchStart":279.5,"redirectEnd":0,"redirectStart":0,"requestStart":279.5,"responseEnd":613.4000000953674,"responseStart":613.4000000953674,"secureConnectionStart":279.5},{"duration":334.09999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":279.69999980926514,"connectEnd":279.69999980926514,"connectStart":279.69999980926514,"domainLookupEnd":279.69999980926514,"domainLookupStart":279.69999980926514,"fetchStart":279.69999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":279.69999980926514,"responseEnd":613.7999997138977,"responseStart":613.7999997138977,"secureConnectionStart":279.69999980926514},{"duration":402.80000019073486,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":279.7999997138977,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":279.7999997138977,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":682.5999999046326,"responseStart":0,"secureConnectionStart":0},{"duration":334.2999997138977,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":280,"connectEnd":280,"connectStart":280,"domainLookupEnd":280,"domainLookupStart":280,"fetchStart":280,"redirectEnd":0,"redirectStart":0,"requestStart":280,"responseEnd":614.2999997138977,"responseStart":614.2999997138977,"secureConnectionStart":280},{"duration":402.59999990463257,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":280.19999980926514,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":280.19999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":682.7999997138977,"responseStart":0,"secureConnectionStart":0},{"duration":334.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":280.40000009536743,"connectEnd":280.40000009536743,"connectStart":280.40000009536743,"domainLookupEnd":280.40000009536743,"domainLookupStart":280.40000009536743,"fetchStart":280.40000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":280.40000009536743,"responseEnd":614.9000000953674,"responseStart":614.9000000953674,"secureConnectionStart":280.40000009536743},{"duration":1337.6999998092651,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":292.90000009536743,"connectEnd":292.90000009536743,"connectStart":292.90000009536743,"domainLookupEnd":292.90000009536743,"domainLookupStart":292.90000009536743,"fetchStart":292.90000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":292.90000009536743,"responseEnd":1630.5999999046326,"responseStart":1630.5,"secureConnectionStart":292.90000009536743},{"duration":1331.9000000953674,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":299.59999990463257,"connectEnd":299.59999990463257,"connectStart":299.59999990463257,"domainLookupEnd":299.59999990463257,"domainLookupStart":299.59999990463257,"fetchStart":299.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":299.59999990463257,"responseEnd":1631.5,"responseStart":1631.5,"secureConnectionStart":299.59999990463257},{"duration":508.40000009536743,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":694.7999997138977,"connectEnd":694.7999997138977,"connectStart":694.7999997138977,"domainLookupEnd":694.7999997138977,"domainLookupStart":694.7999997138977,"fetchStart":694.7999997138977,"redirectEnd":0,"redirectStart":0,"requestStart":694.7999997138977,"responseEnd":1203.1999998092651,"responseStart":1203.1999998092651,"secureConnectionStart":694.7999997138977},{"duration":650.9000000953674,"initiatorType":"script","name":"https://www.google-analytics.com/analytics.js","startTime":1008.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":1008.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1659.4000000953674,"responseStart":0,"secureConnectionStart":0}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":90,"responseStart":273,"responseEnd":300,"domLoading":277,"domInteractive":1668,"domContentLoadedEventStart":1668,"domContentLoadedEventEnd":1716,"domComplete":2336,"loadEventStart":2336,"loadEventEnd":2337,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1642.5999999046326},{"name":"bigPipe.sidebar-id.end","time":1643.2999997138977},{"name":"bigPipe.activity-panel-pipe-id.start","time":1643.4000000953674},{"name":"bigPipe.activity-panel-pipe-id.end","time":1645.2999997138977},{"name":"activityTabFullyLoaded","time":1733.6999998092651}],"measures":[],"correlationId":"735379dd2f024f","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":123,"dbReadsTimeInMs":30,"dbConnsTimeInMs":41,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Bug
Major
MDEV-12288 Reset DB_TRX_ID when the history is removed, to speed up MVCC
MDEV-11068 Review which innodb_compression_algorithm to support in binary packages
The treecommit 4a47938d9c36605aa9fcbc7d3bbd34bea4e7f5f7 (HEAD, origin/bb-10.5-thiru)Author: Thirunarayanan Balathandayuthapani <thiru@mariadb.com>Date: Fri Jul 17 21:03:50 2020 +0530- check empty container for range_set_t::iterator::findcommit 90c308c5e795ceda9c0f644bbde693507b597b74Author: Thirunarayanan Balathandayuthapani <thiru@mariadb.com>Date: Fri Jul 17 19:56:33 2020 +0530MDEV-22970 Possible corruption of page_compressed tables, orwhen scrubbing is enabledperformed well during RQG testing. The issues seen are in actual 10.5 too.