Currently there's no way to prevent the huge size of binarylogs which are generated in a short period of time. In our case we use binlog for MASTER-SLAVE replication and a high traffic weekend filled up the diskspace in the master server.
Percona has implemented max_binlog_files directive which can be used to ensure the maximum disk usage of binarylogs with conjunction with max_binlog_size directive.
I do not know if this is relevant but the author mentions some drawbacks using max_binlog_files variable and suggest a variable max_binlog_space or binlog_space_limit instead.
Nicolas Payart
added a comment - Before working on this feature (which is a real progress I think), you should consider the following issue opened on Percona bug tracker:
https://jira.percona.com/browse/PS-275
I do not know if this is relevant but the author mentions some drawbacks using max_binlog_files variable and suggest a variable max_binlog_space or binlog_space_limit instead.
This would be a useful option! Be it max_binlog_files or binlog_space_limit.
We have a 130GB DB replicated to a backup cluster, and binlog consume about 400GB of HD for a single day!
COUNOTTE CEDRIC
added a comment - This would be a useful option! Be it max_binlog_files or binlog_space_limit.
We have a 130GB DB replicated to a backup cluster, and binlog consume about 400GB of HD for a single day!
People
Unassigned
Onni Hakala
Votes:
4Vote for this issue
Watchers:
7Start watching this issue
Dates
Created:
Updated:
Git Integration
Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.
{"report":{"fcp":908.6999998092651,"ttfb":174.09999990463257,"pageVisibility":"visible","entityId":61948,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":1,"journeyId":"56406ab7-82e0-40e7-98cc-e9816c86aec6","navigationType":0,"readyForUser":963,"redirectCount":0,"resourceLoadedEnd":864.7999997138977,"resourceLoadedStart":182.89999961853027,"resourceTiming":[{"duration":258.5,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":182.89999961853027,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":182.89999961853027,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":441.3999996185303,"responseStart":0,"secureConnectionStart":0},{"duration":258.69999980926514,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/2bf333562ca6724060a9d5f1535471f6/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":183.19999980926514,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":183.19999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":441.8999996185303,"responseStart":0,"secureConnectionStart":0},{"duration":267.7000002861023,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":183.39999961853027,"connectEnd":183.39999961853027,"connectStart":183.39999961853027,"domainLookupEnd":183.39999961853027,"domainLookupStart":183.39999961853027,"fetchStart":183.39999961853027,"redirectEnd":0,"redirectStart":0,"requestStart":183.39999961853027,"responseEnd":451.09999990463257,"responseStart":451.09999990463257,"secureConnectionStart":183.39999961853027},{"duration":345.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/2bf333562ca6724060a9d5f1535471f6/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":184.39999961853027,"connectEnd":184.39999961853027,"connectStart":184.39999961853027,"domainLookupEnd":184.39999961853027,"domainLookupStart":184.39999961853027,"fetchStart":184.39999961853027,"redirectEnd":0,"redirectStart":0,"requestStart":184.39999961853027,"responseEnd":529.8999996185303,"responseStart":529.7999997138977,"secureConnectionStart":184.39999961853027},{"duration":349.59999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":184.59999990463257,"connectEnd":184.59999990463257,"connectStart":184.59999990463257,"domainLookupEnd":184.59999990463257,"domainLookupStart":184.59999990463257,"fetchStart":184.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":184.59999990463257,"responseEnd":534.1999998092651,"responseStart":534.1999998092651,"secureConnectionStart":184.59999990463257},{"duration":350,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":184.69999980926514,"connectEnd":184.69999980926514,"connectStart":184.69999980926514,"domainLookupEnd":184.69999980926514,"domainLookupStart":184.69999980926514,"fetchStart":184.69999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":184.69999980926514,"responseEnd":534.6999998092651,"responseStart":534.6999998092651,"secureConnectionStart":184.69999980926514},{"duration":350.30000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":184.89999961853027,"connectEnd":184.89999961853027,"connectStart":184.89999961853027,"domainLookupEnd":184.89999961853027,"domainLookupStart":184.89999961853027,"fetchStart":184.89999961853027,"redirectEnd":0,"redirectStart":0,"requestStart":184.89999961853027,"responseEnd":535.1999998092651,"responseStart":535.1999998092651,"secureConnectionStart":184.89999961853027},{"duration":410.5,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":185,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":185,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":595.5,"responseStart":0,"secureConnectionStart":0},{"duration":350.5,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":185.19999980926514,"connectEnd":185.19999980926514,"connectStart":185.19999980926514,"domainLookupEnd":185.19999980926514,"domainLookupStart":185.19999980926514,"fetchStart":185.19999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":185.19999980926514,"responseEnd":535.6999998092651,"responseStart":535.6999998092651,"secureConnectionStart":185.19999980926514},{"duration":410.2000002861023,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":185.39999961853027,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":185.39999961853027,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":595.5999999046326,"responseStart":0,"secureConnectionStart":0},{"duration":350.7999997138977,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":185.5,"connectEnd":185.5,"connectStart":185.5,"domainLookupEnd":185.5,"domainLookupStart":185.5,"fetchStart":185.5,"redirectEnd":0,"redirectStart":0,"requestStart":185.5,"responseEnd":536.2999997138977,"responseStart":536.2999997138977,"secureConnectionStart":185.5},{"duration":470.7000002861023,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":186.39999961853027,"connectEnd":186.39999961853027,"connectStart":186.39999961853027,"domainLookupEnd":186.39999961853027,"domainLookupStart":186.39999961853027,"fetchStart":186.39999961853027,"redirectEnd":0,"redirectStart":0,"requestStart":186.39999961853027,"responseEnd":657.0999999046326,"responseStart":657.0999999046326,"secureConnectionStart":186.39999961853027},{"duration":471.19999980926514,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":186.5,"connectEnd":186.5,"connectStart":186.5,"domainLookupEnd":186.5,"domainLookupStart":186.5,"fetchStart":186.5,"redirectEnd":0,"redirectStart":0,"requestStart":186.5,"responseEnd":657.6999998092651,"responseStart":657.5999999046326,"secureConnectionStart":186.5},{"duration":34.200000286102295,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":623.8999996185303,"connectEnd":623.8999996185303,"connectStart":623.8999996185303,"domainLookupEnd":623.8999996185303,"domainLookupStart":623.8999996185303,"fetchStart":623.8999996185303,"redirectEnd":0,"redirectStart":0,"requestStart":623.8999996185303,"responseEnd":658.0999999046326,"responseStart":658.0999999046326,"secureConnectionStart":623.8999996185303},{"duration":203.40000009536743,"initiatorType":"link","name":"https://jira.mariadb.org/s/d5715adaadd168a9002b108b2b039b50-CDN/lu2cib/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/css/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":661.3999996185303,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":661.3999996185303,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":864.7999997138977,"responseStart":0,"secureConnectionStart":0}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":23,"responseStart":174,"responseEnd":182,"domLoading":178,"domInteractive":1015,"domContentLoadedEventStart":1015,"domContentLoadedEventEnd":1055,"domComplete":1617,"loadEventStart":1617,"loadEventEnd":1618,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":996.5999999046326},{"name":"bigPipe.sidebar-id.end","time":997.5},{"name":"bigPipe.activity-panel-pipe-id.start","time":997.6999998092651},{"name":"bigPipe.activity-panel-pipe-id.end","time":998.8999996185303},{"name":"activityTabFullyLoaded","time":1068.7999997138977}],"measures":[],"correlationId":"1633fbd4bbdd43","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":97,"dbReadsTimeInMs":7,"dbConnsTimeInMs":14,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Task
Major
Before working on this feature (which is a real progress I think), you should consider the following issue opened on Percona bug tracker:
https://jira.percona.com/browse/PS-275
I do not know if this is relevant but the author mentions some drawbacks using max_binlog_files variable and suggest a variable max_binlog_space or binlog_space_limit instead.