Type:
Bug
Priority:
Blocker
Resolution:
Fixed
Affects Version/s:
None
Build tested: 22.08.2, latest build from drone (#5838)
Steps:
1. Create a 3PM docker cluster
2. Check cluster status on PM1. master=PM1, slave=PM2, PM3
3. Create a database and a table, insert a row in PM1
4. Verify table gets replicated to PM2
5. Execute "docker container stop mcs1", wait 90 seconds
6. Execute "docker container start mcs1", wait 60 seconds
7. Check cluster status on PM1. master=PM1, slave=PM2, PM3
Yesterday, I noticed MaxScale had PM2 sat as the master
Today, MaxScale also set PM1 as the master (I don't know why such behavior today)
For this test, PM2 was expected to take over as the master
8. Create another table and inserted a row on PM1
9. The table did not get replicated to PM2 or PM3
10. "show slave status" on PM2 returned nothing
11. "show slave status" on PM3 did return status, and no error
PM3 slave status showed master log mariadb-bin.000002, position 4684
PM1 master status showed master log mariadb-bin.000004, position 568
is blocked by
MCOL-5306
Broken connections in mariadb while primary node down. failover related.
Closed
relates to
MCOL-5286
HA Failing when losing a node - restart secondary - pm3
Closed
mentioned in
Page Failed to load
Page Failed to load
Page Failed to load
Page Loading...
Page Loading...
Page Loading...
Page Loading...
Page Loading...
Page Loading...
Show 6 more links (6 mentioned in)
{"report":{"fcp":960.0999999046326,"ttfb":311.59999990463257,"pageVisibility":"visible","entityId":116295,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"ffc56bf5-6272-43f1-bcb9-342bcb27b068","navigationType":0,"readyForUser":1040.6999998092651,"redirectCount":0,"resourceLoadedEnd":992.5,"resourceLoadedStart":317.59999990463257,"resourceTiming":[{"duration":78.09999990463257,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":317.59999990463257,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":317.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":395.69999980926514,"responseStart":0,"secureConnectionStart":0},{"duration":78.09999990463257,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":317.90000009536743,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":317.90000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":396,"responseStart":0,"secureConnectionStart":0},{"duration":136.40000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":318.5,"connectEnd":318.5,"connectStart":318.5,"domainLookupEnd":318.5,"domainLookupStart":318.5,"fetchStart":318.5,"redirectEnd":0,"redirectStart":0,"requestStart":318.5,"responseEnd":454.90000009536743,"responseStart":454.90000009536743,"secureConnectionStart":318.5},{"duration":283.90000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":318.7999997138977,"connectEnd":318.7999997138977,"connectStart":318.7999997138977,"domainLookupEnd":318.7999997138977,"domainLookupStart":318.7999997138977,"fetchStart":318.7999997138977,"redirectEnd":0,"redirectStart":0,"requestStart":318.7999997138977,"responseEnd":602.6999998092651,"responseStart":602.6999998092651,"secureConnectionStart":318.7999997138977},{"duration":287.59999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":319.09999990463257,"connectEnd":319.09999990463257,"connectStart":319.09999990463257,"domainLookupEnd":319.09999990463257,"domainLookupStart":319.09999990463257,"fetchStart":319.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":319.09999990463257,"responseEnd":606.6999998092651,"responseStart":606.6999998092651,"secureConnectionStart":319.09999990463257},{"duration":288,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":319.2999997138977,"connectEnd":319.2999997138977,"connectStart":319.2999997138977,"domainLookupEnd":319.2999997138977,"domainLookupStart":319.2999997138977,"fetchStart":319.2999997138977,"redirectEnd":0,"redirectStart":0,"requestStart":319.2999997138977,"responseEnd":607.2999997138977,"responseStart":607.2999997138977,"secureConnectionStart":319.2999997138977},{"duration":288.2999997138977,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":319.40000009536743,"connectEnd":319.40000009536743,"connectStart":319.40000009536743,"domainLookupEnd":319.40000009536743,"domainLookupStart":319.40000009536743,"fetchStart":319.40000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":319.40000009536743,"responseEnd":607.6999998092651,"responseStart":607.6999998092651,"secureConnectionStart":319.40000009536743},{"duration":289.30000019073486,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":319.59999990463257,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":319.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":608.9000000953674,"responseStart":0,"secureConnectionStart":0},{"duration":288.90000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":319.69999980926514,"connectEnd":319.69999980926514,"connectStart":319.69999980926514,"domainLookupEnd":319.69999980926514,"domainLookupStart":319.69999980926514,"fetchStart":319.69999980926514,"redirectEnd":0,"redirectStart":0,"requestStart":319.69999980926514,"responseEnd":608.5999999046326,"responseStart":608.5999999046326,"secureConnectionStart":319.69999980926514},{"duration":293.7999997138977,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":319.90000009536743,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":319.90000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":613.6999998092651,"responseStart":0,"secureConnectionStart":0},{"duration":289.19999980926514,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":320.09999990463257,"connectEnd":320.09999990463257,"connectStart":320.09999990463257,"domainLookupEnd":320.09999990463257,"domainLookupStart":320.09999990463257,"fetchStart":320.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":320.09999990463257,"responseEnd":609.2999997138977,"responseStart":609.2999997138977,"secureConnectionStart":320.09999990463257},{"duration":670.4000000953674,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":321.5,"connectEnd":321.5,"connectStart":321.5,"domainLookupEnd":321.5,"domainLookupStart":321.5,"fetchStart":321.5,"redirectEnd":0,"redirectStart":0,"requestStart":321.5,"responseEnd":991.9000000953674,"responseStart":991.9000000953674,"secureConnectionStart":321.5},{"duration":670.9000000953674,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":321.59999990463257,"connectEnd":321.59999990463257,"connectStart":321.59999990463257,"domainLookupEnd":321.59999990463257,"domainLookupStart":321.59999990463257,"fetchStart":321.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":321.59999990463257,"responseEnd":992.5,"responseStart":992.5,"secureConnectionStart":321.59999990463257},{"duration":333.90000009536743,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":624,"connectEnd":624,"connectStart":624,"domainLookupEnd":624,"domainLookupStart":624,"fetchStart":624,"redirectEnd":0,"redirectStart":0,"requestStart":624,"responseEnd":957.9000000953674,"responseStart":957.9000000953674,"secureConnectionStart":624},{"duration":211,"initiatorType":"script","name":"https://www.google-analytics.com/analytics.js","startTime":936.6999998092651,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":936.6999998092651,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1147.6999998092651,"responseStart":0,"secureConnectionStart":0}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":152,"responseStart":311,"responseEnd":315,"domLoading":315,"domInteractive":1187,"domContentLoadedEventStart":1187,"domContentLoadedEventEnd":1236,"domComplete":1397,"loadEventStart":1397,"loadEventEnd":1398,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1157.1999998092651},{"name":"bigPipe.sidebar-id.end","time":1158.2999997138977},{"name":"bigPipe.activity-panel-pipe-id.start","time":1158.5},{"name":"bigPipe.activity-panel-pipe-id.end","time":1160.4000000953674},{"name":"activityTabFullyLoaded","time":1252.6999998092651}],"measures":[],"correlationId":"31b5026f6a05ab","effectiveType":"4g","downlink":9.3,"rtt":0,"serverDuration":102,"dbReadsTimeInMs":15,"dbConnsTimeInMs":25,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Build verified: 22.08.7
engine: e243a5332b8613ce0e370a503461990fefc24fce
server: d3049350bb5c61340f5a7518b155d3c9dacdcb33
buildNo: 6202
Executed test case in mustest, test advance.a000_failover.test
Steps performed.
echo Checking MaxScale status......
echo Checking ColumnStore status on mcs1......
echo Running sanity test on mcs1......
echo Checking ColumnStore status on mcs1......
echo Stopping node mcs1......
echo Checking MaxScale status......
echo Checking ColumnStore status on mcs2......
echo Starting node mcs1......
echo Checking MaxScale status......
echo Checking ColumnStore status on mcs1......
echo Create a 1g DBT2 database on mcs2......
echo Check row counts on mcs1 for replication......
echo Drop test database......
echo Ending of test.
Test result, output from the test, has been attached.