galera_3nodes.galera_ipv6_rsync failed on BB 10.2, BB 10.3, BB 10.4, and BB 10.5: "WSREP_SST: [ERROR] rsync daemon port '16008' has been taken".
stdio.log:
10.2.34 0be70a1b773ce66ef1803fcce19522fd9c60c07d
|
galera_3nodes.galera_ipv6_rsync 'innodb' w1 [ fail ]
|
Test ended at 2020-08-25 13:32:41
|
|
CURRENT_TEST: galera_3nodes.galera_ipv6_mariabackup
|
CURRENT_TEST: galera_3nodes.galera_ipv6_mariabackup_section
|
CURRENT_TEST: galera_3nodes.galera_ipv6_mariabackup
|
CURRENT_TEST: galera_3nodes.galera_ipv6_mysqldump
|
CURRENT_TEST: galera_3nodes.galera_ipv6_mariabackup_section
|
CURRENT_TEST: galera_3nodes.galera_ipv6_rsync
|
|
|
Failed to start mysqld.2
|
|
|
- skipping '/dev/shm/var/1/log/galera_3nodes.galera_ipv6_rsync-innodb/'
|
|
Retrying test galera_3nodes.galera_ipv6_rsync, attempt(2/3)...
|
|
***Warnings generated in error logs during shutdown after running tests: galera_3nodes.galera_ipv6_rsync
|
|
WSREP_SST: [ERROR] rsync daemon port '16008' has been taken (20200825 13:32:32.184)
|
2020-08-25 13:32:32 139949739325184 [ERROR] WSREP: Failed to read 'ready <addr>' from: wsrep_sst_rsync --role 'joiner' --address '[::1]:16008' --datadir '/dev/shm/var/1/mysqld.2/data/' --defaults-file '/dev/shm/var/1/my.cnf' --defaults-group-suffix '.2' --parent '29037' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.2 --defaults-file=/dev/shm/var/1/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --bind-address=:: --core-file --loose-debug-sync-timeout=300
|
2020-08-25 13:32:32 139949739325184 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'joiner' --address '[::1]:16008' --datadir '/dev/shm/var/1/mysqld.2/data/' --defaults-file '/dev/shm/var/1/my.cnf' --defaults-group-suffix '.2' --parent '29037' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.2 --defaults-file=/dev/shm/var/1/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --bind-address=:: --core-file --loose-debug-sync-timeout=300: 16 (Device or resource busy)
|
2020-08-25 13:32:32 139949973714688 [ERROR] WSREP: Failed to prepare for 'rsync' SST. Unrecoverable.
|
2020-08-25 13:32:32 139949973714688 [ERROR] Aborting
|
Warning: Memory not freed: 1427624
|
WSREP_SST: [ERROR] rsync daemon port '16011' has been taken (20200825 13:32:32.183)
|
2020-08-25 13:32:32 140613823465216 [ERROR] WSREP: Failed to read 'ready <addr>' from: wsrep_sst_rsync --role 'joiner' --address '[::1]:16011' --datadir '/dev/shm/var/1/mysqld.3/data/' --defaults-file '/dev/shm/var/1/my.cnf' --defaults-group-suffix '.3' --parent '29039' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.3 --defaults-file=/dev/shm/var/1/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --bind-address=:: --core-file --loose-debug-sync-timeout=300
|
2020-08-25 13:32:32 140613823465216 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'joiner' --address '[::1]:16011' --datadir '/dev/shm/var/1/mysqld.3/data/' --defaults-file '/dev/shm/var/1/my.cnf' --defaults-group-suffix '.3' --parent '29039' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.3 --defaults-file=/dev/shm/var/1/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --bind-address=:: --core-file --loose-debug-sync-timeout=300: 16 (Device or resource busy)
|
2020-08-25 13:32:32 140614080018176 [ERROR] WSREP: Failed to prepare for 'rsync' SST. Unrecoverable.
|
2020-08-25 13:32:32 140614080018176 [ERROR] Aborting
|
Warning: Memory not freed: 1427624
|
|
wsrep.wsrep-recover-v25 'binlogoff,innodb' w2 [ skipped ] debug_sync is not available
|
worker[2] > Restart [mysqld.1 - pid: 29555, winpid: 29555] - using different config file
|
wsrep.wsrep_rpl 'innodb,row' w2 [ pass ] 1046
|
worker[2] > Restart [mysqld.1 - pid: 29602, winpid: 29602] - running with different options '--binlog-format=statement --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --log-bin=master-bin' != '--binlog-format=row --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --log-bin=master-bin'
|
worker[2] > Restart [mysqld.2 - pid: 29604, winpid: 29604] - running with different options '--binlog-format=statement --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --log-bin=slave-bin' != '--binlog-format=row --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --log-bin=slave-bin'
|
- duplicates
-
MDEV-21770
`galera_3nodes.galera_ipv6_mariabackup` fails
-
-
Closed
Transition |
Time In Source Status |
Execution Times |
Open |
|
In Progress |
|
1d 12h 34m
|
1
|
In Progress |
|
Closed |
|
55d 2h 37m
|
1
|
{"report":{"fcp":724.6000001430511,"ttfb":176.10000014305115,"pageVisibility":"visible","entityId":91137,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":1,"journeyId":"b82fc3d5-5dcc-422d-94ba-1f30429e74c5","navigationType":0,"readyForUser":800.2999999523163,"redirectCount":0,"resourceLoadedEnd":848.5,"resourceLoadedStart":181.20000004768372,"resourceTiming":[{"duration":7.200000047683716,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":181.20000004768372,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":181.20000004768372,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":188.40000009536743,"responseStart":0,"secureConnectionStart":0},{"duration":8,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":181.60000014305115,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":181.60000014305115,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":189.60000014305115,"responseStart":0,"secureConnectionStart":0},{"duration":64.79999995231628,"initiatorType":"script","name":"https://jira.mariadb.org/s/fbf975c0cce4b1abf04784eeae9ba1f4-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":181.70000004768372,"connectEnd":181.70000004768372,"connectStart":181.70000004768372,"domainLookupEnd":181.70000004768372,"domainLookupStart":181.70000004768372,"fetchStart":181.70000004768372,"redirectEnd":0,"redirectStart":0,"requestStart":181.70000004768372,"responseEnd":246.5,"responseStart":246.5,"secureConnectionStart":181.70000004768372},{"duration":146.90000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/94c15bff32baef80f4096a08aceae8bc-CDN/lu2bu7/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":181.79999995231628,"connectEnd":181.79999995231628,"connectStart":181.79999995231628,"domainLookupEnd":181.79999995231628,"domainLookupStart":181.79999995231628,"fetchStart":181.79999995231628,"redirectEnd":0,"redirectStart":0,"requestStart":181.79999995231628,"responseEnd":328.7000000476837,"responseStart":328.7000000476837,"secureConnectionStart":181.79999995231628},{"duration":143.20000004768372,"initiatorType":"script","name":"https://jira.mariadb.org/s/099b33461394b8015fc36c0a4b96e19f-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":181.79999995231628,"connectEnd":181.79999995231628,"connectStart":181.79999995231628,"domainLookupEnd":181.79999995231628,"domainLookupStart":181.79999995231628,"fetchStart":181.79999995231628,"redirectEnd":0,"redirectStart":0,"requestStart":181.79999995231628,"responseEnd":325,"responseStart":325,"secureConnectionStart":181.79999995231628},{"duration":147.29999995231628,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":181.90000009536743,"connectEnd":181.90000009536743,"connectStart":181.90000009536743,"domainLookupEnd":181.90000009536743,"domainLookupStart":181.90000009536743,"fetchStart":181.90000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":181.90000009536743,"responseEnd":329.2000000476837,"responseStart":329.2000000476837,"secureConnectionStart":181.90000009536743},{"duration":147.39999985694885,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":182.10000014305115,"connectEnd":182.10000014305115,"connectStart":182.10000014305115,"domainLookupEnd":182.10000014305115,"domainLookupStart":182.10000014305115,"fetchStart":182.10000014305115,"redirectEnd":0,"redirectStart":0,"requestStart":182.10000014305115,"responseEnd":329.5,"responseStart":329.5,"secureConnectionStart":182.10000014305115},{"duration":147.70000004768372,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bu7/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":182.20000004768372,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":182.20000004768372,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":329.90000009536743,"responseStart":0,"secureConnectionStart":0},{"duration":147.60000014305115,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":182.29999995231628,"connectEnd":182.29999995231628,"connectStart":182.29999995231628,"domainLookupEnd":182.29999995231628,"domainLookupStart":182.29999995231628,"fetchStart":182.29999995231628,"redirectEnd":0,"redirectStart":0,"requestStart":182.29999995231628,"responseEnd":329.90000009536743,"responseStart":329.90000009536743,"secureConnectionStart":182.29999995231628},{"duration":147.89999985694885,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":182.40000009536743,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":182.40000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":330.2999999523163,"responseStart":0,"secureConnectionStart":0},{"duration":147.89999985694885,"initiatorType":"script","name":"https://jira.mariadb.org/s/3339d87fa2538a859872f2df449bf8d0-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":182.60000014305115,"connectEnd":182.60000014305115,"connectStart":182.60000014305115,"domainLookupEnd":182.60000014305115,"domainLookupStart":182.60000014305115,"fetchStart":182.60000014305115,"redirectEnd":0,"redirectStart":0,"requestStart":182.60000014305115,"responseEnd":330.5,"responseStart":330.5,"secureConnectionStart":182.60000014305115},{"duration":421.90000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":188.5,"connectEnd":188.5,"connectStart":188.5,"domainLookupEnd":188.5,"domainLookupStart":188.5,"fetchStart":188.5,"redirectEnd":0,"redirectStart":0,"requestStart":188.5,"responseEnd":610.4000000953674,"responseStart":610.4000000953674,"secureConnectionStart":188.5},{"duration":433,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":188.60000014305115,"connectEnd":188.60000014305115,"connectStart":188.60000014305115,"domainLookupEnd":188.60000014305115,"domainLookupStart":188.60000014305115,"fetchStart":188.60000014305115,"redirectEnd":0,"redirectStart":0,"requestStart":188.60000014305115,"responseEnd":621.6000001430511,"responseStart":621.6000001430511,"secureConnectionStart":188.60000014305115},{"duration":151,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":467.7999999523163,"connectEnd":467.7999999523163,"connectStart":467.7999999523163,"domainLookupEnd":467.7999999523163,"domainLookupStart":467.7999999523163,"fetchStart":467.7999999523163,"redirectEnd":0,"redirectStart":0,"requestStart":467.7999999523163,"responseEnd":618.7999999523163,"responseStart":618.7999999523163,"secureConnectionStart":467.7999999523163},{"duration":2.4000000953674316,"initiatorType":"script","name":"https://www.google-analytics.com/analytics.js","startTime":648,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":648,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":650.4000000953674,"responseStart":0,"secureConnectionStart":0},{"duration":122.29999995231628,"initiatorType":"link","name":"https://jira.mariadb.org/s/d5715adaadd168a9002b108b2b039b50-CDN/lu2bu7/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/css/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":726.2000000476837,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":726.2000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":848.5,"responseStart":0,"secureConnectionStart":0},{"duration":152.09999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/e65b778d185daf5aee24936755b43da6/_/download/contextbatch/js/browser-metrics-plugin.contrib,-_super,-project.issue.navigator,-jira.view.issue,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":727.1000001430511,"connectEnd":727.1000001430511,"connectStart":727.1000001430511,"domainLookupEnd":727.1000001430511,"domainLookupStart":727.1000001430511,"fetchStart":727.1000001430511,"redirectEnd":0,"redirectStart":0,"requestStart":727.1000001430511,"responseEnd":879.2000000476837,"responseStart":879.2000000476837,"secureConnectionStart":727.1000001430511},{"duration":164.90000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/f51ef5507eea4c158f257c66c93b2a3f-CDN/lu2bu7/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/js/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":727.5,"connectEnd":727.5,"connectStart":727.5,"domainLookupEnd":727.5,"domainLookupStart":727.5,"fetchStart":727.5,"redirectEnd":0,"redirectStart":0,"requestStart":727.5,"responseEnd":892.4000000953674,"responseStart":892.4000000953674,"secureConnectionStart":727.5}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":37,"responseStart":176,"responseEnd":187,"domLoading":180,"domInteractive":861,"domContentLoadedEventStart":861,"domContentLoadedEventEnd":903,"domComplete":1193,"loadEventStart":1193,"loadEventEnd":1193,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":839.2000000476837},{"name":"bigPipe.sidebar-id.end","time":839.9000000953674},{"name":"bigPipe.activity-panel-pipe-id.start","time":840.1000001430511},{"name":"bigPipe.activity-panel-pipe-id.end","time":841.1000001430511},{"name":"activityTabFullyLoaded","time":921.9000000953674}],"measures":[],"correlationId":"779569aa4e3952","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":80,"dbReadsTimeInMs":17,"dbConnsTimeInMs":24,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}