With wsrep_sst_method=mariabackup the SST/IST process fails at this stage:
WSREP_SST: [INFO] mariabackup SST started on joiner (20230613 09:04:17.N)
|
WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20230613 09:04:17.N)
|
WSREP_SST: [INFO] Streaming with mbstream (20230613 09:04:18.N)
|
WSREP_SST: [INFO] Using socat as streamer (20230613 09:04:18.N)
|
|
Usage: timeout [--signal sig | -s sig] [--preserve-status] [--kill-after time | -k time] [--foreground] <duration> <command> <arg ...>
|
WSREP_SST: [INFO] Evaluating timeout -s9 300 socat -u TCP-LISTEN:4444,reuseaddr stdio | '/usr/local//bin/mbstream' -x; RC=( ${PIPESTATUS[@]} )
|
(20230613 09:04:18.N)
|
|
2023-06-13 9:04:18 2 [Note] WSREP: ####### IST uuid:7f4bd4bc-73ee-11ed-8cc1-77200a87198f f: 203400, l: 203407, STRv: 3
|
2023-06-13 9:04:18 2 [Note] WSREP: IST receiver addr using tcp://192.168.1.1:4568
|
2023-06-13 9:04:18 2 [Note] WSREP: Prepared IST receiver for 203400-203407, listening at: tcp://192.168.1.1:4568
|
2023-06-13 9:04:18 0 [Note] WSREP: Member 1.0 (galera1) requested state transfer from '*any*'. Selected 0.0 (galera3)(SYNCED) as don
|
or.
|
2023-06-13 9:04:18 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 203407)
|
2023-06-13 9:04:18 2 [Note] WSREP: Requesting state transfer: success, donor: 0
|
2023-06-13 9:04:18 0 [Warning] WSREP: 0.0 (galera3): State transfer to 1.0 (galera1) failed: -2 (No such file or directory)
|
2023-06-13 9:04:18 0 [ERROR] WSREP: /wrkdirs/usr/ports/databases/galera26/work/galera-release_26.4.14/gcs/src/gcs_group.cpp:gcs_group_handle_j
|
oin_msg():1172: Will never receive state. Need to abort.
|
2023-06-13 9:04:18 0 [Note] WSREP: gcomm: terminating thread
|
2023-06-13 9:04:18 0 [Note] WSREP: gcomm: joining thread
|
2023-06-13 9:04:18 0 [Note] WSREP: gcomm: closing backend
|
2023-06-13 9:04:18 0 [Note] WSREP: view(view_id(NON_PRIM,76dfdac7-93fe,53) memb {
|
82d2bc20-a998,0
|
} joined {
|
} left {
|
} partitioned {
|
76dfdac7-93fe,0
|
8f298c44-9cca,0
|
})
|
2023-06-13 9:04:18 0 [Note] WSREP: PC protocol downgrade 1 -> 0
|
2023-06-13 9:04:18 0 [Note] WSREP: view((empty))
|
2023-06-13 9:04:18 0 [Note] WSREP: gcomm: closed
|
2023-06-13 9:04:18 0 [Note] WSREP: mariadbd: Terminated.
|
The timeout command seems to expect a different call on FreeBSD systems than on Linux.
{"report":{"fcp":1035.3000001907349,"ttfb":288.30000019073486,"pageVisibility":"visible","entityId":122695,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"51767c41-ddda-4138-84ad-b19899802bfa","navigationType":0,"readyForUser":1129,"redirectCount":0,"resourceLoadedEnd":1167.2000002861023,"resourceLoadedStart":294.09999990463257,"resourceTiming":[{"duration":253.2000002861023,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":294.09999990463257,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":294.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":547.3000001907349,"responseStart":0,"secureConnectionStart":0},{"duration":253.09999990463257,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":294.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":294.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":547.5999999046326,"responseStart":0,"secureConnectionStart":0},{"duration":267.1000003814697,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":294.59999990463257,"connectEnd":294.59999990463257,"connectStart":294.59999990463257,"domainLookupEnd":294.59999990463257,"domainLookupStart":294.59999990463257,"fetchStart":294.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":294.59999990463257,"responseEnd":561.7000002861023,"responseStart":561.7000002861023,"secureConnectionStart":294.59999990463257},{"duration":384.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":294.80000019073486,"connectEnd":294.80000019073486,"connectStart":294.80000019073486,"domainLookupEnd":294.80000019073486,"domainLookupStart":294.80000019073486,"fetchStart":294.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":294.80000019073486,"responseEnd":679.3000001907349,"responseStart":679.3000001907349,"secureConnectionStart":294.80000019073486},{"duration":388.2000002861023,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":295.09999990463257,"connectEnd":295.09999990463257,"connectStart":295.09999990463257,"domainLookupEnd":295.09999990463257,"domainLookupStart":295.09999990463257,"fetchStart":295.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":295.09999990463257,"responseEnd":683.3000001907349,"responseStart":683.3000001907349,"secureConnectionStart":295.09999990463257},{"duration":388.40000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":295.30000019073486,"connectEnd":295.30000019073486,"connectStart":295.30000019073486,"domainLookupEnd":295.30000019073486,"domainLookupStart":295.30000019073486,"fetchStart":295.30000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":295.30000019073486,"responseEnd":683.7000002861023,"responseStart":683.7000002861023,"secureConnectionStart":295.30000019073486},{"duration":388.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":295.5,"connectEnd":295.5,"connectStart":295.5,"domainLookupEnd":295.5,"domainLookupStart":295.5,"fetchStart":295.5,"redirectEnd":0,"redirectStart":0,"requestStart":295.5,"responseEnd":684,"responseStart":684,"secureConnectionStart":295.5},{"duration":409,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":295.59999990463257,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":295.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":704.5999999046326,"responseStart":0,"secureConnectionStart":0},{"duration":388.69999980926514,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":295.80000019073486,"connectEnd":295.80000019073486,"connectStart":295.80000019073486,"domainLookupEnd":295.80000019073486,"domainLookupStart":295.80000019073486,"fetchStart":295.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":295.80000019073486,"responseEnd":684.5,"responseStart":684.5,"secureConnectionStart":295.80000019073486},{"duration":408.80000019073486,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":295.90000009536743,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":295.90000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":704.7000002861023,"responseStart":0,"secureConnectionStart":0},{"duration":389.1000003814697,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":296.09999990463257,"connectEnd":296.09999990463257,"connectStart":296.09999990463257,"domainLookupEnd":296.09999990463257,"domainLookupStart":296.09999990463257,"fetchStart":296.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":296.09999990463257,"responseEnd":685.2000002861023,"responseStart":685.2000002861023,"secureConnectionStart":296.09999990463257},{"duration":554.0999999046326,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":301.80000019073486,"connectEnd":301.80000019073486,"connectStart":301.80000019073486,"domainLookupEnd":301.80000019073486,"domainLookupStart":301.80000019073486,"fetchStart":301.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":301.80000019073486,"responseEnd":855.9000000953674,"responseStart":855.9000000953674,"secureConnectionStart":301.80000019073486},{"duration":835.1999998092651,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":301.80000019073486,"connectEnd":301.80000019073486,"connectStart":301.80000019073486,"domainLookupEnd":301.80000019073486,"domainLookupStart":301.80000019073486,"fetchStart":301.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":301.80000019073486,"responseEnd":1137,"responseStart":1137,"secureConnectionStart":301.80000019073486},{"duration":142.40000009536743,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":716.5999999046326,"connectEnd":716.5999999046326,"connectStart":716.5999999046326,"domainLookupEnd":716.5999999046326,"domainLookupStart":716.5999999046326,"fetchStart":716.5999999046326,"redirectEnd":0,"redirectStart":0,"requestStart":716.5999999046326,"responseEnd":859,"responseStart":859,"secureConnectionStart":716.5999999046326},{"duration":176.30000019073486,"initiatorType":"link","name":"https://jira.mariadb.org/s/d5715adaadd168a9002b108b2b039b50-CDN/lu2cib/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/css/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":990.9000000953674,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":990.9000000953674,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1167.2000002861023,"responseStart":0,"secureConnectionStart":0},{"duration":169.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/e65b778d185daf5aee24936755b43da6/_/download/contextbatch/js/browser-metrics-plugin.contrib,-_super,-project.issue.navigator,-jira.view.issue,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":991.9000000953674,"connectEnd":991.9000000953674,"connectStart":991.9000000953674,"domainLookupEnd":991.9000000953674,"domainLookupStart":991.9000000953674,"fetchStart":991.9000000953674,"redirectEnd":0,"redirectStart":0,"requestStart":991.9000000953674,"responseEnd":1161.4000000953674,"responseStart":1161.4000000953674,"secureConnectionStart":991.9000000953674},{"duration":173.2999997138977,"initiatorType":"script","name":"https://jira.mariadb.org/s/097ae97cb8fbec7d6ea4bbb1f26955b9-CDN/lu2cib/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/js/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":992.2000002861023,"connectEnd":992.2000002861023,"connectStart":992.2000002861023,"domainLookupEnd":992.2000002861023,"domainLookupStart":992.2000002861023,"fetchStart":992.2000002861023,"redirectEnd":0,"redirectStart":0,"requestStart":992.2000002861023,"responseEnd":1165.5,"responseStart":1165.5,"secureConnectionStart":992.2000002861023},{"duration":189.2999997138977,"initiatorType":"script","name":"https://www.google-analytics.com/analytics.js","startTime":1028.7000002861023,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":1028.7000002861023,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1218,"responseStart":0,"secureConnectionStart":0}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":118,"responseStart":288,"responseEnd":298,"domLoading":292,"domInteractive":1238,"domContentLoadedEventStart":1238,"domContentLoadedEventEnd":1281,"domComplete":1500,"loadEventStart":1501,"loadEventEnd":1501,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1219.2000002861023},{"name":"bigPipe.sidebar-id.end","time":1220.5999999046326},{"name":"bigPipe.activity-panel-pipe-id.start","time":1220.7000002861023},{"name":"bigPipe.activity-panel-pipe-id.end","time":1222.7000002861023},{"name":"activityTabFullyLoaded","time":1301.9000000953674}],"measures":[],"correlationId":"22066b4ef18a35","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":101,"dbReadsTimeInMs":10,"dbConnsTimeInMs":20,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Is this the right patch?
diff --git a/scripts/wsrep_sst_mariabackup.sh b/scripts/wsrep_sst_mariabackup.sh
index d6334052f24..54e92bfba7b 100644
--- a/scripts/wsrep_sst_mariabackup.sh
+++ b/scripts/wsrep_sst_mariabackup.sh
@@ -799,9 +799,9 @@ recv_joiner()
if [ $tmt -gt 0 ]; then
if [ -n "$(commandex timeout)" ]; then
if timeout --help | grep -qw -F -- '-k'; then
- ltcmd="timeout -k $(( tmt+10 )) $tmt $tcmd"
+ ltcmd="timeout -k $(( tmt+10 ))s ${tmt}s $tcmd"
else
- ltcmd="timeout -s9 $tmt $tcmd"
+ ltcmd="timeout -s 9 $tmt $tcmd"
fi
fi
fi