A Galera cluster uses encryption for SST with the following configuration:
[sst]
|
encrypt=3
|
tkey=/path/to/key.pem
|
tcert=/path/to/cert.pem
|
tca=/path/to/ca.pem
|
Upgrading a node to 10.1.28 (in a Galera cluster of 10.1.23 nodes) fails with:
2017-11-04 18:23:17 140462627223296 [Note] WSREP: (3804918b, 'tcp://0.0.0.0:4567') turning message relay requesting off
|
xb_stream_read_chunk(): wrong chunk magic at offset 0x0.
|
WSREP_SST: [ERROR] Error while getting data from donor node: exit codes: 137 1 (20171104 18:24:55.419)
|
WSREP_SST: [ERROR] Cleanup after exit with status:32 (20171104 18:24:55.421)
|
One explication is that the joiner doesn't expect an encrypted stream, poining at a problem with the configuration under [sst] section.
After some investigation I restricted the problem to the wsrep_sst_xtrabackup-v2's function parse_cnf() which was moved to wsrep_sst_common.
In 10.1.23 parse_cnf() is in wsrep_sst_xtrabackup-v2 and it's:
parse_cnf()
|
{
|
local group=$1
|
local var=$2
|
# print the default settings for given group using my_print_default.
|
# normalize the variable names specified in cnf file (user can use _ or - for example log-bin or log_bin)
|
# then grep for needed variable
|
# finally get the variable value (if variables has been specified multiple time use the last value only)
|
reval=$($MY_PRINT_DEFAULTS $group | awk -F= '{if ($1 ~ /_/) { gsub(/_/,"-",$1); print $1"="$2 } else { print $0 }}' | grep -- "--$var=" | cut -d= -f2- | tail -1)
|
if [[ -z $reval ]];then
|
[[ -n $3 ]] && reval=$3
|
fi
|
echo $reval
|
}
|
In 10.1.28 it's moved to wsrep_sst_common and it's:
parse_cnf()
|
{
|
local group=$1
|
local var=$2
|
local reval=""
|
|
# print the default settings for given group using my_print_default.
|
# normalize the variable names specified in cnf file (user can use _ or - for example log-bin or log_bin)
|
# then grep for needed variable
|
# finally get the variable value (if variables has been specified multiple time use the last value only)
|
|
# look in group+suffix
|
if [[ -n $WSREP_SST_OPT_CONF_SUFFIX ]]; then
|
reval=$($MY_PRINT_DEFAULTS -c $WSREP_SST_OPT_CONF "${group}${WSREP_SST_OPT_CONF_SUFFIX}" | awk -F= '{if ($1 ~ /_/) { gsub(/_/,"-",$1); print $1"="$2 } else { print $0 }}' | grep -- "--$var=" | cut -d= -f2- | tail -1)
|
fi
|
|
# look in group
|
if [[ -z $reval ]]; then
|
reval=$($MY_PRINT_DEFAULTS -c $WSREP_SST_OPT_CONF $group | awk -F= '{if ($1 ~ /_/) { gsub(/_/,"-",$1); print $1"="$2 } else { print $0 }}' | grep -- "--$var=" | cut -d= -f2- | tail -1)
|
fi
|
|
# use default if we haven't found a value
|
if [[ -z $reval ]]; then
|
[[ -n $3 ]] && reval=$3
|
fi
|
echo $reval
|
}
|
|
Using wsrep_sst_common and wsrep_sst_xtrabackup-v2 from version 10.1.23 on 10.1.28 fixes the problem and the node succesfully joins.
- relates to
-
MDEV-15254
10.1.31 does not join an existing cluster with SST xtrabackup-v2
-
-
Closed
{"report":{"fcp":1425.2000000029802,"ttfb":452.70000000298023,"pageVisibility":"visible","entityId":64167,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"b2da431e-c3a6-4999-8bbc-69ca9b3363cb","navigationType":0,"readyForUser":1511.3999999985099,"redirectCount":0,"resourceLoadedEnd":1766.2000000029802,"resourceLoadedStart":458.29999999701977,"resourceTiming":[{"duration":475,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bv2/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":458.29999999701977,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":458.29999999701977,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":933.2999999970198,"responseStart":0,"secureConnectionStart":0},{"duration":475.20000000298023,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bv2/820016/12ta74/2380add21a9a1006587582385952de73/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":458.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":458.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":933.7000000029802,"responseStart":0,"secureConnectionStart":0},{"duration":494.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/e9b27a47da5fb0f74a35acd57e9847fb-CDN/lu2bv2/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":458.70000000298023,"connectEnd":458.70000000298023,"connectStart":458.70000000298023,"domainLookupEnd":458.70000000298023,"domainLookupStart":458.70000000298023,"fetchStart":458.70000000298023,"redirectEnd":0,"redirectStart":0,"requestStart":458.70000000298023,"responseEnd":953.2000000029802,"responseStart":953.2000000029802,"secureConnectionStart":458.70000000298023},{"duration":579.8999999985099,"initiatorType":"script","name":"https://jira.mariadb.org/s/c32eb0da7ad9831253f8397e6cc26afd-CDN/lu2bv2/820016/12ta74/2380add21a9a1006587582385952de73/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":458.8999999985099,"connectEnd":458.8999999985099,"connectStart":458.8999999985099,"domainLookupEnd":458.8999999985099,"domainLookupStart":458.8999999985099,"fetchStart":458.8999999985099,"redirectEnd":0,"redirectStart":0,"requestStart":458.8999999985099,"responseEnd":1038.7999999970198,"responseStart":1038.7999999970198,"secureConnectionStart":458.8999999985099},{"duration":583.2000000029802,"initiatorType":"script","name":"https://jira.mariadb.org/s/bc0bcb146314416123c992714ee00ff7-CDN/lu2bv2/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":459,"connectEnd":459,"connectStart":459,"domainLookupEnd":459,"domainLookupStart":459,"fetchStart":459,"redirectEnd":0,"redirectStart":0,"requestStart":459,"responseEnd":1042.2000000029802,"responseStart":1042.2000000029802,"secureConnectionStart":459},{"duration":583.4000000059605,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":459.29999999701977,"connectEnd":459.29999999701977,"connectStart":459.29999999701977,"domainLookupEnd":459.29999999701977,"domainLookupStart":459.29999999701977,"fetchStart":459.29999999701977,"redirectEnd":0,"redirectStart":0,"requestStart":459.29999999701977,"responseEnd":1042.7000000029802,"responseStart":1042.7000000029802,"secureConnectionStart":459.29999999701977},{"duration":583.6000000014901,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":459.5,"connectEnd":459.5,"connectStart":459.5,"domainLookupEnd":459.5,"domainLookupStart":459.5,"fetchStart":459.5,"redirectEnd":0,"redirectStart":0,"requestStart":459.5,"responseEnd":1043.1000000014901,"responseStart":1043.1000000014901,"secureConnectionStart":459.5},{"duration":642,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bv2/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":459.70000000298023,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":459.70000000298023,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1101.7000000029802,"responseStart":0,"secureConnectionStart":0},{"duration":589,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":459.79999999701977,"connectEnd":459.79999999701977,"connectStart":459.79999999701977,"domainLookupEnd":459.79999999701977,"domainLookupStart":459.79999999701977,"fetchStart":459.79999999701977,"redirectEnd":0,"redirectStart":0,"requestStart":459.79999999701977,"responseEnd":1048.7999999970198,"responseStart":1048.7999999970198,"secureConnectionStart":459.79999999701977},{"duration":641.8999999985099,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bv2/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":460,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":460,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1101.8999999985099,"responseStart":0,"secureConnectionStart":0},{"duration":589.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/719848dd97ebe0663199f49a3936487a-CDN/lu2bv2/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":460.20000000298023,"connectEnd":460.20000000298023,"connectStart":460.20000000298023,"domainLookupEnd":460.20000000298023,"domainLookupStart":460.20000000298023,"fetchStart":460.20000000298023,"redirectEnd":0,"redirectStart":0,"requestStart":460.20000000298023,"responseEnd":1049.7000000029802,"responseStart":1049.7000000029802,"secureConnectionStart":460.20000000298023},{"duration":1300.2999999970198,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":465.5,"connectEnd":465.5,"connectStart":465.5,"domainLookupEnd":465.5,"domainLookupStart":465.5,"fetchStart":465.5,"redirectEnd":0,"redirectStart":0,"requestStart":465.5,"responseEnd":1765.7999999970198,"responseStart":1765.7999999970198,"secureConnectionStart":465.5},{"duration":1300.6000000014901,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bv2/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":465.6000000014901,"connectEnd":465.6000000014901,"connectStart":465.6000000014901,"domainLookupEnd":465.6000000014901,"domainLookupStart":465.6000000014901,"fetchStart":465.6000000014901,"redirectEnd":0,"redirectStart":0,"requestStart":465.6000000014901,"responseEnd":1766.2000000029802,"responseStart":1766.2000000029802,"secureConnectionStart":465.6000000014901},{"duration":335.1000000014901,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":1114.1000000014901,"connectEnd":1114.1000000014901,"connectStart":1114.1000000014901,"domainLookupEnd":1114.1000000014901,"domainLookupStart":1114.1000000014901,"fetchStart":1114.1000000014901,"redirectEnd":0,"redirectStart":0,"requestStart":1114.1000000014901,"responseEnd":1449.2000000029802,"responseStart":1449.2000000029802,"secureConnectionStart":1114.1000000014901}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":119,"responseStart":452,"responseEnd":460,"domLoading":456,"domInteractive":1789,"domContentLoadedEventStart":1789,"domContentLoadedEventEnd":1832,"domComplete":3490,"loadEventStart":3490,"loadEventEnd":3492,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1769.2999999970198},{"name":"bigPipe.sidebar-id.end","time":1770.2000000029802},{"name":"bigPipe.activity-panel-pipe-id.start","time":1770.2999999970198},{"name":"bigPipe.activity-panel-pipe-id.end","time":1772.8999999985099},{"name":"activityTabFullyLoaded","time":1840.1000000014901}],"measures":[],"correlationId":"cd65e063357027","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":267,"dbReadsTimeInMs":67,"dbConnsTimeInMs":76,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}