If you have a custom InnoDB system tablespace defined (i.e. not ibdata1) and if you also have a custom undo tablespace defined, then mariabackup incorrectly tries to open ibdata1 in addition to the custom InnoDB system tablespace.
For example, let's say that you have the following configuration file:
[mariadb-10.2]
|
log_error=mysqld.err
|
datadir=/datadir
|
innodb_data_home_dir=/datadir/data
|
innodb_data_file_path = ib_mysql2_01:1G:autoextend
|
innodb_log_group_home_dir = /datadir/logs
|
innodb_undo_directory = /datadir/undologs
|
innodb_undo_log_truncate = 1
|
innodb_undo_logs = 128
|
innodb_undo_tablespaces = 32
|
And let's say that you try to backup the system with mariabackup in the following way:
mariabackup --backup --databases=mysql --no-lock --parallel=10 --compress --compress-threads=10 --user=root --target-dir=/home/ec2-user/backup
|
It will fail with the following error:
180918 18:26:12 Connecting to MySQL server host: localhost, user: root, password: not set, port: not set, socket: not set
|
Using server version 10.2.16-MariaDB
|
Loading encryption plugin
|
Encryption plugin parameter : '--aws_key_management_key_spec=AES_128'
|
Encryption plugin parameter : '--aws_key_management_log_level=Off'
|
Encryption plugin parameter : '--aws_key_management_master_key_id='
|
Encryption plugin parameter : '--aws_key_management_region='
|
Encryption plugin parameter : '--aws_key_management_request_timeout=0'
|
Encryption plugin parameter : '--aws_key_management_rotate_key=0'
|
mariabackup based on MariaDB server 10.2.16-MariaDB Linux (x86_64)
|
mariabackup: uses posix_fadvise().
|
mariabackup: cd to /datadir/data/
|
mariabackup: open files limit requested 0, set to 1024
|
mariabackup: using the following InnoDB configuration:
|
mariabackup: innodb_data_home_dir = /datadir/data
|
mariabackup: innodb_data_file_path = ib_mysql2_01:1G:autoextend
|
mariabackup: innodb_log_group_home_dir = /datadir/logs
|
2018-09-18 18:26:12 139964570237056 [Note] InnoDB: Number of pools: 1
|
2018-09-18 18:26:12 139964570237056 [ERROR] InnoDB: Operating system error number 2 in a file operation.
|
2018-09-18 18:26:12 139964570237056 [ERROR] InnoDB: The error means the system cannot find the path specified.
|
2018-09-18 18:26:12 139964570237056 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
|
2018-09-18 18:26:12 139964570237056 [ERROR] InnoDB: File /datadir/data/ibdata1: 'open' returned OS error 71. Cannot continue operation
|
180918 18:26:12 [ERROR] mysqld got signal 6 ;
|
This could be because you hit a bug. It is also possible that this binary
|
or one of the libraries it was linked against is corrupt, improperly built,
|
or misconfigured. This error can also be caused by malfunctioning hardware.
|
|
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
|
|
We will try our best to scrape up some info that will hopefully help
|
diagnose the problem, but since we have already crashed,
|
something is definitely wrong and this may fail.
|
|
Server version: 10.2.16-MariaDB
|
key_buffer_size=0
|
read_buffer_size=131072
|
max_used_connections=0
|
max_threads=1
|
thread_count=0
|
It is possible that mysqld could use up to
|
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 5422 K bytes of memory
|
Hope that's ok; if not, decrease some variables in the equation.
|
|
Thread pointer: 0x0
|
Attempting backtrace. You can use the following information to find out
|
where mysqld died. If you see no messages after this, something went
|
terribly wrong...
|
stack_bottom = 0x0 thread_stack 0x49000
|
addr2line: 'mariabackup': No such file
|
mariabackup(my_print_stacktrace+0x2e)[0x7f4c0b43391e]
|
mariabackup(handle_fatal_signal+0x355)[0x7f4c0af1ffb5]
|
sigaction.c:0(__restore_rt)[0x7f4c0a3ea370]
|
:0(__GI_raise)[0x7f4c089741d7]
|
:0(__GI_abort)[0x7f4c089758c8]
|
addr2line: 'mariabackup': No such file
|
mariabackup(+0x9aeff5)[0x7f4c0b1c7ff5]
|
mariabackup(+0x423bcf)[0x7f4c0ac3cbcf]
|
mariabackup(+0x424142)[0x7f4c0ac3d142]
|
mariabackup(+0x45cc8a)[0x7f4c0ac75c8a]
|
mariabackup(main+0x185)[0x7f4c0ac53365]
|
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f4c08960b35]
|
addr2line: 'mariabackup': No such file
|
mariabackup(+0x4539cd)[0x7f4c0ac6c9cd]
|
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
|
information that should help you find out what is causing the crash.
|
strace shows that mariabackup tries to open both the custom InnoDB system tablespace and the default system tablespace (i.e. ibdata1):
stat("/datadir/data/ib_mysql2_01", {st_mode=S_IFREG|0660, st_size=1073741824, ...}) = 0
|
access("/datadir/data/ib_mysql2_01", R_OK) = 0
|
open("/datadir/data/ib_mysql2_01", O_RDONLY|O_CLOEXEC) = 6
|
fstat(6, {st_mode=S_IFREG|0660, st_size=1073741824, ...}) = 0
|
mmap(NULL, 135168, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f4c0a61d000
|
pread64(6, "\230\267R\365\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\27\200\300\0\10\0\0\0\0\0\27"..., 65536, 0) = 65536
|
close(6) = 0
|
open("/datadir/data/ibdata1", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
|
- is caused by
-
MDEV-13561
Mariabackup is incompatible with retroactively created innodb_undo_tablespaces
-
-
Closed
{"report":{"fcp":1049.1000003814697,"ttfb":315,"pageVisibility":"visible","entityId":69857,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"360299e1-cae8-456f-a7b6-c594b1e34aec","navigationType":0,"readyForUser":1128.3000001907349,"redirectCount":0,"resourceLoadedEnd":1184.9000005722046,"resourceLoadedStart":321.1000003814697,"resourceTiming":[{"duration":234.89999961853027,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":321.1000003814697,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":321.1000003814697,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":556,"responseStart":0,"secureConnectionStart":0},{"duration":234.80000019073486,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":321.4000005722046,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":321.4000005722046,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":556.2000007629395,"responseStart":0,"secureConnectionStart":0},{"duration":298.8999996185303,"initiatorType":"script","name":"https://jira.mariadb.org/s/fbf975c0cce4b1abf04784eeae9ba1f4-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":321.6000003814697,"connectEnd":321.6000003814697,"connectStart":321.6000003814697,"domainLookupEnd":321.6000003814697,"domainLookupStart":321.6000003814697,"fetchStart":321.6000003814697,"redirectEnd":0,"redirectStart":0,"requestStart":321.6000003814697,"responseEnd":620.5,"responseStart":620.5,"secureConnectionStart":321.6000003814697},{"duration":363.3999996185303,"initiatorType":"script","name":"https://jira.mariadb.org/s/099b33461394b8015fc36c0a4b96e19f-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":321.6000003814697,"connectEnd":321.6000003814697,"connectStart":321.6000003814697,"domainLookupEnd":321.6000003814697,"domainLookupStart":321.6000003814697,"fetchStart":321.6000003814697,"redirectEnd":0,"redirectStart":0,"requestStart":321.6000003814697,"responseEnd":685,"responseStart":685,"secureConnectionStart":321.6000003814697},{"duration":367.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/94c15bff32baef80f4096a08aceae8bc-CDN/lu2bu7/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":321.70000076293945,"connectEnd":321.70000076293945,"connectStart":321.70000076293945,"domainLookupEnd":321.70000076293945,"domainLookupStart":321.70000076293945,"fetchStart":321.70000076293945,"redirectEnd":0,"redirectStart":0,"requestStart":321.70000076293945,"responseEnd":689.2000007629395,"responseStart":689.2000007629395,"secureConnectionStart":321.70000076293945},{"duration":367.80000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":321.9000005722046,"connectEnd":321.9000005722046,"connectStart":321.9000005722046,"domainLookupEnd":321.9000005722046,"domainLookupStart":321.9000005722046,"fetchStart":321.9000005722046,"redirectEnd":0,"redirectStart":0,"requestStart":321.9000005722046,"responseEnd":689.7000007629395,"responseStart":689.7000007629395,"secureConnectionStart":321.9000005722046},{"duration":368.1000003814697,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":322,"connectEnd":322,"connectStart":322,"domainLookupEnd":322,"domainLookupStart":322,"fetchStart":322,"redirectEnd":0,"redirectStart":0,"requestStart":322,"responseEnd":690.1000003814697,"responseStart":690.1000003814697,"secureConnectionStart":322},{"duration":368.5,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bu7/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":322.1000003814697,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":322.1000003814697,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":690.6000003814697,"responseStart":0,"secureConnectionStart":0},{"duration":368.3999996185303,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":322.20000076293945,"connectEnd":322.20000076293945,"connectStart":322.20000076293945,"domainLookupEnd":322.20000076293945,"domainLookupStart":322.20000076293945,"fetchStart":322.20000076293945,"redirectEnd":0,"redirectStart":0,"requestStart":322.20000076293945,"responseEnd":690.6000003814697,"responseStart":690.6000003814697,"secureConnectionStart":322.20000076293945},{"duration":368.5999994277954,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":322.4000005722046,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":322.4000005722046,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":691,"responseStart":0,"secureConnectionStart":0},{"duration":368.80000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/3339d87fa2538a859872f2df449bf8d0-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":322.5,"connectEnd":322.5,"connectStart":322.5,"domainLookupEnd":322.5,"domainLookupStart":322.5,"fetchStart":322.5,"redirectEnd":0,"redirectStart":0,"requestStart":322.5,"responseEnd":691.3000001907349,"responseStart":691.3000001907349,"secureConnectionStart":322.5},{"duration":854.8000001907349,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":328.4000005722046,"connectEnd":328.4000005722046,"connectStart":328.4000005722046,"domainLookupEnd":328.4000005722046,"domainLookupStart":328.4000005722046,"fetchStart":328.4000005722046,"redirectEnd":0,"redirectStart":0,"requestStart":328.4000005722046,"responseEnd":1183.2000007629395,"responseStart":1183.2000007629395,"secureConnectionStart":328.4000005722046},{"duration":856.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":328.4000005722046,"connectEnd":328.4000005722046,"connectStart":328.4000005722046,"domainLookupEnd":328.4000005722046,"domainLookupStart":328.4000005722046,"fetchStart":328.4000005722046,"redirectEnd":0,"redirectStart":0,"requestStart":328.4000005722046,"responseEnd":1184.9000005722046,"responseStart":1184.9000005722046,"secureConnectionStart":328.4000005722046},{"duration":340.5,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":842,"connectEnd":842,"connectStart":842,"domainLookupEnd":842,"domainLookupStart":842,"fetchStart":842,"redirectEnd":0,"redirectStart":0,"requestStart":842,"responseEnd":1182.5,"responseStart":1182.5,"secureConnectionStart":842},{"duration":178.80000019073486,"initiatorType":"script","name":"https://www.google-analytics.com/analytics.js","startTime":1026.4000005722046,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":1026.4000005722046,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1205.2000007629395,"responseStart":0,"secureConnectionStart":0}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":180,"responseStart":315,"responseEnd":321,"domLoading":318,"domInteractive":1261,"domContentLoadedEventStart":1261,"domContentLoadedEventEnd":1305,"domComplete":1803,"loadEventStart":1803,"loadEventEnd":1804,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1239.1000003814697},{"name":"bigPipe.sidebar-id.end","time":1240.1000003814697},{"name":"bigPipe.activity-panel-pipe-id.start","time":1240.3000001907349},{"name":"bigPipe.activity-panel-pipe-id.end","time":1243.8000001907349},{"name":"activityTabFullyLoaded","time":1312.5}],"measures":[],"correlationId":"22f2f713daf84b","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":71,"dbReadsTimeInMs":11,"dbConnsTimeInMs":17,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}