Xtrabackup 2.4.7 may hang in --prepare phase with MariaDB 10.2 in this test
https://github.com/percona/percona-xtrabackup/blob/2.4/storage/innobase/xtrabackup/test/t/undo_tablespaces.sh
/usr/bin/innobackupex version 2.4.7 based on MySQL server 5.7.13 Linux (x86_64) (revision id: 6f7a799)
xtrabackup: cd to /dev/shm/__var0/var1/backup/
xtrabackup: This target seems to be not prepared yet.
InnoDB: Number of pools: 1
xtrabackup: xtrabackup_logfile detected: size=10092544, start_lsn=(1504807)
xtrabackup: using the following InnoDB configuration for recovery:
xtrabackup: innodb_data_home_dir = .
xtrabackup: innodb_data_file_path = ibdata1:12M:autoextend
xtrabackup: innodb_log_group_home_dir = .
xtrabackup: innodb_log_files_in_group = 1
xtrabackup: innodb_log_file_size = 10092544
xtrabackup: using the following InnoDB configuration for recovery:
xtrabackup: innodb_data_home_dir = .
xtrabackup: innodb_data_file_path = ibdata1:12M:autoextend
xtrabackup: innodb_log_group_home_dir = .
xtrabackup: innodb_log_files_in_group = 1
xtrabackup: innodb_log_file_size = 10092544
xtrabackup: Starting InnoDB instance for recovery.
xtrabackup: Using 104857600 bytes for buffer pool (set by --use-memory parameter)
InnoDB: PUNCH HOLE support available
InnoDB: Mutexes and rw_locks use GCC atomic builtins
InnoDB: Uses event mutexes
InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
InnoDB: Compressed tables use zlib 1.2.8
InnoDB: Number of pools: 1
InnoDB: Using CPU crc32 instructions
InnoDB: Initializing buffer pool, total size = 100M, instances = 1, chunk size = 100M
InnoDB: Completed initialization of buffer pool
InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
InnoDB: Opened 4 undo tablespaces
InnoDB: 4 undo tablespaces made active
InnoDB: Highest supported file format is Barracuda.
InnoDB: Log scan progressed past the checkpoint lsn 1504807
InnoDB: Doing recovery: scanned up to log sequence number 6682112 (57%)
InnoDB: Doing recovery: scanned up to log sequence number 10416535 (99%)
InnoDB: Database was not shutdown normally!
InnoDB: Starting crash recovery.
InnoDB: 1 transaction(s) which must be rolled back or cleaned up in total 16049 row operations to undo
InnoDB: Trx id counter is 1792
InnoDB: Starting an apply batch of log records to the database...
InnoDB: Progress in percent: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99
InnoDB: Apply batch completed
InnoDB: xtrabackup: Last MySQL binlog file position 3503344, file name ./mysql-bin.000002
InnoDB: Creating shared tablespace for temporary commit
InnoDB: Creating shared tablespace for temporary commit
InnoDB: Rolling back trx with id 1466, 16049 rows to undo
InnoDB: Progress in percents: 1InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2 3InnoDB: File './ibtmp1' size is now 12 MB.
InnoDB: 96 redo rollback segment(s) found. 1 redo rollback segment(s) are active.
InnoDB: 32 non-redo rollback segment(s) are active.
4InnoDB: 5.7.13 started; log sequence number 10416535
InnoDB: xtrabackup: Last MySQL binlog file position 3503344, file name ./mysql-bin.000002
xtrabackup: starting shutdown with innodb_fast_shutdown = 1
InnoDB: FTS optimize thread exiting.
InnoDB: Starting shutdown...
InnoDB: Waiting for 1 active transactions to finish
InnoDB: Waiting for 1 active transactions to finish
The problem is not stable. Sometimes I can repeat it 1/10, sometimes it is 9/10 .
10.1.23 and 5.7.18 are not affected. 10.2.5 is affected.
There is consideration that the problem is incompatibility introduced by MDEV-12289 , after which InnoDB 5.7 is not expecting TRX_SYS page slots 1..32 to contain transactions.
There is consideration that --prepare is not needed for simplest backup / restore scenario, and Server may be started directly on backup.
Hide data.zip 2017-05-12 06:31 7.14 MB Andrii Nikitin Extracting archive...
{"report":{"fcp":666.6999999999534,"ttfb":166.10000000009313,"pageVisibility":"visible","entityId":61299,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":16,"apdex":1,"journeyId":"238f03d9-9029-4c06-bb52-85563c11822e","navigationType":0,"readyForUser":753.5,"redirectCount":0,"resourceLoadedEnd":725.5,"resourceLoadedStart":171.60000000009313,"resourceTiming":[{"duration":6.2999999998137355,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":171.60000000009313,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":171.60000000009313,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":177.89999999990687,"responseStart":0,"secureConnectionStart":0},{"duration":6.400000000139698,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":171.89999999990687,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":171.89999999990687,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":178.30000000004657,"responseStart":0,"secureConnectionStart":0},{"duration":62,"initiatorType":"script","name":"https://jira.mariadb.org/s/fbf975c0cce4b1abf04784eeae9ba1f4-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":171.89999999990687,"connectEnd":171.89999999990687,"connectStart":171.89999999990687,"domainLookupEnd":171.89999999990687,"domainLookupStart":171.89999999990687,"fetchStart":171.89999999990687,"redirectEnd":0,"redirectStart":0,"requestStart":171.89999999990687,"responseEnd":233.89999999990687,"responseStart":233.89999999990687,"secureConnectionStart":171.89999999990687},{"duration":134.89999999990687,"initiatorType":"script","name":"https://jira.mariadb.org/s/099b33461394b8015fc36c0a4b96e19f-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":172,"connectEnd":172,"connectStart":172,"domainLookupEnd":172,"domainLookupStart":172,"fetchStart":172,"redirectEnd":0,"redirectStart":0,"requestStart":172,"responseEnd":306.89999999990687,"responseStart":306.89999999990687,"secureConnectionStart":172},{"duration":138.4000000001397,"initiatorType":"script","name":"https://jira.mariadb.org/s/94c15bff32baef80f4096a08aceae8bc-CDN/lu2bu7/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":172.19999999995343,"connectEnd":172.19999999995343,"connectStart":172.19999999995343,"domainLookupEnd":172.19999999995343,"domainLookupStart":172.19999999995343,"fetchStart":172.19999999995343,"redirectEnd":0,"redirectStart":0,"requestStart":172.19999999995343,"responseEnd":310.60000000009313,"responseStart":310.60000000009313,"secureConnectionStart":172.19999999995343},{"duration":139,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":172.30000000004657,"connectEnd":172.30000000004657,"connectStart":172.30000000004657,"domainLookupEnd":172.30000000004657,"domainLookupStart":172.30000000004657,"fetchStart":172.30000000004657,"redirectEnd":0,"redirectStart":0,"requestStart":172.30000000004657,"responseEnd":311.30000000004657,"responseStart":311.30000000004657,"secureConnectionStart":172.30000000004657},{"duration":139.39999999990687,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":172.30000000004657,"connectEnd":172.30000000004657,"connectStart":172.30000000004657,"domainLookupEnd":172.30000000004657,"domainLookupStart":172.30000000004657,"fetchStart":172.30000000004657,"redirectEnd":0,"redirectStart":0,"requestStart":172.30000000004657,"responseEnd":311.69999999995343,"responseStart":311.69999999995343,"secureConnectionStart":172.30000000004657},{"duration":139.89999999990687,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bu7/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":172.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":172.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":312.39999999990687,"responseStart":0,"secureConnectionStart":0},{"duration":139.80000000004657,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":172.5,"connectEnd":172.5,"connectStart":172.5,"domainLookupEnd":172.5,"domainLookupStart":172.5,"fetchStart":172.5,"redirectEnd":0,"redirectStart":0,"requestStart":172.5,"responseEnd":312.30000000004657,"responseStart":312.30000000004657,"secureConnectionStart":172.5},{"duration":140.19999999995343,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":172.69999999995343,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":172.69999999995343,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":312.89999999990687,"responseStart":0,"secureConnectionStart":0},{"duration":140.19999999995343,"initiatorType":"script","name":"https://jira.mariadb.org/s/3339d87fa2538a859872f2df449bf8d0-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":172.80000000004657,"connectEnd":172.80000000004657,"connectStart":172.80000000004657,"domainLookupEnd":172.80000000004657,"domainLookupStart":172.80000000004657,"fetchStart":172.80000000004657,"redirectEnd":0,"redirectStart":0,"requestStart":172.80000000004657,"responseEnd":313,"responseStart":313,"secureConnectionStart":172.80000000004657},{"duration":544.3000000000466,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":178.30000000004657,"connectEnd":178.30000000004657,"connectStart":178.30000000004657,"domainLookupEnd":178.30000000004657,"domainLookupStart":178.30000000004657,"fetchStart":178.30000000004657,"redirectEnd":0,"redirectStart":0,"requestStart":178.30000000004657,"responseEnd":722.6000000000931,"responseStart":722.6000000000931,"secureConnectionStart":178.30000000004657},{"duration":547.1999999999534,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":178.30000000004657,"connectEnd":178.30000000004657,"connectStart":178.30000000004657,"domainLookupEnd":178.30000000004657,"domainLookupStart":178.30000000004657,"fetchStart":178.30000000004657,"redirectEnd":0,"redirectStart":0,"requestStart":178.30000000004657,"responseEnd":725.5,"responseStart":725.5,"secureConnectionStart":178.30000000004657},{"duration":248.69999999995343,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":456.19999999995343,"connectEnd":456.19999999995343,"connectStart":456.19999999995343,"domainLookupEnd":456.19999999995343,"domainLookupStart":456.19999999995343,"fetchStart":456.19999999995343,"redirectEnd":0,"redirectStart":0,"requestStart":456.19999999995343,"responseEnd":704.8999999999069,"responseStart":704.8999999999069,"secureConnectionStart":456.19999999995343},{"duration":87.5999999998603,"initiatorType":"script","name":"https://www.google-analytics.com/analytics.js","startTime":644.3000000000466,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":644.3000000000466,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":731.8999999999069,"responseStart":0,"secureConnectionStart":0}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":8,"responseStart":166,"responseEnd":171,"domLoading":169,"domInteractive":872,"domContentLoadedEventStart":872,"domContentLoadedEventEnd":924,"domComplete":1977,"loadEventStart":1977,"loadEventEnd":1978,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":854.3000000000466},{"name":"bigPipe.sidebar-id.end","time":855.1000000000931},{"name":"bigPipe.activity-panel-pipe-id.start","time":855.1999999999534},{"name":"bigPipe.activity-panel-pipe-id.end","time":857.3999999999069},{"name":"activityTabFullyLoaded","time":939.6999999999534}],"measures":[],"correlationId":"dcdd50613ee18","effectiveType":"4g","downlink":9.1,"rtt":0,"serverDuration":80,"dbReadsTimeInMs":16,"dbConnsTimeInMs":23,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}