[MDEV-29115] mariabackup.mdev-14447 started failing in a new way in CIs Created: 2022-07-17  Updated: 2022-08-04  Resolved: 2022-08-04

Status: Closed
Project: MariaDB Server
Component/s: mariabackup, Tests
Affects Version/s: 10.8, 10.9, 10.10
Fix Version/s: 10.6.9, 10.7.5, 10.8.4, 10.9.2, 10.10.1

Type: Bug Priority: Major
Reporter: Elena Stepanova Assignee: Marko Mäkelä
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Relates
relates to MDEV-14447 mariabackup --incremental --prepare f... Closed
relates to MDEV-14992 BACKUP: in-server backup Open

 Description   

mariabackup.mdev-14447 hadn't been an ideal test, but since ~Jun 9th 2022 it started failing on 10.8+ more frequently and in a new way.

10.8 62419b1733042c30414a4feed89c79ae

mariabackup.mdev-14447                   w10 [ fail ]
        Test ended at 2022-06-09 13:27:14
 
CURRENT_TEST: mariabackup.mdev-14447
[00] 2022-06-09 13:26:40 Connecting to MariaDB server host: localhost, user: root, password: set, port: 16180, socket: /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/tmp/10/mysqld.1.sock
[00] 2022-06-09 13:26:40 Using server version 10.8.4-MariaDB-debug-log
/home/buildbot/maria-slave/fulltest-debug-big-only/build/extra/mariabackup/mariabackup based on MariaDB server 10.8.4-MariaDB Linux (x86_64)
[00] 2022-06-09 13:26:40 incremental backup from 58889 is enabled.
[00] 2022-06-09 13:26:40 uses posix_fadvise().
[00] 2022-06-09 13:26:40 cd to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/mysqld.1/data/
[00] 2022-06-09 13:26:40 open files limit requested 1024, set to 1024
[00] 2022-06-09 13:26:40 mariabackup: using the following InnoDB configuration:
[00] 2022-06-09 13:26:40 innodb_data_home_dir = 
[00] 2022-06-09 13:26:40 innodb_data_file_path = ibdata_first:3M;ibdata_second:1M:autoextend
[00] 2022-06-09 13:26:40 innodb_log_group_home_dir = ./
[00] 2022-06-09 13:26:40 InnoDB: Using Linux native AIO
2022-06-09 13:26:40 0 [Note] InnoDB: Number of transaction pools: 1
2022-06-09 13:26:40 0 [Note] InnoDB: Setting O_DIRECT on file ibdata_first failed
[00] 2022-06-09 13:26:40 mariabackup: Generating a list of tablespaces
[00] 2022-06-09 13:26:41 DDL tracking : modify 5 "./test/t.ibd"
[00] 2022-06-09 13:26:41 DDL tracking : modify 5 "./test/t.ibd"
[00] 2022-06-09 13:26:41 >> log scanned up to (41683142)
[01] 2022-06-09 13:26:41 Copying ibdata_first to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/ibdata_first.delta
[01] 2022-06-09 13:26:41         ...done
[01] 2022-06-09 13:26:41 Copying ibdata_second to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/ibdata_second.delta
[00] 2022-06-09 13:26:41 >> log scanned up to (41707966)
[01] 2022-06-09 13:26:41         ...done
[01] 2022-06-09 13:26:41 Copying ./test/t.ibd to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/test/t.ibd.delta
[01] 2022-06-09 13:26:41         ...done
[01] 2022-06-09 13:26:41 Copying ./mysql/transaction_registry.ibd to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/transaction_registry.ibd.delta
[01] 2022-06-09 13:26:41         ...done
[01] 2022-06-09 13:26:41 Copying ./mysql/innodb_index_stats.ibd to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/innodb_index_stats.ibd.delta
[01] 2022-06-09 13:26:41         ...done
[01] 2022-06-09 13:26:41 Copying ./mysql/innodb_table_stats.ibd to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/innodb_table_stats.ibd.delta
[01] 2022-06-09 13:26:41         ...done
[00] 2022-06-09 13:26:42 Acquiring BACKUP LOCKS...
[00] 2022-06-09 13:26:42 Starting to backup non-InnoDB tables and files
[01] 2022-06-09 13:26:42 Copying ./mtr/global_suppressions.TRG to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mtr/global_suppressions.TRG
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mtr/gs_insert.TRN to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mtr/gs_insert.TRN
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mtr/global_suppressions.MYD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mtr/global_suppressions.MYD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mtr/global_suppressions.MYI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mtr/global_suppressions.MYI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mtr/global_suppressions.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mtr/global_suppressions.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mtr/test_suppressions.TRG to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mtr/test_suppressions.TRG
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mtr/ts_insert.TRN to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mtr/ts_insert.TRN
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mtr/test_suppressions.MYD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mtr/test_suppressions.MYD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mtr/test_suppressions.MYI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mtr/test_suppressions.MYI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mtr/test_suppressions.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mtr/test_suppressions.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mtr/db.opt to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mtr/db.opt
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./test/t.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/test/t.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./test/db.opt to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/test/db.opt
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/session_ssl_status.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/session_ssl_status.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024session.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024session.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/session.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/session.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024processlist.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024processlist.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/processlist.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/processlist.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/metrics.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/metrics.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024waits_global_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024waits_global_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/waits_global_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/waits_global_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024waits_by_host_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024waits_by_host_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/waits_by_host_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/waits_by_host_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024waits_by_user_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024waits_by_user_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/waits_by_user_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/waits_by_user_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024wait_classes_global_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024wait_classes_global_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/wait_classes_global_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/wait_classes_global_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024wait_classes_global_by_avg_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024wait_classes_global_by_avg_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/wait_classes_global_by_avg_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/wait_classes_global_by_avg_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024host_summary.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024host_summary.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/host_summary.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/host_summary.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024host_summary_by_stages.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024host_summary_by_stages.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/host_summary_by_stages.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/host_summary_by_stages.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024host_summary_by_statement_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024host_summary_by_statement_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/host_summary_by_statement_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/host_summary_by_statement_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024host_summary_by_statement_type.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024host_summary_by_statement_type.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/host_summary_by_statement_type.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/host_summary_by_statement_type.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024host_summary_by_file_io.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024host_summary_by_file_io.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/host_summary_by_file_io.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/host_summary_by_file_io.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024host_summary_by_file_io_type.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024host_summary_by_file_io_type.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/host_summary_by_file_io_type.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/host_summary_by_file_io_type.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024user_summary.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024user_summary.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/user_summary.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/user_summary.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024user_summary_by_stages.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024user_summary_by_stages.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/user_summary_by_stages.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/user_summary_by_stages.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024user_summary_by_statement_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024user_summary_by_statement_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/user_summary_by_statement_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/user_summary_by_statement_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024user_summary_by_statement_type.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024user_summary_by_statement_type.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/user_summary_by_statement_type.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/user_summary_by_statement_type.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024user_summary_by_file_io.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024user_summary_by_file_io.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/user_summary_by_file_io.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/user_summary_by_file_io.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024user_summary_by_file_io_type.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024user_summary_by_file_io_type.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/user_summary_by_file_io_type.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/user_summary_by_file_io_type.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024statements_with_temp_tables.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024statements_with_temp_tables.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/statements_with_temp_tables.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/statements_with_temp_tables.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024statements_with_sorting.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024statements_with_sorting.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/statements_with_sorting.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/statements_with_sorting.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024statements_with_runtimes_in_95th_percentile.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024statements_with_runtimes_in_95th_percentile.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/statements_with_runtimes_in_95th_percentile.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/statements_with_runtimes_in_95th_percentile.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024ps_digest_95th_percentile_by_avg_us.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024ps_digest_95th_percentile_by_avg_us.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024ps_digest_avg_latency_distribution.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024ps_digest_avg_latency_distribution.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024statements_with_full_table_scans.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024statements_with_full_table_scans.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/statements_with_full_table_scans.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/statements_with_full_table_scans.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024statements_with_errors_or_warnings.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024statements_with_errors_or_warnings.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/statements_with_errors_or_warnings.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/statements_with_errors_or_warnings.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024statement_analysis.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024statement_analysis.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/statement_analysis.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/statement_analysis.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024schema_table_lock_waits.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024schema_table_lock_waits.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/schema_table_lock_waits.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/schema_table_lock_waits.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/schema_unused_indexes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/schema_unused_indexes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024schema_tables_with_full_table_scans.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024schema_tables_with_full_table_scans.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/schema_tables_with_full_table_scans.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/schema_tables_with_full_table_scans.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024schema_table_statistics_with_buffer.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024schema_table_statistics_with_buffer.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/schema_table_statistics_with_buffer.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/schema_table_statistics_with_buffer.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024schema_table_statistics.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024schema_table_statistics.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/schema_table_statistics.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/schema_table_statistics.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024ps_schema_table_statistics_io.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024ps_schema_table_statistics_io.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024schema_index_statistics.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024schema_index_statistics.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/schema_index_statistics.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/schema_index_statistics.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024memory_global_total.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024memory_global_total.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/memory_global_total.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/memory_global_total.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024memory_global_by_current_bytes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024memory_global_by_current_bytes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/memory_global_by_current_bytes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/memory_global_by_current_bytes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024memory_by_thread_by_current_bytes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024memory_by_thread_by_current_bytes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/memory_by_thread_by_current_bytes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/memory_by_thread_by_current_bytes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024memory_by_host_by_current_bytes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024memory_by_host_by_current_bytes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/memory_by_host_by_current_bytes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/memory_by_host_by_current_bytes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024memory_by_user_by_current_bytes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024memory_by_user_by_current_bytes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/memory_by_user_by_current_bytes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/memory_by_user_by_current_bytes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024io_global_by_wait_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024io_global_by_wait_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/io_global_by_wait_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/io_global_by_wait_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024io_global_by_wait_by_bytes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024io_global_by_wait_by_bytes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/io_global_by_wait_by_bytes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/io_global_by_wait_by_bytes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024io_global_by_file_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024io_global_by_file_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/io_global_by_file_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/io_global_by_file_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024io_global_by_file_by_bytes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024io_global_by_file_by_bytes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/io_global_by_file_by_bytes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/io_global_by_file_by_bytes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024io_by_thread_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024io_by_thread_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/io_by_thread_by_latency.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/io_by_thread_by_latency.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024latest_file_io.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024latest_file_io.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/latest_file_io.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/latest_file_io.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/ps_check_lost_instrumentation.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/ps_check_lost_instrumentation.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/schema_redundant_indexes.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/schema_redundant_indexes.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024schema_flattened_keys.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024schema_flattened_keys.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/schema_auto_increment_columns.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/schema_auto_increment_columns.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/schema_object_overview.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/schema_object_overview.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024innodb_lock_waits.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024innodb_lock_waits.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/innodb_lock_waits.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/innodb_lock_waits.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024innodb_buffer_stats_by_table.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024innodb_buffer_stats_by_table.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/innodb_buffer_stats_by_table.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/innodb_buffer_stats_by_table.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/x@0024innodb_buffer_stats_by_schema.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/x@0024innodb_buffer_stats_by_schema.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/innodb_buffer_stats_by_schema.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/innodb_buffer_stats_by_schema.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/sys_config.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/sys_config.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/sys_config.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/sys_config.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/sys_config.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/sys_config.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/version.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/version.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./sys/db.opt to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/sys/db.opt
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./performance_schema/db.opt to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/performance_schema/db.opt
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/gtid_slave_pos.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/gtid_slave_pos.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/gtid_slave_pos.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/gtid_slave_pos.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/gtid_slave_pos.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/gtid_slave_pos.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/index_stats.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/index_stats.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/index_stats.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/index_stats.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/index_stats.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/index_stats.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/column_stats.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/column_stats.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/column_stats.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/column_stats.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/column_stats.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/column_stats.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/table_stats.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/table_stats.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/table_stats.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/table_stats.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/table_stats.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/table_stats.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/proxies_priv.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/proxies_priv.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/proxies_priv.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/proxies_priv.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/proxies_priv.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/proxies_priv.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/transaction_registry.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/transaction_registry.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/innodb_index_stats.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/innodb_index_stats.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/innodb_table_stats.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/innodb_table_stats.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/event.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/event.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/event.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/event.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/event.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/event.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/slow_log.CSV to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/slow_log.CSV
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/slow_log.CSM to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/slow_log.CSM
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/slow_log.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/slow_log.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/general_log.CSV to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/general_log.CSV
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/general_log.CSM to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/general_log.CSM
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/general_log.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/general_log.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/procs_priv.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/procs_priv.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/procs_priv.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/procs_priv.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/procs_priv.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/procs_priv.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/proc.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/proc.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/proc.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/proc.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/proc.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/proc.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone_leap_second.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone_leap_second.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone_leap_second.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone_leap_second.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone_leap_second.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone_leap_second.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone_transition_type.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone_transition_type.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone_transition_type.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone_transition_type.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone_transition_type.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone_transition_type.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone_transition.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone_transition.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone_transition.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone_transition.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone_transition.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone_transition.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone_name.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone_name.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone_name.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone_name.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/time_zone_name.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/time_zone_name.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/help_keyword.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/help_keyword.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/help_keyword.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/help_keyword.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/help_keyword.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/help_keyword.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/help_relation.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/help_relation.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/help_relation.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/help_relation.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/help_relation.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/help_relation.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/help_category.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/help_category.MAD
[00] 2022-06-09 13:26:42 DDL tracking : modify 5 "./test/t.ibd"
[00] 2022-06-09 13:26:42 DDL tracking : modify 1 "./mysql/innodb_table_stats.ibd"
[00] 2022-06-09 13:26:42 DDL tracking : modify 2 "./mysql/innodb_index_stats.ibd"
[00] 2022-06-09 13:26:42 DDL tracking : modify 5 "./test/t.ibd"
[00] 2022-06-09 13:26:42 DDL tracking : modify 1 "./mysql/innodb_table_stats.ibd"
[00] 2022-06-09 13:26:42 DDL tracking : modify 2 "./mysql/innodb_index_stats.ibd"
[00] 2022-06-09 13:26:42 DDL tracking : modify 5 "./test/t.ibd"
[00] 2022-06-09 13:26:42 >> log scanned up to (42980414)
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/help_category.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/help_category.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/help_category.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/help_category.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/help_topic.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/help_topic.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/help_topic.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/help_topic.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/help_topic.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/help_topic.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/columns_priv.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/columns_priv.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/columns_priv.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/columns_priv.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/columns_priv.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/columns_priv.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/tables_priv.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/tables_priv.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/tables_priv.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/tables_priv.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/tables_priv.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/tables_priv.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/servers.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/servers.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/servers.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/servers.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/servers.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/servers.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/plugin.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/plugin.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/plugin.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/plugin.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/plugin.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/plugin.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/func.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/func.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/func.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/func.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/func.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/func.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/roles_mapping.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/roles_mapping.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/roles_mapping.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/roles_mapping.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/roles_mapping.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/roles_mapping.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/user.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/user.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/global_priv.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/global_priv.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/global_priv.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/global_priv.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/global_priv.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/global_priv.frm
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/db.MAD to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/db.MAD
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/db.MAI to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/db.MAI
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./mysql/db.frm to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/mysql/db.frm
[01] 2022-06-09 13:26:42         ...done
[00] 2022-06-09 13:26:42 Finished backing up non-InnoDB tables and files
[01] 2022-06-09 13:26:42 Copying ./aria_log.00000001 to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/aria_log.00000001
[01] 2022-06-09 13:26:42         ...done
[01] 2022-06-09 13:26:42 Copying ./aria_log_control to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/aria_log_control
[01] 2022-06-09 13:26:42         ...done
[00] 2022-06-09 13:26:42 Waiting for log copy thread to read lsn 42723616
[00] 2022-06-09 13:26:42 Executing FLUSH NO_WRITE_TO_BINLOG ENGINE LOGS...
[00] 2022-06-09 13:26:42 mariabackup: The latest check point (for incremental): '42015745'
mariabackup: Stopping log copying thread.[00] 2022-06-09 13:26:42 Retrying read of log at LSN=42980414
[00] 2022-06-09 13:26:42 >> log scanned up to (42981748)
 
[00] 2022-06-09 13:26:42 >> log scanned up to (43133853)
[00] 2022-06-09 13:26:42 Executing BACKUP STAGE END
[00] 2022-06-09 13:26:42 All tables unlocked
[00] 2022-06-09 13:26:42 Copying /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/mysqld.1/data/ib_buffer_pool to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/ib_buffer_pool
[00] 2022-06-09 13:26:42         ...done
[00] 2022-06-09 13:26:42 Backup created in directory '/home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/'
[00] 2022-06-09 13:26:42 Writing backup-my.cnf
[00] 2022-06-09 13:26:42         ...done
[00] 2022-06-09 13:26:42 Writing xtrabackup_info
[00] 2022-06-09 13:26:42         ...done
[00] 2022-06-09 13:26:42 Redo log (from LSN 42015745 to 43133853) was copied.
[00] 2022-06-09 13:26:42 completed OK!
mysqltest: At line 27: exec of '/home/buildbot/maria-slave/fulltest-debug-big-only/build/extra/mariabackup/mariabackup --prepare --verbose --target-dir=/home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup --incremental-dir=/home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1  2>&1' failed, error: 256, status: 1, errno: 11
Output from before failure:
/home/buildbot/maria-slave/fulltest-debug-big-only/build/extra/mariabackup/mariabackup based on MariaDB server 10.8.4-MariaDB Linux (x86_64)
[00] 2022-06-09 13:26:44 incremental backup from 58889 is enabled.
[00] 2022-06-09 13:26:44 cd to /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup/
[00] 2022-06-09 13:26:44 open files limit requested 0, set to 1024
[00] 2022-06-09 13:26:44 This target seems to be already prepared.
[00] 2022-06-09 13:26:44 mariabackup: using the following InnoDB configuration for recovery:
[00] 2022-06-09 13:26:44 innodb_data_home_dir = .
[00] 2022-06-09 13:26:44 innodb_data_file_path = ibdata_first:3M;ibdata_second:1M:autoextend
[00] 2022-06-09 13:26:44 innodb_log_group_home_dir = /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/
[00] 2022-06-09 13:26:44 InnoDB: Using Linux native AIO
2022-06-09 13:26:44 0 [Note] InnoDB: Setting O_DIRECT on file ./ibdata_first failed
[00] 2022-06-09 13:26:44 mariabackup: Generating a list of tablespaces
[00] 2022-06-09 13:26:44 page size for /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1//ibdata_second.delta is 16384 bytes
[00] 2022-06-09 13:26:44 Applying /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1//ibdata_second.delta to ./ibdata_second...
[00] 2022-06-09 13:26:44 page size for /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1//ibdata_first.delta is 16384 bytes
[00] 2022-06-09 13:26:44 Applying /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1//ibdata_first.delta to ./ibdata_first...
[00] 2022-06-09 13:26:44 page size for /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1//mysql/innodb_table_stats.ibd.delta is 16384 bytes
[00] 2022-06-09 13:26:44 Applying /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1//mysql/innodb_table_stats.ibd.delta to ./mysql/innodb_table_stats.ibd...
[00] 2022-06-09 13:26:44 page size for /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1//mysql/innodb_index_stats.ibd.delta is 16384 bytes
[00] 2022-06-09 13:26:44 Applying /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1//mysql/innodb_index_stats.ibd.delta to ./mysql/innodb_index_stats.ibd...
[00] 2022-06-09 13:26:44 page size for /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1//mysql/transaction_registry.ibd.delta is 16384 bytes
[00] 2022-06-09 13:26:44 Applying /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1//mysql/transaction_registry.ibd.delta to ./mysql/transaction_registry.ibd...
[00] 2022-06-09 13:26:44 page size for /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1//test/t.ibd.delta is 16384 bytes
[00] 2022-06-09 13:26:44 Applying /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1//test/t.ibd.delta to ./test/t.ibd...
[00] 2022-06-09 13:26:44 mariabackup: using the following InnoDB configuration for recovery:
[00] 2022-06-09 13:26:44 innodb_data_home_dir = .
[00] 2022-06-09 13:26:44 innodb_data_file_path = ibdata_first:3M;ibdata_second:1M:autoextend
[00] 2022-06-09 13:26:44 innodb_log_group_home_dir = /home/buildbot/maria-slave/fulltest-debug-big-only/build/mysql-test/var/10/tmp/backup_inc1/
[00] 2022-06-09 13:26:44 InnoDB: Using Linux native AIO
[00] 2022-06-09 13:26:44 Starting InnoDB instance for recovery.
[00] 2022-06-09 13:26:44 mariabackup: Using 104857600 bytes for buffer pool (set by --use-memory parameter)
2022-06-09 13:26:44 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!!
2022-06-09 13:26:44 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2022-06-09 13:26:44 0 [Note] InnoDB: Number of transaction pools: 1
2022-06-09 13:26:44 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
2022-06-09 13:26:44 0 [Note] InnoDB: Using Linux native AIO
2022-06-09 13:26:44 0 [Note] InnoDB: Initializing buffer pool, total size = 100.000MiB, chunk size = 100.000MiB
2022-06-09 13:26:44 0 [Note] InnoDB: Completed initialization of buffer pool
FILE_CHECKPOINT(37441621) read at 40977989
2022-06-09 13:26:44 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=37441621
FILE_CHECKPOINT(37441621) reread at 40977989
FILE_CHECKPOINT(40960806) ignored at 41822953
2022-06-09 13:26:44 0 [Note] InnoDB: Applying log to page [page id: space=0, page number=48]
2022-06-09 13:26:44 0 [Note] InnoDB: apply 41354440: [page id: space=0, page number=48]
2022-06-09 13:26:44 0 [Note] InnoDB: apply 41354440: [page id: space=0, page number=48]
2022-06-09 13:26:44 0 [Note] InnoDB: apply 41354440: [page id: space=0, page number=48]
2022-06-09 13:26:44 0 [Note] InnoDB: apply 41354440: [page id: space=0, page number=48]
2022-06-09 13:26:44 0 [Note] InnoDB: Starting final batch to recover 450 pages from redo log.
2022-06-09 13:26:44 0 [Note] InnoDB: Applying log to page [page id: space=0, page number=607]
2022-06-09 13:26:44 0 [Note] InnoDB: apply 37488777: [page id: space=0, page number=607]
2022-06-09 13:26:44 0 [Note] InnoDB: apply 37488777: [page id: space=0, page number=607]
<...>
2022-06-09 13:26:44 0 [Note] InnoDB: apply 37506040: [page id: space=0, page number=607]
2022-06-09 13:26:44 0 [Note] InnoDB: apply 37506447: [page i

The test fails roughly once a day across all branches, on fulltest-debug-big-only in the old buildbot or on amd64-ubuntu-2004-msan in the new one.
Fresh occurrences can be found via a cross-reference, there is no point linking them as they'll expire.

As said above, the first failure of this kind seems to be of Jun 09, on commit 62419b1733042c30414a4feed89c79ae which is of course unrelated. It could be from this merge, or something shortly preceding it.



 Comments   
Comment by Marko Mäkelä [ 2022-08-02 ]

Could this be due to MDEV-18976?

Comment by Marko Mäkelä [ 2022-08-02 ]

To disable MDEV-18976:

diff --git a/storage/innobase/mtr/mtr0mtr.cc b/storage/innobase/mtr/mtr0mtr.cc
index 5718daeda0b..086d4843582 100644
--- a/storage/innobase/mtr/mtr0mtr.cc
+++ b/storage/innobase/mtr/mtr0mtr.cc
@@ -1129,7 +1129,7 @@ std::pair<lsn_t,mtr_t::page_flush_ahead> mtr_t::do_write()
 	ulint	len	= m_log.size();
 	ut_ad(len > 0);
 
-#ifdef UNIV_DEBUG
+#if 0
 	if (m_log_mode == MTR_LOG_ALL) {
 		m_memo.for_each_block(CIterate<WriteOPT_PAGE_CHECKSUM>(*this));
 		len = m_log.size();

Comment by Marko Mäkelä [ 2022-08-04 ]

The end LSN after running the test is not fully deterministic, but I think that it correlates with the test execution time and the probability of failure or timeout. The ultimate reason why the test fails would be fixed in MDEV-14992, by making a single process responsible for producing and consuming the write-ahead log (persistently writing data and backing it up).

Here is what I got:

variant amount of log written
10.6 baseline 42,946,271
without PAGE_CHECKSUM records 42,835,679
with bulk load (MDEV-515, MDEV-24621) 35,476,353

The MDEV-14447 scenario was that the InnoDB system tablespace is being extended during an incremental backup. The reason why the system tablespace was extended was undo log records. Now that no undo log will be written, I moved the table storage to the system tablespace (innodb_file_per_table=0). With the MDEV-14447 code fix reverted, this optimized test would still reproduce the original MDEV-14447 failure:

10.6 558f1eff64e7708b594ef0315e23bdeb1d23ccf7 without MDEV-14447 fix

2022-08-04  9:46:52 0 [ERROR] InnoDB: The data file './ibdata_first' is of a different size 4352 pages than the 192 pages specified by innodb_data_file_path
2022-08-04  9:46:52 0 [ERROR] InnoDB: Plugin initialization aborted at srv0start.cc[1271] with error Generic error
[00] FATAL ERROR: 2022-08-04 09:46:52 mariabackup: innodb_init() returned 11 (Generic error).

Generated at Thu Feb 08 10:06:01 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.