|
Since I upgraded the mariadb stack from 10.5.15 to 10.5.16 I observe rsync errors during the daily mariabackup
Command :
/usr/bin/mariabackup --backup --rsync --tmpdir=/tmp --slave-info --target-dir=/var/backups/percona
|
Log output (end) :
[00] 2022-06-09 08:42:14 Starting prep copy of non-InnoDB tables and files
|
[00] 2022-06-09 08:42:14 Starting rsync as: rsync -t . --files-from=/tmp/xtrabackup_rsyncfiles_pass1 /var/backups/percona/
|
2022-06-09 8:42:14 0 [Note] InnoDB: Read redo log up to LSN=5532145282560
|
[00] 2022-06-09 08:42:14 >> log scanned up to (5532145282501)
|
rsync: link_stat "/var/lib/mysql/var/lib/mysql/ib_buffer_pool" failed: No such file or directory (2)
|
[00] 2022-06-09 08:42:15 >> log scanned up to (5532145282501)
|
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1207) [sender=3.1.3]
|
[00] 2022-06-09 08:42:15 rsync finished successfully.
|
[00] 2022-06-09 08:42:15 Finished a prep copy of non-InnoDB tables and files
|
[00] 2022-06-09 08:42:15 Acquiring BACKUP LOCKS...
|
[00] 2022-06-09 08:42:15 Starting to backup non-InnoDB tables and files
|
[00] 2022-06-09 08:42:15 Starting rsync as: rsync -t . --files-from=/tmp/xtrabackup_rsyncfiles_pass2 /var/backups/percona/
|
rsync: link_stat "/var/lib/mysql/var/lib/mysql/ib_buffer_pool" failed: No such file or directory (2)
|
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1207) [sender=3.1.3]
|
[00] 2022-06-09 08:42:15 Error: rsync failed with error code 1
|
mariabackup: Stopping log copying thread.[00] 2022-06-09 08:42:15 >> log scanned up to (5532145282501)
|
The files /tmp/xtrabackup_rsyncfiles_pass1 and /tmp/xtrabackup_rsyncfiles_pass2 contains relative paths in the form of ./<dbname>/<tablename>.<ext> except for the last line containing the absolute path /var/lib/mysql/ib_buffer_pool.
I upgraded from 10.3 to 10.5.15 mid-May, and it was working fine until the 10.5.16 upgrade last week.
Below are the defaults for mysqld and mariabackup, ***** replace redacted names.
mysqld --print-defaults
mysqld would have been started with the following arguments:
|
--socket=/run/mysqld/mysqld.sock --innodb_autoextend_increment=1 --innodb_buffer_pool_instances=1 --innodb_buffer_pool_size=2G --innodb_doublewrite=1 --innodb_file_format=Barracuda --innodb_file_per_table=1 --innodb_flush_log_at_trx_commit=1 --innodb_flush_log_at_trx_commit=2 --innodb_large_prefix=ON --innodb_lock_wait_timeout=60 --innodb_log_buffer_size=128M --innodb_log_file_size=48M --innodb_log_files_in_group=2 --innodb_log_group_home_dir=/var/lib/mysql/ --innodb_max_dirty_pages_pct=25 --innodb_thread_concurrency=16 --innodb_file_format=barracuda --sql_mode=ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION --innodb_adaptive_hash_index=OFF --user=mysql --pid-file=/var/run/mysqld/mysqld.pid --socket=/var/run/mysqld/mysqld.sock --port=3306 --basedir=/usr --datadir=/var/lib/mysql --tmpdir=/tmp --lc-messages-dir=/usr/share/mysql --skip-external-locking --bind-address=0.0.0.0 --key_buffer_size=16M --max_allowed_packet=16M --thread_stack=192K --thread_cache_size=8 --myisam_recover_options=BACKUP --query_cache_limit=1M --query_cache_size=16M --log_error=/var/log/mysql/error.log --expire_logs_days=10 --max_binlog_size=100M --character-set-server=utf8mb4 --collation-server=utf8mb4_general_ci --sql_mode=ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION --tmpdir=/var/mysqltmp --user=mysql --pid-file=/var/run/mysqld/mysqld.pid --socket=/var/run/mysqld/mysqld.sock --port=3306 --basedir=/usr --datadir=/var/lib/mysql --tmpdir=/tmp --language=/usr/share/mysql/english --long_query_time=2 --log_bin=/var/log/mysql/mysql-bin.log --server-id=1 --innodb_autoextend_increment=1 --innodb_buffer_pool_instances=1 --innodb_buffer_pool_size=2G --innodb_default_row_format=dynamic --innodb_doublewrite=1 --innodb_file_format=Barracuda --innodb_file_per_table=1 --innodb_flush_log_at_trx_commit=1 --innodb_flush_log_at_trx_commit=2 --innodb_large_prefix=ON --innodb_lock_wait_timeout=60 --innodb_log_buffer_size=128M --innodb_log_file_size=48M --innodb_log_files_in_group=2 --innodb_log_group_home_dir=/var/lib/mysql/ --innodb_max_dirty_pages_pct=25 --innodb_thread_concurrency=16 --long_query_time=0.1 --key_buffer=256M --max_allowed_packet=16M --max_connections=1000 --myisam-recover=BACKUP --query_cache_limit=1M --query_cache_size=128M --table_cache=256 --thread_cache_size=4 --expire_logs_days=11 --max_binlog_size=101M --binlog_do_db=***** --log-slave-updates --binlog_format=ROW --skip-slave-start=yes --log_bin_trust_function_creators=ON --ssl --ssl-ca=/etc/mysql/certs/ca-mysql-*****1-cert.pem --ssl-cert=/etc/mysql/certs/*****1-cert.pem --ssl-key=/etc/mysql/certs/*****1-key.pem --slow_query_log=ON --log_warnings=2 --general_log=OFF --log_error=/var/log/mysql/error.log --slow_query_log_file=/var/log/mysql/mysql-slow.log
|
mariabackup --print-defaults
mariabackup would have been started with the following arguments:
|
--socket=/run/mysqld/mysqld.sock --innodb_autoextend_increment=1 --innodb_buffer_pool_instances=1 --innodb_buffer_pool_size=2G --innodb_doublewrite=1 --innodb_file_format=Barracuda --innodb_file_per_table=1 --innodb_flush_log_at_trx_commit=1 --innodb_flush_log_at_trx_commit=2 --innodb_large_prefix=ON --innodb_lock_wait_timeout=60 --innodb_log_buffer_size=128M --innodb_log_file_size=48M --innodb_log_files_in_group=2 --innodb_log_group_home_dir=/var/lib/mysql/ --innodb_max_dirty_pages_pct=25 --innodb_thread_concurrency=16 --innodb_file_format=barracuda --sql_mode=ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION --innodb_adaptive_hash_index=OFF --user=mysql --pid-file=/var/run/mysqld/mysqld.pid --socket=/var/run/mysqld/mysqld.sock --port=3306 --basedir=/usr --datadir=/var/lib/mysql --tmpdir=/tmp --lc-messages-dir=/usr/share/mysql --skip-external-locking --bind-address=0.0.0.0 --key_buffer_size=16M --max_allowed_packet=16M --thread_stack=192K --thread_cache_size=8 --myisam_recover_options=BACKUP --query_cache_limit=1M --query_cache_size=16M --log_error=/var/log/mysql/error.log --expire_logs_days=10 --max_binlog_size=100M --character-set-server=utf8mb4 --collation-server=utf8mb4_general_ci --sql_mode=ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION --tmpdir=/var/mysqltmp --user=mysql --pid-file=/var/run/mysqld/mysqld.pid --socket=/var/run/mysqld/mysqld.sock --port=3306 --basedir=/usr --datadir=/var/lib/mysql --tmpdir=/tmp --language=/usr/share/mysql/english --long_query_time=2 --log_bin=/var/log/mysql/mysql-bin.log --server-id=1 --innodb_autoextend_increment=1 --innodb_buffer_pool_instances=1 --innodb_buffer_pool_size=2G --innodb_default_row_format=dynamic --innodb_doublewrite=1 --innodb_file_format=Barracuda --innodb_file_per_table=1 --innodb_flush_log_at_trx_commit=1 --innodb_flush_log_at_trx_commit=2 --innodb_large_prefix=ON --innodb_lock_wait_timeout=60 --innodb_log_buffer_size=128M --innodb_log_file_size=48M --innodb_log_files_in_group=2 --innodb_log_group_home_dir=/var/lib/mysql/ --innodb_max_dirty_pages_pct=25 --innodb_thread_concurrency=16 --long_query_time=0.1 --key_buffer=256M --max_allowed_packet=16M --max_connections=1000 --myisam-recover=BACKUP --query_cache_limit=1M --query_cache_size=128M --table_cache=256 --thread_cache_size=4 --expire_logs_days=11 --max_binlog_size=101M --binlog_do_db=***** --log-slave-updates --binlog_format=ROW --skip-slave-start=yes --log_bin_trust_function_creators=ON --ssl --ssl-ca=/etc/mysql/certs/ca-mysql-*****1-cert.pem --ssl-cert=/etc/mysql/certs/*****1-cert.pem --ssl-key=/etc/mysql/certs/*****1-key.pem --slow_query_log=ON --log_warnings=2 --general_log=OFF --log_error=/var/log/mysql/error.log --slow_query_log_file=/var/log/mysql/mysql-slow.log
|
|