[MDEV-26995] mariabackup --prepare fails on Windows NAS - Jira

Details

Type: Bug
Status: Closed (View Workflow)
Priority: Major
Resolution: Not a Bug
Affects Version/s: 10.5.10
Fix Version/s: N/A
Component/s: mariabackup
Labels:
None
Environment:
CentOS + Windows NAS

Description

mariabackup --backup works well, however it fails on --prepare stage.

[root@XXX XXX]# mariadb-backup --prepare --target-dir=/mnt/backup/XXX/mariadb/$dt

mariadb-backup based on MariaDB server 10.5.10-7-MariaDB Linux (x86_64)

[00] 2021-10-06 19:21:30 cd to /mnt/backup/XXX/mariadb/202110061912/

[00] 2021-10-06 19:21:30 open files limit requested 0, set to 1024

[00] 2021-10-06 19:21:31 This target seems to be not prepared yet.

[00] 2021-10-06 19:21:31 mariabackup: using the following InnoDB configuration for recovery:

[00] 2021-10-06 19:21:31 innodb_data_home_dir = .

[00] 2021-10-06 19:21:31 innodb_data_file_path = ibdata1:12M:autoextend

[00] 2021-10-06 19:21:31 innodb_log_group_home_dir = .

[00] 2021-10-06 19:21:31 InnoDB: Using Linux native AIO

[00] 2021-10-06 19:21:31 Starting InnoDB instance for recovery.

[00] 2021-10-06 19:21:31 mariabackup: Using 104857600 bytes for buffer pool (set by --use-memory parameter)

2021-10-06 19:21:31 0 [Note] InnoDB: Uses event mutexes

2021-10-06 19:21:31 0 [Note] InnoDB: Compressed tables use zlib 1.2.11

2021-10-06 19:21:31 0 [Note] InnoDB: Number of pools: 1

2021-10-06 19:21:31 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions

2021-10-06 19:21:31 0 [Note] InnoDB: Using Linux native AIO

2021-10-06 19:21:31 0 [Note] InnoDB: Initializing buffer pool, total size = 104857600, chunk size = 104857600

2021-10-06 19:21:31 0 [Note] InnoDB: Completed initialization of buffer pool

2021-10-06 19:21:31 0 [Warning] InnoDB: Retry attempts for reading partial data failed.

2021-10-06 19:21:31 0 [ERROR] InnoDB: Operating system error number 13 in a file operation.

2021-10-06 19:21:31 0 [ERROR] InnoDB: The error means mysqld does not have the access rights to the directory.

2021-10-06 19:21:31 0 [ERROR] [FATAL] InnoDB: Tried to read 5120 bytes at offset 2048, but was only able to read 0.Cannot read from file. OS error number 13.

211006 19:21:31 [ERROR] mysqld got signal 6 ;

This could be because you hit a bug. It is also possible that this binary

or one of the libraries it was linked against is corrupt, improperly built,

or misconfigured. This error can also be caused by malfunctioning hardware.

To report this bug, see https://mariadb.com/kb/en/reporting-bugs

We will try our best to scrape up some info that will hopefully help

diagnose the problem, but since we have already crashed,

something is definitely wrong and this may fail.

Server version: 10.5.10-7-MariaDB-enterprise

key_buffer_size=0

read_buffer_size=131072

max_used_connections=0

max_threads=1

thread_count=0

It is possible that mysqld could use up to

key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 6057 K  bytes of memory

Hope that's ok; if not, decrease some variables in the equation.

Thread pointer: 0x0

Attempting backtrace. You can use the following information to find out

where mysqld died. If you see no messages after this, something went

terribly wrong...

stack_bottom = 0x0 thread_stack 0x49000

addr2line: 'mariadb-backup': そのようなファイルはありません

mariadb-backup(my_print_stacktrace+0x2e)[0x55d5918a29be]

Printing to addr2line failed

mariadb-backup(handle_fatal_signal+0x485)[0x55d5913907d5]

sigaction.c:0(__restore_rt)[0x7fc2610d7b20]

:0(__GI_raise)[0x7fc26041c37f]

:0(__GI_abort)[0x7fc260406db5]

addr2line: 'mariadb-backup': そのようなファイルはありません

mariadb-backup(+0x65fc95)[0x55d590fdbc95]

mariadb-backup(+0x642ef4)[0x55d590fbeef4]

mariadb-backup(+0xd737c2)[0x55d5916ef7c2]

mariadb-backup(+0xd5e3c0)[0x55d5916da3c0]

mariadb-backup(+0xd65e23)[0x55d5916e1e23]

mariadb-backup(+0xd690ea)[0x55d5916e50ea]

mariadb-backup(+0xd69654)[0x55d5916e5654]

mariadb-backup(+0x65828b)[0x55d590fd428b]

mariadb-backup(+0x6b2b1b)[0x55d59102eb1b]

mariadb-backup(main+0x181)[0x55d590febdc1]

??:0(__libc_start_main)[0x7fc260408493]

addr2line: 'mariadb-backup': そのようなファイルはありません

mariadb-backup(_start+0x2e)[0x55d59101d9de]

The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains

information that should help you find out what is causing the crash.

Writing a core file...

Working directory at /mnt/backup/XXX/mariadb/202110061912

Resource Limits:

Limit                     Soft Limit           Hard Limit           Units

Max cpu time              unlimited            unlimited            seconds

Max file size             unlimited            unlimited            bytes

Max data size             unlimited            unlimited            bytes

Max stack size            8388608              unlimited            bytes

Max core file size        unlimited            unlimited            bytes

Max resident set          unlimited            unlimited            bytes

Max processes             158623               158623               processes

Max open files            1024                 262144               files

Max locked memory         65536                65536                bytes

Max address space         unlimited            unlimited            bytes

Max file locks            unlimited            unlimited            locks

Max pending signals       158623               158623               signals

Max msgqueue size         819200               819200               bytes

Max nice priority         0                    0

Max realtime priority     0                    0

Max realtime timeout      unlimited            unlimited            us

Core pattern: |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e

中止 (コアダンプ)

[root@XXX ~]# df -h

....

//xxx.xx.xx.xxx/Share 3.7T 86G 3.6T 3% /mnt/data

//xxx.xx.xx.xxx/Backup 3.7T 86G 3.6T 3% /mnt/backup

tmpfs 3.9G 4.0K 3.9G 1% /run/user/1000

[root@XXX ~]# cat /etc/selinux/config

# This file controls the state of SELinux on the system.

# SELINUX= can take one of these three values:

# enforcing - SELinux security policy is enforced.

# permissive - SELinux prints warnings instead of enforcing.

# disabled - No SELinux policy is loaded.

SELINUX=permissive

# SELINUXTYPE= can take one of these three values:

# targeted - Targeted processes are protected,

# minimum - Modification of targeted policy. Only selected processes are protected.

# mls - Multi Level Security protection.

SELINUXTYPE=targeted

customer noted:

The execution logs for each are attached.

- NAS

- Local Storage

Investigate the cause of the following error that occurs when executing "prepare" in the backup directory on the NAS.

(When I copy the file to local storage and run "prepare", it terminates normally, so there seems to be no problem with the backup file.)

```

2021-10-29 20:18:10 0 [Warning] InnoDB: Retry attempts for reading partial data failed.

2021-10-29 20:18:10 0 [ERROR] InnoDB: Operating system error number 13 in a file operation.

2021-10-29 20:18:10 0 [ERROR] InnoDB: The error means mysqld does not have the access rights to the directory.

2021-10-29 20:18:10 0 [ERROR] [FATAL] InnoDB: Tried to read 65536 bytes at offset 2048, but was only able to read 0.Cannot read from file. OS error number 13.

```

This weren't much information in `/var/log/messages`

Attachments

Issue Links

relates to

MDEV-30266 Preparing a mariabackup on a mounted CIFS / SMB file system fails

Open

Activity

Ascending order - Click to sort in descending order

Allen Lee (Inactive) created issue - 2021-11-08 05:16

Allen Lee (Inactive) added a comment - 2021-11-08 05:19 - edited

Since I do not have Windows based NAS server, I tested this with windows file sharing with SMB.

[root@localhost windows]# mariabackup --backup --target-dir=/data/cifs/windows/backup

[00] 2021-11-07 20:02:48 Connecting to MySQL server host: localhost, user: not set, password: not set, port: not set, socket: not set

[00] 2021-11-07 20:02:48 Failed to connect to MySQL server: Access denied for user ''@'localhost' (using password: NO).

[root@localhost windows]# mariabackup --backup --target-dir=/data/cifs/windows/backup --user=root

[00] 2021-11-07 20:02:55 Connecting to MySQL server host: localhost, user: root, password: not set, port: not set, socket: not set

[00] 2021-11-07 20:02:55 Using server version 10.5.10-7-MariaDB-enterprise-log

mariabackup based on MariaDB server 10.5.10-7-MariaDB Linux (x86_64)

[00] 2021-11-07 20:02:55 uses posix_fadvise().

[00] 2021-11-07 20:02:55 cd to /var/lib/mysql/

[00] 2021-11-07 20:02:55 open files limit requested 0, set to 1024

[00] 2021-11-07 20:02:55 mariabackup: using the following InnoDB configuration:

[00] 2021-11-07 20:02:55 innodb_data_home_dir =

[00] 2021-11-07 20:02:55 innodb_data_file_path = ibdata1:12M:autoextend

[00] 2021-11-07 20:02:55 innodb_log_group_home_dir = ./

[00] 2021-11-07 20:02:55 InnoDB: Using Linux native AIO

2021-11-07 20:02:55 0 [Note] InnoDB: Number of pools: 1

[00] 2021-11-07 20:02:55 mariabackup: Generating a list of tablespaces

[00] 2021-11-07 20:02:55 DDL tracking : create 5 "./test/test_table_gtid.ibd"

[00] 2021-11-07 20:02:55 DDL tracking : create 6 "./fproiddb/pmrt.ibd"

[00] 2021-11-07 20:02:55 >> log scanned up to (51805)

[00] 2021-11-07 20:02:55 Connecting to MySQL server host: localhost, user: root, password: not set, port: not set, socket: not set

[00] 2021-11-07 20:02:55 Connecting to MySQL server host: localhost, user: root, password: not set, port: not set, socket: not set

[00] 2021-11-07 20:02:55 BACKUP STAGE START

[00] 2021-11-07 20:02:55 Acquiring BACKUP LOCKS...

[00] 2021-11-07 20:02:55 Copying ./aria_log_control to /data/cifs/windows/backup/aria_log_control

[00] 2021-11-07 20:02:55         ...done

[00] 2021-11-07 20:02:55 Start scanning aria tables.

[00] 2021-11-07 20:02:55 Start scanning aria log files.

[00] 2021-11-07 20:02:55 Found aria log file: aria_log.00000001, current: 1, min: 1, max: 1

[00] 2021-11-07 20:02:55 Found 1 aria log files, minimum log number 1, maximum log number 1, last log number 1

[00] 2021-11-07 20:02:55 Stop scanning aria tables.

[00] 2021-11-07 20:02:55 Copying ibdata1 to /data/cifs/windows/backup/ibdata1

[00] 2021-11-07 20:02:55         ...done

[00] 2021-11-07 20:02:55 Copying ./mysql/innodb_table_stats.ibd to /data/cifs/windows/backup/mysql/innodb_table_stats.ibd

[00] 2021-11-07 20:02:55         ...done

[00] 2021-11-07 20:02:55 Copying ./mysql/innodb_index_stats.ibd to /data/cifs/windows/backup/mysql/innodb_index_stats.ibd

[00] 2021-11-07 20:02:55         ...done

[00] 2021-11-07 20:02:55 Copying ./mysql/transaction_registry.ibd to /data/cifs/windows/backup/mysql/transaction_registry.ibd

[00] 2021-11-07 20:02:55         ...done

[00] 2021-11-07 20:02:55 Copying ./mysql/gtid_slave_pos.ibd to /data/cifs/windows/backup/mysql/gtid_slave_pos.ibd

[00] 2021-11-07 20:02:55         ...done

[00] 2021-11-07 20:02:55 Copying ./test/test_table_gtid.ibd to /data/cifs/windows/backup/test/test_table_gtid.ibd

[00] 2021-11-07 20:02:55         ...done

[00] 2021-11-07 20:02:55 Copying ./fproiddb/pmrt.ibd to /data/cifs/windows/backup/fproiddb/pmrt.ibd

[00] 2021-11-07 20:02:55         ...done

[00] 2021-11-07 20:02:55 aria table file ./mysql/db.MAI is copied successfully.

[00] 2021-11-07 20:02:55 aria table file ./mysql/db.MAD is copied successfully.

[00] 2021-11-07 20:02:55 aria table file ./mysql/global_priv.MAI is copied successfully.

[00] 2021-11-07 20:02:55 aria table file ./mysql/global_priv.MAD is copied successfully.

[00] 2021-11-07 20:02:55 aria table file ./mysql/roles_mapping.MAI is copied successfully.

[00] 2021-11-07 20:02:55 aria table file ./mysql/roles_mapping.MAD is copied successfully.

[00] 2021-11-07 20:02:55 aria table file ./mysql/func.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/func.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/plugin.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/plugin.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/servers.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/servers.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/tables_priv.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/tables_priv.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/columns_priv.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/columns_priv.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/time_zone_name.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/time_zone_name.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/time_zone.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/time_zone.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/time_zone_transition.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/time_zone_transition.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/time_zone_transition_type.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/time_zone_transition_type.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/time_zone_leap_second.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/time_zone_leap_second.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/proc.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/proc.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/procs_priv.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/procs_priv.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/event.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/event.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/proxies_priv.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/proxies_priv.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/server_audit_filters.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/server_audit_filters.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/server_audit_users.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/server_audit_users.MAD is copied successfully.

[00] 2021-11-07 20:02:56 Start copying aria log file tail: ./aria_log.00000001

[00] 2021-11-07 20:02:56 Stop copying aria log file tail: ./aria_log.00000001, copied 24576 bytes

[00] 2021-11-07 20:02:56 BACKUP STAGE FLUSH

[00] 2021-11-07 20:02:56 Start scanning common engine tables, need backup locks: 0, collect log and stat tables: 1

[00] 2021-11-07 20:02:56 Log table found: mysql.general_log

[00] 2021-11-07 20:02:56 Collect log table file: ./mysql/general_log.CSM

[00] 2021-11-07 20:02:56 Collect log table file: ./mysql/general_log.CSV

[00] 2021-11-07 20:02:56 Log table found: mysql.slow_log

[00] 2021-11-07 20:02:56 Collect log table file: ./mysql/slow_log.CSM

[00] 2021-11-07 20:02:56 Collect log table file: ./mysql/slow_log.CSV

[00] 2021-11-07 20:02:56 Stop scanning common engine tables

[00] 2021-11-07 20:02:56 Start copying aria log file tail: ./aria_log.00000001

[00] 2021-11-07 20:02:56 Stop copying aria log file tail: ./aria_log.00000001, copied 0 bytes

[00] 2021-11-07 20:02:56 aria table file ./mysql/help_keyword.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/help_keyword.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/help_relation.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/help_relation.MAD is copied successfully.

[00] 2021-11-07 20:02:56 >> log scanned up to (51805)

[00] 2021-11-07 20:02:56 aria table file ./mysql/help_category.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/help_category.MAD is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/help_topic.MAI is copied successfully.

[00] 2021-11-07 20:02:56 aria table file ./mysql/help_topic.MAD is copied successfully.

[00] 2021-11-07 20:02:56 Start scanning common engine tables, need backup locks: 1, collect log and stat tables: 0

[00] 2021-11-07 20:02:56 Stop scanning common engine tables

[00] 2021-11-07 20:02:56 Starting to backup non-InnoDB tables and files

[01] 2021-11-07 20:02:56 Copying ./mysql/db.opt to /data/cifs/windows/backup/mysql/db.opt

[01] 2021-11-07 20:02:56         ...done

[00] 2021-11-07 20:02:56 Copied file ./mysql/slow_log.CSV for log table `mysql`.`slow_log`, 0 bytes

[01] 2021-11-07 20:02:56 Copying ./mysql/db.frm to /data/cifs/windows/backup/mysql/db.frm

[01] 2021-11-07 20:02:56         ...done

[00] 2021-11-07 20:02:56 Copied file ./mysql/general_log.CSV for log table `mysql`.`general_log`, 0 bytes

[01] 2021-11-07 20:02:56 Copying ./mysql/global_priv.frm to /data/cifs/windows/backup/mysql/global_priv.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/user.frm to /data/cifs/windows/backup/mysql/user.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/roles_mapping.frm to /data/cifs/windows/backup/mysql/roles_mapping.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/func.frm to /data/cifs/windows/backup/mysql/func.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/plugin.frm to /data/cifs/windows/backup/mysql/plugin.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/servers.frm to /data/cifs/windows/backup/mysql/servers.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/tables_priv.frm to /data/cifs/windows/backup/mysql/tables_priv.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/columns_priv.frm to /data/cifs/windows/backup/mysql/columns_priv.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/help_topic.frm to /data/cifs/windows/backup/mysql/help_topic.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/help_category.frm to /data/cifs/windows/backup/mysql/help_category.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/help_relation.frm to /data/cifs/windows/backup/mysql/help_relation.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/help_keyword.frm to /data/cifs/windows/backup/mysql/help_keyword.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/time_zone_name.frm to /data/cifs/windows/backup/mysql/time_zone_name.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/time_zone.frm to /data/cifs/windows/backup/mysql/time_zone.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/time_zone_transition.frm to /data/cifs/windows/backup/mysql/time_zone_transition.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/time_zone_transition_type.frm to /data/cifs/windows/backup/mysql/time_zone_transition_type.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/time_zone_leap_second.frm to /data/cifs/windows/backup/mysql/time_zone_leap_second.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/proc.frm to /data/cifs/windows/backup/mysql/proc.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/procs_priv.frm to /data/cifs/windows/backup/mysql/procs_priv.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/general_log.frm to /data/cifs/windows/backup/mysql/general_log.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/slow_log.frm to /data/cifs/windows/backup/mysql/slow_log.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/event.frm to /data/cifs/windows/backup/mysql/event.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/innodb_table_stats.frm to /data/cifs/windows/backup/mysql/innodb_table_stats.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/innodb_index_stats.frm to /data/cifs/windows/backup/mysql/innodb_index_stats.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/transaction_registry.frm to /data/cifs/windows/backup/mysql/transaction_registry.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/proxies_priv.frm to /data/cifs/windows/backup/mysql/proxies_priv.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/table_stats.frm to /data/cifs/windows/backup/mysql/table_stats.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/column_stats.frm to /data/cifs/windows/backup/mysql/column_stats.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/index_stats.frm to /data/cifs/windows/backup/mysql/index_stats.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/gtid_slave_pos.frm to /data/cifs/windows/backup/mysql/gtid_slave_pos.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/server_audit_filters.frm to /data/cifs/windows/backup/mysql/server_audit_filters.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./mysql/server_audit_users.frm to /data/cifs/windows/backup/mysql/server_audit_users.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./performance_schema/db.opt to /data/cifs/windows/backup/performance_schema/db.opt

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./test/db.opt to /data/cifs/windows/backup/test/db.opt

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./test/test_table_gtid.frm to /data/cifs/windows/backup/test/test_table_gtid.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./fproiddb/db.opt to /data/cifs/windows/backup/fproiddb/db.opt

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./fproiddb/pmrt.frm to /data/cifs/windows/backup/fproiddb/pmrt.frm

[01] 2021-11-07 20:02:56         ...done

[01] 2021-11-07 20:02:56 Copying ./fprofrdmdb/db.opt to /data/cifs/windows/backup/fprofrdmdb/db.opt

[01] 2021-11-07 20:02:56         ...done

[00] 2021-11-07 20:02:56 Finished backing up non-InnoDB tables and files

[00] 2021-11-07 20:02:56 Waiting for log copy thread to read lsn 51805

[00] 2021-11-07 20:02:57 >> log scanned up to (51805)

[00] 2021-11-07 20:02:57 Start copying aria log file tail: ./aria_log.00000001

[00] 2021-11-07 20:02:57 Stop copying aria log file tail: ./aria_log.00000001, copied 0 bytes

[00] 2021-11-07 20:02:57 BACKUP STAGE BLOCK_COMMIT

[00] 2021-11-07 20:02:57 Start copying statistics aria tables.

[00] 2021-11-07 20:02:57 Copied file ./mysql/slow_log.CSM for log table `mysql`.`slow_log`, 35 bytes

[00] 2021-11-07 20:02:57 Copied file ./mysql/slow_log.CSV for log table `mysql`.`slow_log`, 0 bytes

[00] 2021-11-07 20:02:57 Copied file ./mysql/general_log.CSM for log table `mysql`.`general_log`, 35 bytes

[00] 2021-11-07 20:02:57 Copied file ./mysql/general_log.CSV for log table `mysql`.`general_log`, 0 bytes

[00] 2021-11-07 20:02:57 aria table file ./mysql/index_stats.MAI is copied successfully.

[00] 2021-11-07 20:02:57 aria table file ./mysql/index_stats.MAD is copied successfully.

[00] 2021-11-07 20:02:57 aria table file ./mysql/column_stats.MAI is copied successfully.

[00] 2021-11-07 20:02:57 aria table file ./mysql/column_stats.MAD is copied successfully.

[00] 2021-11-07 20:02:57 aria table file ./mysql/table_stats.MAI is copied successfully.

[00] 2021-11-07 20:02:57 aria table file ./mysql/table_stats.MAD is copied successfully.

[00] 2021-11-07 20:02:57 Stop copying statistics aria tables.

[00] 2021-11-07 20:02:57 Start copying aria log file tail: ./aria_log.00000001

[00] 2021-11-07 20:02:57 Stop copying aria log file tail: ./aria_log.00000001, copied 8192 bytes

[00] 2021-11-07 20:02:57 Writing xtrabackup_binlog_info

[00] 2021-11-07 20:02:57         ...done

[00] 2021-11-07 20:02:57 Executing FLUSH NO_WRITE_TO_BINLOG ENGINE LOGS...

[00] 2021-11-07 20:02:57 mariabackup: The latest check point (for incremental): '45166'

mariabackup: Stopping log copying thread.[00] 2021-11-07 20:02:57 >> log scanned up to (51805)

[00] 2021-11-07 20:02:57 >> log scanned up to (51805)

[00] 2021-11-07 20:02:57 BACKUP STAGE END

[00] 2021-11-07 20:02:57 Executing BACKUP STAGE END

[00] 2021-11-07 20:02:57 All tables unlocked

[00] 2021-11-07 20:02:57 Copying ib_buffer_pool to /data/cifs/windows/backup/ib_buffer_pool

[00] 2021-11-07 20:02:57         ...done

[00] 2021-11-07 20:02:57 Backup created in directory '/data/cifs/windows/backup/'

[00] 2021-11-07 20:02:57 MySQL binlog position: filename 'mariadb-bin.000003', position '4254', GTID of the last change '100-1-22'

[00] 2021-11-07 20:02:57 Writing backup-my.cnf

[00] 2021-11-07 20:02:57         ...done

[00] 2021-11-07 20:02:57 Writing xtrabackup_info

[00] 2021-11-07 20:02:57         ...done

[00] 2021-11-07 20:02:57 Redo log (from LSN 45166 to 51805) was copied.

[00] 2021-11-07 20:02:57 completed OK!

[root@localhost windows]# mariabackup --prepare --target-dir=/data/cifs/windows/backup --user=root

mariabackup based on MariaDB server 10.5.10-7-MariaDB Linux (x86_64)

[00] 2021-11-07 20:03:09 cd to /data/cifs/windows/backup/

[00] 2021-11-07 20:03:09 open files limit requested 0, set to 1024

[00] 2021-11-07 20:03:09 This target seems to be not prepared yet.

[00] 2021-11-07 20:03:09 mariabackup: using the following InnoDB configuration for recovery:

[00] 2021-11-07 20:03:09 innodb_data_home_dir = .

[00] 2021-11-07 20:03:09 innodb_data_file_path = ibdata1:12M:autoextend

[00] 2021-11-07 20:03:09 innodb_log_group_home_dir = .

[00] 2021-11-07 20:03:09 InnoDB: Using Linux native AIO

[00] 2021-11-07 20:03:09 Starting InnoDB instance for recovery.

[00] 2021-11-07 20:03:09 mariabackup: Using 104857600 bytes for buffer pool (set by --use-memory parameter)

2021-11-07 20:03:09 0 [Note] InnoDB: Uses event mutexes

2021-11-07 20:03:09 0 [Note] InnoDB: Compressed tables use zlib 1.2.7

2021-11-07 20:03:09 0 [Note] InnoDB: Number of pools: 1

2021-11-07 20:03:09 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions

2021-11-07 20:03:09 0 [Note] InnoDB: Using Linux native AIO

2021-11-07 20:03:09 0 [Note] InnoDB: Initializing buffer pool, total size = 104857600, chunk size = 104857600

2021-11-07 20:03:09 0 [Note] InnoDB: Completed initialization of buffer pool

2021-11-07 20:03:09 0 [Warning] InnoDB: Retry attempts for reading partial data failed.

2021-11-07 20:03:09 0 [ERROR] InnoDB: Operating system error number 13 in a file operation.

2021-11-07 20:03:09 0 [ERROR] InnoDB: The error means mysqld does not have the access rights to the directory.

2021-11-07 20:03:09 0 [ERROR] [FATAL] InnoDB: Tried to read 7168 bytes at offset 2048, but was only able to read 0.Cannot read from file. OS error number 13.

211107 20:03:09 [ERROR] mysqld got signal 6 ;

This could be because you hit a bug. It is also possible that this binary

or one of the libraries it was linked against is corrupt, improperly built,

or misconfigured. This error can also be caused by malfunctioning hardware.

To report this bug, see https://mariadb.com/kb/en/reporting-bugs

We will try our best to scrape up some info that will hopefully help

diagnose the problem, but since we have already crashed,

something is definitely wrong and this may fail.

Server version: 10.5.10-7-MariaDB-enterprise

key_buffer_size=0

read_buffer_size=131072

max_used_connections=0

max_threads=1

thread_count=0

It is possible that mysqld could use up to

key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 6057 K  bytes of memory

Hope that's ok; if not, decrease some variables in the equation.

Thread pointer: 0x0

Attempting backtrace. You can use the following information to find out

where mysqld died. If you see no messages after this, something went

terribly wrong...

stack_bottom = 0x0 thread_stack 0x49000

addr2line: 'mariabackup': No such file

mariabackup(my_print_stacktrace+0x2e)[0x559ea27b382e]

Printing to addr2line failed

mariabackup(handle_fatal_signal+0x307)[0x559ea21f7f97]

sigaction.c:0(__restore_rt)[0x7f1343d6f5f0]

:0(__GI_raise)[0x7f13431bb337]

:0(__GI_abort)[0x7f13431bca28]

addr2line: 'mariabackup': No such file

mariabackup(+0xf0fb70)[0x559ea26b1b70]

mariabackup(+0xe195ad)[0x559ea25bb5ad]

mariabackup(+0xe1c917)[0x559ea25be917]

mariabackup(+0xdfe958)[0x559ea25a0958]

mariabackup(+0xdff9b8)[0x559ea25a19b8]

mariabackup(+0xe08e88)[0x559ea25aae88]

mariabackup(+0xe0d715)[0x559ea25af715]

mariabackup(+0xe0e34b)[0x559ea25b034b]

mariabackup(+0xec19cc)[0x559ea26639cc]

mariabackup(+0x6cf962)[0x559ea1e71962]

mariabackup(main+0x17f)[0x559ea1e155ff]

??:0(__libc_start_main)[0x7f13431a7505]

addr2line: 'mariabackup': No such file

mariabackup(+0x6bca23)[0x559ea1e5ea23]

The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains

information that should help you find out what is causing the crash.

Writing a core file...

Working directory at /data/cifs/windows/backup

Resource Limits:

Limit                     Soft Limit           Hard Limit           Units

Max cpu time              unlimited            unlimited            seconds

Max file size             unlimited            unlimited            bytes

Max data size             unlimited            unlimited            bytes

Max stack size            8388608              unlimited            bytes

Max core file size        0                    unlimited            bytes

Max resident set          unlimited            unlimited            bytes

Max processes             63344                63344                processes

Max open files            1024                 4096                 files

Max locked memory         65536                65536                bytes

Max address space         unlimited            unlimited            bytes

Max file locks            unlimited            unlimited            locks

Max pending signals       63344                63344                signals

Max msgqueue size         819200               819200               bytes

Max nice priority         0                    0

Max realtime priority     0                    0

Max realtime timeout      unlimited            unlimited            us

Core pattern: |/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t e %P %I %h

Aborted (core dumped)

I was hitting the same signal 6.

Allen Lee (Inactive) added a comment - 2021-11-08 05:19 - edited Since I do not have Windows based NAS server, I tested this with windows file sharing with SMB. [root @localhost windows]# mariabackup --backup --target-dir=/data/cifs/windows/backup [ 00 ] 2021 - 11 - 07 20 : 02 : 48 Connecting to MySQL server host: localhost, user: not set, password: not set, port: not set, socket: not set [ 00 ] 2021 - 11 - 07 20 : 02 : 48 Failed to connect to MySQL server: Access denied for user '' @ 'localhost' (using password: NO). [root @localhost windows]# mariabackup --backup --target-dir=/data/cifs/windows/backup --user=root [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Connecting to MySQL server host: localhost, user: root, password: not set, port: not set, socket: not set [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Using server version 10.5 . 10 - 7 -MariaDB-enterprise-log mariabackup based on MariaDB server 10.5 . 10 - 7 -MariaDB Linux (x86_64) [ 00 ] 2021 - 11 - 07 20 : 02 : 55 uses posix_fadvise(). [ 00 ] 2021 - 11 - 07 20 : 02 : 55 cd to /var/lib/mysql/ [ 00 ] 2021 - 11 - 07 20 : 02 : 55 open files limit requested 0 , set to 1024 [ 00 ] 2021 - 11 - 07 20 : 02 : 55 mariabackup: using the following InnoDB configuration: [ 00 ] 2021 - 11 - 07 20 : 02 : 55 innodb_data_home_dir = [ 00 ] 2021 - 11 - 07 20 : 02 : 55 innodb_data_file_path = ibdata1:12M:autoextend [ 00 ] 2021 - 11 - 07 20 : 02 : 55 innodb_log_group_home_dir = ./ [ 00 ] 2021 - 11 - 07 20 : 02 : 55 InnoDB: Using Linux native AIO 2021 - 11 - 07 20 : 02 : 55 0 [Note] InnoDB: Number of pools: 1 [ 00 ] 2021 - 11 - 07 20 : 02 : 55 mariabackup: Generating a list of tablespaces [ 00 ] 2021 - 11 - 07 20 : 02 : 55 DDL tracking : create 5 "./test/test_table_gtid.ibd" [ 00 ] 2021 - 11 - 07 20 : 02 : 55 DDL tracking : create 6 "./fproiddb/pmrt.ibd" [ 00 ] 2021 - 11 - 07 20 : 02 : 55 >> log scanned up to ( 51805 ) [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Connecting to MySQL server host: localhost, user: root, password: not set, port: not set, socket: not set [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Connecting to MySQL server host: localhost, user: root, password: not set, port: not set, socket: not set [ 00 ] 2021 - 11 - 07 20 : 02 : 55 BACKUP STAGE START [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Acquiring BACKUP LOCKS... [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Copying ./aria_log_control to /data/cifs/windows/backup/aria_log_control [ 00 ] 2021 - 11 - 07 20 : 02 : 55 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Start scanning aria tables. [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Start scanning aria log files. [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Found aria log file: aria_log. 00000001 , current: 1 , min: 1 , max: 1 [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Found 1 aria log files, minimum log number 1 , maximum log number 1 , last log number 1 [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Stop scanning aria tables. [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Copying ibdata1 to /data/cifs/windows/backup/ibdata1 [ 00 ] 2021 - 11 - 07 20 : 02 : 55 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Copying ./mysql/innodb_table_stats.ibd to /data/cifs/windows/backup/mysql/innodb_table_stats.ibd [ 00 ] 2021 - 11 - 07 20 : 02 : 55 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Copying ./mysql/innodb_index_stats.ibd to /data/cifs/windows/backup/mysql/innodb_index_stats.ibd [ 00 ] 2021 - 11 - 07 20 : 02 : 55 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Copying ./mysql/transaction_registry.ibd to /data/cifs/windows/backup/mysql/transaction_registry.ibd [ 00 ] 2021 - 11 - 07 20 : 02 : 55 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Copying ./mysql/gtid_slave_pos.ibd to /data/cifs/windows/backup/mysql/gtid_slave_pos.ibd [ 00 ] 2021 - 11 - 07 20 : 02 : 55 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Copying ./test/test_table_gtid.ibd to /data/cifs/windows/backup/test/test_table_gtid.ibd [ 00 ] 2021 - 11 - 07 20 : 02 : 55 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 55 Copying ./fproiddb/pmrt.ibd to /data/cifs/windows/backup/fproiddb/pmrt.ibd [ 00 ] 2021 - 11 - 07 20 : 02 : 55 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 55 aria table file ./mysql/db.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 55 aria table file ./mysql/db.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 55 aria table file ./mysql/global_priv.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 55 aria table file ./mysql/global_priv.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 55 aria table file ./mysql/roles_mapping.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 55 aria table file ./mysql/roles_mapping.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 55 aria table file ./mysql/func.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/func.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/plugin.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/plugin.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/servers.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/servers.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/tables_priv.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/tables_priv.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/columns_priv.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/columns_priv.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/time_zone_name.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/time_zone_name.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/time_zone.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/time_zone.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/time_zone_transition.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/time_zone_transition.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/time_zone_transition_type.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/time_zone_transition_type.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/time_zone_leap_second.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/time_zone_leap_second.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/proc.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/proc.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/procs_priv.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/procs_priv.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/event.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/event.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/proxies_priv.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/proxies_priv.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/server_audit_filters.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/server_audit_filters.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/server_audit_users.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/server_audit_users.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Start copying aria log file tail: ./aria_log. 00000001 [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Stop copying aria log file tail: ./aria_log. 00000001 , copied 24576 bytes [ 00 ] 2021 - 11 - 07 20 : 02 : 56 BACKUP STAGE FLUSH [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Start scanning common engine tables, need backup locks: 0 , collect log and stat tables: 1 [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Log table found: mysql.general_log [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Collect log table file: ./mysql/general_log.CSM [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Collect log table file: ./mysql/general_log.CSV [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Log table found: mysql.slow_log [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Collect log table file: ./mysql/slow_log.CSM [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Collect log table file: ./mysql/slow_log.CSV [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Stop scanning common engine tables [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Start copying aria log file tail: ./aria_log. 00000001 [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Stop copying aria log file tail: ./aria_log. 00000001 , copied 0 bytes [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/help_keyword.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/help_keyword.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/help_relation.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/help_relation.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 >> log scanned up to ( 51805 ) [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/help_category.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/help_category.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/help_topic.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 aria table file ./mysql/help_topic.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Start scanning common engine tables, need backup locks: 1 , collect log and stat tables: 0 [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Stop scanning common engine tables [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Starting to backup non-InnoDB tables and files [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/db.opt to /data/cifs/windows/backup/mysql/db.opt [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Copied file ./mysql/slow_log.CSV for log table `mysql`.`slow_log`, 0 bytes [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/db.frm to /data/cifs/windows/backup/mysql/db.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Copied file ./mysql/general_log.CSV for log table `mysql`.`general_log`, 0 bytes [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/global_priv.frm to /data/cifs/windows/backup/mysql/global_priv.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/user.frm to /data/cifs/windows/backup/mysql/user.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/roles_mapping.frm to /data/cifs/windows/backup/mysql/roles_mapping.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/func.frm to /data/cifs/windows/backup/mysql/func.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/plugin.frm to /data/cifs/windows/backup/mysql/plugin.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/servers.frm to /data/cifs/windows/backup/mysql/servers.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/tables_priv.frm to /data/cifs/windows/backup/mysql/tables_priv.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/columns_priv.frm to /data/cifs/windows/backup/mysql/columns_priv.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/help_topic.frm to /data/cifs/windows/backup/mysql/help_topic.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/help_category.frm to /data/cifs/windows/backup/mysql/help_category.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/help_relation.frm to /data/cifs/windows/backup/mysql/help_relation.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/help_keyword.frm to /data/cifs/windows/backup/mysql/help_keyword.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/time_zone_name.frm to /data/cifs/windows/backup/mysql/time_zone_name.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/time_zone.frm to /data/cifs/windows/backup/mysql/time_zone.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/time_zone_transition.frm to /data/cifs/windows/backup/mysql/time_zone_transition.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/time_zone_transition_type.frm to /data/cifs/windows/backup/mysql/time_zone_transition_type.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/time_zone_leap_second.frm to /data/cifs/windows/backup/mysql/time_zone_leap_second.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/proc.frm to /data/cifs/windows/backup/mysql/proc.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/procs_priv.frm to /data/cifs/windows/backup/mysql/procs_priv.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/general_log.frm to /data/cifs/windows/backup/mysql/general_log.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/slow_log.frm to /data/cifs/windows/backup/mysql/slow_log.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/event.frm to /data/cifs/windows/backup/mysql/event.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/innodb_table_stats.frm to /data/cifs/windows/backup/mysql/innodb_table_stats.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/innodb_index_stats.frm to /data/cifs/windows/backup/mysql/innodb_index_stats.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/transaction_registry.frm to /data/cifs/windows/backup/mysql/transaction_registry.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/proxies_priv.frm to /data/cifs/windows/backup/mysql/proxies_priv.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/table_stats.frm to /data/cifs/windows/backup/mysql/table_stats.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/column_stats.frm to /data/cifs/windows/backup/mysql/column_stats.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/index_stats.frm to /data/cifs/windows/backup/mysql/index_stats.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/gtid_slave_pos.frm to /data/cifs/windows/backup/mysql/gtid_slave_pos.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/server_audit_filters.frm to /data/cifs/windows/backup/mysql/server_audit_filters.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./mysql/server_audit_users.frm to /data/cifs/windows/backup/mysql/server_audit_users.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./performance_schema/db.opt to /data/cifs/windows/backup/performance_schema/db.opt [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./test/db.opt to /data/cifs/windows/backup/test/db.opt [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./test/test_table_gtid.frm to /data/cifs/windows/backup/test/test_table_gtid.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./fproiddb/db.opt to /data/cifs/windows/backup/fproiddb/db.opt [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./fproiddb/pmrt.frm to /data/cifs/windows/backup/fproiddb/pmrt.frm [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 01 ] 2021 - 11 - 07 20 : 02 : 56 Copying ./fprofrdmdb/db.opt to /data/cifs/windows/backup/fprofrdmdb/db.opt [ 01 ] 2021 - 11 - 07 20 : 02 : 56 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Finished backing up non-InnoDB tables and files [ 00 ] 2021 - 11 - 07 20 : 02 : 56 Waiting for log copy thread to read lsn 51805 [ 00 ] 2021 - 11 - 07 20 : 02 : 57 >> log scanned up to ( 51805 ) [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Start copying aria log file tail: ./aria_log. 00000001 [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Stop copying aria log file tail: ./aria_log. 00000001 , copied 0 bytes [ 00 ] 2021 - 11 - 07 20 : 02 : 57 BACKUP STAGE BLOCK_COMMIT [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Start copying statistics aria tables. [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Copied file ./mysql/slow_log.CSM for log table `mysql`.`slow_log`, 35 bytes [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Copied file ./mysql/slow_log.CSV for log table `mysql`.`slow_log`, 0 bytes [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Copied file ./mysql/general_log.CSM for log table `mysql`.`general_log`, 35 bytes [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Copied file ./mysql/general_log.CSV for log table `mysql`.`general_log`, 0 bytes [ 00 ] 2021 - 11 - 07 20 : 02 : 57 aria table file ./mysql/index_stats.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 57 aria table file ./mysql/index_stats.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 57 aria table file ./mysql/column_stats.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 57 aria table file ./mysql/column_stats.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 57 aria table file ./mysql/table_stats.MAI is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 57 aria table file ./mysql/table_stats.MAD is copied successfully. [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Stop copying statistics aria tables. [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Start copying aria log file tail: ./aria_log. 00000001 [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Stop copying aria log file tail: ./aria_log. 00000001 , copied 8192 bytes [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Writing xtrabackup_binlog_info [ 00 ] 2021 - 11 - 07 20 : 02 : 57 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Executing FLUSH NO_WRITE_TO_BINLOG ENGINE LOGS... [ 00 ] 2021 - 11 - 07 20 : 02 : 57 mariabackup: The latest check point ( for incremental): '45166' mariabackup: Stopping log copying thread.[ 00 ] 2021 - 11 - 07 20 : 02 : 57 >> log scanned up to ( 51805 ) [ 00 ] 2021 - 11 - 07 20 : 02 : 57 >> log scanned up to ( 51805 ) [ 00 ] 2021 - 11 - 07 20 : 02 : 57 BACKUP STAGE END [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Executing BACKUP STAGE END [ 00 ] 2021 - 11 - 07 20 : 02 : 57 All tables unlocked [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Copying ib_buffer_pool to /data/cifs/windows/backup/ib_buffer_pool [ 00 ] 2021 - 11 - 07 20 : 02 : 57 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Backup created in directory '/data/cifs/windows/backup/' [ 00 ] 2021 - 11 - 07 20 : 02 : 57 MySQL binlog position: filename 'mariadb-bin.000003' , position '4254' , GTID of the last change '100-1-22' [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Writing backup-my.cnf [ 00 ] 2021 - 11 - 07 20 : 02 : 57 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Writing xtrabackup_info [ 00 ] 2021 - 11 - 07 20 : 02 : 57 ...done [ 00 ] 2021 - 11 - 07 20 : 02 : 57 Redo log (from LSN 45166 to 51805 ) was copied. [ 00 ] 2021 - 11 - 07 20 : 02 : 57 completed OK! [root @localhost windows]# mariabackup --prepare --target-dir=/data/cifs/windows/backup --user=root mariabackup based on MariaDB server 10.5 . 10 - 7 -MariaDB Linux (x86_64) [ 00 ] 2021 - 11 - 07 20 : 03 : 09 cd to /data/cifs/windows/backup/ [ 00 ] 2021 - 11 - 07 20 : 03 : 09 open files limit requested 0 , set to 1024 [ 00 ] 2021 - 11 - 07 20 : 03 : 09 This target seems to be not prepared yet. [ 00 ] 2021 - 11 - 07 20 : 03 : 09 mariabackup: using the following InnoDB configuration for recovery: [ 00 ] 2021 - 11 - 07 20 : 03 : 09 innodb_data_home_dir = . [ 00 ] 2021 - 11 - 07 20 : 03 : 09 innodb_data_file_path = ibdata1:12M:autoextend [ 00 ] 2021 - 11 - 07 20 : 03 : 09 innodb_log_group_home_dir = . [ 00 ] 2021 - 11 - 07 20 : 03 : 09 InnoDB: Using Linux native AIO [ 00 ] 2021 - 11 - 07 20 : 03 : 09 Starting InnoDB instance for recovery. [ 00 ] 2021 - 11 - 07 20 : 03 : 09 mariabackup: Using 104857600 bytes for buffer pool (set by --use-memory parameter) 2021 - 11 - 07 20 : 03 : 09 0 [Note] InnoDB: Uses event mutexes 2021 - 11 - 07 20 : 03 : 09 0 [Note] InnoDB: Compressed tables use zlib 1.2 . 7 2021 - 11 - 07 20 : 03 : 09 0 [Note] InnoDB: Number of pools: 1 2021 - 11 - 07 20 : 03 : 09 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions 2021 - 11 - 07 20 : 03 : 09 0 [Note] InnoDB: Using Linux native AIO 2021 - 11 - 07 20 : 03 : 09 0 [Note] InnoDB: Initializing buffer pool, total size = 104857600 , chunk size = 104857600 2021 - 11 - 07 20 : 03 : 09 0 [Note] InnoDB: Completed initialization of buffer pool 2021 - 11 - 07 20 : 03 : 09 0 [Warning] InnoDB: Retry attempts for reading partial data failed. 2021 - 11 - 07 20 : 03 : 09 0 [ERROR] InnoDB: Operating system error number 13 in a file operation. 2021 - 11 - 07 20 : 03 : 09 0 [ERROR] InnoDB: The error means mysqld does not have the access rights to the directory. 2021 - 11 - 07 20 : 03 : 09 0 [ERROR] [FATAL] InnoDB: Tried to read 7168 bytes at offset 2048 , but was only able to read 0 .Cannot read from file. OS error number 13 . 211107 20 : 03 : 09 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https: //mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.5 . 10 - 7 -MariaDB-enterprise key_buffer_size= 0 read_buffer_size= 131072 max_used_connections= 0 max_threads= 1 thread_count= 0 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 6057 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this , something went terribly wrong... stack_bottom = 0x0 thread_stack 0x49000 addr2line: 'mariabackup' : No such file mariabackup(my_print_stacktrace+ 0x2e )[ 0x559ea27b382e ] Printing to addr2line failed mariabackup(handle_fatal_signal+ 0x307 )[ 0x559ea21f7f97 ] sigaction.c: 0 (__restore_rt)[ 0x7f1343d6f5f0 ] : 0 (__GI_raise)[ 0x7f13431bb337 ] : 0 (__GI_abort)[ 0x7f13431bca28 ] addr2line: 'mariabackup' : No such file mariabackup(+ 0xf0fb70 )[ 0x559ea26b1b70 ] mariabackup(+ 0xe195ad )[ 0x559ea25bb5ad ] mariabackup(+ 0xe1c917 )[ 0x559ea25be917 ] mariabackup(+ 0xdfe958 )[ 0x559ea25a0958 ] mariabackup(+ 0xdff9b8 )[ 0x559ea25a19b8 ] mariabackup(+ 0xe08e88 )[ 0x559ea25aae88 ] mariabackup(+ 0xe0d715 )[ 0x559ea25af715 ] mariabackup(+ 0xe0e34b )[ 0x559ea25b034b ] mariabackup(+ 0xec19cc )[ 0x559ea26639cc ] mariabackup(+ 0x6cf962 )[ 0x559ea1e71962 ] mariabackup(main+ 0x17f )[ 0x559ea1e155ff ] ??: 0 (__libc_start_main)[ 0x7f13431a7505 ] addr2line: 'mariabackup' : No such file mariabackup(+ 0x6bca23 )[ 0x559ea1e5ea23 ] The manual page at https: //mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /data/cifs/windows/backup Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size 0 unlimited bytes Max resident set unlimited unlimited bytes Max processes 63344 63344 processes Max open files 1024 4096 files Max locked memory 65536 65536 bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 63344 63344 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: |/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t e %P %I %h Aborted (core dumped) I was hitting the same signal 6.

Allen Lee (Inactive) made changes - 2021-11-08 06:08

Field	Original Value	New Value
Fix Version/s		N/A [ 14700 ]
Resolution		Not a Bug [ 6 ]
Status	Open [ 1 ]	Closed [ 6 ]

Allen Lee (Inactive) made changes - 2021-11-08 23:31

Description

mariabackup --backup works well, however it fails on --prepare stage.

{code:java}
[root@DBSV DBSV]# mariadb-backup --prepare --target-dir=/mnt/backup/DBSV/mariadb/$dt
mariadb-backup based on MariaDB server 10.5.10-7-MariaDB Linux (x86_64)
[00] 2021-10-06 19:21:30 cd to /mnt/backup/DBSV/mariadb/202110061912/
[00] 2021-10-06 19:21:30 open files limit requested 0, set to 1024
[00] 2021-10-06 19:21:31 This target seems to be not prepared yet.
[00] 2021-10-06 19:21:31 mariabackup: using the following InnoDB configuration for recovery:
[00] 2021-10-06 19:21:31 innodb_data_home_dir = .
[00] 2021-10-06 19:21:31 innodb_data_file_path = ibdata1:12M:autoextend
[00] 2021-10-06 19:21:31 innodb_log_group_home_dir = .
[00] 2021-10-06 19:21:31 InnoDB: Using Linux native AIO
[00] 2021-10-06 19:21:31 Starting InnoDB instance for recovery.
[00] 2021-10-06 19:21:31 mariabackup: Using 104857600 bytes for buffer pool (set by --use-memory parameter)
2021-10-06 19:21:31 0 [Note] InnoDB: Uses event mutexes
2021-10-06 19:21:31 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2021-10-06 19:21:31 0 [Note] InnoDB: Number of pools: 1
2021-10-06 19:21:31 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
2021-10-06 19:21:31 0 [Note] InnoDB: Using Linux native AIO
2021-10-06 19:21:31 0 [Note] InnoDB: Initializing buffer pool, total size = 104857600, chunk size = 104857600
2021-10-06 19:21:31 0 [Note] InnoDB: Completed initialization of buffer pool
2021-10-06 19:21:31 0 [Warning] InnoDB: Retry attempts for reading partial data failed.
2021-10-06 19:21:31 0 [ERROR] InnoDB: Operating system error number 13 in a file operation.
2021-10-06 19:21:31 0 [ERROR] InnoDB: The error means mysqld does not have the access rights to the directory.
2021-10-06 19:21:31 0 [ERROR] [FATAL] InnoDB: Tried to read 5120 bytes at offset 2048, but was only able to read 0.Cannot read from file. OS error number 13.
211006 19:21:31 [ERROR] mysqld got signal 6 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.

To report this bug, see https://mariadb.com/kb/en/reporting-bugs

We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.

Server version: 10.5.10-7-MariaDB-enterprise
key_buffer_size=0
read_buffer_size=131072
max_used_connections=0
max_threads=1
thread_count=0
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 6057 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

Thread pointer: 0x0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0x0 thread_stack 0x49000
addr2line: 'mariadb-backup': そのようなファイルはありません
mariadb-backup(my_print_stacktrace+0x2e)[0x55d5918a29be]
Printing to addr2line failed
mariadb-backup(handle_fatal_signal+0x485)[0x55d5913907d5]
sigaction.c:0(__restore_rt)[0x7fc2610d7b20]
:0(__GI_raise)[0x7fc26041c37f]
:0(__GI_abort)[0x7fc260406db5]
addr2line: 'mariadb-backup': そのようなファイルはありません
mariadb-backup(+0x65fc95)[0x55d590fdbc95]
mariadb-backup(+0x642ef4)[0x55d590fbeef4]
mariadb-backup(+0xd737c2)[0x55d5916ef7c2]
mariadb-backup(+0xd5e3c0)[0x55d5916da3c0]
mariadb-backup(+0xd65e23)[0x55d5916e1e23]
mariadb-backup(+0xd690ea)[0x55d5916e50ea]
mariadb-backup(+0xd69654)[0x55d5916e5654]
mariadb-backup(+0x65828b)[0x55d590fd428b]
mariadb-backup(+0x6b2b1b)[0x55d59102eb1b]
mariadb-backup(main+0x181)[0x55d590febdc1]
??:0(__libc_start_main)[0x7fc260408493]
addr2line: 'mariadb-backup': そのようなファイルはありません
mariadb-backup(_start+0x2e)[0x55d59101d9de]
The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains
information that should help you find out what is causing the crash.
Writing a core file...
Working directory at /mnt/backup/DBSV/mariadb/202110061912
Resource Limits:
Limit Soft Limit Hard Limit Units
Max cpu time unlimited unlimited seconds
Max file size unlimited unlimited bytes
Max data size unlimited unlimited bytes
Max stack size 8388608 unlimited bytes
Max core file size unlimited unlimited bytes
Max resident set unlimited unlimited bytes
Max processes 158623 158623 processes
Max open files 1024 262144 files
Max locked memory 65536 65536 bytes
Max address space unlimited unlimited bytes
Max file locks unlimited unlimited locks
Max pending signals 158623 158623 signals
Max msgqueue size 819200 819200 bytes
Max nice priority 0 0
Max realtime priority 0 0
Max realtime timeout unlimited unlimited us
Core pattern: |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e

中止 (コアダンプ)
{code}

{code:java}
[root@DBSV ~]# df -h
ファイルシスサイズ使用残り使用% マウント位置
devtmpfs 20G 0 20G 0% /dev
tmpfs 20G 7.3M 20G 1% /dev/shm
tmpfs 20G 1.5M 20G 1% /run
tmpfs 20G 0 20G 0% /sys/fs/cgroup
/dev/mapper/rhel-root 1.1T 18G 1.1T 2% /
/dev/sdb2 1006M 236M 771M 24% /boot
/dev/sdb1 599M 5.8M 594M 1% /boot/efi
//172.16.10.138/Share 3.7T 86G 3.6T 3% /mnt/data
//172.16.10.138/Backup 3.7T 86G 3.6T 3% /mnt/backup
tmpfs 3.9G 4.0K 3.9G 1% /run/user/1000

[root@DBSV ~]# cat /etc/selinux/config

# This file controls the state of SELinux on the system.
# SELINUX= can take one of these three values:
# enforcing - SELinux security policy is enforced.
# permissive - SELinux prints warnings instead of enforcing.
# disabled - No SELinux policy is loaded.
SELINUX=permissive
# SELINUXTYPE= can take one of these three values:
# targeted - Targeted processes are protected,
# minimum - Modification of targeted policy. Only selected processes are protected.
# mls - Multi Level Security protection.
SELINUXTYPE=targeted
{code}

customer noted:
{code:java}
The execution logs for each are attached.
- NAS
- Local Storage

Investigate the cause of the following error that occurs when executing "prepare" in the backup directory on the NAS.
(When I copy the file to local storage and run "prepare", it terminates normally, so there seems to be no problem with the backup file.)

```
2021-10-29 20:18:10 0 [Warning] InnoDB: Retry attempts for reading partial data failed.
2021-10-29 20:18:10 0 [ERROR] InnoDB: Operating system error number 13 in a file operation.
2021-10-29 20:18:10 0 [ERROR] InnoDB: The error means mysqld does not have the access rights to the directory.
2021-10-29 20:18:10 0 [ERROR] [FATAL] InnoDB: Tried to read 65536 bytes at offset 2048, but was only able to read 0.Cannot read from file. OS error number 13.
```
{code}

This weren't much information in `/var/log/messages`

mariabackup --backup works well, however it fails on --prepare stage.

{code:java}
[root@XXX XXX]# mariadb-backup --prepare --target-dir=/mnt/backup/XXX/mariadb/$dt
mariadb-backup based on MariaDB server 10.5.10-7-MariaDB Linux (x86_64)
[00] 2021-10-06 19:21:30 cd to /mnt/backup/XXX/mariadb/202110061912/
[00] 2021-10-06 19:21:30 open files limit requested 0, set to 1024
[00] 2021-10-06 19:21:31 This target seems to be not prepared yet.
[00] 2021-10-06 19:21:31 mariabackup: using the following InnoDB configuration for recovery:
[00] 2021-10-06 19:21:31 innodb_data_home_dir = .
[00] 2021-10-06 19:21:31 innodb_data_file_path = ibdata1:12M:autoextend
[00] 2021-10-06 19:21:31 innodb_log_group_home_dir = .
[00] 2021-10-06 19:21:31 InnoDB: Using Linux native AIO
[00] 2021-10-06 19:21:31 Starting InnoDB instance for recovery.
[00] 2021-10-06 19:21:31 mariabackup: Using 104857600 bytes for buffer pool (set by --use-memory parameter)
2021-10-06 19:21:31 0 [Note] InnoDB: Uses event mutexes
2021-10-06 19:21:31 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2021-10-06 19:21:31 0 [Note] InnoDB: Number of pools: 1
2021-10-06 19:21:31 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
2021-10-06 19:21:31 0 [Note] InnoDB: Using Linux native AIO
2021-10-06 19:21:31 0 [Note] InnoDB: Initializing buffer pool, total size = 104857600, chunk size = 104857600
2021-10-06 19:21:31 0 [Note] InnoDB: Completed initialization of buffer pool
2021-10-06 19:21:31 0 [Warning] InnoDB: Retry attempts for reading partial data failed.
2021-10-06 19:21:31 0 [ERROR] InnoDB: Operating system error number 13 in a file operation.
2021-10-06 19:21:31 0 [ERROR] InnoDB: The error means mysqld does not have the access rights to the directory.
2021-10-06 19:21:31 0 [ERROR] [FATAL] InnoDB: Tried to read 5120 bytes at offset 2048, but was only able to read 0.Cannot read from file. OS error number 13.
211006 19:21:31 [ERROR] mysqld got signal 6 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.

To report this bug, see https://mariadb.com/kb/en/reporting-bugs

We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.

Server version: 10.5.10-7-MariaDB-enterprise
key_buffer_size=0
read_buffer_size=131072
max_used_connections=0
max_threads=1
thread_count=0
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 6057 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

Thread pointer: 0x0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0x0 thread_stack 0x49000
addr2line: 'mariadb-backup': そのようなファイルはありません
mariadb-backup(my_print_stacktrace+0x2e)[0x55d5918a29be]
Printing to addr2line failed
mariadb-backup(handle_fatal_signal+0x485)[0x55d5913907d5]
sigaction.c:0(__restore_rt)[0x7fc2610d7b20]
:0(__GI_raise)[0x7fc26041c37f]
:0(__GI_abort)[0x7fc260406db5]
addr2line: 'mariadb-backup': そのようなファイルはありません
mariadb-backup(+0x65fc95)[0x55d590fdbc95]
mariadb-backup(+0x642ef4)[0x55d590fbeef4]
mariadb-backup(+0xd737c2)[0x55d5916ef7c2]
mariadb-backup(+0xd5e3c0)[0x55d5916da3c0]
mariadb-backup(+0xd65e23)[0x55d5916e1e23]
mariadb-backup(+0xd690ea)[0x55d5916e50ea]
mariadb-backup(+0xd69654)[0x55d5916e5654]
mariadb-backup(+0x65828b)[0x55d590fd428b]
mariadb-backup(+0x6b2b1b)[0x55d59102eb1b]
mariadb-backup(main+0x181)[0x55d590febdc1]
??:0(__libc_start_main)[0x7fc260408493]
addr2line: 'mariadb-backup': そのようなファイルはありません
mariadb-backup(_start+0x2e)[0x55d59101d9de]
The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains
information that should help you find out what is causing the crash.
Writing a core file...
Working directory at /mnt/backup/XXX/mariadb/202110061912
Resource Limits:
Limit Soft Limit Hard Limit Units
Max cpu time unlimited unlimited seconds
Max file size unlimited unlimited bytes
Max data size unlimited unlimited bytes
Max stack size 8388608 unlimited bytes
Max core file size unlimited unlimited bytes
Max resident set unlimited unlimited bytes
Max processes 158623 158623 processes
Max open files 1024 262144 files
Max locked memory 65536 65536 bytes
Max address space unlimited unlimited bytes
Max file locks unlimited unlimited locks
Max pending signals 158623 158623 signals
Max msgqueue size 819200 819200 bytes
Max nice priority 0 0
Max realtime priority 0 0
Max realtime timeout unlimited unlimited us
Core pattern: |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e

中止 (コアダンプ)
{code}

{code:java}
[root@XXX ~]# df -h
....
//xxx.xx.xx.xxx/Share 3.7T 86G 3.6T 3% /mnt/data
//xxx.xx.xx.xxx/Backup 3.7T 86G 3.6T 3% /mnt/backup
tmpfs 3.9G 4.0K 3.9G 1% /run/user/1000

[root@XXX ~]# cat /etc/selinux/config

# This file controls the state of SELinux on the system.
# SELINUX= can take one of these three values:
# enforcing - SELinux security policy is enforced.
# permissive - SELinux prints warnings instead of enforcing.
# disabled - No SELinux policy is loaded.
SELINUX=permissive
# SELINUXTYPE= can take one of these three values:
# targeted - Targeted processes are protected,
# minimum - Modification of targeted policy. Only selected processes are protected.
# mls - Multi Level Security protection.
SELINUXTYPE=targeted
{code}

customer noted:
{code:java}
The execution logs for each are attached.
- NAS
- Local Storage

Investigate the cause of the following error that occurs when executing "prepare" in the backup directory on the NAS.
(When I copy the file to local storage and run "prepare", it terminates normally, so there seems to be no problem with the backup file.)

```
2021-10-29 20:18:10 0 [Warning] InnoDB: Retry attempts for reading partial data failed.
2021-10-29 20:18:10 0 [ERROR] InnoDB: Operating system error number 13 in a file operation.
2021-10-29 20:18:10 0 [ERROR] InnoDB: The error means mysqld does not have the access rights to the directory.
2021-10-29 20:18:10 0 [ERROR] [FATAL] InnoDB: Tried to read 65536 bytes at offset 2048, but was only able to read 0.Cannot read from file. OS error number 13.
```
{code}

This weren't much information in `/var/log/messages`

Sergei Golubchik made changes - 2021-12-06 21:54

Workflow

MariaDB v3 [ 127113 ]

MariaDB v4 [ 159830 ]

Daniel Black made changes - 2022-12-19 21:17

Link

This issue relates to MDEV-30266 [ MDEV-30266 ]

Jira Automation (IT) made changes - 2024-07-04 01:55

Zendesk Related Tickets

128050

People

Assignee:: Unassigned

Reporter:: Allen Lee (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 2021-11-08 05:16

Updated:: 2024-07-07 21:01

Resolved:: 2021-11-08 06:08

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.

MariaDB Server

Details

Description

Attachments

Issue Links

Activity

People

Dates

Git Integration