[MDEV-22226] mariabackup SST fails, open-files-limit limited by that of mysqld Created: 2020-04-12  Updated: 2023-04-11

Status: Open
Project: MariaDB Server
Component/s: Galera SST, mariabackup
Affects Version/s: 10.4.12
Fix Version/s: 10.4

Type: Bug Priority: Major
Reporter: Adam Purkrt Assignee: Julius Goryavsky
Resolution: Unresolved Votes: 0
Labels: None
Environment:

gentoo gnu/linux


 Description   

0) galera cluster of three nodes
1) config:
[mysqld]open_files_limit is unset, i.e. using the default calculated value
[mysqld]wsrep_sst_method=mariabackup
[mariabackup]open-files-limit = 35000
2) cat /proc/<pid of mysqld>/limits | grep files
Max open files 10640 10640 files
3) find /var/lib/mysql -type f | wc -l
31303
4) start SST - it fails - /var/lib/mysql/mariabackup.backup.log on the donor says:
[00] 2020-04-12 13:33:13 open files limit requested 35000, set to 10640
...
2020-04-12 13:33:25 0 [ERROR] InnoDB: Operating system error number 24 in a file operation.
2020-04-12 13:33:25 0 [ERROR] InnoDB: Error number 24 means 'Too many open files'

[mariabackup]open-files-limit is limited by the current limit of mysqld during SST. Seems like a bug.

 Comments   
Comment by Adam Purkrt [ 2020-04-12 ]

When I run mariabackup as root
g1 ~ # mariabackup --backup --target-dir=/root/backup/ --user=mariabackup --password=<password>
the open-files-limit is respected - I see
...
[00] 2020-04-12 14:49:27 open files limit requested 35000, set to 35000
...
and the backup works fine. It is only during sst when it fails.

Generated at Thu Feb 08 09:13:09 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.