[MDEV-15661] After Sporadically occurred ' [Warning] InnoDB: Allocated tablespace ID 88 for test/t, old maximum was 0 ' , mariabackup.mdev-14447 test failed Created: 2018-03-26  Updated: 2018-03-26  Resolved: 2018-03-26

Status: Closed
Project: MariaDB Server
Component/s: Backup
Affects Version/s: 10.3.5
Fix Version/s: N/A

Type: Bug Priority: Major
Reporter: Zdravelina Sokolovska (Inactive) Assignee: Vladislav Vaintroub
Resolution: Not a Bug Votes: 0
Labels: None
Environment:

CentOS 7.4



 Description   

After Sporadically occurred ' [Warning] InnoDB: Allocated tablespace ID 88 for test/t, old maximum was 0 ' , mariabackup.mdev-14447 test failed

run mariadb mtr test mariabackup.mdev-14447 consecutively with --repeat option
test failed after sporadically occurred
[Warning] InnoDB: Allocated tablespace ID 88 for test/t, old maximum was 0

mariabackup.mdev-14447                   [ pass ]  11260
mariabackup.mdev-14447                   [ pass ]  11573
mariabackup.mdev-14447                   [ pass ]  11727
mariabackup.mdev-14447                   [ pass ]  11771
mariabackup.mdev-14447                   [ pass ]  11580
mariabackup.mdev-14447                   [ pass ]  11691
mariabackup.mdev-14447                   [ pass ]  11855
mariabackup.mdev-14447                   [ pass ]  11881
mariabackup.mdev-14447                   [ pass ]  12058
mariabackup.mdev-14447                   [ pass ]  12220
mariabackup.mdev-14447                   [ pass ]  12051
mariabackup.mdev-14447                   [ pass ]  12120
mariabackup.mdev-14447                   [ pass ]  12325
mariabackup.mdev-14447                   [ pass ]  13292
mariabackup.mdev-14447                   [ pass ]  13232
mariabackup.mdev-14447                   [ pass ]  11354
mariabackup.mdev-14447                   [ pass ]  11620
mariabackup.mdev-14447                   [ pass ]  12218
mariabackup.mdev-14447                   [ pass ]  12977
mariabackup.mdev-14447                   [ pass ]  11361
mariabackup.mdev-14447                   [ pass ]  13461
mariabackup.mdev-14447                   [ pass ]  11909
mariabackup.mdev-14447                   [ pass ]  13410
mariabackup.mdev-14447                   [ pass ]  13948
mariabackup.mdev-14447                   [ pass ]  12512
mariabackup.mdev-14447                   [ pass ]  12877
mariabackup.mdev-14447                   [ pass ]  13470
mariabackup.mdev-14447                   [ pass ]  14115
mariabackup.mdev-14447                   [ pass ]  13678
mariabackup.mdev-14447                   [ pass ]  13124
mariabackup.mdev-14447                   [ pass ]  14078
mariabackup.mdev-14447                   [ pass ]  13475
mariabackup.mdev-14447                   [ pass ]  14636
mariabackup.mdev-14447                   [ pass ]  14248
mariabackup.mdev-14447                   [ pass ]  13628
mariabackup.mdev-14447                   [ pass ]  14280
mariabackup.mdev-14447                   [ pass ]  14168
mariabackup.mdev-14447                   [ pass ]  13639
mariabackup.mdev-14447                   [ pass ]  14179
mariabackup.mdev-14447                   [ pass ]  13184
mariabackup.mdev-14447                   [ pass ]  13566
mariabackup.mdev-14447                   [ pass ]  15727
mariabackup.mdev-14447                   [ pass ]  14819
mariabackup.mdev-14447                   [ pass ]  16480
mariabackup.mdev-14447                   [ pass ]  14831
mariabackup.mdev-14447                   [ pass ]  15355
mariabackup.mdev-14447                   [ pass ]  14137
mariabackup.mdev-14447                   [ pass ]  14878
mariabackup.mdev-14447                   [ pass ]  15809
mariabackup.mdev-14447                   [ pass ]  15089
mariabackup.mdev-14447                   [ pass ]  15553
mariabackup.mdev-14447                   [ pass ]  14264
mariabackup.mdev-14447                   [ pass ]  15258
mariabackup.mdev-14447                   [ pass ]  15464
mariabackup.mdev-14447                   [ pass ]  14297
mariabackup.mdev-14447                   [ pass ]  16311
mariabackup.mdev-14447                   [ pass ]  16461
mariabackup.mdev-14447                   [ pass ]  15944
mariabackup.mdev-14447                   [ pass ]  15192
mariabackup.mdev-14447                   [ pass ]  17921
mariabackup.mdev-14447                   [ pass ]  16306
mariabackup.mdev-14447                   [ pass ]  16215
mariabackup.mdev-14447                   [ pass ]  15849
mariabackup.mdev-14447                   [ pass ]  16927
mariabackup.mdev-14447                   [ pass ]  16877
mariabackup.mdev-14447                   [ pass ]  18100
mariabackup.mdev-14447                   [ pass ]  17755
mariabackup.mdev-14447                   [ pass ]  15808
mariabackup.mdev-14447                   [ pass ]  18084
mariabackup.mdev-14447                   [ pass ]  16844
mariabackup.mdev-14447                   [ pass ]  17581
mariabackup.mdev-14447                   [ pass ]  18477
mariabackup.mdev-14447                   [ pass ]  18265
mariabackup.mdev-14447                   [ pass ]  18410
mariabackup.mdev-14447                   [ pass ]  17125
mariabackup.mdev-14447                   [ pass ]  17650
mariabackup.mdev-14447                   [ pass ]  19241
mariabackup.mdev-14447                   [ pass ]  17524
mariabackup.mdev-14447                   [ pass ]  17026
mariabackup.mdev-14447                   [ pass ]  18247
mariabackup.mdev-14447                   [ pass ]  18581
mariabackup.mdev-14447                   [ pass ]  18078
mariabackup.mdev-14447                   [ pass ]  18341
mariabackup.mdev-14447                   [ fail ]
        Test ended at 2018-03-22 14:09:56
 
CURRENT_TEST: mariabackup.mdev-14447
180322 14:09:53 Connecting to MySQL server host: localhost, user: root, password: set, port: 16000, socket: /usr/share/mysql-test/var/tmp/mysqld.1.sock
Using server version 10.3.5-MariaDB-log
/usr/bin/mariabackup based on MariaDB server 10.3.5-MariaDB Linux (x86_64)
incremental backup from 3500846409 is enabled.
mariabackup: uses posix_fadvise().
mariabackup: cd to /usr/share/mysql-test/var/mysqld.1/data/
mariabackup: open files limit requested 1024, set to 1024
mariabackup: using the following InnoDB configuration:
mariabackup:   innodb_data_home_dir = .
mariabackup:   innodb_data_file_path = ibdata_first:3M;ibdata_second:1M:autoextend
mariabackup:   innodb_log_group_home_dir = ./
2018-03-22 14:09:53 0 [Note] InnoDB: Number of pools: 1
180322 14:09:53 >> log scanned up to (3542731032)
mariabackup: Generating a list of tablespaces
2018-03-22 14:09:53 0 [Warning] InnoDB: Allocated tablespace ID 88 for test/t, old maximum was 0
mariabackup: using the full scan for incremental backup
180322 14:09:53 [01] Copying ./ibdata_first to /usr/share/mysql-test/var/tmp/backup_inc1/ibdata_first.delta
180322 14:09:53 [01]        ...done
180322 14:09:53 [01] Copying ./ibdata_second to /usr/share/mysql-test/var/tmp/backup_inc1/ibdata_second.delta
180322 14:09:54 >> log scanned up to (3542731032)
180322 14:09:55 [01]        ...done
180322 14:09:55 [01] Copying ./test/t.ibd to /usr/share/mysql-test/var/tmp/backup_inc1/test/t.ibd.delta
/usr/bin/mariabackup: Error writing file '/usr/share/mysql-test/var/tmp/backup_inc1/test/t.ibd.delta' (Errcode: 28 "No space left on device")
[01] mariabackup: Error: xtrabackup_copy_datafile() failed.
[01] mariabackup: Error: failed to copy datafile.
mysqltest: At line 17: exec of '/usr/bin/mariabackup --defaults-file=/usr/share/mysql-test/var/my.cnf  --backup --target-dir=/usr/share/mysql-test/var/tmp/backup_inc1 --incremental-basedir=/usr/share/mysql-test/var/tmp/backup' failed, error: 256, status: 1, errno: 11
Output from before failure:
count(*)
100000
 
 
 
The result from queries just before the failure was:
call mtr.add_suppression("InnoDB: New log files created");
CREATE TABLE t(a varchar(40) PRIMARY KEY, b varchar(40), c varchar(40), d varchar(40), index(b,c,d)) ENGINE INNODB;
# Create full backup , modify table, then create incremental/differential backup
BEGIN;
INSERT INTO t select uuid(), uuid(), uuid(), uuid() from seq_1_to_100000;
COMMIT;
SELECT count(*) FROM t;
count(*)
100000
 
 - saving '/usr/share/mysql-test/var/log/mariabackup.mdev-14447/' to '/usr/share/mysql-test/var/log/mariabackup.mdev-14447/'
mariabackup.mdev-14447                   [ pass ]  11901
mariabackup.mdev-14447                   [ pass ]  11553
mariabackup.mdev-14447                   [ pass ]  11741
mariabackup.mdev-14447                   [ pass ]  11701
mariabackup.mdev-14447                   [ pass ]  11749
mariabackup.mdev-14447                   [ pass ]  11758
mariabackup.mdev-14447                   [ pass ]  12043
mariabackup.mdev-14447                   [ pass ]  11379
mariabackup.mdev-14447                   [ pass ]  12032
mariabackup.mdev-14447                   [ pass ]  12005
mariabackup.mdev-14447                   [ pass ]  12150
mariabackup.mdev-14447                   [ pass ]  12007
mariabackup.mdev-14447                   [ pass ]  12230
mariabackup.mdev-14447                   [ pass ]  12404
mariabackup.mdev-14447                   [ pass ]  12182
mariabackup.mdev-14447                   [ pass ]  11410



 Comments   
Comment by Vladislav Vaintroub [ 2018-03-26 ]

The actual error is here #

/usr/bin/mariabackup: Error writing file '/usr/share/mysql-test/var/tmp/backup_inc1/test/t.ibd.delta' (Errcode: 28 "No space left on device")
 
[01] mariabackup: Error: xtrabackup_copy_datafile() failed.
 
[01] mariabackup: Error: failed to copy datafile.

Comment by Vladislav Vaintroub [ 2018-03-26 ]

Closing, since the actual cause was "no space left".

Comment by Zdravelina Sokolovska (Inactive) [ 2018-03-26 ]

2018-03-22 14:09:53 0 [Warning] InnoDB: Allocated tablespace ID 88 for test/t, old maximum was 0
occurred before error " No space left on device" and there is actually free space

  1. # df -h
    Filesystem Size Used Avail Use% Mounted on
    /dev/sda3 137G 20G 118G 15% /
    devtmpfs 984M 0 984M 0% /dev
    tmpfs 995M 300M 696M 31% /dev/shm
    tmpfs 995M 17M 979M 2% /run
    tmpfs 995M 0 995M 0% /sys/fs/cgroup
    /dev/sda1 1014M 139M 876M 14% /boot
    tmpfs 199M 0 199M 0% /run/user/0

in addition during the execution of mariabackup.mdev-14447 is taken only ~100M

Comment by Vladislav Vaintroub [ 2018-03-26 ]

Please ignore the [WARNING] first, if there are error entries . I do not know where /usr/share/mysql-test/var/tmp/backup_inc1/test/t.ibd.delta points, so maybe you can find this out, why there is errno 28 which corresponds to "no space left on device"

Generated at Thu Feb 08 08:23:04 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.