[MDEV-14286] Smoke test / sanity check for changes made in scope of MDEV-13328 - Jira

Details

Type: Technical task
Status: Closed (View Workflow)
Priority: Major
Resolution: Done
Affects Version/s: N/A
Fix Version/s: N/A
Component/s: Tests
Labels:
None

Sprint:
10.1.29

Description

DML before export, also DML before DISCARD TABLESPACE
at least some 100 megabytes of data in the table, with a big buffer pool, so that stale pages will stay around
maybe just import an empty table (that should be the worst exercise)
and in fact, you don’t necessarily have to copy large .ibd files during the test; we only need one .ibd file for the empty table to be imported (in a test loop)

so, basically:

create table;

loop:

insert/replace a lot;

alter table...discard tablespace;

copy empty file

alter table..import tablespace;

goto loop

and of course, multiple threads in parallel, each using their own table
and lots of secondary indexes

Test description

The implemented test is limited to what's prescribed in the request above, with only one addition – at the step "copy empty file", during the course of the test we alternate between using empty tablespaces and tablespaces with data.

Since the test is expected to use rather big tables, which take a lot of time to create, in order to speed up the process, the test is performed in a half-automated-half-manual mode.
One-time activity (manual):

server is started with default parameters;
tables are pre-created;
tables are flushed for export;
tablespaces are exported and stored manually;
tables are unlocked;
tables are populated;
tables are flushed for export;
tablespaces are exported and stored manually;
tables are unlocked;
server is shut down;
the whole data directory is stored along with the exported/stored tablespaces.

Repeated activity;

the stored data directory is copied back;
server is started manually with parameters which are needed for the current test;
an automated test is performed on the running server;
server is shut down manually.

Data structures
CREATE TABLE t1 ( pk INT AUTO_INCREMENT PRIMARY KEY, f1 INT, f2 INT NOT NULL, f3 BIGINT, f4 BIGINT NOT NULL, f5 VARCHAR(1024), f6 VARCHAR(2048) NOT NULL, f7 CHAR(255), f8 CHAR(128) NOT NULL, UNIQUE(f1), UNIQUE(f7), KEY(f2,f5(64)), KEY(f3,f6(128)), KEY(f4,f7), KEY(f1,f8) ) ENGINE=INNODB ROW_FORMAT = COMPACT ;
CREATE TABLE t2 ( pk INT AUTO_INCREMENT PRIMARY KEY, f1 INT, f2 INT NOT NULL, f3 BIGINT, f4 BIGINT NOT NULL, f5 VARCHAR(1024), f6 VARCHAR(2048) NOT NULL, f7 CHAR(255), f8 CHAR(128) NOT NULL, UNIQUE(f1), UNIQUE(f7), KEY(f2,f5(64)), KEY(f3,f6(128)), KEY(f4,f7), KEY(f1,f8) ) ENGINE=INNODB ROW_FORMAT = REDUNDANT ;
set global innodb_file_format=Barracuda;
CREATE TABLE t3 ( pk INT AUTO_INCREMENT PRIMARY KEY, f1 INT, f2 INT NOT NULL, f3 BIGINT, f4 BIGINT NOT NULL, f5 VARCHAR(1024), f6 VARCHAR(2048) NOT NULL, f7 CHAR(255), f8 CHAR(128) NOT NULL, UNIQUE(f1), UNIQUE(f7), KEY(f2,f5(64)), KEY(f3,f6(128)), KEY(f4,f7), KEY(f1,f8) ) ENGINE=INNODB ROW_FORMAT = COMPRESSED ;
CREATE TABLE t4 ( pk INT AUTO_INCREMENT PRIMARY KEY, f1 INT, f2 INT NOT NULL, f3 BIGINT, f4 BIGINT NOT NULL, f5 VARCHAR(1024), f6 VARCHAR(2048) NOT NULL, f7 CHAR(255), f8 CHAR(128) NOT NULL, UNIQUE(f1), UNIQUE(f7), KEY(f2,f5(64)), KEY(f3,f6(128)), KEY(f4,f7), KEY(f1,f8) ) ENGINE=INNODB ROW_FORMAT = DYNAMIC ;
CREATE TABLE t5 ( pk INT AUTO_INCREMENT PRIMARY KEY, f1 INT, f2 INT NOT NULL, f3 BIGINT, f4 BIGINT NOT NULL, f5 VARCHAR(1024), f6 VARCHAR(2048) NOT NULL, f7 CHAR(255), f8 CHAR(128) NOT NULL, UNIQUE(f1), UNIQUE(f7), KEY(f2,f5(64)), KEY(f3,f6(128)), KEY(f4,f7), KEY(f1,f8) ) ENGINE=INNODB ROW_FORMAT = DYNAMIC PAGE_COMPRESSED=1 PAGE_COMPRESSION_LEVEL=3;
CREATE TABLE t6 ( pk INT AUTO_INCREMENT PRIMARY KEY, f1 INT, f2 INT NOT NULL, f3 BIGINT, f4 BIGINT NOT NULL, f5 VARCHAR(1024), f6 VARCHAR(2048) NOT NULL, f7 CHAR(255), f8 CHAR(128) NOT NULL, UNIQUE(f1), UNIQUE(f7), KEY(f2,f5(64)), KEY(f3,f6(128)), KEY(f4,f7), KEY(f1,f8) ) ENGINE=INNODB ROW_FORMAT = DYNAMIC PAGE_COMPRESSED=1;
CREATE TABLE t7 ( pk INT AUTO_INCREMENT PRIMARY KEY, f1 INT, f2 INT NOT NULL, f3 BIGINT, f4 BIGINT NOT NULL, f5 VARCHAR(1024), f6 VARCHAR(2048) NOT NULL, f7 CHAR(255), f8 CHAR(128) NOT NULL, UNIQUE(f1), UNIQUE(f7), KEY(f2,f5(64)), KEY(f3,f6(128)), KEY(f4,f7), KEY(f1,f8) ) ENGINE=INNODB ROW_FORMAT = COMPACT PAGE_COMPRESSED=1;
CREATE TABLE t8 ( pk INT AUTO_INCREMENT PRIMARY KEY, f1 INT, f2 INT NOT NULL, f3 BIGINT, f4 BIGINT NOT NULL, f5 VARCHAR(1024), f6 VARCHAR(2048) NOT NULL, f7 CHAR(255), f8 CHAR(128) NOT NULL, UNIQUE(f1), UNIQUE(f7), KEY(f2,f5(64)), KEY(f3,f6(128)), KEY(f4,f7), KEY(f1,f8) ) ENGINE=INNODB ROW_FORMAT = COMPACT PAGE_COMPRESSED=1 PAGE_COMPRESSION_LEVEL=9;

Initial table contents
INSERT INTO t1 SELECT NULL, seq, seq%1000, seq%10, seq%10000, CONCAT('f5_',(seq%1000)), CONCAT('f6_',(seq%100)), CONCAT('f7_',seq), CONCAT('f8_',(seq%10)) FROM seq_1_to_10000;
INSERT INTO t2 SELECT NULL, seq, seq%1000, seq%10, seq%10000, CONCAT('f5_',(seq%1000)), CONCAT('f6_',(seq%100)), CONCAT('f7_',seq), CONCAT('f8_',(seq%10)) FROM seq_1_to_50000;
INSERT INTO t3 SELECT NULL, seq, seq%1000, seq%10, seq%10000, CONCAT('f5_',(seq%1000)), CONCAT('f6_',(seq%100)), CONCAT('f7_',seq), CONCAT('f8_',(seq%10)) FROM seq_1_to_100000;
INSERT INTO t4 SELECT NULL, seq, seq%1000, seq%10, seq%10000, CONCAT('f5_',(seq%1000)), CONCAT('f6_',(seq%100)), CONCAT('f7_',seq), CONCAT('f8_',(seq%10)) FROM seq_1_to_200000;
INSERT INTO t5 SELECT NULL, seq, seq%1000, seq%10, seq%10000, CONCAT('f5_',(seq%1000)), CONCAT('f6_',(seq%100)), CONCAT('f7_',seq), CONCAT('f8_',(seq%10)) FROM seq_1_to_300000;
INSERT INTO t6 SELECT NULL, seq, seq%1000, seq%10, seq%10000, CONCAT('f5_',(seq%1000)), CONCAT('f6_',(seq%100)), CONCAT('f7_',seq), CONCAT('f8_',(seq%10)) FROM seq_1_to_30000;
INSERT INTO t7 SELECT NULL, seq, seq%1000, seq%10, seq%10000, CONCAT('f5_',(seq%1000)), CONCAT('f6_',(seq%100)), CONCAT('f7_',seq), CONCAT('f8_',(seq%10)) FROM seq_1_to_80000;
INSERT INTO t8 SELECT NULL, seq, seq%1000, seq%10, seq%10000, CONCAT('f5_',(seq%1000)), CONCAT('f6_',(seq%100)), CONCAT('f7_',seq), CONCAT('f8_',(seq%10)) FROM seq_1_to_800000;

Stored tablespaces
-rw-r----- 1 elenst elenst 26214400 Nov 6 13:28 data/test/t1.ibd.backup
-rw-r----- 1 elenst elenst 104857600 Nov 6 13:28 data/test/t2.ibd.backup
-rw-r----- 1 elenst elenst 96468992 Nov 6 13:28 data/test/t3.ibd.backup
-rw-r----- 1 elenst elenst 364904448 Nov 6 13:28 data/test/t4.ibd.backup
-rw-r----- 1 elenst elenst 515899392 Nov 6 13:29 data/test/t5.ibd.backup
-rw-r----- 1 elenst elenst 62914560 Nov 6 13:29 data/test/t6.ibd.backup
-rw-r----- 1 elenst elenst 146800640 Nov 6 13:29 data/test/t7.ibd.backup
-rw-r----- 1 elenst elenst 1430257664 Nov 6 13:29 data/test/t8.ibd.backup

-rw-r----- 1 elenst elenst 196608 Nov 6 13:28 data/test/t1.ibd.empty
-rw-r----- 1 elenst elenst 196608 Nov 6 13:28 data/test/t2.ibd.empty
-rw-r----- 1 elenst elenst 98304 Nov 6 13:28 data/test/t3.ibd.empty
-rw-r----- 1 elenst elenst 196608 Nov 6 13:28 data/test/t4.ibd.empty
-rw-r----- 1 elenst elenst 196608 Nov 6 13:28 data/test/t5.ibd.empty
-rw-r----- 1 elenst elenst 196608 Nov 6 13:28 data/test/t6.ibd.empty
-rw-r----- 1 elenst elenst 196608 Nov 6 13:28 data/test/t7.ibd.empty
-rw-r----- 1 elenst elenst 196608 Nov 6 13:28 data/test/t8.ibd.empty

Test results

Note: Any noticeable deviations and inaccuracies in executing the scenario caused various problems. These problems are considered to be outside the scope of this task and attributed to the general instability of export and DISCARD/IMPORT tablespace functionality. Analysis of such failures was not performed.

Smoke tests for stability

Several runs of the described test were performed, all with the same data:

1-thread test on a server with innodb_buffer_pool_size=128M general_log=on, otherwise defaults, for table t1;
8-thread test on a server with innodb_buffer_pool_size=128M general_log=on, otherwise defaults;
8-thread test on a server with innodb_buffer_pool_size=2G general_log=on, otherwise defaults;
8-thread test on a server with innodb_buffer_pool_size=4G general_log=on, otherwise defaults;
8-thread test on a server with innodb_buffer_pool_size=8G general_log=on, otherwise defaults;
8-thread test on a server with innodb_buffer_pool_size=2G general_log=on ignore-builtin-innodb plugin-load-add=ha_innodb, otherwise defaults;

The duration of the test runs varied from 10 to 30 min. All test runs were performed on a debug build.

In all variations above, the test was considered a pass if the server didn't crash during the duration of the test.

On the initial implementation, bb-10.1-marko 1fb7ac18c417c8fbd95, the test caused failure described in this comment. The failure was reproducible via a stress test and MTR.

The failure stopped happening after a temporary patch and didn't re-appear after the real fix. No other crashes were observed.

Sanity check for performance regressions

The same test flow was converted into a performance comparison test. The tests were performed in an environment not tuned for benchmarks, results are not considered in any way accurate, and absolute values are irrelevant. The purpose of the test was to check for critical performance regressions. All tests were run on non-debug builds.

Several test runs were performed:

1-thread latency comparison* test on servers with innodb_buffer_pool_size=4G general_log=on, otherwise defaults, table t3;
1-thread latency comparison* test on servers with innodb_buffer_pool_size=4G general_log=on, otherwise defaults, table t8;
8-thread throughput comparison** tests on a servers with innodb_buffer_pool_size=8G general_log=on, otherwise defaults;
1-thread throughput comparison** tests on a servers with innodb_buffer_pool_size=8G general_log=on, otherwise defaults, table t5;
8-thread throughput comparison** tests on a servers with innodb_buffer_pool_size=128M general_log=on, otherwise defaults;

* For the latency comparison test, two servers are running side-by-side. The test executes the same query on both servers one after another, compares the execution time, and reports differences which exceed a given threshold

** For the throughput comparison test, only one server is started at a time. All test flow is run on the server for a given time interval, after that the overall number of all queries (including DML) per thread is calculated, and resulting numbers are compared.

Examples of results of throughput test:

8-thread 10-min test, buffer pool 8G

thread/table	10.1	bb-10.1-marko
1	451	478
2	283	286
3	345	425
4	271	320
5	233	287
6	418	418
7	322	314
8	381	348

8-thread 10-min test, buffer pool 128M

thread/table	10.1	bb-10.1-marko
1	392	452
2	286	378
3	349	349
4	325	340
5	302	244
6	391	468
7	322	402
8	381	348

1-thread 10-min test, buffer pool 8G, table t5

10.1	bb-10.1-marko
1043	1043

yes, exactly the same, not a typo, weird coincidence

No differences which could not be explained by unreliability of the test environment have been noticed during tests.

Attachments

Activity

Ascending order - Click to sort in descending order

Elena Stepanova added a comment - 2017-11-04 22:03

bb-10.1-marko 1fb7ac18c417c8fbd95
2017-11-05 00:02:20 7fd51f616b00 InnoDB: Assertion failure in thread 140553331239680 in file buf0buf.cc line 3555
InnoDB: Failing assertion: mode == BUF_GET_POSSIBLY_FREED \|\| !fix_block->page.file_page_was_freed
InnoDB: We intentionally generate a memory trap.

#5 0x00007fd51d5aa3fa in abort () from /lib/x86_64-linux-gnu/libc.so.6
#6 0x00007fd516a20cf9 in buf_page_get_gen (space=4, zip_size=0, offset=138, rw_latch=3, guess=0x0, mode=12, file=0x7fd516d01d38 "/data/src/bb-10.1-marko/storage/innobase/row/row0import.cc", line=2158, mtr=0x7fd51f614420, err=0x0) at /data/src/bb-10.1-marko/storage/innobase/buf/buf0buf.cc:3554
#7 0x00007fd516bd1876 in PageConverter::operator() (this=0x7fd51f614050, offset=2260992, block=0x7fd51f613370) at /data/src/bb-10.1-marko/storage/innobase/row/row0import.cc:2158
#8 0x00007fd516a98f3d in fil_iterate (iter=..., block=0x7fd51f613370, callback=...) at /data/src/bb-10.1-marko/storage/innobase/fil/fil0fil.cc:6512
#9 0x00007fd516a999ee in fil_tablespace_iterate (table=0x7fd515ebb8f8, n_io_buffers=64, callback=...) at /data/src/bb-10.1-marko/storage/innobase/fil/fil0fil.cc:6776
#10 0x00007fd516bd4ca9 in row_import_for_mysql (table=0x7fd515ebb8f8, prebuilt=0x7fd507583078) at /data/src/bb-10.1-marko/storage/innobase/row/row0import.cc:3604
#11 0x00007fd516af90a1 in ha_innodb::discard_or_import_tablespace (this=0x7fd5074b0088, discard=0 '\000') at /data/src/bb-10.1-marko/storage/innobase/handler/ha_innodb.cc:12412
#12 0x000055eedc944ec2 in handler::ha_discard_or_import_tablespace (this=0x7fd5074b0088, discard=0 '\000') at /data/src/bb-10.1-marko/sql/handler.cc:4189
#13 0x000055eedc7bf401 in mysql_discard_or_import_tablespace (thd=0x7fd513fc7070, table_list=0x7fd5074fa178, discard=false) at /data/src/bb-10.1-marko/sql/sql_table.cc:5666
#14 0x000055eedc83864d in Sql_cmd_discard_import_tablespace::execute (this=0x7fd5074fa770, thd=0x7fd513fc7070) at /data/src/bb-10.1-marko/sql/sql_alter.cc:365
#15 0x000055eedc70917c in mysql_execute_command (thd=0x7fd513fc7070) at /data/src/bb-10.1-marko/sql/sql_parse.cc:5680
#16 0x000055eedc70d42d in mysql_parse (thd=0x7fd513fc7070, rawbuf=0x7fd5074fa088 "ALTER TABLE t1 IMPORT TABLESPACE", length=32, parser_state=0x7fd51f6155e0) at /data/src/bb-10.1-marko/sql/sql_parse.cc:7326
#17 0x000055eedc6fc042 in dispatch_command (command=COM_QUERY, thd=0x7fd513fc7070, packet=0x7fd515ec9071 "ALTER TABLE t1 IMPORT TABLESPACE", packet_length=32) at /data/src/bb-10.1-marko/sql/sql_parse.cc:1477
#18 0x000055eedc6fadc7 in do_command (thd=0x7fd513fc7070) at /data/src/bb-10.1-marko/sql/sql_parse.cc:1106
#19 0x000055eedc833a63 in do_handle_one_connection (thd_arg=0x7fd513fc7070) at /data/src/bb-10.1-marko/sql/sql_connect.cc:1349
#20 0x000055eedc8337c7 in handle_one_connection (arg=0x7fd513fc7070) at /data/src/bb-10.1-marko/sql/sql_connect.cc:1261
#21 0x000055eedcbecb98 in pfs_spawn_thread (arg=0x7fd515ebb8f0) at /data/src/bb-10.1-marko/storage/perfschema/pfs.cc:1861
#22 0x00007fd51f2a5494 in start_thread (arg=0x7fd51f616b00) at pthread_create.c:333
#23 0x00007fd51d65e93f in clone () from /lib/x86_64-linux-gnu/libc.so.6

Run with --mysqld=--sequence
--source include/have_innodb.inc

CREATE DATABASE db;
USE db;
--let $dir= `SELECT CONCAT(@@datadir,'/',DATABASE())`

CREATE TABLE t1 (pk INT PRIMARY KEY, f1 CHAR(255), UNIQUE(f1)) ENGINE=InnoDB;
INSERT INTO t1 SELECT seq, CONCAT('f1_',seq) FROM seq_1_to_10000;

FLUSH TABLE t1 FOR EXPORT;
--copy_file $dir/t1.ibd $dir/t1.ibd.backup
UNLOCK TABLES;

ALTER TABLE t1 DISCARD TABLESPACE;
--copy_file $dir/t1.ibd.backup $dir/t1.ibd
ALTER TABLE t1 IMPORT TABLESPACE;

# Cleanup
DROP TABLE t1;

Elena Stepanova added a comment - 2017-11-04 22:03 bb-10.1-marko 1fb7ac18c417c8fbd95 2017-11-05 00:02:20 7fd51f616b00 InnoDB: Assertion failure in thread 140553331239680 in file buf0buf.cc line 3555 InnoDB: Failing assertion: mode == BUF_GET_POSSIBLY_FREED || !fix_block->page.file_page_was_freed InnoDB: We intentionally generate a memory trap. #5 0x00007fd51d5aa3fa in abort () from /lib/x86_64-linux-gnu/libc.so.6 #6 0x00007fd516a20cf9 in buf_page_get_gen (space=4, zip_size=0, offset=138, rw_latch=3, guess=0x0, mode=12, file=0x7fd516d01d38 "/data/src/bb-10.1-marko/storage/innobase/row/row0import.cc", line=2158, mtr=0x7fd51f614420, err=0x0) at /data/src/bb-10.1-marko/storage/innobase/buf/buf0buf.cc:3554 #7 0x00007fd516bd1876 in PageConverter::operator() (this=0x7fd51f614050, offset=2260992, block=0x7fd51f613370) at /data/src/bb-10.1-marko/storage/innobase/row/row0import.cc:2158 #8 0x00007fd516a98f3d in fil_iterate (iter=..., block=0x7fd51f613370, callback=...) at /data/src/bb-10.1-marko/storage/innobase/fil/fil0fil.cc:6512 #9 0x00007fd516a999ee in fil_tablespace_iterate (table=0x7fd515ebb8f8, n_io_buffers=64, callback=...) at /data/src/bb-10.1-marko/storage/innobase/fil/fil0fil.cc:6776 #10 0x00007fd516bd4ca9 in row_import_for_mysql (table=0x7fd515ebb8f8, prebuilt=0x7fd507583078) at /data/src/bb-10.1-marko/storage/innobase/row/row0import.cc:3604 #11 0x00007fd516af90a1 in ha_innodb::discard_or_import_tablespace (this=0x7fd5074b0088, discard=0 '\000') at /data/src/bb-10.1-marko/storage/innobase/handler/ha_innodb.cc:12412 #12 0x000055eedc944ec2 in handler::ha_discard_or_import_tablespace (this=0x7fd5074b0088, discard=0 '\000') at /data/src/bb-10.1-marko/sql/handler.cc:4189 #13 0x000055eedc7bf401 in mysql_discard_or_import_tablespace (thd=0x7fd513fc7070, table_list=0x7fd5074fa178, discard=false) at /data/src/bb-10.1-marko/sql/sql_table.cc:5666 #14 0x000055eedc83864d in Sql_cmd_discard_import_tablespace::execute (this=0x7fd5074fa770, thd=0x7fd513fc7070) at /data/src/bb-10.1-marko/sql/sql_alter.cc:365 #15 0x000055eedc70917c in mysql_execute_command (thd=0x7fd513fc7070) at /data/src/bb-10.1-marko/sql/sql_parse.cc:5680 #16 0x000055eedc70d42d in mysql_parse (thd=0x7fd513fc7070, rawbuf=0x7fd5074fa088 "ALTER TABLE t1 IMPORT TABLESPACE", length=32, parser_state=0x7fd51f6155e0) at /data/src/bb-10.1-marko/sql/sql_parse.cc:7326 #17 0x000055eedc6fc042 in dispatch_command (command=COM_QUERY, thd=0x7fd513fc7070, packet=0x7fd515ec9071 "ALTER TABLE t1 IMPORT TABLESPACE", packet_length=32) at /data/src/bb-10.1-marko/sql/sql_parse.cc:1477 #18 0x000055eedc6fadc7 in do_command (thd=0x7fd513fc7070) at /data/src/bb-10.1-marko/sql/sql_parse.cc:1106 #19 0x000055eedc833a63 in do_handle_one_connection (thd_arg=0x7fd513fc7070) at /data/src/bb-10.1-marko/sql/sql_connect.cc:1349 #20 0x000055eedc8337c7 in handle_one_connection (arg=0x7fd513fc7070) at /data/src/bb-10.1-marko/sql/sql_connect.cc:1261 #21 0x000055eedcbecb98 in pfs_spawn_thread (arg=0x7fd515ebb8f0) at /data/src/bb-10.1-marko/storage/perfschema/pfs.cc:1861 #22 0x00007fd51f2a5494 in start_thread (arg=0x7fd51f616b00) at pthread_create.c:333 #23 0x00007fd51d65e93f in clone () from /lib/x86_64-linux-gnu/libc.so.6 Run with --mysqld=--sequence --source include/have_innodb.inc CREATE DATABASE db; USE db; --let $dir= `SELECT CONCAT(@@datadir,'/',DATABASE())` CREATE TABLE t1 (pk INT PRIMARY KEY , f1 CHAR (255), UNIQUE (f1)) ENGINE=InnoDB; INSERT INTO t1 SELECT seq, CONCAT( 'f1_' ,seq) FROM seq_1_to_10000; FLUSH TABLE t1 FOR EXPORT; --copy_file $dir/t1.ibd $dir/t1.ibd.backup UNLOCK TABLES; ALTER TABLE t1 DISCARD TABLESPACE; --copy_file $dir/t1.ibd.backup $dir/t1.ibd ALTER TABLE t1 IMPORT TABLESPACE; # Cleanup DROP TABLE t1;

Marko Mäkelä added a comment - 2017-11-06 09:44

I refactored the code so that instead of renaming BUF_PEEK_IF_IN_POOL (and slightly changing its semantics), a new mode BUF_EVICT_IF_IN_POOL is introduced.
This should avoid the debug assertion.

The assertion normally makes sense, because it tries to catch access to pages that were marked as free. In IMPORT, we are only accessing the pages in order to evict them from the buffer pool; we do not care about the page contents. Therefore the assertion failure was not a sign of real trouble.

Marko Mäkelä added a comment - 2017-11-06 09:44 I refactored the code so that instead of renaming BUF_PEEK_IF_IN_POOL (and slightly changing its semantics), a new mode BUF_EVICT_IF_IN_POOL is introduced. This should avoid the debug assertion. The assertion normally makes sense, because it tries to catch access to pages that were marked as free. In IMPORT, we are only accessing the pages in order to evict them from the buffer pool; we do not care about the page contents. Therefore the assertion failure was not a sign of real trouble.

Elena Stepanova added a comment - 2017-11-06 17:31

Failures encountered during initial adjustments of the test, which are considered irrelevant to this bugfix and attributed to either misuse of the feature, or its general (known) instability

InnoDB: Number of bytes after aio 0 requested 16384

InnoDB: from file ./test/t28435.ibd

 InnoDB: Operation Linux aio to file /data/src/bb-10.1-marko/storage/xtradb/os/os0file.cc and at line 5648

2017-11-04 17:25:08 140429567706880 [ERROR] InnoDB: File ./test/t28435.ibd: 'Linux aio' returned OS error 0. Cannot continue operation

171104 17:25:08 [ERROR] mysqld got signal 6 ;

# 2017-11-04T17:25:18 [28346] Thread 1 (Thread 0x7fb84e7fc700 (LWP 28401)):

# 2017-11-04T17:25:18 [28346] #0  __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:57

# 2017-11-04T17:25:18 [28346] #1  0x0000564e33e8bd7f in my_write_core (sig=6) at /data/src/bb-10.1-marko/mysys/stacktrace.c:477

# 2017-11-04T17:25:18 [28346] #2  0x0000564e3382abea in handle_fatal_signal (sig=6) at /data/src/bb-10.1-marko/sql/signal_handler.cc:296

# 2017-11-04T17:25:18 [28346] #3  <signal handler called>

# 2017-11-04T17:25:18 [28346] #4  0x00007fb86e2e8fcf in raise () from /lib/x86_64-linux-gnu/libc.so.6

# 2017-11-04T17:25:18 [28346] #5  0x00007fb86e2ea3fa in abort () from /lib/x86_64-linux-gnu/libc.so.6

# 2017-11-04T17:25:18 [28346] #6  0x0000564e33bfdbbd in os_file_handle_error_cond_exit (name=0x7fb83fc16278 "./test/t28435.ibd", operation=0x564e340a16d1 "Linux aio", should_exit=1, on_error_silent=0, file=0x564e340a0390 "/data/src/bb-10.1-marko/storage/xtradb/os/os0file.cc", line=5648) at /data/src/bb-10.1-marko/storage/xtradb/os/os0file.cc:915

# 2017-11-04T17:25:18 [28346] #7  0x0000564e33bfdc04 in os_file_handle_error (name=0x7fb83fc16278 "./test/t28435.ibd", operation=0x564e340a16d1 "Linux aio", file=0x564e340a0390 "/data/src/bb-10.1-marko/storage/xtradb/os/os0file.cc", line=5648) at /data/src/bb-10.1-marko/storage/xtradb/os/os0file.cc:935

# 2017-11-04T17:25:18 [28346] #8  0x0000564e33c032e3 in os_aio_linux_handle (global_seg=3, message1=0x7fb84e7fbe40, message2=0x7fb84e7fbe48, type=0x7fb84e7fbe50, space_id=0x7fb84e7fbe58) at /data/src/bb-10.1-marko/storage/xtradb/os/os0file.cc:5648

# 2017-11-04T17:25:18 [28346] #9  0x0000564e33ddbc9b in fil_aio_wait (segment=3) at /data/src/bb-10.1-marko/storage/xtradb/fil/fil0fil.cc:6372

# 2017-11-04T17:25:18 [28346] #10 0x0000564e33ccbede in io_handler_thread (arg=0x564e351397d8 <n+24>) at /data/src/bb-10.1-marko/storage/xtradb/srv/srv0start.cc:585

# 2017-11-04T17:25:18 [28346] #11 0x00007fb86ffe5494 in start_thread (arg=0x7fb84e7fc700) at pthread_create.c:333

# 2017-11-04T17:25:18 [28346] #12 0x00007fb86e39e93f in clone () from /lib/x86_64-linux-gnu/libc.so.6

2017-11-04 17:52:52 7f81603d6b00  InnoDB: Operating system error number 2 in a file operation.

InnoDB: The error means the system cannot find the path specified.

2017-11-04 17:52:52 140193642146560 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t29573.ibd

2017-11-04 17:52:52 140193642146560 [Note] InnoDB: Discarding tablespace of table "test"."t29573": Tablespace not found

2017-11-04 17:52:52 140193606486784 [ERROR] InnoDB: Cannot delete tablespace 68 because it is not found in the tablespace memory cache.

2017-11-04 17:52:52 140193606486784 [Warning] InnoDB: Cannot delete tablespace 68 in DISCARD TABLESPACE. Tablespace not found

2017-11-04 17:52:53 140193642449664 [ERROR] InnoDB: Cannot delete tablespace 69 because it is not found in the tablespace memory cache.

2017-11-04 17:52:53 140193642449664 [Warning] InnoDB: Cannot delete tablespace 69 in DISCARD TABLESPACE. Tablespace not found

2017-11-04 17:52:53 140193606486784 [Note] InnoDB: Sync to disk

...

2017-11-04 17:52:54 140193642449664 [Note] InnoDB: Phase IV - Flush complete

2017-11-04 17:52:54 7f81603d6b00  InnoDB: Assertion failure in thread 140193642146560 in file log0log.cc line 2292

InnoDB: Failing assertion: oldest_lsn >= log_sys->next_checkpoint_lsn

# 2017-11-04T17:53:02 [29494] #5  0x00007f815e4123fa in abort () from /lib/x86_64-linux-gnu/libc.so.6

# 2017-11-04T17:53:02 [29494] #6  0x00005583101f193d in log_checkpoint (sync=1, write_always=1, safe_to_ignore=0) at /data/src/bb-10.1-marko/storage/xtradb/log/log0log.cc:2292

# 2017-11-04T17:53:02 [29494] #7  0x00005583101f1af6 in log_make_checkpoint_at (lsn=18446744073709551615, write_always=1) at /data/src/bb-10.1-marko/storage/xtradb/log/log0log.cc:2351

# 2017-11-04T17:53:02 [29494] #8  0x0000558310265627 in row_import_cleanup (prebuilt=0x7f812fcfb078, trx=0x7f812fcb0d78, err=DB_TABLESPACE_NOT_FOUND) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:2270

# 2017-11-04T17:53:02 [29494] #9  0x0000558310265705 in row_import_error (prebuilt=0x7f812fcfb078, trx=0x7f812fcb0d78, err=DB_TABLESPACE_NOT_FOUND) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:2298

# 2017-11-04T17:53:02 [29494] #10 0x000055831026856d in row_import_for_mysql (table=0x7f812fcc5ff8, prebuilt=0x7f812fcfb078) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:3594

# 2017-11-04T17:53:02 [29494] #11 0x0000558310186f27 in ha_innobase::discard_or_import_tablespace (this=0x7f812fc91888, discard=0 '\000') at /data/src/bb-10.1-marko/storage/xtradb/handler/ha_innodb.cc:12988

# 2017-11-04T17:53:02 [29494] #12 0x000055830fe4aec2 in handler::ha_discard_or_import_tablespace (this=0x7f812fc91888, discard=0 '\000') at /data/src/bb-10.1-marko/sql/handler.cc:4189

# 2017-11-04T17:53:02 [29494] #13 0x000055830fcc5401 in mysql_discard_or_import_tablespace (thd=0x7f813a777070, table_list=0x7f812fc221b0, discard=false) at /data/src/bb-10.1-marko/sql/sql_table.cc:5666

# 2017-11-04T17:53:02 [29494] #14 0x000055830fd3e64d in Sql_cmd_discard_import_tablespace::execute (this=0x7f812fc227a8, thd=0x7f813a777070) at /data/src/bb-10.1-marko/sql/sql_alter.cc:365

# 2017-11-04T17:53:02 [29494] #15 0x000055830fc0f17c in mysql_execute_command (thd=0x7f813a777070) at /data/src/bb-10.1-marko/sql/sql_parse.cc:5680

# 2017-11-04T17:53:02 [29494] #16 0x000055830fc1342d in mysql_parse (thd=0x7f813a777070, rawbuf=0x7f812fc22088 "ALTER TABLE t29573 IMPORT TABLESPACE /* QNO 324 CON_ID 7 */", length=59, parser_state=0x7f81603d5630) at /data/src/bb-10.1-marko/sql/sql_parse.cc:7326

# 2017-11-04T17:53:02 [29494] #17 0x000055830fc02042 in dispatch_command (command=COM_QUERY, thd=0x7f813a777070, packet=0x7f813a77d071 " ALTER TABLE t29573 IMPORT TABLESPACE /* QNO 324 CON_ID 7 */ ", packet_length=61) at /data/src/bb-10.1-marko/sql/sql_parse.cc:1477

# 2017-11-04T17:53:02 [29494] #18 0x000055830fc00dc7 in do_command (thd=0x7f813a777070) at /data/src/bb-10.1-marko/sql/sql_parse.cc:1106

# 2017-11-04T17:53:02 [29494] #19 0x000055830fd39a63 in do_handle_one_connection (thd_arg=0x7f813a777070) at /data/src/bb-10.1-marko/sql/sql_connect.cc:1349

# 2017-11-04T17:53:02 [29494] #20 0x000055830fd397c7 in handle_one_connection (arg=0x7f813a777070) at /data/src/bb-10.1-marko/sql/sql_connect.cc:1261

# 2017-11-04T17:53:02 [29494] #21 0x00007f816010d494 in start_thread (arg=0x7f81603d6b00) at pthread_create.c:333

# 2017-11-04T17:53:02 [29494] #22 0x00007f815e4c693f in clone () from /lib/x86_64-linux-gnu/libc.so.6

2017-11-04 19:16:34 140404377053952 [ERROR] InnoDB: Cannot delete tablespace 25 because it is not found in the tablespace memory cache.

2017-11-04 19:16:34 140404377053952 [Warning] InnoDB: Cannot delete tablespace 25 in DISCARD TABLESPACE. Tablespace not found

2017-11-04 19:16:34 140404377053952 [Note] InnoDB: Sync to disk

2017-11-04 19:16:34 140404377053952 [Note] InnoDB: Sync to disk - done!

2017-11-04 19:16:34 140404377053952 [Note] InnoDB: Phase I - Update all pages

2017-11-04 19:16:34 140404377053952 [Note] InnoDB: Sync to disk

2017-11-04 19:16:34 140404377053952 [Note] InnoDB: Sync to disk - done!

2017-11-04 19:16:34 140404377053952 [Note] InnoDB: Discarding tablespace of table "test"."t7662": Data structure corruption

2017-11-04 19:16:34 140404413319936 [ERROR] InnoDB: The table test/t7656 doesn't have a corresponding tablespace, it was discarded.

2017-11-04 19:16:34 140404413319936 [Warning] InnoDB: Trying to access missing tablespace 23.

2017-11-04 19:16:34 140404413016832 [ERROR] InnoDB: The table test/t7658 doesn't have a corresponding tablespace, it was discarded.

2017-11-04 19:16:34 140404413016832 [ERROR] InnoDB: The table test/t7658 doesn't have a corresponding tablespace, it was discarded.

2017-11-04 19:16:34 140404413016832 [ERROR] Got error 155 when reading table './test/t7658'

2017-11-04 19:16:34 140404413016832 [ERROR] InnoDB: The table test/t7658 doesn't have a corresponding tablespace, it was discarded.

2017-11-04 19:16:34 140404413016832 [ERROR] InnoDB: The table test/t7658 doesn't have a corresponding tablespace, it was discarded.

2017-11-04 19:16:34 140404377053952 [ERROR] InnoDB: The table test/t7662 doesn't have a corresponding tablespace, it was discarded.

2017-11-04 19:16:35 140404413016832 [ERROR] InnoDB: Cannot delete tablespace 14 because it is not found in the tablespace memory cache.

2017-11-04 19:16:35 140404413016832 [Warning] InnoDB: Cannot delete tablespace 14 in DISCARD TABLESPACE. Tablespace not found

2017-11-04 19:16:35 140404413319936 [ERROR] InnoDB: Cannot delete tablespace 23 because it is not found in the tablespace memory cache.

2017-11-04 19:16:35 140404377053952 [ERROR] InnoDB: Cannot delete tablespace 25 because it is not found in the tablespace memory cache.

2017-11-04 19:16:35 140404377053952 [Warning] InnoDB: Cannot delete tablespace 25 in DISCARD TABLESPACE. Tablespace not found

2017-11-04 19:16:35 140404413016832 [Note] InnoDB: Sync to disk

2017-11-04 19:16:35 140404413319936 [ERROR] InnoDB: The table test/t7656 doesn't have a corresponding tablespace, it was discarded.

2017-11-04 19:16:35 140404413319936 [ERROR] InnoDB: The table test/t7656 doesn't have a corresponding tablespace, it was discarded.

2017-11-04 19:16:35 140404377053952 [Note] InnoDB: Sync to disk

2017-11-04 19:16:35 140404413319936 [ERROR] InnoDB: Cannot delete tablespace 26 because it is not found in the tablespace memory cache.

2017-11-04 19:16:35 140404413319936 [Warning] InnoDB: Cannot delete tablespace 26 in DISCARD TABLESPACE. Tablespace not found

2017-11-04 19:16:35 140404413016832 [Note] InnoDB: Sync to disk - done!

2017-11-04 19:16:35 140404377053952 [Note] InnoDB: Sync to disk - done!

2017-11-04 19:16:36 140404377053952 [Note] InnoDB: Phase I - Update all pages

2017-11-04 19:16:36 140404413016832 [Note] InnoDB: Phase I - Update all pages

2017-11-04 19:16:36 140404413016832 [Note] InnoDB: Sync to disk

2017-11-04 19:16:36 7fb27104eb00  InnoDB: Assertion failure in thread 140404377053952 in file rem0rec.ic line 998

InnoDB: Failing assertion: curr <= last

# 2017-11-04T19:16:43 [7580] #5  0x00007fb2712d63fa in abort () from /lib/x86_64-linux-gnu/libc.so.6

# 2017-11-04T19:16:43 [7580] #6  0x0000558b6c94056d in rec_offs_validate (rec=0x0, index=0x0, offsets=0x7fb27104c138) at /data/src/bb-10.1-marko/storage/xtradb/include/rem0rec.ic:998

# 2017-11-04T19:16:43 [7580] #7  0x0000558b6c9406ac in rec_offs_any_extern (offsets=0x7fb27104c138) at /data/src/bb-10.1-marko/storage/xtradb/include/rem0rec.ic:1086

# 2017-11-04T19:16:43 [7580] #8  0x0000558b6c9444b6 in PageConverter::adjust_cluster_index_blob_ref (this=0x7fb27104c0a0, rec=0x7fb241d90080 "\200", offsets=0x7fb27104c138) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:1717

# 2017-11-04T19:16:43 [7580] #9  0x0000558b6c9445a5 in PageConverter::adjust_cluster_record (this=0x7fb27104c0a0, index=0x7fb241c33078, rec=0x7fb241d90080 "\200", offsets=0x7fb27104c138, deleted=false) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:1768

# 2017-11-04T19:16:43 [7580] #10 0x0000558b6c94474e in PageConverter::update_records (this=0x7fb27104c0a0, block=0x7fb27104b1d0) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:1821

# 2017-11-04T19:16:43 [7580] #11 0x0000558b6c9449db in PageConverter::update_index_page (this=0x7fb27104c0a0, block=0x7fb27104b1d0) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:1914

# 2017-11-04T19:16:43 [7580] #12 0x0000558b6c944c91 in PageConverter::update_page (this=0x7fb27104c0a0, block=0x7fb27104b1d0, page_type=@0x7fb27104afb8: 17855) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:1987

# 2017-11-04T19:16:43 [7580] #13 0x0000558b6c944fc8 in PageConverter::operator() (this=0x7fb27104c0a0, offset=163840, block=0x7fb27104b1d0) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:2108

# 2017-11-04T19:16:43 [7580] #14 0x0000558b6cad2b42 in fil_iterate (iter=..., block=0x7fb27104b1d0, callback=...) at /data/src/bb-10.1-marko/storage/xtradb/fil/fil0fil.cc:6848

# 2017-11-04T19:16:43 [7580] #15 0x0000558b6cad3605 in fil_tablespace_iterate (table=0x7fb241cc55f8, n_io_buffers=64, callback=...) at /data/src/bb-10.1-marko/storage/xtradb/fil/fil0fil.cc:7112

# 2017-11-04T19:16:43 [7580] #16 0x0000558b6c9485f3 in row_import_for_mysql (table=0x7fb241cc55f8, prebuilt=0x7fb241c2b078) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:3609

# 2017-11-04T19:16:43 [7580] #17 0x0000558b6c866f27 in ha_innobase::discard_or_import_tablespace (this=0x7fb241c91088, discard=0 '\000') at /data/src/bb-10.1-marko/storage/xtradb/handler/ha_innodb.cc:12988

# 2017-11-04T19:16:43 [7580] #18 0x0000558b6c52aec2 in handler::ha_discard_or_import_tablespace (this=0x7fb241c91088, discard=0 '\000') at /data/src/bb-10.1-marko/sql/handler.cc:4189

# 2017-11-04T19:16:43 [7580] #19 0x0000558b6c3a5401 in mysql_discard_or_import_tablespace (thd=0x7fb24d78d070, table_list=0x7fb241c221b0, discard=false) at /data/src/bb-10.1-marko/sql/sql_table.cc:5666

# 2017-11-04T19:16:43 [7580] #20 0x0000558b6c41e64d in Sql_cmd_discard_import_tablespace::execute (this=0x7fb241c227a8, thd=0x7fb24d78d070) at /data/src/bb-10.1-marko/sql/sql_alter.cc:365

# 2017-11-04T19:16:43 [7580] #21 0x0000558b6c2ef17c in mysql_execute_command (thd=0x7fb24d78d070) at /data/src/bb-10.1-marko/sql/sql_parse.cc:5680

# 2017-11-04T19:16:43 [7580] #22 0x0000558b6c2f342d in mysql_parse (thd=0x7fb24d78d070, rawbuf=0x7fb241c22088 "ALTER TABLE t7662 IMPORT TABLESPACE /* QNO 227 CON_ID 9 */", length=58, parser_state=0x7fb27104d630) at /data/src/bb-10.1-marko/sql/sql_parse.cc:7326

# 2017-11-04T19:16:43 [7580] #23 0x0000558b6c2e2042 in dispatch_command (command=COM_QUERY, thd=0x7fb24d78d070, packet=0x7fb24d793071 " ALTER TABLE t7662 IMPORT TABLESPACE /* QNO 227 CON_ID 9 */ ", packet_length=60) at /data/src/bb-10.1-marko/sql/sql_parse.cc:1477

# 2017-11-04T19:16:43 [7580] #24 0x0000558b6c2e0dc7 in do_command (thd=0x7fb24d78d070) at /data/src/bb-10.1-marko/sql/sql_parse.cc:1106

# 2017-11-04T19:16:43 [7580] #25 0x0000558b6c419a63 in do_handle_one_connection (thd_arg=0x7fb24d78d070) at /data/src/bb-10.1-marko/sql/sql_connect.cc:1349

# 2017-11-04T19:16:43 [7580] #26 0x0000558b6c4197c7 in handle_one_connection (arg=0x7fb24d78d070) at /data/src/bb-10.1-marko/sql/sql_connect.cc:1261

# 2017-11-04T19:16:43 [7580] #27 0x00007fb272fd1494 in start_thread (arg=0x7fb27104eb00) at pthread_create.c:333

# 2017-11-04T19:16:43 [7580] #28 0x00007fb27138a93f in clone () from /lib/x86_64-linux-gnu/libc.so.6

2017-11-04 21:01:35 7f1f92847b00  InnoDB: Operating system error number 2 in a file operation.

InnoDB: The error means the system cannot find the path specified.

2017-11-04 21:01:35 139773578869504 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t2.ibd

2017-11-04 21:01:35 139773578869504 [Note] InnoDB: Discarding tablespace of table "test"."t2": Tablespace not found

2017-11-04 21:01:38 7f1f92891b00  InnoDB: Operating system error number 2 in a file operation.

InnoDB: The error means the system cannot find the path specified.

2017-11-04 21:01:38 139773579172608 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t1.ibd

2017-11-04 21:01:38 139773579172608 [Note] InnoDB: Discarding tablespace of table "test"."t1": Tablespace not found

2017-11-04 21:01:38 7f1f8f561b00  InnoDB: Operating system error number 2 in a file operation.

InnoDB: The error means the system cannot find the path specified.

2017-11-04 21:01:38 139773525498624 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t6.ibd

2017-11-04 21:01:38 139773525498624 [Note] InnoDB: Discarding tablespace of table "test"."t6": Tablespace not found

2017-11-04 21:01:38 7f1f8f5f5b00  InnoDB: Operating system error number 2 in a file operation.

InnoDB: The error means the system cannot find the path specified.

2017-11-04 21:01:39 139773526104832 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t4.ibd

2017-11-04 21:01:39 139773526104832 [Note] InnoDB: Discarding tablespace of table "test"."t4": Tablespace not found

2017-11-04 21:01:40 7f1f8f5abb00  InnoDB: Operating system error number 2 in a file operation.

InnoDB: The error means the system cannot find the path specified.

2017-11-04 21:01:40 139773525801728 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t5.ibd

2017-11-04 21:01:40 139773525801728 [Note] InnoDB: Discarding tablespace of table "test"."t5": Tablespace not found

2017-11-04 21:01:40 7f1f927fdb00  InnoDB: Operating system error number 2 in a file operation.

InnoDB: The error means the system cannot find the path specified.

2017-11-04 21:01:40 139773578566400 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t3.ibd

2017-11-04 21:01:40 139773578566400 [Note] InnoDB: Discarding tablespace of table "test"."t3": Tablespace not found

2017-11-04 21:01:49 7f1f8f4cdb00  InnoDB: Operating system error number 2 in a file operation.

InnoDB: The error means the system cannot find the path specified.

2017-11-04 21:01:49 139773524892416 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t8.ibd

2017-11-04 21:01:49 139773524892416 [Note] InnoDB: Discarding tablespace of table "test"."t8": Tablespace not found

2017-11-04 21:01:49 7f1f68ffb700  InnoDB: Assertion failure in thread 139772882302720 in file btr0cur.cc line 792

InnoDB: Failing assertion: fil_page_get_type(page) == 17855

# 2017-11-04T21:01:52 [14021] #5  0x00007f1f908393fa in abort () from /lib/x86_64-linux-gnu/libc.so.6

# 2017-11-04T21:01:52 [14021] #6  0x0000556818b6e1c2 in btr_cur_search_to_nth_level (index=0x7f1f63859578, level=0, tuple=0x7f1f67852178, mode=4, latch_mode=2, cursor=0x7f1f68ffa650, has_search_latch=0, file=0x556818efc648 "/d

ata/src/bb-10.1-marko/storage/xtradb/row/row0row.cc", line=823, mtr=0x7f1f68ffa730) at /data/src/bb-10.1-marko/storage/xtradb/btr/btr0cur.cc:792

# 2017-11-04T21:01:52 [14021] #7  0x0000556818ad4d2c in btr_pcur_open_low (index=0x7f1f63859578, level=0, tuple=0x7f1f67852178, mode=4, latch_mode=8194, cursor=0x7f1f68ffa650, file=0x556818efc648 "/data/src/bb-10.1-marko/stora

ge/xtradb/row/row0row.cc", line=823, mtr=0x7f1f68ffa730) at /data/src/bb-10.1-marko/storage/xtradb/include/btr0pcur.ic:440

# 2017-11-04T21:01:52 [14021] #8  0x0000556818ad6bac in row_search_index_entry (index=0x7f1f63859578, entry=0x7f1f67852178, mode=8194, pcur=0x7f1f68ffa650, mtr=0x7f1f68ffa730) at /data/src/bb-10.1-marko/storage/xtradb/row/row0

row.cc:823

# 2017-11-04T21:01:52 [14021] #9  0x0000556818ad0758 in row_purge_remove_sec_if_poss_leaf (node=0x7f1f9030ea78, index=0x7f1f63859578, entry=0x7f1f67852178) at /data/src/bb-10.1-marko/storage/xtradb/row/row0purge.cc:452

# 2017-11-04T21:01:52 [14021] #10 0x0000556818ad09c7 in row_purge_remove_sec_if_poss (node=0x7f1f9030ea78, index=0x7f1f63859578, entry=0x7f1f67852178) at /data/src/bb-10.1-marko/storage/xtradb/row/row0purge.cc:533

# 2017-11-04T21:01:52 [14021] #11 0x0000556818ad0b29 in row_purge_del_mark (node=0x7f1f9030ea78) at /data/src/bb-10.1-marko/storage/xtradb/row/row0purge.cc:581

# 2017-11-04T21:01:52 [14021] #12 0x0000556818ad147a in row_purge_record_func (node=0x7f1f9030ea78, undo_rec=0x7f1f6781c088 "\025\372\016", thr=0x7f1f6ceaffc0, updated_extern=false) at /data/src/bb-10.1-marko/storage/xtradb/ro

w/row0purge.cc:860

# 2017-11-04T21:01:52 [14021] #13 0x0000556818ad16a6 in row_purge (node=0x7f1f9030ea78, undo_rec=0x7f1f6781c088 "\025\372\016", thr=0x7f1f6ceaffc0) at /data/src/bb-10.1-marko/storage/xtradb/row/row0purge.cc:916

# 2017-11-04T21:01:52 [14021] #14 0x0000556818ad194e in row_purge_step (thr=0x7f1f6ceaffc0) at /data/src/bb-10.1-marko/storage/xtradb/row/row0purge.cc:996

# 2017-11-04T21:01:52 [14021] #15 0x0000556818a6f21b in que_thr_step (thr=0x7f1f6ceaffc0) at /data/src/bb-10.1-marko/storage/xtradb/que/que0que.cc:1089

# 2017-11-04T21:01:52 [14021] #16 0x0000556818a6f41f in que_run_threads_low (thr=0x7f1f6ceaffc0) at /data/src/bb-10.1-marko/storage/xtradb/que/que0que.cc:1151

# 2017-11-04T21:01:52 [14021] #17 0x0000556818a6f5ab in que_run_threads (thr=0x7f1f6ceaffc0) at /data/src/bb-10.1-marko/storage/xtradb/que/que0que.cc:1192

# 2017-11-04T21:01:52 [14021] #18 0x0000556818b207d2 in trx_purge (n_purge_threads=1, batch_size=300, truncate=false) at /data/src/bb-10.1-marko/storage/xtradb/trx/trx0purge.cc:1254

# 2017-11-04T21:01:52 [14021] #19 0x0000556818b045ba in srv_do_purge (n_threads=1, n_total_purged=0x7f1f68ffaea0) at /data/src/bb-10.1-marko/storage/xtradb/srv/srv0srv.cc:3442

# 2017-11-04T21:01:52 [14021] #20 0x0000556818b04b5d in srv_purge_coordinator_thread (arg=0x0) at /data/src/bb-10.1-marko/storage/xtradb/srv/srv0srv.cc:3592

# 2017-11-04T21:01:52 [14021] #21 0x00007f1f92534494 in start_thread (arg=0x7f1f68ffb700) at pthread_create.c:333

Elena Stepanova added a comment - 2017-11-06 17:31 Failures encountered during initial adjustments of the test, which are considered irrelevant to this bugfix and attributed to either misuse of the feature, or its general (known) instability InnoDB: Number of bytes after aio 0 requested 16384 InnoDB: from file ./test/t28435.ibd InnoDB: Operation Linux aio to file /data/src/bb-10.1-marko/storage/xtradb/os/os0file.cc and at line 5648 2017-11-04 17:25:08 140429567706880 [ERROR] InnoDB: File ./test/t28435.ibd: 'Linux aio' returned OS error 0. Cannot continue operation 171104 17:25:08 [ERROR] mysqld got signal 6 ; # 2017-11-04T17:25:18 [28346] Thread 1 (Thread 0x7fb84e7fc700 (LWP 28401)): # 2017-11-04T17:25:18 [28346] #0 __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:57 # 2017-11-04T17:25:18 [28346] #1 0x0000564e33e8bd7f in my_write_core (sig=6) at /data/src/bb-10.1-marko/mysys/stacktrace.c:477 # 2017-11-04T17:25:18 [28346] #2 0x0000564e3382abea in handle_fatal_signal (sig=6) at /data/src/bb-10.1-marko/sql/signal_handler.cc:296 # 2017-11-04T17:25:18 [28346] #3 <signal handler called> # 2017-11-04T17:25:18 [28346] #4 0x00007fb86e2e8fcf in raise () from /lib/x86_64-linux-gnu/libc.so.6 # 2017-11-04T17:25:18 [28346] #5 0x00007fb86e2ea3fa in abort () from /lib/x86_64-linux-gnu/libc.so.6 # 2017-11-04T17:25:18 [28346] #6 0x0000564e33bfdbbd in os_file_handle_error_cond_exit (name=0x7fb83fc16278 "./test/t28435.ibd", operation=0x564e340a16d1 "Linux aio", should_exit=1, on_error_silent=0, file=0x564e340a0390 "/data/src/bb-10.1-marko/storage/xtradb/os/os0file.cc", line=5648) at /data/src/bb-10.1-marko/storage/xtradb/os/os0file.cc:915 # 2017-11-04T17:25:18 [28346] #7 0x0000564e33bfdc04 in os_file_handle_error (name=0x7fb83fc16278 "./test/t28435.ibd", operation=0x564e340a16d1 "Linux aio", file=0x564e340a0390 "/data/src/bb-10.1-marko/storage/xtradb/os/os0file.cc", line=5648) at /data/src/bb-10.1-marko/storage/xtradb/os/os0file.cc:935 # 2017-11-04T17:25:18 [28346] #8 0x0000564e33c032e3 in os_aio_linux_handle (global_seg=3, message1=0x7fb84e7fbe40, message2=0x7fb84e7fbe48, type=0x7fb84e7fbe50, space_id=0x7fb84e7fbe58) at /data/src/bb-10.1-marko/storage/xtradb/os/os0file.cc:5648 # 2017-11-04T17:25:18 [28346] #9 0x0000564e33ddbc9b in fil_aio_wait (segment=3) at /data/src/bb-10.1-marko/storage/xtradb/fil/fil0fil.cc:6372 # 2017-11-04T17:25:18 [28346] #10 0x0000564e33ccbede in io_handler_thread (arg=0x564e351397d8 <n+24>) at /data/src/bb-10.1-marko/storage/xtradb/srv/srv0start.cc:585 # 2017-11-04T17:25:18 [28346] #11 0x00007fb86ffe5494 in start_thread (arg=0x7fb84e7fc700) at pthread_create.c:333 # 2017-11-04T17:25:18 [28346] #12 0x00007fb86e39e93f in clone () from /lib/x86_64-linux-gnu/libc.so.6 2017-11-04 17:52:52 7f81603d6b00 InnoDB: Operating system error number 2 in a file operation. InnoDB: The error means the system cannot find the path specified. 2017-11-04 17:52:52 140193642146560 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t29573.ibd 2017-11-04 17:52:52 140193642146560 [Note] InnoDB: Discarding tablespace of table "test"."t29573": Tablespace not found 2017-11-04 17:52:52 140193606486784 [ERROR] InnoDB: Cannot delete tablespace 68 because it is not found in the tablespace memory cache. 2017-11-04 17:52:52 140193606486784 [Warning] InnoDB: Cannot delete tablespace 68 in DISCARD TABLESPACE. Tablespace not found 2017-11-04 17:52:53 140193642449664 [ERROR] InnoDB: Cannot delete tablespace 69 because it is not found in the tablespace memory cache. 2017-11-04 17:52:53 140193642449664 [Warning] InnoDB: Cannot delete tablespace 69 in DISCARD TABLESPACE. Tablespace not found 2017-11-04 17:52:53 140193606486784 [Note] InnoDB: Sync to disk ... 2017-11-04 17:52:54 140193642449664 [Note] InnoDB: Phase IV - Flush complete 2017-11-04 17:52:54 7f81603d6b00 InnoDB: Assertion failure in thread 140193642146560 in file log0log.cc line 2292 InnoDB: Failing assertion: oldest_lsn >= log_sys->next_checkpoint_lsn # 2017-11-04T17:53:02 [29494] #5 0x00007f815e4123fa in abort () from /lib/x86_64-linux-gnu/libc.so.6 # 2017-11-04T17:53:02 [29494] #6 0x00005583101f193d in log_checkpoint (sync=1, write_always=1, safe_to_ignore=0) at /data/src/bb-10.1-marko/storage/xtradb/log/log0log.cc:2292 # 2017-11-04T17:53:02 [29494] #7 0x00005583101f1af6 in log_make_checkpoint_at (lsn=18446744073709551615, write_always=1) at /data/src/bb-10.1-marko/storage/xtradb/log/log0log.cc:2351 # 2017-11-04T17:53:02 [29494] #8 0x0000558310265627 in row_import_cleanup (prebuilt=0x7f812fcfb078, trx=0x7f812fcb0d78, err=DB_TABLESPACE_NOT_FOUND) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:2270 # 2017-11-04T17:53:02 [29494] #9 0x0000558310265705 in row_import_error (prebuilt=0x7f812fcfb078, trx=0x7f812fcb0d78, err=DB_TABLESPACE_NOT_FOUND) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:2298 # 2017-11-04T17:53:02 [29494] #10 0x000055831026856d in row_import_for_mysql (table=0x7f812fcc5ff8, prebuilt=0x7f812fcfb078) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:3594 # 2017-11-04T17:53:02 [29494] #11 0x0000558310186f27 in ha_innobase::discard_or_import_tablespace (this=0x7f812fc91888, discard=0 '\000') at /data/src/bb-10.1-marko/storage/xtradb/handler/ha_innodb.cc:12988 # 2017-11-04T17:53:02 [29494] #12 0x000055830fe4aec2 in handler::ha_discard_or_import_tablespace (this=0x7f812fc91888, discard=0 '\000') at /data/src/bb-10.1-marko/sql/handler.cc:4189 # 2017-11-04T17:53:02 [29494] #13 0x000055830fcc5401 in mysql_discard_or_import_tablespace (thd=0x7f813a777070, table_list=0x7f812fc221b0, discard=false) at /data/src/bb-10.1-marko/sql/sql_table.cc:5666 # 2017-11-04T17:53:02 [29494] #14 0x000055830fd3e64d in Sql_cmd_discard_import_tablespace::execute (this=0x7f812fc227a8, thd=0x7f813a777070) at /data/src/bb-10.1-marko/sql/sql_alter.cc:365 # 2017-11-04T17:53:02 [29494] #15 0x000055830fc0f17c in mysql_execute_command (thd=0x7f813a777070) at /data/src/bb-10.1-marko/sql/sql_parse.cc:5680 # 2017-11-04T17:53:02 [29494] #16 0x000055830fc1342d in mysql_parse (thd=0x7f813a777070, rawbuf=0x7f812fc22088 "ALTER TABLE t29573 IMPORT TABLESPACE /* QNO 324 CON_ID 7 */", length=59, parser_state=0x7f81603d5630) at /data/src/bb-10.1-marko/sql/sql_parse.cc:7326 # 2017-11-04T17:53:02 [29494] #17 0x000055830fc02042 in dispatch_command (command=COM_QUERY, thd=0x7f813a777070, packet=0x7f813a77d071 " ALTER TABLE t29573 IMPORT TABLESPACE /* QNO 324 CON_ID 7 */ ", packet_length=61) at /data/src/bb-10.1-marko/sql/sql_parse.cc:1477 # 2017-11-04T17:53:02 [29494] #18 0x000055830fc00dc7 in do_command (thd=0x7f813a777070) at /data/src/bb-10.1-marko/sql/sql_parse.cc:1106 # 2017-11-04T17:53:02 [29494] #19 0x000055830fd39a63 in do_handle_one_connection (thd_arg=0x7f813a777070) at /data/src/bb-10.1-marko/sql/sql_connect.cc:1349 # 2017-11-04T17:53:02 [29494] #20 0x000055830fd397c7 in handle_one_connection (arg=0x7f813a777070) at /data/src/bb-10.1-marko/sql/sql_connect.cc:1261 # 2017-11-04T17:53:02 [29494] #21 0x00007f816010d494 in start_thread (arg=0x7f81603d6b00) at pthread_create.c:333 # 2017-11-04T17:53:02 [29494] #22 0x00007f815e4c693f in clone () from /lib/x86_64-linux-gnu/libc.so.6 2017-11-04 19:16:34 140404377053952 [ERROR] InnoDB: Cannot delete tablespace 25 because it is not found in the tablespace memory cache. 2017-11-04 19:16:34 140404377053952 [Warning] InnoDB: Cannot delete tablespace 25 in DISCARD TABLESPACE. Tablespace not found 2017-11-04 19:16:34 140404377053952 [Note] InnoDB: Sync to disk 2017-11-04 19:16:34 140404377053952 [Note] InnoDB: Sync to disk - done! 2017-11-04 19:16:34 140404377053952 [Note] InnoDB: Phase I - Update all pages 2017-11-04 19:16:34 140404377053952 [Note] InnoDB: Sync to disk 2017-11-04 19:16:34 140404377053952 [Note] InnoDB: Sync to disk - done! 2017-11-04 19:16:34 140404377053952 [Note] InnoDB: Discarding tablespace of table "test"."t7662": Data structure corruption 2017-11-04 19:16:34 140404413319936 [ERROR] InnoDB: The table test/t7656 doesn't have a corresponding tablespace, it was discarded. 2017-11-04 19:16:34 140404413319936 [Warning] InnoDB: Trying to access missing tablespace 23. 2017-11-04 19:16:34 140404413016832 [ERROR] InnoDB: The table test/t7658 doesn't have a corresponding tablespace, it was discarded. 2017-11-04 19:16:34 140404413016832 [ERROR] InnoDB: The table test/t7658 doesn't have a corresponding tablespace, it was discarded. 2017-11-04 19:16:34 140404413016832 [ERROR] Got error 155 when reading table './test/t7658' 2017-11-04 19:16:34 140404413016832 [ERROR] InnoDB: The table test/t7658 doesn't have a corresponding tablespace, it was discarded. 2017-11-04 19:16:34 140404413016832 [ERROR] InnoDB: The table test/t7658 doesn't have a corresponding tablespace, it was discarded. 2017-11-04 19:16:34 140404377053952 [ERROR] InnoDB: The table test/t7662 doesn't have a corresponding tablespace, it was discarded. 2017-11-04 19:16:35 140404413016832 [ERROR] InnoDB: Cannot delete tablespace 14 because it is not found in the tablespace memory cache. 2017-11-04 19:16:35 140404413016832 [Warning] InnoDB: Cannot delete tablespace 14 in DISCARD TABLESPACE. Tablespace not found 2017-11-04 19:16:35 140404413319936 [ERROR] InnoDB: Cannot delete tablespace 23 because it is not found in the tablespace memory cache. 2017-11-04 19:16:35 140404377053952 [ERROR] InnoDB: Cannot delete tablespace 25 because it is not found in the tablespace memory cache. 2017-11-04 19:16:35 140404377053952 [Warning] InnoDB: Cannot delete tablespace 25 in DISCARD TABLESPACE. Tablespace not found 2017-11-04 19:16:35 140404413016832 [Note] InnoDB: Sync to disk 2017-11-04 19:16:35 140404413319936 [ERROR] InnoDB: The table test/t7656 doesn't have a corresponding tablespace, it was discarded. 2017-11-04 19:16:35 140404413319936 [ERROR] InnoDB: The table test/t7656 doesn't have a corresponding tablespace, it was discarded. 2017-11-04 19:16:35 140404377053952 [Note] InnoDB: Sync to disk 2017-11-04 19:16:35 140404413319936 [ERROR] InnoDB: Cannot delete tablespace 26 because it is not found in the tablespace memory cache. 2017-11-04 19:16:35 140404413319936 [Warning] InnoDB: Cannot delete tablespace 26 in DISCARD TABLESPACE. Tablespace not found 2017-11-04 19:16:35 140404413016832 [Note] InnoDB: Sync to disk - done! 2017-11-04 19:16:35 140404377053952 [Note] InnoDB: Sync to disk - done! 2017-11-04 19:16:36 140404377053952 [Note] InnoDB: Phase I - Update all pages 2017-11-04 19:16:36 140404413016832 [Note] InnoDB: Phase I - Update all pages 2017-11-04 19:16:36 140404413016832 [Note] InnoDB: Sync to disk 2017-11-04 19:16:36 7fb27104eb00 InnoDB: Assertion failure in thread 140404377053952 in file rem0rec.ic line 998 InnoDB: Failing assertion: curr <= last # 2017-11-04T19:16:43 [7580] #5 0x00007fb2712d63fa in abort () from /lib/x86_64-linux-gnu/libc.so.6 # 2017-11-04T19:16:43 [7580] #6 0x0000558b6c94056d in rec_offs_validate (rec=0x0, index=0x0, offsets=0x7fb27104c138) at /data/src/bb-10.1-marko/storage/xtradb/include/rem0rec.ic:998 # 2017-11-04T19:16:43 [7580] #7 0x0000558b6c9406ac in rec_offs_any_extern (offsets=0x7fb27104c138) at /data/src/bb-10.1-marko/storage/xtradb/include/rem0rec.ic:1086 # 2017-11-04T19:16:43 [7580] #8 0x0000558b6c9444b6 in PageConverter::adjust_cluster_index_blob_ref (this=0x7fb27104c0a0, rec=0x7fb241d90080 "\200", offsets=0x7fb27104c138) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:1717 # 2017-11-04T19:16:43 [7580] #9 0x0000558b6c9445a5 in PageConverter::adjust_cluster_record (this=0x7fb27104c0a0, index=0x7fb241c33078, rec=0x7fb241d90080 "\200", offsets=0x7fb27104c138, deleted=false) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:1768 # 2017-11-04T19:16:43 [7580] #10 0x0000558b6c94474e in PageConverter::update_records (this=0x7fb27104c0a0, block=0x7fb27104b1d0) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:1821 # 2017-11-04T19:16:43 [7580] #11 0x0000558b6c9449db in PageConverter::update_index_page (this=0x7fb27104c0a0, block=0x7fb27104b1d0) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:1914 # 2017-11-04T19:16:43 [7580] #12 0x0000558b6c944c91 in PageConverter::update_page (this=0x7fb27104c0a0, block=0x7fb27104b1d0, page_type=@0x7fb27104afb8: 17855) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:1987 # 2017-11-04T19:16:43 [7580] #13 0x0000558b6c944fc8 in PageConverter::operator() (this=0x7fb27104c0a0, offset=163840, block=0x7fb27104b1d0) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:2108 # 2017-11-04T19:16:43 [7580] #14 0x0000558b6cad2b42 in fil_iterate (iter=..., block=0x7fb27104b1d0, callback=...) at /data/src/bb-10.1-marko/storage/xtradb/fil/fil0fil.cc:6848 # 2017-11-04T19:16:43 [7580] #15 0x0000558b6cad3605 in fil_tablespace_iterate (table=0x7fb241cc55f8, n_io_buffers=64, callback=...) at /data/src/bb-10.1-marko/storage/xtradb/fil/fil0fil.cc:7112 # 2017-11-04T19:16:43 [7580] #16 0x0000558b6c9485f3 in row_import_for_mysql (table=0x7fb241cc55f8, prebuilt=0x7fb241c2b078) at /data/src/bb-10.1-marko/storage/xtradb/row/row0import.cc:3609 # 2017-11-04T19:16:43 [7580] #17 0x0000558b6c866f27 in ha_innobase::discard_or_import_tablespace (this=0x7fb241c91088, discard=0 '\000') at /data/src/bb-10.1-marko/storage/xtradb/handler/ha_innodb.cc:12988 # 2017-11-04T19:16:43 [7580] #18 0x0000558b6c52aec2 in handler::ha_discard_or_import_tablespace (this=0x7fb241c91088, discard=0 '\000') at /data/src/bb-10.1-marko/sql/handler.cc:4189 # 2017-11-04T19:16:43 [7580] #19 0x0000558b6c3a5401 in mysql_discard_or_import_tablespace (thd=0x7fb24d78d070, table_list=0x7fb241c221b0, discard=false) at /data/src/bb-10.1-marko/sql/sql_table.cc:5666 # 2017-11-04T19:16:43 [7580] #20 0x0000558b6c41e64d in Sql_cmd_discard_import_tablespace::execute (this=0x7fb241c227a8, thd=0x7fb24d78d070) at /data/src/bb-10.1-marko/sql/sql_alter.cc:365 # 2017-11-04T19:16:43 [7580] #21 0x0000558b6c2ef17c in mysql_execute_command (thd=0x7fb24d78d070) at /data/src/bb-10.1-marko/sql/sql_parse.cc:5680 # 2017-11-04T19:16:43 [7580] #22 0x0000558b6c2f342d in mysql_parse (thd=0x7fb24d78d070, rawbuf=0x7fb241c22088 "ALTER TABLE t7662 IMPORT TABLESPACE /* QNO 227 CON_ID 9 */", length=58, parser_state=0x7fb27104d630) at /data/src/bb-10.1-marko/sql/sql_parse.cc:7326 # 2017-11-04T19:16:43 [7580] #23 0x0000558b6c2e2042 in dispatch_command (command=COM_QUERY, thd=0x7fb24d78d070, packet=0x7fb24d793071 " ALTER TABLE t7662 IMPORT TABLESPACE /* QNO 227 CON_ID 9 */ ", packet_length=60) at /data/src/bb-10.1-marko/sql/sql_parse.cc:1477 # 2017-11-04T19:16:43 [7580] #24 0x0000558b6c2e0dc7 in do_command (thd=0x7fb24d78d070) at /data/src/bb-10.1-marko/sql/sql_parse.cc:1106 # 2017-11-04T19:16:43 [7580] #25 0x0000558b6c419a63 in do_handle_one_connection (thd_arg=0x7fb24d78d070) at /data/src/bb-10.1-marko/sql/sql_connect.cc:1349 # 2017-11-04T19:16:43 [7580] #26 0x0000558b6c4197c7 in handle_one_connection (arg=0x7fb24d78d070) at /data/src/bb-10.1-marko/sql/sql_connect.cc:1261 # 2017-11-04T19:16:43 [7580] #27 0x00007fb272fd1494 in start_thread (arg=0x7fb27104eb00) at pthread_create.c:333 # 2017-11-04T19:16:43 [7580] #28 0x00007fb27138a93f in clone () from /lib/x86_64-linux-gnu/libc.so.6 2017-11-04 21:01:35 7f1f92847b00 InnoDB: Operating system error number 2 in a file operation. InnoDB: The error means the system cannot find the path specified. 2017-11-04 21:01:35 139773578869504 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t2.ibd 2017-11-04 21:01:35 139773578869504 [Note] InnoDB: Discarding tablespace of table "test"."t2": Tablespace not found 2017-11-04 21:01:38 7f1f92891b00 InnoDB: Operating system error number 2 in a file operation. InnoDB: The error means the system cannot find the path specified. 2017-11-04 21:01:38 139773579172608 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t1.ibd 2017-11-04 21:01:38 139773579172608 [Note] InnoDB: Discarding tablespace of table "test"."t1": Tablespace not found 2017-11-04 21:01:38 7f1f8f561b00 InnoDB: Operating system error number 2 in a file operation. InnoDB: The error means the system cannot find the path specified. 2017-11-04 21:01:38 139773525498624 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t6.ibd 2017-11-04 21:01:38 139773525498624 [Note] InnoDB: Discarding tablespace of table "test"."t6": Tablespace not found 2017-11-04 21:01:38 7f1f8f5f5b00 InnoDB: Operating system error number 2 in a file operation. InnoDB: The error means the system cannot find the path specified. 2017-11-04 21:01:39 139773526104832 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t4.ibd 2017-11-04 21:01:39 139773526104832 [Note] InnoDB: Discarding tablespace of table "test"."t4": Tablespace not found 2017-11-04 21:01:40 7f1f8f5abb00 InnoDB: Operating system error number 2 in a file operation. InnoDB: The error means the system cannot find the path specified. 2017-11-04 21:01:40 139773525801728 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t5.ibd 2017-11-04 21:01:40 139773525801728 [Note] InnoDB: Discarding tablespace of table "test"."t5": Tablespace not found 2017-11-04 21:01:40 7f1f927fdb00 InnoDB: Operating system error number 2 in a file operation. InnoDB: The error means the system cannot find the path specified. 2017-11-04 21:01:40 139773578566400 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t3.ibd 2017-11-04 21:01:40 139773578566400 [Note] InnoDB: Discarding tablespace of table "test"."t3": Tablespace not found 2017-11-04 21:01:49 7f1f8f4cdb00 InnoDB: Operating system error number 2 in a file operation. InnoDB: The error means the system cannot find the path specified. 2017-11-04 21:01:49 139773524892416 [ERROR] InnoDB: Trying to import a tablespace, but could not open the tablespace file ./test/t8.ibd 2017-11-04 21:01:49 139773524892416 [Note] InnoDB: Discarding tablespace of table "test"."t8": Tablespace not found 2017-11-04 21:01:49 7f1f68ffb700 InnoDB: Assertion failure in thread 139772882302720 in file btr0cur.cc line 792 InnoDB: Failing assertion: fil_page_get_type(page) == 17855 # 2017-11-04T21:01:52 [14021] #5 0x00007f1f908393fa in abort () from /lib/x86_64-linux-gnu/libc.so.6 # 2017-11-04T21:01:52 [14021] #6 0x0000556818b6e1c2 in btr_cur_search_to_nth_level (index=0x7f1f63859578, level=0, tuple=0x7f1f67852178, mode=4, latch_mode=2, cursor=0x7f1f68ffa650, has_search_latch=0, file=0x556818efc648 "/d ata/src/bb-10.1-marko/storage/xtradb/row/row0row.cc", line=823, mtr=0x7f1f68ffa730) at /data/src/bb-10.1-marko/storage/xtradb/btr/btr0cur.cc:792 # 2017-11-04T21:01:52 [14021] #7 0x0000556818ad4d2c in btr_pcur_open_low (index=0x7f1f63859578, level=0, tuple=0x7f1f67852178, mode=4, latch_mode=8194, cursor=0x7f1f68ffa650, file=0x556818efc648 "/data/src/bb-10.1-marko/stora ge/xtradb/row/row0row.cc", line=823, mtr=0x7f1f68ffa730) at /data/src/bb-10.1-marko/storage/xtradb/include/btr0pcur.ic:440 # 2017-11-04T21:01:52 [14021] #8 0x0000556818ad6bac in row_search_index_entry (index=0x7f1f63859578, entry=0x7f1f67852178, mode=8194, pcur=0x7f1f68ffa650, mtr=0x7f1f68ffa730) at /data/src/bb-10.1-marko/storage/xtradb/row/row0 row.cc:823 # 2017-11-04T21:01:52 [14021] #9 0x0000556818ad0758 in row_purge_remove_sec_if_poss_leaf (node=0x7f1f9030ea78, index=0x7f1f63859578, entry=0x7f1f67852178) at /data/src/bb-10.1-marko/storage/xtradb/row/row0purge.cc:452 # 2017-11-04T21:01:52 [14021] #10 0x0000556818ad09c7 in row_purge_remove_sec_if_poss (node=0x7f1f9030ea78, index=0x7f1f63859578, entry=0x7f1f67852178) at /data/src/bb-10.1-marko/storage/xtradb/row/row0purge.cc:533 # 2017-11-04T21:01:52 [14021] #11 0x0000556818ad0b29 in row_purge_del_mark (node=0x7f1f9030ea78) at /data/src/bb-10.1-marko/storage/xtradb/row/row0purge.cc:581 # 2017-11-04T21:01:52 [14021] #12 0x0000556818ad147a in row_purge_record_func (node=0x7f1f9030ea78, undo_rec=0x7f1f6781c088 "\025\372\016", thr=0x7f1f6ceaffc0, updated_extern=false) at /data/src/bb-10.1-marko/storage/xtradb/ro w/row0purge.cc:860 # 2017-11-04T21:01:52 [14021] #13 0x0000556818ad16a6 in row_purge (node=0x7f1f9030ea78, undo_rec=0x7f1f6781c088 "\025\372\016", thr=0x7f1f6ceaffc0) at /data/src/bb-10.1-marko/storage/xtradb/row/row0purge.cc:916 # 2017-11-04T21:01:52 [14021] #14 0x0000556818ad194e in row_purge_step (thr=0x7f1f6ceaffc0) at /data/src/bb-10.1-marko/storage/xtradb/row/row0purge.cc:996 # 2017-11-04T21:01:52 [14021] #15 0x0000556818a6f21b in que_thr_step (thr=0x7f1f6ceaffc0) at /data/src/bb-10.1-marko/storage/xtradb/que/que0que.cc:1089 # 2017-11-04T21:01:52 [14021] #16 0x0000556818a6f41f in que_run_threads_low (thr=0x7f1f6ceaffc0) at /data/src/bb-10.1-marko/storage/xtradb/que/que0que.cc:1151 # 2017-11-04T21:01:52 [14021] #17 0x0000556818a6f5ab in que_run_threads (thr=0x7f1f6ceaffc0) at /data/src/bb-10.1-marko/storage/xtradb/que/que0que.cc:1192 # 2017-11-04T21:01:52 [14021] #18 0x0000556818b207d2 in trx_purge (n_purge_threads=1, batch_size=300, truncate=false) at /data/src/bb-10.1-marko/storage/xtradb/trx/trx0purge.cc:1254 # 2017-11-04T21:01:52 [14021] #19 0x0000556818b045ba in srv_do_purge (n_threads=1, n_total_purged=0x7f1f68ffaea0) at /data/src/bb-10.1-marko/storage/xtradb/srv/srv0srv.cc:3442 # 2017-11-04T21:01:52 [14021] #20 0x0000556818b04b5d in srv_purge_coordinator_thread (arg=0x0) at /data/src/bb-10.1-marko/storage/xtradb/srv/srv0srv.cc:3592 # 2017-11-04T21:01:52 [14021] #21 0x00007f1f92534494 in start_thread (arg=0x7f1f68ffb700) at pthread_create.c:333

People

Assignee:: Elena Stepanova

Reporter:: Elena Stepanova

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 2017-11-04 21:53

Updated:: 2017-11-06 18:02

Resolved:: 2017-11-06 18:02

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.

MariaDB Server