[#MDEV-16198] [Draft] Assertion `index->page != 0xFFFFFFFFU' failed in btr_cur_search_to_nth_level

https://api.travis-ci.org/v3/job/379443455/log.txt

The scenario involves DDL and multiple crash-restarts.

bb-10.3-marko cd15e764a8a4f3e799f1efaede413c95e3233df6
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Cannot open datafile for read-only: './test/FTS_0000000000000796_BEING_DELETED.ibd' OS error: 71
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Could not find a valid tablespace file for ``test`.`FTS_0000000000000796_BEING_DELETED``. Please refer to http://dev.mysql.com/doc/refman/5.7/en/innodb-troubleshooting-datadict.html for how to resolve the issue.
2018-05-16 4:04:00 0 [Warning] InnoDB: Ignoring tablespace for `test`.`FTS_0000000000000796_BEING_DELETED` because it could not be opened.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Cannot open datafile for read-only: './test/FTS_0000000000000796_BEING_DELETED_CACHE.ibd' OS error: 71
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Could not find a valid tablespace file for ``test`.`FTS_0000000000000796_BEING_DELETED_CACHE``. Please refer to http://dev.mysql.com/doc/refman/5.7/en/innodb-troubleshooting-datadict.html for how to resolve the issue.
2018-05-16 4:04:00 0 [Warning] InnoDB: Ignoring tablespace for `test`.`FTS_0000000000000796_BEING_DELETED_CACHE` because it could not be opened.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Cannot open datafile for read-only: './test/FTS_0000000000000796_CONFIG.ibd' OS error: 71
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Could not find a valid tablespace file for ``test`.`FTS_0000000000000796_CONFIG``. Please refer to http://dev.mysql.com/doc/refman/5.7/en/innodb-troubleshooting-datadict.html for how to resolve the issue.
2018-05-16 4:04:00 0 [Warning] InnoDB: Ignoring tablespace for `test`.`FTS_0000000000000796_CONFIG` because it could not be opened.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Cannot open datafile for read-only: './test/FTS_0000000000000796_DELETED.ibd' OS error: 71
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Could not find a valid tablespace file for ``test`.`FTS_0000000000000796_DELETED``. Please refer to http://dev.mysql.com/doc/refman/5.7/en/innodb-troubleshooting-datadict.html for how to resolve the issue.
2018-05-16 4:04:00 0 [Warning] InnoDB: Ignoring tablespace for `test`.`FTS_0000000000000796_DELETED` because it could not be opened.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Failed to find tablespace for table `test`.`FTS_0000000000000796_BEING_DELETED` in the cache. Attempting to load the tablespace with space id 1990
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Cannot open datafile for read-only: './test/FTS_0000000000000796_BEING_DELETED.ibd' OS error: 71
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Could not find a valid tablespace file for ``test`.`FTS_0000000000000796_BEING_DELETED``. Please refer to http://dev.mysql.com/doc/refman/5.7/en/innodb-troubleshooting-datadict.html for how to resolve the issue.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Failed to find tablespace for table `test`.`FTS_0000000000000796_BEING_DELETED_CACHE` in the cache. Attempting to load the tablespace with space id 1991
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Cannot open datafile for read-only: './test/FTS_0000000000000796_BEING_DELETED_CACHE.ibd' OS error: 71
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Could not find a valid tablespace file for ``test`.`FTS_0000000000000796_BEING_DELETED_CACHE``. Please refer to http://dev.mysql.com/doc/refman/5.7/en/innodb-troubleshooting-datadict.html for how to resolve the issue.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Failed to find tablespace for table `test`.`FTS_0000000000000796_CONFIG` in the cache. Attempting to load the tablespace with space id 1992
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Cannot open datafile for read-only: './test/FTS_0000000000000796_CONFIG.ibd' OS error: 71
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Could not find a valid tablespace file for ``test`.`FTS_0000000000000796_CONFIG``. Please refer to http://dev.mysql.com/doc/refman/5.7/en/innodb-troubleshooting-datadict.html for how to resolve the issue.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Failed to find tablespace for table `test`.`FTS_0000000000000796_DELETED` in the cache. Attempting to load the tablespace with space id 1993
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Cannot open datafile for read-only: './test/FTS_0000000000000796_DELETED.ibd' OS error: 71
2018-05-16 4:04:00 0 [ERROR] InnoDB: Operating system error number 2 in a file operation.
2018-05-16 4:04:00 0 [ERROR] InnoDB: The error means the system cannot find the path specified.
2018-05-16 4:04:00 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Could not find a valid tablespace file for ``test`.`FTS_0000000000000796_DELETED``. Please refer to http://dev.mysql.com/doc/refman/5.7/en/innodb-troubleshooting-datadict.html for how to resolve the issue.
2018-05-16 4:04:00 0 [ERROR] InnoDB: Trying to load index `FTS_COMMON_TABLE_IND` for table `test`.`FTS_0000000000000796_DELETED_CACHE`, but the index tree has been freed!
2018-05-16 4:04:00 0 [Warning] InnoDB: Parent table of FTS auxiliary table test/FTS_0000000000000796_000000000000095d_INDEX_1 not found.
2018-05-16 4:04:00 0 [Warning] InnoDB: Parent table of FTS auxiliary table test/FTS_0000000000000796_000000000000095d_INDEX_2 not found.
2018-05-16 4:04:00 0 [Warning] InnoDB: Parent table of FTS auxiliary table test/FTS_0000000000000796_000000000000095d_INDEX_3 not found.
2018-05-16 4:04:00 0 [Warning] InnoDB: Parent table of FTS auxiliary table test/FTS_0000000000000796_000000000000095d_INDEX_4 not found.
2018-05-16 4:04:00 0 [Warning] InnoDB: Parent table of FTS auxiliary table test/FTS_0000000000000796_000000000000095d_INDEX_5 not found.
2018-05-16 4:04:00 0 [Warning] InnoDB: Parent table of FTS auxiliary table test/FTS_0000000000000796_000000000000095d_INDEX_6 not found.
Version: '10.3.7-MariaDB-debug-log' socket: '/home/travis/logs/vardir1_4/mysql.sock' port: 19300 Source distribution
2018-05-16 4:04:00 13 [ERROR] mysqld: Table './test/seq3' is marked as crashed and should be repaired
2018-05-16 4:04:00 13 [Warning] Checking table: './test/seq3'

2018-05-16  4:04:01 13 [ERROR] InnoDB: Trying to load index `FTS_COMMON_TABLE_IND` for table `test`.`FTS_0000000000000796_DELETED_CACHE`, but the index tree has been freed!

mysqld: /home/travis/src/storage/innobase/btr/btr0cur.cc:1001: dberr_t btr_cur_search_to_nth_level_func(dict_index_t*, ulint, const dtuple_t*, page_cur_mode_t, ulint, btr_cur_t*, rw_lock_t*, const char*, unsigned int, mtr_t*, ib_uint64_t): Assertion `index->page != 0xFFFFFFFFU' failed.

180516  4:04:06 [ERROR] mysqld got signal 6 ;

#7  0x00007febef637ca2 in __GI___assert_fail (assertion=0x5651837f2f13 "index->page != 0xFFFFFFFFU", file=0x5651837f2738 "/home/travis/src/storage/innobase/btr/btr0cur.cc", line=1001, function=0x5651837f7680 <btr_cur_search_to_nth_level_func(dict_index_t*, unsigned long, dtuple_t const*, page_cur_mode_t, unsigned long, btr_cur_t*, rw_lock_t*, char const*, unsigned int, mtr_t*, unsigned long)::__PRETTY_FUNCTION__> "dberr_t btr_cur_search_to_nth_level_func(dict_index_t*, ulint, const dtuple_t*, page_cur_mode_t, ulint, btr_cur_t*, rw_lock_t*, const char*, unsigned int, mtr_t*, ib_uint64_t)") at assert.c:101

#8  0x0000565183174a39 in btr_cur_search_to_nth_level_func (index=0x56518698b738, level=0, tuple=0x7febb0045ec8, mode=PAGE_CUR_GE, latch_mode=1, cursor=0x7febb0045bd8, ahi_latch=0x0, file=0x5651837a9690 "/home/travis/src/storage/innobase/row/row0sel.cc", line=1325, mtr=0x7febec191160, autoinc=0) at /home/travis/src/storage/innobase/btr/btr0cur.cc:1001

#9  0x00005651830a3480 in btr_pcur_open_with_no_init_func (index=0x56518698b738, tuple=0x7febb0045ec8, mode=PAGE_CUR_GE, latch_mode=1, cursor=0x7febb0045bd8, ahi_latch=0x0, file=0x5651837a9690 "/home/travis/src/storage/innobase/row/row0sel.cc", line=1325, mtr=0x7febec191160) at /home/travis/src/storage/innobase/include/btr0pcur.ic:501

#10 0x00005651830a6fd5 in row_sel_open_pcur (plan=0x7febb0045bc8, ahi_latch=0x0, mtr=0x7febec191160) at /home/travis/src/storage/innobase/row/row0sel.cc:1325

#11 0x00005651830a7aa4 in row_sel (node=0x7febb00457a0, thr=0x7febb00468a8) at /home/travis/src/storage/innobase/row/row0sel.cc:1663

#12 0x00005651830a8ff9 in row_sel_step (thr=0x7febb00468a8) at /home/travis/src/storage/innobase/row/row0sel.cc:2328

#13 0x000056518301af39 in que_thr_step (thr=0x7febb00468a8) at /home/travis/src/storage/innobase/que/que0que.cc:1022

#14 0x000056518301b310 in que_run_threads_low (thr=0x7febb00468a8) at /home/travis/src/storage/innobase/que/que0que.cc:1108

#15 0x000056518301b500 in que_run_threads (thr=0x7febb00468a8) at /home/travis/src/storage/innobase/que/que0que.cc:1148

#16 0x000056518329ab10 in fts_eval_sql (trx=0x7febec2be908, graph=0x7febb00467e8) at /home/travis/src/storage/innobase/fts/fts0sql.cc:238

#17 0x000056518327b672 in fts_cmp_set_sync_doc_id (table=0x56518698c748, doc_id_cmp=0, read_only=0, doc_id=0x7febec191c98) at /home/travis/src/storage/innobase/fts/fts0fts.cc:2709

#18 0x000056518328079d in fts_init_doc_id (table=0x56518698c748) at /home/travis/src/storage/innobase/fts/fts0fts.cc:4936

#19 0x000056518327b371 in fts_get_next_doc_id (table=0x56518698c748, doc_id=0x7febec191d08) at /home/travis/src/storage/innobase/fts/fts0fts.cc:2624

#20 0x000056518307073e in row_mysql_convert_row_to_innobase (row=0x7feba438bd30, prebuilt=0x7feba438af88, mysql_rec=0x7feba438a6c8 "\374\001 \220\006\004\260\353\177", blob_heap=0x7febec191d88) at /home/travis/src/storage/innobase/row/row0mysql.cc:658

#21 0x00005651830724e1 in row_insert_for_mysql (mysql_rec=0x7feba438a6c8 "\374\001 \220\006\004\260\353\177", prebuilt=0x7feba438af88, ins_mode=ROW_INS_NORMAL) at /home/travis/src/storage/innobase/row/row0mysql.cc:1410

#22 0x0000565182f1eb4e in ha_innobase::write_row (this=0x7feba4389ec8, record=0x7feba438a6c8 "\374\001 \220\006\004\260\353\177") at /home/travis/src/storage/innobase/handler/ha_innodb.cc:8106

#23 0x0000565182d16082 in handler::ha_write_row (this=0x7feba4389ec8, buf=0x7feba438a6c8 "\374\001 \220\006\004\260\353\177") at /home/travis/src/sql/handler.cc:6195

#24 0x00005651829da0c1 in write_record (thd=0x7febb00012c0, table=0x7feba4389280, info=0x7febec1922f0) at /home/travis/src/sql/sql_insert.cc:2026

#25 0x00005651829d7485 in mysql_insert (thd=0x7febb00012c0, table_list=0x7febb0013b50, fields=..., values_list=..., update_fields=..., update_values=..., duplic=DUP_ERROR, ignore=false) at /home/travis/src/sql/sql_insert.cc:1069

#26 0x0000565182a17c72 in mysql_execute_command (thd=0x7febb00012c0) at /home/travis/src/sql/sql_parse.cc:4725

#27 0x0000565182a2267a in mysql_parse (thd=0x7febb00012c0, rawbuf=0x7febb00139b8 "INSERT INTO t1 (col1,col2,col3,col4) VALUES ( 4, 4, 4, REPEAT(CAST(4 AS CHAR(1)),@fill_amount)) /* QNO 36 CON_ID 15 */", length=118, parser_state=0x7febec1935f0, is_com_multi=false, is_next_command=false) at /home/travis/src/sql/sql_parse.cc:8019

#28 0x0000565182a0fafe in dispatch_command (command=COM_QUERY, thd=0x7febb00012c0, packet=0x7febb000b1f1 "INSERT INTO t1 (col1,col2,col3,col4) VALUES ( 4, 4, 4, REPEAT(CAST(4 AS CHAR(1)),@fill_amount)) /* QNO 36 CON_ID 15 */ ", packet_length=119, is_com_multi=false, is_next_command=false) at /home/travis/src/sql/sql_parse.cc:1846

#29 0x0000565182a0e52f in do_command (thd=0x7febb00012c0) at /home/travis/src/sql/sql_parse.cc:1391

#30 0x0000565182b74681 in do_handle_one_connection (connect=0x565186a33830) at /home/travis/src/sql/sql_connect.cc:1402

#31 0x0000565182b74405 in handle_one_connection (arg=0x565186a33830) at /home/travis/src/sql/sql_connect.cc:1308

#32 0x00007febf01f9184 in start_thread (arg=0x7febec194700) at pthread_create.c:312

#33 0x00007febef70603d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

experimental 6c40fc679d99de2a34ba7e3b6ac807b84be5942a

perl /home/travis/rqg//run-scenario.pl --duration=350 --threads=6 --seed=1526443359 --engine=InnoDB --reporters=Backtrace,ErrorLog,Deadlock --validators=TransformerNoComparator --transformers=ExecuteAsExecuteImmediate,ExecuteAsInsertSelect,ExecuteAsUnion,ExecuteAsUpdateDelete,ExecuteAsView,ExecuteAsPreparedTwice,ExecuteAsSPTwice,ExecuteAsTrigger --redefine=conf/mariadb/general-workarounds.yy --mysqld=--log_output=FILE --views --vcols --redefine=conf/mariadb/versioning.yy --redefine=conf/mariadb/alter_table.yy --redefine=conf/mariadb/bulk_insert.yy --redefine=conf/mariadb/sequences.yy --basedir=/home/travis/server --mysqld=--log_bin_trust_function_creators=1 --mysqld=--log-bin --mysqld=--max-statement-time=10 --mysqld=--lock-wait-timeout=20 --mysqld=--innodb-lock-wait-timeout=15 --mysqld=--loose-debug_assert_on_not_freed_memory=0 --grammar=conf/runtime/alter_online.yy --gendata=conf/runtime/alter_online.zz --scenario=Restart --scenario-type=crash --vardir=/home/travis/logs/vardir1_4

[MDEV-16198] [Draft] Assertion `index->page != 0xFFFFFFFFU' failed in btr_cur_search_to_nth_level_func Created: 2018-05-16 Updated: 2023-11-28 Resolved: 2023-11-28
Status:	Closed
Project:	MariaDB Server
Component/s:	Storage Engine - InnoDB
Affects Version/s:	10.3
Fix Version/s:	N/A

[MDEV-16198] [Draft] Assertion `index->page != 0xFFFFFFFFU' failed in btr_cur_search_to_nth_level_func Created: 2018-05-16 Updated: 2023-11-28 Resolved: 2023-11-28