query:

    # The following

    # ALTER TABLE t1 MODIFY COLUMN col2 INT NOT NULL |

    # ALTER TABLE t1 MODIFY COLUMN col2 INT          ;

    # or just Marko's proposal

        ALTER TABLE t1 FORCE ;

query_init:

    # same assert

    # CREATE TABLE t1 ( col2 INT ) ENGINE = InnoDB ROW_FORMAT = Dynamic ;

    # CREATE TABLE t1 ( col2 INT ) ENGINE = InnoDB ROW_FORMAT = Redundant ;

    # CREATE TABLE t1 ( col2 INT ) ENGINE = InnoDB ROW_FORMAT = Compressed ;

      CREATE TABLE t1 ( col2 INT ) ENGINE = InnoDB ROW_FORMAT = Compact ;

Replay on

- 10.2.24 commit bc8d173b9f9a629d6301f5e8eb011155b041de4a 2019-04-15

- 10.3.15 commit a2335b791aa06fbf4b784486ed9d34ba75af9d51   2019-04-14

- 10.4.5    commit eb056f8726131b652f22b33b23c0682741ea5475 2019-04-16

Please use the uploaded MTR based test MDEV-18200.test.

2019-04-16 17:51:12 140650916363264 [ERROR] InnoDB: Cannot open datafile for read-only: './test/#sql-ib1974.ibd' OS error: 71

[00] FATAL ERROR: 2019-04-16 17:51:12 Can't open datafile test/#sql-ib1974

mysqltest: At line 27: exec of '/dev/shm/10.2/extra/mariabackup/mariabackup --defaults-file=/dev/shm/10.2/mysql-test/var/my.cnf  --backup --target-dir=/dev/shm/10.2/mysql-test/var/tmp/backup' failed, error: 256, status: 1, errno: 11

I have set the label "affects-tests" because a quite high fraction of my RQG based tests for Mariabackup abort with this failure.

The unfortunate consequence is:

Other maybe existing and unknown bugs have a significant lower chance to show up.

2019-07-05 21:45:04 140439568443200 [Note] InnoDB: New log files created, LSN=33849437

2019-07-05 21:45:04 140439568443200 [Note] InnoDB: Highest supported file format is Barracuda.

2019-07-05 21:45:04 140439568443200 [ERROR] InnoDB: Operating system error number 2 in a file operation.

2019-07-05 21:45:04 140439568443200 [ERROR] InnoDB: The error means the system cannot find the path specified.

2019-07-05 21:45:04 140439568443200 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.

2019-07-05 21:45:04 140439568443200 [ERROR] InnoDB: Cannot open datafile for read-only: './test/#sql-2498_10.ibd' OS error: 71

2019-07-05 21:45:04 140439568443200 [ERROR] InnoDB: Operating system error number 2 in a file operation.

2019-07-05 21:45:04 140439568443200 [ERROR] InnoDB: The error means the system cannot find the path specified.

2019-07-05 21:45:04 140439568443200 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them.

2019-07-05 21:45:04 140439568443200 [ERROR] InnoDB: Could not find a valid tablespace file for `test/#sql-2498_10`. Please refer to https://mariadb.com/kb/en/innodb-data-dictionary-troubleshooting/ for how to resolve the issue.

2019-07-05 21:45:04 140439568443200 [Note] InnoDB: 1 transaction(s) which must be rolled back or cleaned up in total 1 row operations to undo

2019-07-05 21:45:04 140439568443200 [Note] InnoDB: Trx id counter is 5120

2019-07-05 21:45:04 140439568443200 [Note] InnoDB: Deleting ./test/#sql-2498_10.ibd

2019-07-05 21:45:04 140439568443200 [Note] InnoDB: Removed datafile ./test/#sql-2498_10.ibd for table test/#sql-2498_10

2019-07-05 21:45:05 140439043770112 [Note] InnoDB: Starting in background the rollback of recovered transactions

2019-07-05 21:45:05 140439568443200 [Note] InnoDB: 128 out of 128 rollback segments are active.

2019-07-05 21:45:05 140439568443200 [Note] InnoDB: Creating shared tablespace for temporary tables

2019-07-05 21:45:05 140439568443200 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...

2019-07-05 21:45:05 140439568443200 [Note] InnoDB: File './ibtmp1' size is now 12 MB.

2019-07-05 21:45:05 140439568443200 [Note] InnoDB: Waiting for purge to start

2019-07-05 21:45:05 140439043770112 [Note] InnoDB: Rolled back recovered transaction 4617

2019-07-05 21:45:05 140439043770112 [Note] InnoDB: Rollback of non-prepared transactions completed

git clone https://github.com/MariaDB/randgen --branch mdev18200 rqg-mdev18200

cd rqg-mdev18200

. ./mdev18200.cmd <your basedir> <your vardir>

$ sudo -u tom gdb --args extra/mariabackup/mariabackup --user=root --target-dir=/tmp/b --socket=/tmp/build-mariadb-server-10.3.sock  --backup

GNU gdb (GDB) Fedora 12.1-1.fc36

Copyright (C) 2022 Free Software Foundation, Inc.

License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>

This is free software: you are free to change and redistribute it.

There is NO WARRANTY, to the extent permitted by law.

Type "show copying" and "show warranty" for details.

This GDB was configured as "x86_64-redhat-linux-gnu".

Type "show configuration" for configuration details.

For bug reporting instructions, please see:

<https://www.gnu.org/software/gdb/bugs/>.

Find the GDB manual and other documentation resources online at:

    <http://www.gnu.org/software/gdb/documentation/>.

For help, type "help".

Type "apropos word" to search for commands related to "word"...

Reading symbols from extra/mariabackup/mariabackup...

(gdb) run

Starting program: /home/dan/repos/build-mariadb-server-10.3/extra/mariabackup/mariabackup --user=root --target-dir=/tmp/b --socket=/tmp/build-mariadb-server-10.3.sock --backup

[Thread debugging using libthread_db enabled]

Using host libthread_db library "/lib64/libthread_db.so.1".

[00] 2022-08-29 09:43:16 Connecting to MySQL server host: localhost, user: root, password: not set, port: not set, socket: /tmp/build-mariadb-server-10.3.sock

[00] 2022-08-29 09:43:16 Using server version 10.3.37-MariaDB

[00] 2022-08-29 09:43:16 Warning: option 'datadir' has different values:

  '/var/lib/mysql' in defaults file

  '/tmp/build-mariadb-server-10.3-datadir/' in SHOW VARIABLES

/home/dan/repos/build-mariadb-server-10.3/extra/mariabackup/mariabackup based on MariaDB server 10.3.37-MariaDB Linux (x86_64)

[00] 2022-08-29 09:43:16 uses posix_fadvise().

[00] 2022-08-29 09:43:16 cd to /tmp/build-mariadb-server-10.3-datadir/

[00] 2022-08-29 09:43:16 open files limit requested 0, set to 1024

[00] 2022-08-29 09:43:16 mariabackup: using the following InnoDB configuration:

[00] 2022-08-29 09:43:16 innodb_data_home_dir = 

[00] 2022-08-29 09:43:16 innodb_data_file_path = ibdata1:12M:autoextend

[00] 2022-08-29 09:43:16 innodb_log_group_home_dir = ./

[00] 2022-08-29 09:43:16 InnoDB: Using Linux native AIO

2022-08-29  9:43:16 0 [Note] InnoDB: Number of pools: 1

2022-08-29  9:43:16 0 [Warning] InnoDB: Unable to open "./ib_logfile0" to check native AIO read support.

2022-08-29  9:43:16 0 [Warning] InnoDB: Linux Native AIO disabled.

2022-08-29  9:43:16 0 [ERROR] InnoDB: Operating system error number 13 in a file operation.

2022-08-29  9:43:16 0 [ERROR] InnoDB: The error means mysqld does not have the access rights to the directory.

2022-08-29 09:43:16 0x7ffff7c447c0  InnoDB: Assertion failure in file /home/dan/repos/mariadb-server-10.3/storage/innobase/fil/fil0fil.cc line 668

InnoDB: Failing assertion: success

InnoDB: We intentionally generate a memory trap.

InnoDB: Submit a detailed bug report to https://jira.mariadb.org/

InnoDB: If you get repeated assertion failures or crashes, even

InnoDB: immediately after the mysqld startup, there may be

InnoDB: corruption in the InnoDB tablespace. Please refer to

InnoDB: https://mariadb.com/kb/en/library/innodb-recovery-modes/

InnoDB: about forcing recovery.

Program received signal SIGABRT, Aborted.

0x00007ffff768ec4c in __pthread_kill_implementation () from /lib64/libc.so.6

Missing separate debuginfos, use: dnf debuginfo-install bzip2-libs-1.0.8-11.fc36.x86_64 glibc-2.35-15.fc36.x86_64 libaio-0.3.111-13.fc36.x86_64 libcap-2.48-4.fc36.x86_64 libgcc-12.2.1-1.fc36.x86_64 libgcrypt-1.10.1-3.fc36.x86_64 libgpg-error-1.45-1.fc36.x86_64 libstdc++-12.2.1-1.fc36.x86_64 libxcrypt-4.4.28-1.fc36.x86_64 libzstd-1.5.2-2.fc36.x86_64 lz4-libs-1.9.3-4.fc36.x86_64 pcre-8.45-1.fc36.1.x86_64 snappy-1.1.9-4.fc36.x86_64 systemd-libs-250.8-1.fc36.x86_64 xz-libs-5.2.5-9.fc36.x86_64 zlib-1.2.11-32.fc36.x86_64

(gdb) bt

#0  0x00007ffff768ec4c in __pthread_kill_implementation () from /lib64/libc.so.6

#1  0x00007ffff763e9c6 in raise () from /lib64/libc.so.6

#2  0x00007ffff76287f4 in abort () from /lib64/libc.so.6

#3  0x0000000000c4954b in ut_dbg_assertion_failed (expr=0xf3116f "success", 

    file=0xf161c0 "/home/dan/repos/mariadb-server-10.3/storage/innobase/fil/fil0fil.cc", line=668)

    at /home/dan/repos/mariadb-server-10.3/storage/innobase/ut/ut0dbg.cc:60

#4  0x0000000000ade1b4 in fil_node_open_file (node=0x1ed7160) at /home/dan/repos/mariadb-server-10.3/storage/innobase/fil/fil0fil.cc:668

#5  0x0000000000add6b4 in fil_node_prepare_for_io (node=0x1ed7160, space=0x1ed6f00)

    at /home/dan/repos/mariadb-server-10.3/storage/innobase/fil/fil0fil.cc:4068

#6  0x0000000000ae0b0d in fil_io (type=..., sync=false, page_id=..., page_size=..., byte_offset=0, len=512, buf=0x1675600 <log_sys+1024>, 

    message=0x0, ignore_missing_space=<optimized out>) at /home/dan/repos/mariadb-server-10.3/storage/innobase/fil/fil0fil.cc:4334

#7  0x0000000000b8537d in log_header_read (header=0) at /home/dan/repos/mariadb-server-10.3/storage/innobase/log/log0log.cc:1372

#8  recv_find_max_checkpoint (max_field=<optimized out>) at /home/dan/repos/mariadb-server-10.3/storage/innobase/log/log0recv.cc:1248

#9  0x00000000005a0708 in xtrabackup_backup_func () at /home/dan/repos/mariadb-server-10.3/extra/mariabackup/xtrabackup.cc:4409

#10 0x000000000059fe58 in main_low (argv=0x1e9f6f8) at /home/dan/repos/mariadb-server-10.3/extra/mariabackup/xtrabackup.cc:6745

#11 main (argc=<optimized out>, argv=0x7fffffffe468) at /home/dan/repos/mariadb-server-10.3/extra/mariabackup/xtrabackup.cc:6548

diff --git a/storage/innobase/fil/fil0fil.cc b/storage/innobase/fil/fil0fil.cc

index a196303c39f..9ea9fa025f1 100644

--- a/storage/innobase/fil/fil0fil.cc

+++ b/storage/innobase/fil/fil0fil.cc

@@ -665,8 +665,14 @@ static bool fil_node_open_file(fil_node_t* node)

                                        .physical())));

        }

+#ifdef MYSQL_SERVER

        ut_a(success);

        ut_a(node->is_open());

+#else

+       if (!success || !node->is_open()) {

+               exit(1);

+       }

+#endif

        fil_system.n_open++;