Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-25506

Atomic DDL: .frm file is removed and orphan InnoDB tablespace is left behind upon crash recovery

    XMLWordPrintable

Details

    Description

      In the test run, a server crash was induced while CREATE TABLE IF NOT EXISTS tt11 AS SELECT ... was being executed.

      After the crash, the original datadir contained both .frm and .ibd files:

      $ ls -l workdirs/worker7/vardir1_65/data_orig/test/tt11*
      		 
      -rw-rw---- 1 mdbe mdbe   462 Apr 24 14:17 workdirs/worker7/vardir1_65/data_orig/test/tt11.frm
      		 
      -rw-rw---- 1 mdbe mdbe 65536 Apr 24 14:17 workdirs/worker7/vardir1_65/data_orig/test/tt11.ibd

      Upon recovery on this datadir, InnoDB complains in the error log:

      bb-10.6-monty 8a94dabc9 with trigger patch

      		 
      2021-04-24 14:17:06 0 [ERROR] InnoDB: Table `test`.`tt11` does not exist in the InnoDB internal data dictionary though MariaDB is trying to drop it. Have you copied the .frm file of the table to the MariaDB database directory from another database? Please refer to https://mariadb.com/kb/en/innodb-troubleshooting/ for how to resolve the issue.
      		 
      2021-04-24 14:17:06 0 [Note] DDL_LOG: Crash recovery executed 1 entries

      After the recovery the .frm file is no longer there, but .ibd still is:

      $ ls -l workdirs/worker7/vardir1_65/data/test/tt11*
      		 
      -rw-rw---- 1 mdbe mdbe 65536 Apr 24 14:17 workdirs/worker7/vardir1_65/data/test/tt11.ibd

      And the table cannot be either dropped or created:

      MariaDB [test]> create table tt11 (a int);
      		 
      ERROR 1813 (HY000): Tablespace for table '`test`.`tt11`' exists. Please DISCARD the tablespace before IMPORT
      		 
      MariaDB [test]> drop table tt11;
      		 
      ERROR 1051 (42S02): Unknown table 'test.tt11'
      		 
      MariaDB [test]> create table tt11 (a int);
      		 
      ERROR 1813 (HY000): Tablespace for table '`test`.`tt11`' exists. Please DISCARD the tablespace before IMPORT

      The "before" and "after" datadirs, logs and rr profiles are available.

      Attachments

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. MDEV-372 Table gets fatally corrupted if server crashes during ALTER TABLE, "table doesn't exist" is reported

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25646 Atomic DDL: InnoDB: Datafile './test/<tablename>.ibd' is corrupted. Cannot determine the space ID from the first 64 pages

          • Major - Major loss of function.
          • Closed
          causes

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25902 Unexpected ER_LOCK_WAIT_TIMEOUT and result after timeout, assertion failure err != DB_DUPLICATE_KEY

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25919 InnoDB reports misleading lock wait timeout on DDL operations

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25936 Crash during DDL that involves FULLTEXT INDEX

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25950 InnoDB: Ignoring strange row from mysql.innodb_index_stats after valid DDL.

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-26012 InnoDB purge and shutdown hangs after failed ALTER TABLE

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-26041 Recovery failure due to delete-marked SYS_FIELDS record

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-27017 Assertion failure 'table->get_ref_count() == 0' on DDL that involves FULLTEXT INDEX

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-27234 InnoDB dictionary recovery wrongly uses READ UNCOMMITTED isolation level instead of READ COMMITTED

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-27274 DROP TABLE after failed IMPORT TABLESPACE fails to delete files

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-27973 SIGSEGV in ha_innobase::reset from THD::mark_tmp_table_as_free_for_reuse (opt builds) and handler::ha_reset (dbg builds) on TRUNCATE

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-28079 Shutdown hangs after altering innodb partition fts table

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-28240 InnoDB Temporary Tablespace (ibtmp1) is continuously growing

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          includes

          Bug - A problem which impairs or prevents the functions of the product. MDEV-21602 CREATE TABLE…PRIMARY KEY…SELECT workaround causes DROP TABLE to ignore locks

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is blocked by

          Task - A task that needs to be done. MDEV-18518 Implement atomic multi-table (or multi-partition) CREATE TABLE for InnoDB

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Task - A task that needs to be done. MDEV-25691 Simplify handlerton::drop_database for InnoDB

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25743 Unnecessary copying of table names in InnoDB dictionary operations

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MDEV-22409 Draft: 1932: Table 'test.t1' doesn't exist in engine after crash recovery

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-23484 Rollback unnecessarily acquires dict_operation_lock for every row

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-23721 Assertion ‘node->table->is_temporary() || lock_table_has_locks(node->table)’ failed in row_undo_ins

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25850 CREATE FULLTEXT INDEX unnecessarily writes undo log

          • Major - Major loss of function.
          • Stalled

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25852 Orphan #sql*.ibd files are occasionally left behind after killed ALTER TABLE

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25935 Misleading error message due to FOREIGN KEY on RENAME TABLE

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-26578 ERROR: AddressSanitizer: heap-use-after-free around dict_table_t::is_temporary_name

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-26966 The parameter innodb_force_load_corrupted makes no sense

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-30286 InnoDB: Failing assertion: sym_node->table != NULL

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-31132 Deadlock between a DDL operation and a purge of InnoDB history

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Task - A task that needs to be done. MDEV-32786 Optimization of DROP TABLE for Galera

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-21175 Remove dict_table_t::n_foreign_key_checks_running from InnoDB

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-24408 Crash-safe DROP DATABASE

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-26127 Assertion `err != DB_DUPLICATE_KEY' failed or InnoDB: Failing assertion: id != 0 on ALTER ... REBUILD PARTITION

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-29846 deadlock on dict_sys.mutex on database drop

          • Major - Major loss of function.
          • Open
          mentioned in

          Page Loading...

          Activity

            People

              marko Marko Mäkelä
              elenst Elena Stepanova
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.