Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-17567

Atomic DDL

    XMLWordPrintable

    Details

      Description

      The purpose of this task is to ensure that the following internal operations
      are atomic (either all or nothing) for all storage engines:

      Manage .frm
      Storage engine data dictionary
      Binary log

      This will solve the following things:

      • .frm context and storage engine dictionary is always in sync
      • no #sql-xxxx files if server crashes during alter table
      • binary log will always contain the DDL statement if it succeeded

      The cost of doing the above should not be more than 1-2 sync per DDL.

      High level architecture

      When doing a DDL, store somewhere (either trough write_ddl_log_entry() or
      some new method):

      • Operation
      • Number of tables
      • Table name
      • Table id for original table
      • Table id for resulting table (in case of rename)
      • sql command (for binary log)

      If there is no table id (for example for CSV) we would use the
      timestamp of the files.

      With the above information we would be able to continue from the place
      where the operation failed.

      Low level architecture (to be done before implementation starts)

      Describe in detail the source changes needed for:

      CREATE TABLE
      CREATE TABLE ... SELECT
      DROP TABLE t1,t2,t3,t4;
      RENAME TABLE t1 as t2, t2 as t1;
      ALTER TABLE

        Attachments

          Issue Links

          blocks

          Task - A task that needs to be done. MDEV-11633 Make the InnoDB system tablespace optional

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-11655 Transactional data dictionary

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-15140 Implement Partial / Filtered Indexes

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-18518 Implement atomic multi-table (or multi-partition) CREATE TABLE for InnoDB

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-23570 deprecate keep_files_on_create

          • Major - Major loss of function.
          • Open
          includes

          Task - A task that needs to be done. MDEV-23842 Atomic RENAME TABLE

          • Major - Major loss of function.
          • In Review

          Task - A task that needs to be done. MDEV-23844 Atomic DROP TABLE

          • Major - Major loss of function.
          • In Progress

          Task - A task that needs to be done. MDEV-24395 Atomic DROP TRIGGER

          • Major - Major loss of function.
          • In Review

          Task - A task that needs to be done. MDEV-24408 Atomic DROP DATABASE

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-24576 Atomic CREATE TABLE

          • Major - Major loss of function.
          • In Review

          Task - A task that needs to be done. MDEV-24607 ATOMIC CREATE VIEW

          • Major - Major loss of function.
          • In Review

          Task - A task that needs to be done. MDEV-24746 Atomic CREATE TRIGGER

          • Major - Major loss of function.
          • In Review
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. MDEV-20677 Renaming files may not be filesystem-crash-safe

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-24589 DROP TABLE is not crash-safe

          • Critical - Crashes, loss of data, severe memory leak.
          • Open
          is part of

          Task - A task that needs to be done. MDEV-4259 transactional DDL

          • Critical - Crashes, loss of data, severe memory leak.
          • Open
          relates to

          Task - A task that needs to be done. MDEV-18518 Implement atomic multi-table (or multi-partition) CREATE TABLE for InnoDB

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-22928 SUMMARY: AddressSanitizer: SEGV storage/innobase/include/dict0mem.h:1178 in dict_index_t::is_spatial() const

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-23741 InnoDB: Table ... contains <n> indexes inside InnoDB, which is different from the number of indexes <n> defined in the MariaDB

          • Major - Major loss of function.
          • Closed

          Technical task - A technical task. MDEV-24755 Rebase FK tasks on top of Atomic DDL

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-6642 Server crashed with assertion failure in file ha_innodb.cc line 8619

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-11675 Lag Free Alter On Slave

          • Critical - Crashes, loss of data, severe memory leak.
          • Confirmed

          Task - A task that needs to be done. MDEV-16290 ALTER TABLE ... RENAME COLUMN syntax

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Task - A task that needs to be done. MDEV-16417 Store Foreign Key metadata outside of InnoDB

          • Critical - Crashes, loss of data, severe memory leak.
          • In Review

          Technical task - A technical task. MDEV-21053 Crash safety of foreign key DDL

          • Critical - Crashes, loss of data, severe memory leak.
          • In Review

          Bug - A problem which impairs or prevents the functions of the product. MDEV-22056 Rocks db corrupts data when disk is out of space

          • Major - Major loss of function.
          • Open

            Activity

              People

              Assignee:
              monty Michael Widenius
              Reporter:
              monty Michael Widenius
              Votes:
              7 Vote for this issue
              Watchers:
              19 Start watching this issue

                Dates

                Created:
                Updated: