Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-15528

Avoid writing freed InnoDB pages

Details

    Description

      When a InnoDB data file page is freed, its contents becomes garbage, and any storage allocated in the data file is wasted.

      MariaDB 10.4 introduced an InnoDB redo log record MLOG_INIT_FREE_PAGE for marking pages as freed. In MDEV-12353 (MariaDB 10.5.2), that record was replaced with FREE_PAGE. This record could be treated as no-op, or we can punch a hole for page_compressed=1 tables.

      If innodb_immediate_scrub_data_uncompressed is set, we should initialize the page with zeros. This will replace some of the non-working scrubbing logic (MDEV-8139). The scrubbing will be fixed further in MDEV-8139.

      The following parameters will be deprecated and ignored and the problematic ‘background scrubbing’ code removed:

      • innodb-background-scrub-data-uncompressed
      • innodb-background-scrub-data-compressed
      • innodb-background-scrub-data-interval
      • innodb-background-scrub-data-check-interval

      For page_compressed tables the freed page will be hole-punched

      Attachments

        Issue Links

          blocks

          Task - A task that needs to be done. MDEV-12227 Defer writes to the InnoDB temporary tablespace

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-17596 Assertion `block->page.flush_observer == __null || block->page.flush_observer == observer' failed in buf_flush_note_modification

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-18724 Replace buf_block_t::mutex with more std::atomic

          • Major - Major loss of function.
          • Closed
          causes

          Bug - A problem which impairs or prevents the functions of the product. MDEV-22096 Mariabackup copied too old page or too new checkpoint

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-22097 Not applying DELETE_ROW_FORMAT_REDUNDANT due to corruption

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-22103 INNODB_ENCRYPTION_NUM_KEY_REQUESTS is missing from INFORMATION_SCHEMA.GLOBAL_STATUS

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-22139 fseg_free_page_low() fails to write FREE_PAGE record, breaking recovery

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-22169 Recovery fails after failing to insert into mlog_init

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-22495 Assertion mode == 16 || mode == 12 || fix_block->page.status != buf_page_t::FREED failed in ibuf_read_merge_pages()

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-22710 Assertion `mode == 16 || mode == 12 || fix_block->page.status != buf_page_t::FREED' failed in buf_page_get_low

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-23252 Assertion failure 'req_type.is_dblwr_recover() || err == DB_SUCCESS' for page_compressed tables

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-24695 Encryption is modifying a freed page

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-27500 buf_page_free() fails to drop the adaptive hash index

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-27985 buf_flush_freed_pages() causes InnoDB to hang

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-30404 Inconsistent updates of PAGE_MAX_TRX_ID on ROW_FORMAT=COMPRESSED pages

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-30438 innodb.undo_truncate,4k fails when --innodb-immediate-scrub-data-uncompressed is enabled

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-32552 Write-ahead logging is broken for freed pages

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MDEV-11696 Page Compression Has No Effect on Table Data File Size

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Task - A task that needs to be done. MDEV-16526 Overhaul the InnoDB page flushing

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-17380 innodb_flush_neighbors=ON should be ignored on SSD

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-21952 ibdata1 file size growing in MariaDB

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-23973 Change buffer corruption when reallocating an recently freed page

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-24569 Assertion `mach_read_from_4(frame + 4U) == block.page.id().page_no()' failed in log_phys_t::apply

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25026 Various code paths are accessing freed pages

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-28699 Shrink temporary tablespaces without restart

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-31816 buf_LRU_free_page() does not preserve ROW_FORMAT=COMPRESSED block state

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-33112 innodb_undo_log_truncate=ON is blocking page writes

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-8139 Fix scrubbing

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-11068 Review which innodb_compression_algorithm to support in binary packages

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-12226 Avoid writes of freed (garbage) pages to InnoDB data files

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-12699 Improve crash recovery of corrupted data pages

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-15949 InnoDB: Failing assertion: space->n_pending_ops == 0 in fil_delete_tablespace upon DROP TABLE

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-16796 TRUNCATE TABLE slowdown with innodb_file_per_table=ON

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-17380 innodb_flush_neighbors=ON should be ignored on SSD

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-18698 Show InnoDB's internal background threads in SHOW ENGINE INNODB STATUS

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-20813 Assertion `!srv_safe_truncate || !newest_lsn || fil_page_get_type(page)' or `!newest_lsn || fil_page_get_type(page)' failed in buf_flush_init_for_writing

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-22190 After IMPORT: InnoDB: Record 126 is above rec heap top 120

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-22839 ROW_FORMAT=COMPRESSED vs PAGE_COMPRESSION=1 - size comparison

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-24780 [FATAL] InnoDB: Trying to read page number <...> with encryption and innodb-background-scrub-data-uncompressed

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            Ascending order - Click to sort in descending order
            marko Marko Mäkelä created issue -
            marko Marko Mäkelä made changes -
            Field Original Value New Value
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            Status Open [ 1 ] Confirmed [ 10101 ]
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            Fix Version/s 10.5 [ 23123 ]
            Fix Version/s 10.3 [ 22126 ]
            marko Marko Mäkelä made changes -
            NRE Projects RM_105_CANDIDATE RM_104ES_CANDIDATE
            marko Marko Mäkelä made changes -
            Assignee Thirunarayanan Balathandayuthapani [ thiru ] Marko Mäkelä [ marko ]
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            Description When a InnoDB data file page is freed, its contents becomes garbage, and any storage allocated in the data file is wasted.

            We should introduce an InnoDB redo log record for marking pages as freed. This record, say, {{MLOG_PAGE_FREE}}, could be treated as no-op, or we could elect to punch a hole, especially when the {{page_compressed=1}} option is used.

            If scrubbing is enabled, we should initialize the page with zeros. This should replace some of the non-working scrubbing logic (MDEV-8139).             		When a InnoDB data file page is freed, its contents becomes garbage, and any storage allocated in the data file is wasted.

            We should introduce an InnoDB redo log record for marking pages as freed. This record, {{MLOG_INIT_FREE_PAGE}}, could be treated as no-op, or we could elect to punch a hole, especially when the {{page_compressed=1}} option is used.

            If scrubbing is enabled, we should initialize the page with zeros. This should replace some of the non-working scrubbing logic (MDEV-8139).
            marko Marko Mäkelä made changes -
            serg Sergei Golubchik made changes -
            Fix Version/s 10.5 [ 23123 ]
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            Assignee Marko Mäkelä [ marko ] Thirunarayanan Balathandayuthapani [ thiru ]
            thiru Thirunarayanan Balathandayuthapani made changes -
            Status Confirmed [ 10101 ] In Progress [ 3 ]
            marko Marko Mäkelä made changes -
            serg Sergei Golubchik made changes -
            Fix Version/s 10.5 [ 23123 ]
            Fix Version/s 10.4 [ 22408 ]
            thiru Thirunarayanan Balathandayuthapani made changes -
            Fix Version/s 10.5.2 [ 24030 ]
            Fix Version/s 10.5 [ 23123 ]
            Resolution Fixed [ 1 ]
            Status In Progress [ 3 ] Closed [ 6 ]
            marko Marko Mäkelä made changes -
            Description When a InnoDB data file page is freed, its contents becomes garbage, and any storage allocated in the data file is wasted.

            We should introduce an InnoDB redo log record for marking pages as freed. This record, {{MLOG_INIT_FREE_PAGE}}, could be treated as no-op, or we could elect to punch a hole, especially when the {{page_compressed=1}} option is used.

            If scrubbing is enabled, we should initialize the page with zeros. This should replace some of the non-working scrubbing logic (MDEV-8139).             		When a InnoDB data file page is freed, its contents becomes garbage, and any storage allocated in the data file is wasted.

            MariaDB 10.4 introduced an InnoDB redo log record {{MLOG_INIT_FREE_PAGE}} for marking pages as freed. In MDEV-12353 (MariaDB 10.5.2), that record was replaced with {{FREE_PAGE}}. This record could be treated as no-op, or we can punch a hole for {{page_compressed=1}} tables.

            If {{innodb_immediate_scrub_data_uncompressed}} is set, we should initialize the page with zeros. This will replace some of the non-working scrubbing logic (MDEV-8139). The scrubbing will be fixed further in MDEV-8139.

            The following parameters will be deprecated and ignored and the problematic ‘background scrubbing’ code removed:
            * innodb-background-scrub-data-uncompressed
            * innodb-background-scrub-data-compressed
            * innodb-background-scrub-data-interval
            * innodb-background-scrub-data-check-interval
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            monty Michael Widenius made changes -
            Summary Punch holes when pages are freed Avoid writing freed InnoDB pages
            monty Michael Widenius made changes -
            Description When a InnoDB data file page is freed, its contents becomes garbage, and any storage allocated in the data file is wasted.

            MariaDB 10.4 introduced an InnoDB redo log record {{MLOG_INIT_FREE_PAGE}} for marking pages as freed. In MDEV-12353 (MariaDB 10.5.2), that record was replaced with {{FREE_PAGE}}. This record could be treated as no-op, or we can punch a hole for {{page_compressed=1}} tables.

            If {{innodb_immediate_scrub_data_uncompressed}} is set, we should initialize the page with zeros. This will replace some of the non-working scrubbing logic (MDEV-8139). The scrubbing will be fixed further in MDEV-8139.

            The following parameters will be deprecated and ignored and the problematic ‘background scrubbing’ code removed:
            * innodb-background-scrub-data-uncompressed
            * innodb-background-scrub-data-compressed
            * innodb-background-scrub-data-interval
            * innodb-background-scrub-data-check-interval             		When a InnoDB data file page is freed, its contents becomes garbage, and any storage allocated in the data file is wasted.

            MariaDB 10.4 introduced an InnoDB redo log record {{MLOG_INIT_FREE_PAGE}} for marking pages as freed. In MDEV-12353 (MariaDB 10.5.2), that record was replaced with {{FREE_PAGE}}. This record could be treated as no-op, or we can punch a hole for {{page_compressed=1}} tables.

            If {{innodb_immediate_scrub_data_uncompressed}} is set, we should initialize the page with zeros. This will replace some of the non-working scrubbing logic (MDEV-8139). The scrubbing will be fixed further in MDEV-8139.

            The following parameters will be deprecated and ignored and the problematic ‘background scrubbing’ code removed:
            * innodb-background-scrub-data-uncompressed
            * innodb-background-scrub-data-compressed
            * innodb-background-scrub-data-interval
            * innodb-background-scrub-data-check-interval

            For page_compressed tables the freed page will be hole-punched
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            serg Sergei Golubchik made changes -
            Workflow MariaDB v3 [ 85945 ] MariaDB v4 [ 153930 ]
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            thiru Thirunarayanan Balathandayuthapani made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            rob.schwyzer@mariadb.com Rob Schwyzer (Inactive) made changes -
            rob.schwyzer@mariadb.com Rob Schwyzer (Inactive) made changes -

            People

              thiru Thirunarayanan Balathandayuthapani
              marko Marko Mäkelä
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.