Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-32050

UNDO logs still growing for write-intensive workloads

Details

    Description

      The issue with growing innodb_history_length (aka growing disk footprint of UNDO logs) that was originally reported in MDEV-29401 is still not solved for certain workloads.

      Attachments

        Issue Links

          blocks

          New Feature - A new feature of the product, which has yet to be developed. MDEV-16260 Scale the purge effort according to the workload

          • Major - Major loss of function.
          • Open
          causes

          Bug - A problem which impairs or prevents the functions of the product. MDEV-32788 CMAKE_BUILD_TYPE=Debug build failure with SUX_LOCK_GENERIC

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-33819 The purge of committed history is mis-parsing some log

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-34515 Contention between secondary index UPDATE and purge due to large innodb_purge_batch_size

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          New Feature - A new feature of the product, which has yet to be developed. MDEV-17598 InnoDB index option for per-record transaction ID

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-26356 Performance regression after dict_sys.mutex removal

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-29401 InnoDB history list length increased in 10.6 compared to 10.5 for the same load

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-30628 10.6 performance regression with sustained high-connection write-only OLTP workload (55-80% degradation)

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Task - A task that needs to be done. MDEV-32573 Document UNDO logs still growing for write-intensive workloads

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-32588 InnoDB may hang when running out of buffer pool

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-32820 Race condition between trx_purge_free_segment() and trx_undo_create()

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-32873 Test innodb.innodb-index-online occasionally fails

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-33213 History list is not shrunk unless there is a pause in the workload

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-34259 Optimization in row_purge_poss_sec Function for Undo Purge Process

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-35895 purge_sys_t::close_and_reopen() can busy loop for a long time

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-14602 Reduce malloc()/free() usage in InnoDB

          • Major - Major loss of function.
          • Confirmed

          Task - A task that needs to be done. MDEV-18746 Reduce the amount of mem_heap_create() or malloc()

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-26356 Performance regression after dict_sys.mutex removal

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-32622 [mariadb-galera] The undo log is very large, how can there be fewer undo log logs

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-33137 Assertion `end_lsn == page_lsn' failed in recv_recover_page

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed
          mentioned in

          Page Loading...

          Activity

            Ascending order - Click to sort in descending order
            View 45 older comments
            marko Marko Mäkelä added a comment -

            https://ci.mariadb.org/42505/ contains the packages for the 10.6 main branch for the fix of MDEV-33213.

            marko Marko Mäkelä added a comment - https://ci.mariadb.org/42505/ contains the packages for the 10.6 main branch for the fix of MDEV-33213 .
            TheWitness Larry Adams added a comment -

            Okay, thanks Marko.

            TheWitness Larry Adams added a comment - Okay, thanks Marko.
            TheWitness Larry Adams added a comment -

            Marko,

            The RHEL8 RPM's are missing. Seems the only ones missing the RPM's. Can you get that fixed?

            Larry

            TheWitness Larry Adams added a comment - Marko, The RHEL8 RPM's are missing. Seems the only ones missing the RPM's. Can you get that fixed? Larry
            serg Sergei Golubchik added a comment -

            Take the next build, https://ci.mariadb.org/42507/
            It has only has changes in test files, so the server is the same. The additional commit is:

            commit 6a514ef6727
            		 
            Author: Marko Mäkelä <marko.makela@mariadb.com>
            		 
            Date:   Wed Jan 17 12:50:44 2024 +0200
            		 
             
            		 
                MDEV-30940: Try to fix the test
            		 
             
            		 
             mysql-test/suite/innodb/r/lock_move_wait_lock_race.result | 3 ++-
            		 
             mysql-test/suite/innodb/t/lock_move_wait_lock_race.test   | 3 ++-
            		 
             2 files changed, 4 insertions(+), 2 deletions(-)

            serg Sergei Golubchik added a comment - Take the next build, https://ci.mariadb.org/42507/ It has only has changes in test files, so the server is the same. The additional commit is: commit 6a514ef6727 Author: Marko Mäkelä <marko.makela@mariadb.com> Date: Wed Jan 17 12:50:44 2024 +0200   MDEV-30940: Try to fix the test   mysql-test/suite/innodb/r/lock_move_wait_lock_race.result | 3 ++- mysql-test/suite/innodb/t/lock_move_wait_lock_race.test | 3 ++- 2 files changed, 4 insertions(+), 2 deletions(-)
            TheWitness Larry Adams added a comment - - edited

            Thanks Sergei,

            I rolled back to 10.6.15-10 Enterprise last night. I'll wait on another signal from Marko before taking other actions. The history list length is slowly winding down towards zero again. It's not as aggressive as I would like, but at least going in the right direction now.

            Larry

            TheWitness Larry Adams added a comment - - edited Thanks Sergei, I rolled back to 10.6.15-10 Enterprise last night. I'll wait on another signal from Marko before taking other actions. The history list length is slowly winding down towards zero again. It's not as aggressive as I would like, but at least going in the right direction now. Larry

            People

              marko Marko Mäkelä
              axel Axel Schwenke
              Votes:
              3 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.