Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-23399

10.5 performance regression with IO-bound tpcc

Details

    Description

      Triggered by this blog post from Percona.
      Problem could be reproduced with sysbench-tpcc and Percona settings. Buffer pool 25G for 100G data set (1000 warehouses). Datadir located on SSD. tpcc workload with 32 benchmark threads on hardware with 16 cores/32 hyperthreads.
      Throughput starts high and then decreases over a varying time period (500 .. 1200 seconds) to reach ~200 tps. Performance schema shows lots of time spent with buf_pool_mutex. CPU usage of the mariadbd process is rather low around 300%.
      MySQL 8.0 does not show that problem. MariaDB 10.5.4 performs better than pre-10.5.5 shapshot.

      Attachments

        Issue Links

          blocks

          Task - A task that needs to be done. MDEV-12227 Defer writes to the InnoDB temporary tablespace

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-14481 Execute InnoDB crash recovery in the background

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-16526 Overhaul the InnoDB page flushing

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-23720 Change innodb_log_optimize_ddl=OFF by default

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Task - A task that needs to be done. MDEV-23756 Implement event-driven innodb_adaptive_flushing=OFF that ignores innodb_io_capacity

          • Major - Major loss of function.
          • Open
          causes

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25072 Hang + Heap Corruption: SIGABRT in __libc_message from _int_free on DBUGCloseFile

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25773 sysbench-TPCC failed to prepare with extremely slow execution

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25801 DROP DATABASE very slow after innodb undo log truncate

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-27022 Buffer pool is being flushed during recovery

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-28371 Assertion fold == id.fold() failed in buf_flush_check_neighbor()

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. MDEV-23410 buf_LRU_scan_and_free_block() fails to stop at first freed block

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed
          is caused by

          Task - A task that needs to be done. MDEV-15053 Reduce buf_pool_t::mutex contention

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Task - A task that needs to be done. MDEV-15058 Remove multiple InnoDB buffer pool instances

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Task - A task that needs to be done. MDEV-11384 AliSQL: [Feature] Issue#19 BUFFER POOL LIST SCAN OPTIMIZATION

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-21452 Use condition variables and normal mutexes instead of InnoDB os_event and mutex

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-23719 Make lock_sys use page_id_t

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-23855 InnoDB log checkpointing causes regression for write-heavy OLTP

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-24022 mariabackup.undo_space_id failed in buildbot

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-24278 InnoDB page cleaner keeps waking up on idle server

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-24913 Assertion !recv_no_log_write in log_write_up_to()

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-26004 Excessive wait times in buf_LRU_get_free_block()

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-27466 Deadlock when purge thread races the flush thread for page lock under Innodb redo log space pressure

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-28052 test main.implicit_commit crashed on sparc64

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-28415 ALTER TABLE on a large table hangs InnoDB

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-13670 [Note] InnoDB: page_cleaner: 1000ms intended loop took XXXXms. The settings might not be optimal. (flushed=0 and evicted=0, during the time.)

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-14550 Error log flood : "InnoDB: page_cleaner: 1000ms intended loop took N ms. The settings might not be optimal."

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-21330 Lock monitor doesn't print a semaphore's last reserved thread in non-debug builds and INFORMATION_SCHEMA.INNODB_SYS_SEMAPHORE_WAITS is totally broken

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-24024 innodb.ibuf_not_empty failed in buildbot

          • Major - Major loss of function.
          • Closed
          links to

          Web Link Percona Server 5.7: multi-threaded LRU flushing

          Activity

            Transition Time In Source Status Execution Times
            Marko Mäkelä made transition -
            Open In Progress
            		3h 32m 1
            Marko Mäkelä made transition -
            In Progress Stalled
            		3d 7m 1
            Marko Mäkelä made transition -
            Stalled In Progress
            		6d 23h 48m 1
            Marko Mäkelä made transition -
            In Progress In Review
            		48d 16h 40m 1
            Vladislav Vaintroub made transition -
            In Review Stalled
            		13d 6h 44m 1
            Marko Mäkelä made transition -
            Stalled Closed
            		2h 18m 1

            People

              marko Marko Mäkelä
              axel Axel Schwenke
              Votes:
              7 Vote for this issue
              Watchers:
              22 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.