Details
-
Bug
-
Status: Closed (View Workflow)
-
Blocker
-
Resolution: Fixed
-
10.5, 10.6, 10.11, 11.0(EOL), 11.1(EOL), 11.2(EOL), 11.3(EOL)
-
Ubuntu 18.04 on AMD64
Ubuntu 20.04 on AMD64
Description
After implementing MDEV-32757, we are seeing a performance anomaly with innodb_undo_log_truncate=ON. The server is not actually hung or deadlocked (it will eventually recover), but buf_pool.mutex is being occupied for an extremely long time (several minutes).
- trx_purge_truncate_history() writes the message InnoDB: Truncating and is about to truncate an undo log tablespace.
- trx_purge_truncate_history() is busy-looping in a scan of buf_pool.flush_list because one of the pages belonging to the undo tablespace is write-fixed.
- During the time trx_purge_truncate_history() releases and re-acquires buf_pool.flush_list_mutex, buf_flush_page_cleaner (which is holding buf_pool.mutex in buf_do_flush_list_batch()) cannot grab it, in this Ubuntu 18.04 version of GNU libc and Linux kernel (4.15.0-112-generic). This could be similar to
MDEV-31343andMDEV-30180, which could only be reproduced in the same particular environment. - Most threads are blocked because the buf_flush_page_cleaner thread is holding buf_pool.mutex.
There is some indication that buf_flush_list_batch() may be making some progress (writing out some pages), but it would be extremely slow.
Attachments
Issue Links
- relates to
-
MDEV-26733 assert on shutdown lock->lock_word == X_LOCK_DECR in test
-
- Open
-
-
MDEV-33062 innodb_undo_log_truncate=ON prevents fast shutdown
-
- Closed
-
-
MDEV-33112 innodb_undo_log_truncate=ON is blocking page writes
-
- Closed
-
-
MDEV-33213 History list is not shrunk unless there is a pause in the workload
-
- Closed
-
-
MDEV-30180 Server hang with innodb_undo_log_truncate=ON
-
- Closed
-
-
MDEV-31343 Another server hang with innodb_undo_log_truncate=ON
-
- Closed
-
-
MDEV-32757 innodb_undo_log_truncate=ON is not crash safe
-
- Closed
-
Activity
Field | Original Value | New Value |
---|---|---|
Link |
This issue relates to |
Link |
This issue relates to |
Link |
This issue relates to |
Status | Open [ 1 ] | In Progress [ 3 ] |
Status | In Progress [ 3 ] | In Testing [ 10301 ] |
Assignee | Marko Mäkelä [ marko ] | Axel Schwenke [ axel ] |
Attachment | mariadb-ES-10.5-MDEV-33009.zip [ 72684 ] |
Attachment | 10.6-MDEV-33009-1.png [ 72685 ] |
Attachment | mariadb-ES-10.5-MDEV-33009-fb800bd29ab.zip [ 72687 ] |
Link | This issue relates to MDEV-26733 [ MDEV-26733 ] |
Status | In Testing [ 10301 ] | Stalled [ 10000 ] |
Assignee | Axel Schwenke [ axel ] | Marko Mäkelä [ marko ] |
Environment | Ubuntu 18.04 on AMD64 |
Ubuntu 18.04 on AMD64
Ubuntu 20.04 on AMD64 |
Status | Stalled [ 10000 ] | In Progress [ 3 ] |
Status | In Progress [ 3 ] | In Testing [ 10301 ] |
Assignee | Marko Mäkelä [ marko ] | Axel Schwenke [ axel ] |
Status | In Testing [ 10301 ] | Stalled [ 10000 ] |
Assignee | Axel Schwenke [ axel ] | Marko Mäkelä [ marko ] |
Attachment | mariadb-10.6-MDEV-33009-76b99fccb44.zip [ 72695 ] |
Attachment | mariadb-10.5-MDEV-33009-e1c545486ad+1.zip [ 72696 ] |
Attachment | 24x5_high_threads.pdf [ 72702 ] |
Link |
This issue relates to |
Attachment | MDEV-33009-9682add5cdf.png [ 72706 ] |
Attachment | MDEV-33062-3ef0e678b1c.png [ 72707 ] |
issue.field.resolutiondate | 2023-12-19 15:47:41.0 | 2023-12-19 15:47:41.396 |
Fix Version/s | 10.5.24 [ 29517 ] | |
Fix Version/s | 10.6.17 [ 29518 ] | |
Fix Version/s | 10.11.7 [ 29519 ] | |
Fix Version/s | 11.0.5 [ 29520 ] | |
Fix Version/s | 11.1.4 [ 29024 ] | |
Fix Version/s | 11.2.3 [ 29521 ] | |
Fix Version/s | 11.3.2 [ 29522 ] | |
Fix Version/s | 10.5 [ 23123 ] | |
Fix Version/s | 10.6 [ 24028 ] | |
Fix Version/s | 10.11 [ 27614 ] | |
Fix Version/s | 11.0 [ 28320 ] | |
Fix Version/s | 11.1 [ 28549 ] | |
Fix Version/s | 11.3 [ 28565 ] | |
Fix Version/s | 11.2 [ 28603 ] | |
Resolution | Fixed [ 1 ] | |
Status | Stalled [ 10000 ] | Closed [ 6 ] |
Link |
This issue relates to |
Link |
This issue relates to |