[MDEV-19514] Defer change buffer merge until pages are requested - Jira

Details

Type: Task
Status: Closed (View Workflow)
Priority: Critical
Resolution: Fixed
Fix Version/s: 10.5.0
Component/s: Storage Engine - InnoDB
Labels:
- performance

Description

For ~~MDEV-14481~~, we must defer the change buffer merge to the moment when the secondary index leaf page is requested by a user thread.

This would also simplify ~~MDEV-16526~~, because the change buffer I/O would not have to be treated as a special case.

The change buffer format will not be changed as part of this task. That could remain part of ~~MDEV-11634~~.

As part of this, the counter innodb_ibuf_merge_usec will be removed from information_schema.innodb_metrics.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending
- Thumbnails
- List
- Download All

MDEV-19514.ods
57 kB
2019-09-27 15:31
MDEV-19514-2.ods
74 kB
2019-10-08 10:14
MDEV-19514-3.ods
63 kB
2019-10-04 15:11

Issue Links

blocks

MDEV-11634 Improve the InnoDB change buffer

Closed

MDEV-14481 Execute InnoDB crash recovery in the background

Closed

MDEV-16526 Overhaul the InnoDB page flushing

Closed

MDEV-18724 Replace buf_block_t::mutex with more std::atomic

Closed

causes

MDEV-22090 Change buffer is not freed after dropping or rebuilding table

Closed

is blocked by

MDEV-20543 Latching order violation during B-tree operations

Closed

MDEV-20805 ibuf_add_free_page() is not initializing FIL_PAGE_TYPE first

Closed

is part of

MDEV-12700 Allow innodb_read_only startup without prior slow shutdown

Closed

relates to

MDEV-16989 InnoDB hang on crash recovery: Waited for 10 seconds for 256 pending reads

Closed

MDEV-21030 MariaDB keepts crashing on start

Closed

MDEV-23380 InnoDB reads a page from disk despite parsing MLOG_INIT_FILE_PAGE2 record

Closed

MDEV-23973 Change buffer corruption when reallocating an recently freed page

Closed

MDEV-25783 CHECK TABLE harvests InnoDB: Index 'abdcef' contains 10001 entries, should be 10000

Closed

MDEV-26464 InnoDB: Failing assertion: UT_LIST_GET_LEN(buf_pool->flush_list) == 0 during shutdown

Closed

MDEV-27199 Require ib_logfile0 to exist unless innodb_force_recovery=6

Closed

MDEV-27734 Set innodb_change_buffering=none by default

Closed

MDEV-34759 buf_page_get_low() is unnecessarily acquiring exclusive latch on secondary index pages

Closed

MDEV-18698 Show InnoDB's internal background threads in SHOW ENGINE INNODB STATUS

Open

MDEV-27153 ibdata1 file Leaking ? (errno 135) - using innodb_undo_tablespaces

Closed

MDEV-31621 Remove ibuf_read_merge_pages() call from ibuf_insert_low()

Closed

mentioned in: Page Loading...; Page Loading...

(2 is blocked by, 1 is part of, 12 relates to, 2 mentioned in)

Activity

Ascending order - Click to sort in descending order

Marko Mäkelä created issue - 2019-05-17 13:31

Marko Mäkelä made changes - 2019-05-17 13:31

Field	Original Value	New Value
Link		This issue blocks ~~MDEV-14481~~ [ ~~MDEV-14481~~ ]

Marko Mäkelä made changes - 2019-05-17 13:31

Link

This issue blocks ~~MDEV-16526~~ [ ~~MDEV-16526~~ ]

Marko Mäkelä made changes - 2019-05-17 13:31

Status

Open [ 1 ]

Confirmed [ 10101 ]

Marko Mäkelä made changes - 2019-05-17 13:33

Link

This issue blocks ~~MDEV-11634~~ [ ~~MDEV-11634~~ ]

Ralf Gebhardt made changes - 2019-05-17 13:39

Priority

Major [ 3 ]

Critical [ 2 ]

Marko Mäkelä made changes - 2019-05-20 13:49

Link

This issue blocks ~~MDEV-18724~~ [ ~~MDEV-18724~~ ]

Thirunarayanan Balathandayuthapani made changes - 2019-05-28 10:42

Status

Confirmed [ 10101 ]

In Progress [ 3 ]

Thirunarayanan Balathandayuthapani made changes - 2019-08-30 05:54

Assignee	Thirunarayanan Balathandayuthapani [ thiru ]	Marko Mäkelä [ marko ]
Status	In Progress [ 3 ]	In Review [ 10002 ]

Marko Mäkelä made changes - 2019-09-03 07:10

Assignee	Marko Mäkelä [ marko ]	Thirunarayanan Balathandayuthapani [ thiru ]
Status	In Review [ 10002 ]	Stalled [ 10000 ]

Marko Mäkelä made changes - 2019-09-03 11:01

Link

This issue is part of ~~MDEV-12700~~ [ ~~MDEV-12700~~ ]

Thirunarayanan Balathandayuthapani made changes - 2019-09-05 16:04

Assignee	Thirunarayanan Balathandayuthapani [ thiru ]	Marko Mäkelä [ marko ]
Status	Stalled [ 10000 ]	In Review [ 10002 ]

Marko Mäkelä made changes - 2019-09-09 12:47

Description

For ~~MDEV-14481~~, we must defer the change buffer merge to the moment when the secondary index leaf page is requested by a user thread.

This would also simplify ~~MDEV-16526~~, because the change buffer I/O would not have to be treated as a special case.

This should also allow us to remove the buf_pool->watch and BUF_BLOCK_POOL_WATCH.

The change buffer format will not be changed as part of this task. That could remain part of ~~MDEV-11634~~.

For ~~MDEV-14481~~, we must defer the change buffer merge to the moment when the secondary index leaf page is requested by a user thread.

This would also simplify ~~MDEV-16526~~, because the change buffer I/O would not have to be treated as a special case.

The change buffer format will not be changed as part of this task. That could remain part of ~~MDEV-11634~~.

As part of this, the counter {{innodb_ibuf_merge_usec}} will be removed from {{information_schema.innodb_metrics}}.

Marko Mäkelä made changes - 2019-09-10 07:58

Link

This issue is blocked by ~~MDEV-20543~~ [ ~~MDEV-20543~~ ]

Marko Mäkelä made changes - 2019-09-10 15:09

Assignee	Marko Mäkelä [ marko ]	Thirunarayanan Balathandayuthapani [ thiru ]
Status	In Review [ 10002 ]	Stalled [ 10000 ]

Thirunarayanan Balathandayuthapani made changes - 2019-09-19 06:39

Assignee	Thirunarayanan Balathandayuthapani [ thiru ]	Marko Mäkelä [ marko ]
Status	Stalled [ 10000 ]	In Review [ 10002 ]

Marko Mäkelä made changes - 2019-09-26 10:31

Assignee	Marko Mäkelä [ marko ]	Thirunarayanan Balathandayuthapani [ thiru ]
Status	In Review [ 10002 ]	Stalled [ 10000 ]

Axel Schwenke made changes - 2019-09-27 15:31

Attachment

MDEV-19514.ods [ 49026 ]

Marko Mäkelä made changes - 2019-09-30 09:57

Assignee

Thirunarayanan Balathandayuthapani [ thiru ]

Matthias Leich [ mleich ]

Axel Schwenke made changes - 2019-10-04 15:11

Attachment		MDEV-19514-2.ods [ 49084 ]
Attachment		MDEV-19514-3.ods [ 49085 ]

Axel Schwenke made changes - 2019-10-08 10:14

Attachment

~~MDEV-19514~~-2.ods [ 49084 ]

Axel Schwenke made changes - 2019-10-08 10:14

Attachment

MDEV-19514-2.ods [ 49143 ]

Marko Mäkelä made changes - 2019-10-11 11:11

Link

This issue is blocked by ~~MDEV-20805~~ [ ~~MDEV-20805~~ ]

Marko Mäkelä made changes - 2019-10-11 14:57

issue.field.resolutiondate

2019-10-11 14:57:48.0

2019-10-11 14:57:48.628

Marko Mäkelä made changes - 2019-10-11 14:57

Fix Version/s		10.5.0 [ 23709 ]
Fix Version/s	10.5 [ 23123 ]
Assignee	Matthias Leich [ mleich ]	Marko Mäkelä [ marko ]
Resolution		Fixed [ 1 ]
Status	Stalled [ 10000 ]	Closed [ 6 ]

Marko Mäkelä made changes - 2019-11-05 07:54

Link

This issue relates to ~~MDEV-12700~~ [ ~~MDEV-12700~~ ]

Marko Mäkelä made changes - 2019-11-05 07:56

Link

This issue relates to ~~MDEV-12700~~ [ ~~MDEV-12700~~ ]

Marko Mäkelä made changes - 2020-02-25 11:37

Link

This issue relates to ~~MDEV-21030~~ [ ~~MDEV-21030~~ ]

Marko Mäkelä made changes - 2020-03-31 07:48

Link

This issue relates to MDEV-18698 [ MDEV-18698 ]

Marko Mäkelä made changes - 2020-03-31 11:25

Link

This issue causes ~~MDEV-22090~~ [ ~~MDEV-22090~~ ]

Marko Mäkelä made changes - 2020-08-03 09:00

Link

This issue relates to ~~MDEV-23380~~ [ ~~MDEV-23380~~ ]

Marko Mäkelä made changes - 2020-10-16 12:49

Link

This issue relates to ~~MDEV-23973~~ [ ~~MDEV-23973~~ ]

Marko Mäkelä made changes - 2020-10-19 18:10

Link

This issue relates to ~~MDEV-16989~~ [ ~~MDEV-16989~~ ]

Marko Mäkelä made changes - 2021-06-04 12:09

Link

This issue relates to ~~MDEV-25783~~ [ ~~MDEV-25783~~ ]

Marko Mäkelä made changes - 2021-09-08 08:11

Link

This issue relates to ~~MDEV-26464~~ [ ~~MDEV-26464~~ ]

Sergei Golubchik made changes - 2021-12-06 21:24

Workflow

MariaDB v3 [ 96805 ]

MariaDB v4 [ 133957 ]

Marko Mäkelä made changes - 2021-12-08 14:26

Link

This issue relates to ~~MDEV-27199~~ [ ~~MDEV-27199~~ ]

Marko Mäkelä made changes - 2022-01-31 12:18

Link

This issue relates to ~~MDEV-27153~~ [ ~~MDEV-27153~~ ]

Marko Mäkelä made changes - 2022-02-03 06:53

Link

This issue relates to ~~MDEV-27734~~ [ ~~MDEV-27734~~ ]

Marko Mäkelä made changes - 2023-07-05 06:01

Link

This issue relates to ~~MDEV-31621~~ [ ~~MDEV-31621~~ ]

Rob Schwyzer (Inactive) made changes - 2023-10-18 17:42

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 36166 ]

Rob Schwyzer (Inactive) made changes - 2023-10-19 21:18

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 36203 ]

Marko Mäkelä made changes - 2024-08-16 08:47

Link

This issue relates to ~~MDEV-34759~~ [ ~~MDEV-34759~~ ]

People

Assignee:: Marko Mäkelä

Reporter:: Marko Mäkelä

Votes:: 0 Vote for this issue

Watchers:: 9 Start watching this issue

Dates

Created:: 2019-05-17 13:31

Updated:: 2024-08-16 08:47

Resolved:: 2019-10-11 14:57

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.

MariaDB Server

Details

Description

Attachments

Attachments

Issue Links

Activity

People

Dates

Git Integration