[MDEV-31227] innodb_flush_method=O_DIRECT causes 3x regression in workload - Jira

Details

Type: Bug
Status: Closed (View Workflow)
Priority: Minor
Resolution: Not a Bug
Affects Version/s: 10.6.12, 10.6.13
Fix Version/s: N/A
Component/s: Storage Engine - InnoDB
Labels:
None
Environment:
CentOS 7, kernel 3.10

Description

Repro procedure is the same as ~~MDEV-30567~~. Additional details for that in the comments.

In short, this is the performance discrepancy we're seeing in 10.6.13 (10.6.12 performs similarly but slightly worse)-

# Default (O_DIRECT)

# * Q0: real: 14.21  min: 14.21  max: 14.21

# innodb-flush-method = fsync

# * Q0: real: 4.94  min: 4.94  max: 4.94

# innodb-flush-method = O_DSYNC

# * Q0: real: 4.92  min: 4.92  max: 4.92

# innodb-flush-method = littlesync

# * Q0: real: 4.91  min: 4.91  max: 4.91

# innodb-flush-method = nosync

# * Q0: real: 4.95  min: 4.95  max: 4.95

# innodb-flush-method = O_DIRECT

# * Q0: real: 14.21  min: 14.21  max: 14.21

# innodb-flush-method = O_DIRECT_NO_FSYNC

# * Q0: real: 12.81  min: 12.81  max: 12.81

The customer for whom we are concerned about this issue for is currently using 10.4 where innodb_flush_method=fsync is the default. For 10.6 though, this changes to O_DIRECT. For now, we're advising the customer to hard-specify innodb_flush_method=fsync for 10.6. However, we know that O_DIRECT was made default in 10.6 as it generally improves over fsync, so we'd like to know if the regression we're seeing here is due to a bug that, if fixed, would make O_DIRECT the all-around ideal it is intended to be.

Attachments

Issue Links

duplicates

MDEV-27772 Performance regression with default configuration in 10.6

Open

is blocked by

MDEV-29967 innodb_read_ahead_threshold (linear read-ahead) does not work

Closed

relates to

MDEV-30567 rec_get_offsets() is not optimal

Closed

MDEV-30986 Slow full index scan in 10.6 vs 10.5 for the (slow) I/O-bound case

Closed

MDEV-35813 Performance regression in INSERT…SELECT due to unnecessarily making InnoDB log durable

Closed

mentioned in: Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...

(9 mentioned in)

Activity

Ascending order - Click to sort in descending order

Rob Schwyzer (Inactive) created issue - 2023-05-09 23:35

Rob Schwyzer (Inactive) made changes - 2023-05-09 23:35

Field	Original Value	New Value
Link		This issue relates to ~~MDEV-30567~~ [ ~~MDEV-30567~~ ]

Rob Schwyzer (Inactive) made changes - 2023-05-09 23:49

Priority

Major [ 3 ]

Minor [ 4 ]

Marko Mäkelä made changes - 2023-05-10 05:27

Link

This issue is blocked by ~~MDEV-29967~~ [ ~~MDEV-29967~~ ]

Marko Mäkelä made changes - 2023-05-10 05:27

Link

This issue is blocked by ~~MDEV-30986~~ [ ~~MDEV-30986~~ ]

Julien Fritsch made changes - 2023-05-10 06:53

Fix Version/s		10.4 [ 22408 ]
Fix Version/s		10.5 [ 23123 ]
Fix Version/s		10.6 [ 24028 ]

Julien Fritsch made changes - 2023-05-10 06:57

Fix Version/s	10.4 [ 22408 ]
Fix Version/s	10.5 [ 23123 ]

Julien Fritsch made changes - 2023-05-10 07:00

Assignee

Marko Mäkelä [ marko ]

Rob Schwyzer (Inactive) made changes - 2023-05-10 19:36

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 35293 ]

Rob Schwyzer (Inactive) made changes - 2023-05-10 20:32

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 35294 ]

Rob Schwyzer (Inactive) made changes - 2023-05-10 21:11

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 35306 ]

Rob Schwyzer (Inactive) made changes - 2023-05-12 20:26

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 35294 ]

Rob Schwyzer (Inactive) made changes - 2023-05-15 20:18

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 35312 ]

Rob Schwyzer (Inactive) made changes - 2023-05-17 19:49

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 35314 ]

Marko Mäkelä made changes - 2023-05-24 14:27

Assignee	Marko Mäkelä [ marko ]	Rob Schwyzer [ JIRAUSER40844 ]
Status	Open [ 1 ]	Needs Feedback [ 10501 ]

Rob Schwyzer (Inactive) made changes - 2023-05-24 22:20

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 35405 ]

Rob Schwyzer (Inactive) made changes - 2023-05-24 22:27

Assignee

Rob Schwyzer [ JIRAUSER40844 ]

Marko Mäkelä [ marko ]

Rob Schwyzer (Inactive) made changes - 2023-05-24 22:27

Status

Needs Feedback [ 10501 ]

Open [ 1 ]

Marko Mäkelä made changes - 2023-06-07 09:02

Assignee	Marko Mäkelä [ marko ]	Rob Schwyzer [ JIRAUSER40844 ]
Status	Open [ 1 ]	Needs Feedback [ 10501 ]

Marko Mäkelä made changes - 2023-06-07 09:10

Link

This issue is blocked by ~~MDEV-30986~~ [ ~~MDEV-30986~~ ]

Marko Mäkelä made changes - 2023-06-07 09:11

Link

This issue relates to ~~MDEV-30986~~ [ ~~MDEV-30986~~ ]

Rob Schwyzer (Inactive) made changes - 2023-06-07 19:09

Assignee

Rob Schwyzer [ JIRAUSER40844 ]

Aleksey Midenkov [ midenok ]

Rob Schwyzer (Inactive) made changes - 2023-06-07 19:30

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 35428 ]

Aleksey Midenkov made changes - 2023-06-12 15:38

Status

Needs Feedback [ 10501 ]

Open [ 1 ]

Aleksey Midenkov made changes - 2023-06-12 15:38

Assignee

Aleksey Midenkov [ midenok ]

Marko Mäkelä [ marko ]

Rob Schwyzer (Inactive) made changes - 2023-06-14 21:54

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 35445 ]

Julien Fritsch made changes - 2023-06-21 06:46

Status

Open [ 1 ]

Confirmed [ 10101 ]

Rob Schwyzer (Inactive) made changes - 2023-06-21 22:56

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 35458 ]

Rob Schwyzer (Inactive) made changes - 2023-06-28 20:25

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 35471 ]

Marko Mäkelä made changes - 2023-06-29 15:46

Status

Confirmed [ 10101 ]

Open [ 1 ]

Marko Mäkelä made changes - 2023-06-29 15:50

Assignee	Marko Mäkelä [ marko ]	Rob Schwyzer [ JIRAUSER40844 ]
Status	Open [ 1 ]	Needs Feedback [ 10501 ]

Aleksey Midenkov made changes - 2023-07-04 18:45

Assignee	Rob Schwyzer [ JIRAUSER40844 ]	Marko Mäkelä [ marko ]
Status	Needs Feedback [ 10501 ]	Open [ 1 ]

Rob Schwyzer (Inactive) made changes - 2023-07-05 20:25

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 35496 ]

Marko Mäkelä made changes - 2023-07-06 08:01

Assignee	Marko Mäkelä [ marko ]	Rob Schwyzer [ JIRAUSER40844 ]
Status	Open [ 1 ]	Needs Feedback [ 10501 ]

Aleksey Midenkov made changes - 2023-07-06 13:29

Assignee

Rob Schwyzer [ JIRAUSER40844 ]

Aleksey Midenkov [ midenok ]

Aleksey Midenkov made changes - 2023-07-06 13:29

Status

Needs Feedback [ 10501 ]

Open [ 1 ]

Aleksey Midenkov made changes - 2023-07-06 13:29

Component/s		Storage Engine - InnoDB [ 10129 ]
Fix Version/s		N/A [ 14700 ]
Fix Version/s	10.6 [ 24028 ]
Resolution		Not a Bug [ 6 ]
Status	Open [ 1 ]	Closed [ 6 ]

Rob Schwyzer (Inactive) made changes - 2023-07-07 17:21

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 35293 ]

Marko Mäkelä made changes - 2023-08-15 07:32

Link

This issue duplicates MDEV-27772 [ MDEV-27772 ]

Jira Automation (IT) made changes - 2024-07-04 01:12

Zendesk Related Tickets		201658
Zendesk active tickets		201658

Marko Mäkelä made changes - 2025-03-10 14:13

Link

This issue relates to ~~MDEV-35813~~ [ ~~MDEV-35813~~ ]

People

Assignee:: Aleksey Midenkov

Reporter:: Rob Schwyzer (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 7 Start watching this issue

Dates

Created:: 2023-05-09 23:35

Updated:: 2025-03-10 14:13

Resolved:: 2023-07-06 13:29

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.

MariaDB Server

Details

Description

Attachments

Issue Links

Activity

People

Dates

Git Integration