[MDEV-11556] InnoDB redo log apply fails to adjust data file sizes - Jira

Details

Type: Bug
Status: Closed (View Workflow)
Priority: Major
Resolution: Fixed
Affects Version/s: 10.1.20
Fix Version/s: 10.1.21, 10.2.4
Component/s: Backup, Storage Engine - InnoDB
Labels:
None

Sprint:
10.2.4-5

Description

Prepare of partial backup (with --tables option) sporadically fails with following error :

InnoDB: Error: tablespace size stored in header is 4864 pages, but
InnoDB: the sum of data file sizes is only 768 pages
InnoDB: Cannot start InnoDB. The tail of the system tablespace is
InnoDB: missing.

Attached are:
test_partial_uncommitted.sh - test which reliably demonstrates the problem in my environment
test_partial_uncommitted.log - corresponding log
my.cnf - config used
partial_uncommitted.test 'identical' mtr test, which DOES NOT demonstrate the problem (for unknown reasons (generated xtrabackup_info and backup-my.cnf are identical to .sh test).

Interesting observation is that all tables are backed up - this should be another bug eventually if not fixed as part of this.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending
- Thumbnails
- List
- Download All

my.cnf
0.3 kB
2016-12-13 10:52
partial_uncommitted.test
0.5 kB
2016-12-13 10:53
problem.tar.gz
8.89 MB
2016-12-13 14:25
test_partial_uncommitted.log
25 kB
2016-12-13 10:51
test_partial_uncommitted.sh
0.7 kB
2016-12-13 10:51

Issue Links

causes

MDEV-12027 posix_fallocate returned OS error 201.

Closed

MDEV-12075 innodb_use_fallocate does not work in MariaDB Server 10.1.21

Closed

MDEV-22501 Various issues when using --innodb-data-file-size-debug=-1 | SIGABRT in fil_mutex_enter_and_prepare_for_io

Closed

relates to

MDEV-11690 Remove UNIV_HOTBACKUP

Closed

MDEV-11915 Detect InnoDB system tablespace size mismatch early

Closed

MDEV-12022 InnoDB wrongly ignores the end of an .ibd file

Closed

MDEV-13822 Mariabackup --prepare --incremental sets file size incorrectly

Closed

MDEV-14082 Enforcing innodb_open_files leads to fil_system->mutex problem

Closed

MDEV-18194 Incremental prepare tries to access page which is out of tablespace bounds.

Closed

MDEV-30069 InnoDB: Trying to write ... bytes at ... outside the bounds of the file ...

Closed

MDEV-11968 With innodb_page_size=8K crash with 'Error 17' after "Tried to read 65536 bytes at offset 0. Was only able to read 49152."

Closed

MDEV-12893 innodb.log_data_file_size failed in buildbot with InnoDB: Database page corruption

Closed

MDEV-14447 mariabackup --incremental --prepare fails to extend last file when applying ibdata1.delta

Closed

MDEV-23190 Assertion `id.page_no() < space.size' during recovery

Closed

MDEV-26068 Server crashes when innodb-data-file-size-debug set to 1

Closed

(10 relates to)

Activity

Ascending order - Click to sort in descending order

Andrii Nikitin (Inactive) created issue - 2016-12-13 10:51

Andrii Nikitin (Inactive) made changes - 2016-12-13 10:51

Field	Original Value	New Value
Attachment		test_partial_uncommitted.log [ 42995 ]
Attachment		test_partial_uncommitted.sh [ 42996 ]

Andrii Nikitin (Inactive) made changes - 2016-12-13 10:52

Attachment

my.cnf [ 42997 ]

Andrii Nikitin (Inactive) made changes - 2016-12-13 10:53

Attachment

partial_uncommitted.test [ 42998 ]

Vladislav Vaintroub made changes - 2016-12-13 13:37

Fix Version/s

10.1 [ 16100 ]

Andrii Nikitin (Inactive) made changes - 2016-12-13 14:25

Attachment

problem.tar.gz [ 43000 ]

Marko Mäkelä made changes - 2016-12-15 14:25

Assignee

Vladislav Vaintroub [ wlad ]

Marko Mäkelä [ marko ]

Andrii Nikitin (Inactive) made changes - 2016-12-16 16:23

Attachment

error.txt [ 43008 ]

Andrii Nikitin (Inactive) made changes - 2016-12-16 16:49

Comment

[ ok, it looks that the real problem in this and some similar phantoms is that for some reasons Xtradb and InnoDB start/initialize several times inside mysqld in my builds. (See attached mysqld error log Errors.txt). That may explain 'too late checks' as well probably. Not sure how that might happen, but it looks 'proper' builds are not affected.

Suggest closing as invalid, unless somebody wants to investigate how that build may happen at all. ]

Andrii Nikitin (Inactive) made changes - 2016-12-16 16:49

Attachment

error.txt [ 43008 ]

Marko Mäkelä made changes - 2016-12-20 10:20

Status

Open [ 1 ]

In Progress [ 3 ]

Rasmus Johansson (Inactive) made changes - 2016-12-22 10:09

Sprint

10.2.4-5 [ 125 ]

Rasmus Johansson (Inactive) made changes - 2016-12-22 10:09

Rank

Ranked higher

Marko Mäkelä made changes - 2016-12-28 09:59

Summary

Prepare of partial backup fails "tablespace size stored in header is 4864 pages, but the sum of data file sizes is only 768"

InnoDB redo log apply fails to adjust data file sizes

Marko Mäkelä made changes - 2016-12-28 12:13

Assignee	Marko Mäkelä [ marko ]	Jan Lindström [ jplindst ]
Status	In Progress [ 3 ]	In Review [ 10002 ]

Jan Lindström (Inactive) made changes - 2016-12-29 06:51

Assignee	Jan Lindström [ jplindst ]	Marko Mäkelä [ marko ]
Status	In Review [ 10002 ]	Stalled [ 10000 ]

Marko Mäkelä made changes - 2016-12-29 07:05

Status

Stalled [ 10000 ]

In Progress [ 3 ]

Marko Mäkelä made changes - 2016-12-29 11:15

Status

In Progress [ 3 ]

In Review [ 10002 ]

Jan Lindström (Inactive) made changes - 2016-12-29 14:36

Assignee

Marko Mäkelä [ marko ]

Jan Lindström [ jplindst ]

Jan Lindström (Inactive) made changes - 2016-12-29 14:37

Assignee	Jan Lindström [ jplindst ]	Marko Mäkelä [ marko ]
Status	In Review [ 10002 ]	Stalled [ 10000 ]

Marko Mäkelä made changes - 2016-12-30 08:07

Status

Stalled [ 10000 ]

In Progress [ 3 ]

Marko Mäkelä made changes - 2016-12-30 11:49

issue.field.resolutiondate

2016-12-30 11:49:58.0

2016-12-30 11:49:58.745

Marko Mäkelä made changes - 2016-12-30 11:49

Component/s		Storage Engine - InnoDB [ 10129 ]
Fix Version/s		10.1.21 [ 22113 ]
Fix Version/s		10.2.4 [ 22116 ]
Fix Version/s	10.1 [ 16100 ]
Resolution		Fixed [ 1 ]
Status	In Progress [ 3 ]	Closed [ 6 ]

Marko Mäkelä made changes - 2016-12-30 13:54

Link

This issue relates to ~~MDEV-11690~~ [ ~~MDEV-11690~~ ]

Marko Mäkelä made changes - 2017-01-26 12:04

Link

This issue relates to ~~MDEV-11915~~ [ ~~MDEV-11915~~ ]

Marko Mäkelä made changes - 2017-02-08 09:18

Link

This issue relates to ~~MDEV-12022~~ [ ~~MDEV-12022~~ ]

Marko Mäkelä made changes - 2017-02-16 08:02

Link

This issue causes ~~MDEV-12075~~ [ ~~MDEV-12075~~ ]

Marko Mäkelä made changes - 2017-02-17 13:46

Link

This issue causes ~~MDEV-12027~~ [ ~~MDEV-12027~~ ]

Marko Mäkelä made changes - 2017-05-31 12:02

Link

This issue relates to ~~MDEV-11968~~ [ ~~MDEV-11968~~ ]

Marko Mäkelä made changes - 2017-09-16 06:51

Link

This issue relates to ~~MDEV-13822~~ [ ~~MDEV-13822~~ ]

Marko Mäkelä made changes - 2017-09-18 05:29

Link

This issue relates to ~~MDEV-12893~~ [ ~~MDEV-12893~~ ]

Marko Mäkelä made changes - 2017-10-17 07:58

Link

This issue relates to ~~MDEV-14082~~ [ ~~MDEV-14082~~ ]

Marko Mäkelä made changes - 2017-11-21 12:14

Link

This issue relates to ~~MDEV-14447~~ [ ~~MDEV-14447~~ ]

Marko Mäkelä made changes - 2019-01-24 16:55

Link

This issue relates to ~~MDEV-18194~~ [ ~~MDEV-18194~~ ]

Marko Mäkelä made changes - 2020-05-08 08:09

Link

This issue causes ~~MDEV-22501~~ [ ~~MDEV-22501~~ ]

Marko Mäkelä made changes - 2020-07-16 09:25

Link

This issue relates to ~~MDEV-23190~~ [ ~~MDEV-23190~~ ]

Marko Mäkelä made changes - 2021-07-01 10:58

Link

This issue relates to ~~MDEV-26068~~ [ ~~MDEV-26068~~ ]

Sergei Golubchik made changes - 2021-12-06 21:43

Workflow

MariaDB v3 [ 78752 ]

MariaDB v4 [ 151370 ]

Marko Mäkelä made changes - 2022-11-22 09:00

Link

This issue relates to ~~MDEV-30069~~ [ ~~MDEV-30069~~ ]

People

Assignee:: Marko Mäkelä

Reporter:: Andrii Nikitin (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 2016-12-13 10:51

Updated:: 2022-11-22 09:00

Resolved:: 2016-12-30 11:49

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.