[MDEV-24197] Prepare step of backup failing on large backup - Jira

Details

Type: Bug
Status: Closed (View Workflow)
Priority: Critical
Resolution: Fixed
Affects Version/s: 10.2.27, 10.5.6, 10.5.9
Fix Version/s: 10.2.38, 10.3.29, 10.4.19, 10.5.10
Component/s: Backup
Labels:
None

Description

Customer is running backup on very large dataset (18TB). Backup completes successfully, but fails during prepare step.
Here is the planned backup process as the customer has detailed:

1. On Source:
  mariabackup --user=root --backup --target-dir=/opt/database/backup --stream=xbstream --parallel=12 | pigz -c | socat - TCP-LISTEN:4444,reuseaddr
2. On Target
  rm -rf /var/lib/mysql/*
  rm -rf /var/log/mysql/*
  cd /var/lib/mysql
  socat -u TCP:192.168.111.184:4444 STDOUT | pigz -dc | mbstream -x
  mariabackup --user=root --use-memory=100G --prepare --target-dir=/var/lib/mysql/
  rm -rf ib_logfile*
  chown -R mysql:mysql /var/lib/mysql/
  systemctl start mariadb

The prepare fails as such:
2020-11-03 15:08:46 0 [Note] InnoDB: To recover: 2407553 pages from log
2020-11-03 15:08:54 0 [ERROR] InnoDB: Not applying INSERT_REUSE_REDUNDANT due to corruption on [page id: space=0, page number=120831]
2020-11-03 15:08:54 0 [ERROR] InnoDB: Set innodb_force_recovery=1 to ignore corruption.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending
- Thumbnails
- List
- Download All

screenshot-1.png
9 kB
2020-12-10 11:00

Issue Links

causes

MDEV-25328 --innodb command line option causes mariabackup to fail

Closed

is blocked by

MDEV-25031 Not applying INSERT_REUSE_REDUNDANT due to corruption on page

Closed

relates to

MDEV-17289 Multi-pass recovery fails to apply some redo log records

Closed

MDEV-21724 Optimize page_cur_insert_rec_low() redo logging

Closed

MDEV-24719 backport MDEV-24705 from 10.5 to 10.2, 10.3, 10.4

Closed

MDEV-25031 Not applying INSERT_REUSE_REDUNDANT due to corruption on page

Closed

MDEV-24705 add check that LSN of the last skipped log record equals to FIL_PAGE_LSN field

Closed

mentioned in: Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...; Page Loading...

(2 relates to, 6 mentioned in)

Activity

Ascending order - Click to sort in descending order

Isaac Venn (Inactive) created issue - 2020-11-11 19:38

Max Mether made changes - 2020-11-13 22:25

Field	Original Value	New Value
Assignee		Vladislav Lesin [ vlad.lesin ]

Julien Fritsch made changes - 2020-11-17 16:32

Fix Version/s

10.5 [ 23123 ]

Max Mether made changes - 2020-11-17 23:30

Priority

Major [ 3 ]

Critical [ 2 ]

Vladislav Lesin made changes - 2020-11-18 13:09

Link

This issue relates to TODO-2645 [ TODO-2645 ]

Marko Mäkelä made changes - 2020-11-19 05:45

Link

This issue relates to ~~MDEV-18976~~ [ ~~MDEV-18976~~ ]

Marko Mäkelä made changes - 2020-11-19 05:45

Link

This issue relates to ~~MDEV-21724~~ [ ~~MDEV-21724~~ ]

Marko Mäkelä made changes - 2020-11-19 05:45

Link

This issue relates to ~~MDEV-17289~~ [ ~~MDEV-17289~~ ]

Richard made changes - 2020-12-10 11:00

Attachment

screenshot-1.png [ 55161 ]

Julien Fritsch made changes - 2020-12-15 18:47

Link

This issue is blocked by ~~MDEV-18976~~ [ ~~MDEV-18976~~ ]

Julien Fritsch made changes - 2020-12-15 18:47

Link

This issue relates to ~~MDEV-18976~~ [ ~~MDEV-18976~~ ]

Todd Coker made changes - 2020-12-15 19:35

Link

This issue relates to TODO-2696 [ TODO-2696 ]

Julien Fritsch made changes - 2020-12-16 16:13

Link

This issue blocks TODO-2696 [ TODO-2696 ]

Julien Fritsch made changes - 2020-12-16 16:13

Link

This issue relates to TODO-2696 [ TODO-2696 ]

Vladislav Lesin made changes - 2021-01-28 11:48

Link

This issue is blocked by ~~MDEV-24719~~ [ ~~MDEV-24719~~ ]

Vladislav Lesin made changes - 2021-02-03 06:58

Link

This issue is blocked by ~~MDEV-18976~~ [ ~~MDEV-18976~~ ]

Julien Fritsch made changes - 2021-02-03 16:44

Affects Version/s

10.2.27 [ 23717 ]

Julien Fritsch made changes - 2021-02-03 16:45

Fix Version/s		10.2 [ 14601 ]
Fix Version/s		10.3 [ 22126 ]
Fix Version/s		10.4 [ 22408 ]

Vladislav Lesin made changes - 2021-02-03 16:57

Link

This issue relates to ~~MDEV-24705~~ [ ~~MDEV-24705~~ ]

Julien Fritsch made changes - 2021-02-11 08:46

Status

Open [ 1 ]

In Progress [ 3 ]

Todd Coker made changes - 2021-02-18 19:54

Link

This issue relates to TODO-2797 [ TODO-2797 ]

Todd Coker made changes - 2021-02-18 20:14

Link

This issue relates to TODO-2797 [ TODO-2797 ]

Todd Coker made changes - 2021-02-18 20:18

Link

This issue relates to TODO-2798 [ TODO-2798 ]

Richard Stracke made changes - 2021-03-05 09:25

Affects Version/s

10.5.9 [ 25109 ]

Vladislav Lesin made changes - 2021-03-05 11:56

Link

This issue is blocked by ~~MDEV-24719~~ [ ~~MDEV-24719~~ ]

Vladislav Lesin made changes - 2021-03-05 11:57

Link

This issue relates to ~~MDEV-24719~~ [ ~~MDEV-24719~~ ]

Vladislav Lesin made changes - 2021-03-11 06:37

Link

This issue relates to ~~MDEV-25031~~ [ ~~MDEV-25031~~ ]

Marko Mäkelä made changes - 2021-03-11 12:50

Link

This issue is blocked by ~~MDEV-25031~~ [ ~~MDEV-25031~~ ]

Julien Fritsch made changes - 2021-03-11 16:22

Fix Version/s	10.3 [ 22126 ]
Fix Version/s	10.4 [ 22408 ]

Julien Fritsch made changes - 2021-03-15 08:23

Labels

need_feedback

Todd Coker made changes - 2021-03-16 20:36

Link

This issue relates to TODO-2841 [ TODO-2841 ]

Julien Fritsch made changes - 2021-03-23 13:58

Assignee

Vladislav Lesin [ vlad.lesin ]

Sergei Golubchik [ serg ]

Marko Mäkelä made changes - 2021-03-29 08:10

Status

In Progress [ 3 ]

Stalled [ 10000 ]

Marko Mäkelä made changes - 2021-03-29 08:12

Assignee

Sergei Golubchik [ serg ]

Marko Mäkelä [ marko ]

Marko Mäkelä made changes - 2021-03-29 08:17

Status

Stalled [ 10000 ]

In Progress [ 3 ]

Julien Fritsch made changes - 2021-03-30 18:28

Labels

need_feedback

Marko Mäkelä made changes - 2021-04-01 10:38

issue.field.resolutiondate

2021-04-01 10:38:41.0

2021-04-01 10:38:41.025

Marko Mäkelä made changes - 2021-04-01 10:38

Fix Version/s		10.2.38 [ 25207 ]
Fix Version/s		10.3.29 [ 25206 ]
Fix Version/s		10.4.19 [ 25205 ]
Fix Version/s		10.5.10 [ 25204 ]
Fix Version/s	10.2 [ 14601 ]
Fix Version/s	10.5 [ 23123 ]
Resolution		Fixed [ 1 ]
Status	In Progress [ 3 ]	Closed [ 6 ]

Julius Goryavsky made changes - 2021-04-02 02:02

Link

This issue causes ~~MDEV-25328~~ [ ~~MDEV-25328~~ ]

Todd Coker made changes - 2021-05-10 20:20

Link

This issue relates to TODO-2914 [ TODO-2914 ]

Rob Schwyzer (Inactive) made changes - 2021-06-23 22:44

Labels

ServiceNow

Rob Schwyzer (Inactive) made changes - 2021-07-02 19:47

Labels

ServiceNow

76qDvLB8Gju6Hs7nk3VY3EX42G795W5z

Sergei Golubchik made changes - 2021-08-13 22:33

Labels

76qDvLB8Gju6Hs7nk3VY3EX42G795W5z

Rob Schwyzer (Inactive) made changes - 2021-09-30 16:38

Remote Link

This issue links to "Page (Confluence)" [ 32006 ]

Rob Schwyzer (Inactive) made changes - 2021-09-30 16:41

Remote Link

This issue links to "Page (Confluence)" [ 32009 ]

Rob Schwyzer (Inactive) made changes - 2021-10-07 16:39

Remote Link

This issue links to "Page (Confluence)" [ 32102 ]

Rob Schwyzer (Inactive) made changes - 2021-10-14 16:47

Remote Link

This issue links to "Page (Confluence)" [ 32214 ]

Rob Schwyzer (Inactive) made changes - 2021-10-21 16:52

Remote Link

This issue links to "Page (Confluence)" [ 32246 ]

Rob Schwyzer (Inactive) made changes - 2021-10-28 15:50

Remote Link

This issue links to "Page (Confluence)" [ 32302 ]

Rob Schwyzer (Inactive) made changes - 2021-11-03 22:46

Remote Link

This issue links to "Page (MariaDB Confluence)" [ 32322 ]

Rob Schwyzer (Inactive) made changes - 2021-11-04 19:14

Remote Link

This issue links to "Page (Confluence)" [ 32006 ]

Sergei Golubchik made changes - 2021-12-06 21:52

Workflow

MariaDB v3 [ 115685 ]

MariaDB v4 [ 158586 ]

Jira Automation (IT) made changes - 2024-07-04 02:37

Zendesk Related Tickets		201658 113746 138428 190872 158864 149604 104491 157419
Zendesk active tickets		201658

People

Assignee:: Marko Mäkelä

Reporter:: Isaac Venn (Inactive)

Votes:: 7 Vote for this issue

Watchers:: 18 Start watching this issue

Dates

Created:: 2020-11-11 19:38

Updated:: 2024-09-06 10:00

Resolved:: 2021-04-01 10:38

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.

MariaDB Server

Details

Description

Attachments

Attachments

Issue Links

Activity

People

Dates

Git Integration