Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-24197

Prepare step of backup failing on large backup

    XMLWordPrintable

    Details

      Description

      Customer is running backup on very large dataset (18TB). Backup completes successfully, but fails during prepare step.
      Here is the planned backup process as the customer has detailed:

        1. On Source:
          mariabackup --user=root --backup --target-dir=/opt/database/backup --stream=xbstream --parallel=12 | pigz -c | socat - TCP-LISTEN:4444,reuseaddr
        2. On Target
          rm -rf /var/lib/mysql/*
          rm -rf /var/log/mysql/*
          cd /var/lib/mysql
          socat -u TCP:192.168.111.184:4444 STDOUT | pigz -dc | mbstream -x
          mariabackup --user=root --use-memory=100G --prepare --target-dir=/var/lib/mysql/
          rm -rf ib_logfile*
          chown -R mysql:mysql /var/lib/mysql/
          systemctl start mariadb

      The prepare fails as such:
      2020-11-03 15:08:46 0 [Note] InnoDB: To recover: 2407553 pages from log
      2020-11-03 15:08:54 0 [ERROR] InnoDB: Not applying INSERT_REUSE_REDUNDANT due to corruption on [page id: space=0, page number=120831]
      2020-11-03 15:08:54 0 [ERROR] InnoDB: Set innodb_force_recovery=1 to ignore corruption.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              marko Marko Mäkelä
              Reporter:
              ivenn Isaac Venn
              Votes:
              7 Vote for this issue
              Watchers:
              18 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: