Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-25568

"RENAME TABLE" causes "Ignoring data file ... with space ID xxxx, since the redo log references ... with space ID xxxx."

Details

    Description

      Hi,

      I do a daily "snapshot" restore of my daily backup performed by MariaBackup.

      I've just noticed that I see *LOADS* of messages like:

      Ignoring data file 'database1/table1.ibd' with space ID 25508, since the redo log references database1/table1.ibd with space ID 25506.

      On tables that some jobs perform a "RENAME TABLE", to swap with a new version of them.

      I've been seeing this since very long ago, but became more noticeable now that there is a job that does "RENAME TABLE" every 5 minutes.

      Is this normal?
      Does this mean anything bad to the database or backups? Or to the 'restored' database?

      Is there any risk of corruption because of this, or loss of data/tables?

      Thank you.

      Attachments

        Issue Links

          Activity

            Yes, the messages are normal and nothing to worry about. The messages were originally introduced by me in 2014 in MySQL 5.7 when I changed the redo log format and the recovery logic to rely on the redo log explicitly identifying the modified .ibd files. Before that, recovery used to read every .ibd file in the data directory in order to determine the numeric tablespace identifier.

            Because I do not remember us observing any problems with that logic in the past 3 years, I think that it is safe to remove the message output.

            Note: DDL operations are not expected to be fully crash-safe before MDEV-17567 has been implemented. In Mariabackup, there is some extra locking and logging, so that a correct backup should be created even if the server is concurrently executing DDL.

            If we ignore mismatch between .frm files and InnoDB (until MDEV-17567 fixes that), then RENAME TABLE inside InnoDB should be crash-safe ever since MDEV-14717.

            marko Marko Mäkelä added a comment - Yes, the messages are normal and nothing to worry about. The messages were originally introduced by me in 2014 in MySQL 5.7 when I changed the redo log format and the recovery logic to rely on the redo log explicitly identifying the modified .ibd files. Before that, recovery used to read every .ibd file in the data directory in order to determine the numeric tablespace identifier. Because I do not remember us observing any problems with that logic in the past 3 years, I think that it is safe to remove the message output. Note: DDL operations are not expected to be fully crash-safe before MDEV-17567 has been implemented. In Mariabackup, there is some extra locking and logging, so that a correct backup should be created even if the server is concurrently executing DDL. If we ignore mismatch between .frm files and InnoDB (until MDEV-17567 fixes that), then RENAME TABLE inside InnoDB should be crash-safe ever since MDEV-14717 .

            There are two similar messages that are output by the function fil_ibd_load(). I think that the one

            Ignoring data file … with space ID 123. Another data file called … exists with the same space ID.
            

            deserves to be preserved.

            marko Marko Mäkelä added a comment - There are two similar messages that are output by the function fil_ibd_load() . I think that the one Ignoring data file … with space ID 123. Another data file called … exists with the same space ID. deserves to be preserved.
            nunop Nuno added a comment -

            Thank you very much marko !

            nunop Nuno added a comment - Thank you very much marko !

            People

              marko Marko Mäkelä
              nunop Nuno
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.