Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-34416

InnoDB: Corrupted page and suggested set innodb_force_recovery=1 but it's still error

    XMLWordPrintable

Details

    • Bug
    • Status: Open (View Workflow)
    • Major
    • Resolution: Unresolved
    • 10.11.7
    • None
    • None
    • CloudLinux, Manufacturer: Dell Inc. Product Name: PowerEdge R440

    Description

      I am encountering an issue with MariaDB that is preventing it from starting. The error details are as follows:

      674 mysqld: 2024-06-08  4:21:38 0 [Note] libgovernor.so found
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Note] All governors functions found too
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Note] Governor connected
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Note] All governors lve functions found too
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Warning] Could not increase number of max_open_files to more than 300000 (request: 8194079)
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Note] Starting MariaDB 10.11.7-MariaDB-cll-lve source revision 87e13722a95af5d9378d990caf48cb6874439347 as process 4737
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Note] InnoDB: Compressed tables use zlib 1.2.7
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Note] InnoDB: Number of transaction pools: 1
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Note] InnoDB: Using Linux native AIO
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Note] InnoDB: Initializing buffer pool, total size = 10.046GiB, chunk size = 160.734MiB
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Note] InnoDB: Completed initialization of buffer pool
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Note] InnoDB: Buffered log writes (block size=4096 bytes)
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Note] InnoDB: Resetting space id's in the doublewrite buffer
      /var/log/messages-20240609.gz:Jun  8 04:21:38 server-hostname mysqld: 2024-06-08  4:21:38 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=151567102415015
      /var/log/messages-20240609.gz:Jun  8 04:21:39 server-hostname mysqld: 2024-06-08  4:21:39 0 [ERROR] InnoDB: Corrupted page identifier at 151567287619189; set innodb_force_recovery=1 to ignore the record.
      /var/log/messages-20240609.gz:Jun  8 04:21:39 server-hostname mysqld: 2024-06-08  4:21:39 0 [Note] InnoDB: End of log at LSN=151567287619189
      /var/log/messages-20240609.gz:Jun  8 04:21:39 server-hostname mysqld: 2024-06-08  4:21:39 0 [ERROR] InnoDB: Plugin initialization aborted with error Generic error
      /var/log/messages-20240609.gz:Jun  8 04:21:39 server-hostname mysqld: 2024-06-08  4:21:39 0 [Note] InnoDB: Starting shutdown...
      /var/log/messages-20240609.gz:Jun  8 04:21:39 server-hostname mysqld: 2024-06-08  4:21:39 0 [ERROR] Plugin 'InnoDB' registration as a STORAGE ENGINE failed.
      /var/log/messages-20240609.gz:Jun  8 04:21:39 server-hostname mysqld: 2024-06-08  4:21:39 0 [Note] Plugin 'FEEDBACK' is disabled.
      /var/log/messages-20240609.gz:Jun  8 04:21:39 server-hostname mysqld: 2024-06-08  4:21:39 0 [Warning] 'innodb-log-write-ahead-size' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
      /var/log/messages-20240609.gz:Jun  8 04:21:39 server-hostname mysqld: 2024-06-08  4:21:39 0 [ERROR] Unknown/unsupported storage engine: InnoDB
      

      Even after initiating recovery mode levels 1 through 5, MariaDB still fails to start. The error message displayed is as follows:

      mysqld: 2024-06-08  4:22:48 0 [Warning] Could not increase number of max_open_files to more than 300000 (request: 8194079)
      /var/log/messages-20240609.gz:Jun  8 04:22:48 server-hostname mysqld: 2024-06-08  4:22:48 0 [Note] Starting MariaDB 10.11.7-MariaDB-cll-lve source revision 87e13722a95af5d9378d990caf48cb6874439347 as process 30059
      /var/log/messages-20240609.gz:Jun  8 04:22:48 server-hostname mysqld: 2024-06-08  4:22:48 0 [Note] InnoDB: !!! innodb_force_recovery is set to 1 !!!
      /var/log/messages-20240609.gz:Jun  8 04:22:48 server-hostname mysqld: 2024-06-08  4:22:48 0 [Note] InnoDB: Compressed tables use zlib 1.2.7
      /var/log/messages-20240609.gz:Jun  8 04:22:48 server-hostname mysqld: 2024-06-08  4:22:48 0 [Note] InnoDB: Number of transaction pools: 1
      /var/log/messages-20240609.gz:Jun  8 04:22:48 server-hostname mysqld: 2024-06-08  4:22:48 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
      /var/log/messages-20240609.gz:Jun  8 04:22:48 server-hostname mysqld: 2024-06-08  4:22:48 0 [Note] InnoDB: Using Linux native AIO
      /var/log/messages-20240609.gz:Jun  8 04:22:48 server-hostname mysqld: 2024-06-08  4:22:48 0 [Note] InnoDB: Initializing buffer pool, total size = 10.046GiB, chunk size = 160.734MiB
      /var/log/messages-20240609.gz:Jun  8 04:22:48 server-hostname mysqld: 2024-06-08  4:22:48 0 [Note] InnoDB: Completed initialization of buffer pool
      /var/log/messages-20240609.gz:Jun  8 04:22:48 server-hostname mysqld: 2024-06-08  4:22:48 0 [Note] InnoDB: Buffered log writes (block size=4096 bytes)
      /var/log/messages-20240609.gz:Jun  8 04:22:48 server-hostname mysqld: 2024-06-08  4:22:48 0 [Note] InnoDB: Resetting space id's in the doublewrite buffer
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=151567102415015
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Note] InnoDB: At LSN: 151567236353013: unable to open file ./u709475469_VPhUq/#sql-ib5978250.ibd for tablespace 5978240
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Note] InnoDB: At LSN: 151567236362543: unable to open file ./u709475469_VPhUq/#sql-ib5978251.ibd for tablespace 5978241
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Warning] InnoDB: Ignoring corrupted page identifier at LSN 151567287619189
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Warning] InnoDB: Ignoring malformed log record at LSN 151567287619189
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Warning] InnoDB: Ignoring malformed log record at LSN 151567287619189
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Warning] InnoDB: Ignoring corrupted page identifier at LSN 151567287619189
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Warning] InnoDB: Ignoring corrupted page identifier at LSN 151567287619189
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Warning] InnoDB: Ignoring corrupted page identifier at LSN 151567287619189
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Warning] InnoDB: Ignoring malformed log record at LSN 151567287619189
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Warning] InnoDB: Ignoring malformed log record at LSN 151567287619189
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Warning] InnoDB: Ignoring corrupted page identifier at LSN 151567287619189
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Warning] InnoDB: Ignoring corrupted page identifier at LSN 151567287619189
      /var/log/messages-20240609.gz:Jun  8 04:22:49 server-hostname mysqld: 2024-06-08  4:22:49 0 [Note] InnoDB: End of log at LSN=151567287810828
      /var/log/messages-20240609.gz:Jun  8 04:22:52 server-hostname mysqld_exporter: ts=2024-06-08T04:22:52.293Z caller=exporter.go:152 level=error msg="Error pinging mysqld" err="dial unix /var/lib/mysql/mysql.sock: connect: connection refused"
      /var/log/messages-20240609.gz:Jun  8 04:23:07 server-hostname mysqld_exporter: ts=2024-06-08T04:23:07.295Z caller=exporter.go:152 level=error msg="Error pinging mysqld" err="dial unix /var/lib/mysql/mysql.sock: connect: connection refused"
      /var/log/messages-20240609.gz:Jun  8 04:23:22 server-hostname mysqld_exporter: ts=2024-06-08T04:23:22.293Z caller=exporter.go:152 level=error msg="Error pinging mysqld" err="dial unix /var/lib/mysql/mysql.sock: connect: connection refused"
      /var/log/messages-20240609.gz:Jun  8 04:23:37 server-hostname mysqld_exporter: ts=2024-06-08T04:23:37.294Z caller=exporter.go:152 level=error msg="Error pinging mysqld" err="dial unix /var/lib/mysql/mysql.sock: connect: connection refused"
      /var/log/messages-20240609.gz:Jun  8 04:23:52 server-hostname mysqld_exporter: ts=2024-06-08T04:23:52.294Z caller=exporter.go:152 level=error msg="Error pinging mysqld" err="dial unix /var/lib/mysql/mysql.sock: connect: connection refused"
      /var/log/messages-20240609.gz:Jun  8 04:24:07 server-hostname mysqld_exporter: ts=2024-06-08T04:24:07.294Z caller=exporter.go:152 level=error msg="Error pinging mysqld" err="dial unix /var/lib/mysql/mysql.sock: connect: connection refused"
      /var/log/messages-20240609.gz:Jun  8 04:24:22 server-hostname mysqld_exporter: ts=2024-06-08T04:24:22.294Z caller=exporter.go:152 level=error msg="Error pinging mysqld" err="dial unix /var/lib/mysql/mysql.sock: connect: connection refused"
      /var/log/messages-20240609.gz:Jun  8 04:24:37 server-hostname mysqld_exporter: ts=2024-06-08T04:24:37.294Z caller=exporter.go:152 level=error msg="Error pinging mysqld" err="dial unix /var/lib/mysql/mysql.sock: connect: connection refused"
      /var/log/messages-20240609.gz:Jun  8 04:24:52 server-hostname mysqld_exporter: ts=2024-06-08T04:24:52.294Z caller=exporter.go:152 level=error msg="Error pinging mysqld" err="dial unix /var/lib/mysql/mysql.sock: connect: connection refused"
      /var/log/messages-20240609.gz:Jun  8 04:25:07 server-hostname mysqld_exporter: ts=2024-06-08T04:25:07.294Z caller=exporter.go:152 level=error msg="Error pinging mysqld" err="dial unix /var/lib/mysql/mysql.sock: connect: connection refused"
      /var/log/messages-20240609.gz:Jun  8 04:25:22 server-hostname mysqld_exporter: ts=2024-06-08T04:25:22.294Z caller=exporter.go:152 level=error msg="Error pinging mysqld" err="dial unix /var/lib/mysql/mysql.sock: connect: connection refused"
      /var/log/messages-20240609.gz:Jun  8 04:25:36 server-hostname mysqld: 2024-06-08  4:25:36 0 [Note] libgovernor.so found
      

      Finally, the MariaDB service was able to start using recovery mode level 6. Could you please investigate the cause of this issue and advise on how to resolve it?

      Thank you.

      Attachments

        Activity

          People

            Unassigned Unassigned
            Amrih Setyabudi Amrih
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.