Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-11192

Error "Checsum failure while reading node partition in file" makes server crashes

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Not a Bug
    • Affects Version/s: 10.0.27
    • Fix Version/s: N/A
    • Labels:
    • Environment:

      Description

      After replacing SSD drives laying under the the RAID+LVM (256GB drives to larger 512GB drives) and extending the LVM logical volume, server started crashing with:

      Checksum failure while reading node partition in file ... error on different TokuDB files (example crash.log attached) - most of the time it's main files, sometime index
      Table structure attached. Crash can be reproduced easily by reading the whole table (or identify the failing part of the data range and read its data).

      The only solution was to drop index/table - in case of table it hurt because it contained 10M-100M lines of data.
      What helps was to split large tables into partitions, smaller ones are not crashing anymore, but the the ones containing 30M+ lines per partition still crashes from time to time.

      My question is if it's related to storage layer or tokudb/mariadb?

        Attachments

        1. 20160711-mysqld.err
          9 kB
          Jan Hejl
        2. 201611071723-mysql.err
          12 kB
          Jan Hejl
        3. 201611110203-innodb-mysqld.err
          10 kB
          Jan Hejl
        4. 20161118-mysqld.err
          451 kB
          Jan Hejl
        5. core-gdb-201611071338.txt
          33 kB
          Jan Hejl
        6. core-gdb-201611071723.txt
          36 kB
          Jan Hejl
        7. core-gdb-full-201611071338.txt
          46 kB
          Jan Hejl
        8. core-gdb-full-201611071338.txt
          46 kB
          Jan Hejl
        9. core-gdb-full-201611071723.txt
          49 kB
          Jan Hejl
        10. crash.log
          1.0 kB
          Jan Hejl
        11. emerge.info
          5 kB
          Jan Hejl
        12. my.cnf
          4 kB
          Jan Hejl
        13. scanner.sql
          1 kB
          Jan Hejl

          Activity

            People

            • Assignee:
              jplindst Jan Lindström
              Reporter:
              jhejl Jan Hejl
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: