Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-600

LP:982872 - Aria recovery crash, or assertion `!new_page' failure in _ma_apply_redo_insert_row_head_or_tail, or assertion `page_offset >= keypage_header && page_offset <= page_length' failure in _ma_apply_redo_index

    XMLWordPrintable

Details

    Description

      One of our servers that was recently upgraded to MariaDB 5.3 crashed at startup:

      Apr 16 10:12:04 server1 mysqld_safe: Starting mysqld daemon with databases from /var/lib/mysql
      Apr 16 10:12:04 server1 mysqld: 120416 10:12:04 [Warning] 'master-host' is deprecated and will be removed in a future release. Please use ''CHANGE MASTER'' instead.
      Apr 16 10:12:04 server1 mysqld: 120416 10:12:04 [Note] Plugin 'BLACKHOLE' is disabled.
      Apr 16 10:12:04 server1 mysqld: 120416 10:12:04 [Note] Plugin 'FEDERATED' is disabled.
      Apr 16 10:12:04 server1 mysqld: 120416 10:12:04 [Note] mysqld: Aria engine: starting recovery
      Apr 16 10:12:09 server1 mysqld: recovered pages: 0% 10% 20% 30% 40% 50% 60% 70% 80% 90%2d2d2d d:2d:2d [ERROR] mysqld got signal 11 ;
      Apr 16 10:12:09 server1 mysqld: This could be because you hit a bug. It is also possible that this binary
      Apr 16 10:12:09 server1 mysqld: or one of the libraries it was linked against is corrupt, improperly built,
      Apr 16 10:12:09 server1 mysqld: or misconfigured. This error can also be caused by malfunctioning hardware.
      Apr 16 10:12:09 server1 mysqld: 
      Apr 16 10:12:09 server1 mysqld: To report this bug, see http://kb.askmonty.org/en/reporting-bugs
      Apr 16 10:12:09 server1 mysqld: 
      Apr 16 10:12:09 server1 mysqld: We will try our best to scrape up some info that will hopefully help
      Apr 16 10:12:09 server1 mysqld: diagnose the problem, but since we have already crashed, 
      Apr 16 10:12:09 server1 mysqld: something is definitely wrong and this may fail.
      Apr 16 10:12:09 server1 mysqld: 
      Apr 16 10:12:09 server1 mysqld: Server version: 5.3.5-MariaDB-ga-mariadb113~squeeze-log
      Apr 16 10:12:09 server1 mysqld: key_buffer_size=268435456
      Apr 16 10:12:09 server1 mysqld: read_buffer_size=131072
      Apr 16 10:12:09 server1 mysqld: max_used_connections=0
      Apr 16 10:12:09 server1 mysqld: max_threads=251
      Apr 16 10:12:09 server1 mysqld: thread_count=0
      Apr 16 10:12:09 server1 mysqld: connection_count=0
      Apr 16 10:12:09 server1 mysqld: It is possible that mysqld could use up to 
      Apr 16 10:12:09 server1 mysqld: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 811573 K  bytes of memory
      Apr 16 10:12:09 server1 mysqld: Hope that's ok; if not, decrease some variables in the equation.
      Apr 16 10:12:09 server1 mysqld: 
      Apr 16 10:12:09 server1 mysqld: Thread pointer: 0x0
      Apr 16 10:12:09 server1 mysqld: Attempting backtrace. You can use the following information to find out
      Apr 16 10:12:09 server1 mysqld: where mysqld died. If you see no messages after this, something went
      Apr 16 10:12:09 server1 mysqld: terribly wrong...
      Apr 16 10:12:09 server1 mysqld: stack_bottom = 0 thread_stack 0x40000
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(my_print_stacktrace+0x2e) [0x7f5dc446cd4e]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(handle_fatal_signal+0x494) [0x7f5dc4197e14]
      Apr 16 10:12:09 server1 mysqld: /lib/libpthread.so.0(+0xeff0) [0x7f5dc25dcff0]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(bmove_upp+0x10) [0x7f5dc447cc00]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(_ma_apply_redo_index+0x5b9) [0x7f5dc42bf069]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(+0x63fd9d) [0x7f5dc42ccd9d]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(+0x63bde1) [0x7f5dc42c8de1]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(+0x63f415) [0x7f5dc42cc415]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(maria_apply_log+0x1b4) [0x7f5dc42cdbf4]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(maria_recovery_from_log+0x4e) [0x7f5dc42ce5de]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(+0x5f4b46) [0x7f5dc4281b46]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(ha_initialize_handlerton(st_plugin_int*)+0x38) [0x7f5dc418a1c8]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(+0x58bbec) [0x7f5dc4218bec]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(plugin_init(int*, char**, int)+0x52d) [0x7f5dc421af0d]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(+0x3e098a) [0x7f5dc406d98a]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(main+0x1ee) [0x7f5dc40706ae]
      Apr 16 10:12:09 server1 mysqld: /lib/libc.so.6(__libc_start_main+0xfd) [0x7f5dc1aecc8d]
      Apr 16 10:12:09 server1 mysqld: /usr/sbin/mysqld(+0x2fe669) [0x7f5dc3f8b669]
      Apr 16 10:12:09 server1 mysqld: The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
      Apr 16 10:12:09 server1 mysqld: information that should help you find out what is causing the crash.
      Apr 16 10:12:09 server1 mysqld: Writing a core file
      Apr 16 10:12:09 server1 mysqld_safe: mysqld from pid file /var/run/mysqld/mysqld.pid ended
      Apr 16 10:12:18 server1 /etc/init.d/mysql[3844]: 0 processes alive and '/usr/bin/mysqladmin --defaults-file=/etc/mysql/debian.cnf ping' resulted in
      Apr 16 10:12:18 server1 /etc/init.d/mysql[3844]: #007/usr/bin/mysqladmin: connect to server at 'localhost' failed
      Apr 16 10:12:18 server1 /etc/init.d/mysql[3844]: error: 'Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)'
      Apr 16 10:12:18 server1 /etc/init.d/mysql[3844]: Check that mysqld is running and that the socket: '/var/run/mysqld/mysqld.sock' exists!
      Apr 16 10:12:18 server1 /etc/init.d/mysql[3844]: 

      Removing /var/lib/mysql/aria* "fixed" this. I'll upload the aria* files to FTP so this can be analyzed.

      Attachments

        Issue Links

          Activity

            People

              monty Michael Widenius
              dreasvandonselaar Dreas van Donselaar (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.