Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-20559

Crash and autorestarting MariaDB 10.4.7 server

    XMLWordPrintable

Details

    Description

      MariaDB 10.4.7 крашится, после чего перезапускается.

      На 10.4.6 beta было так же. После нескольких таких падений это привело к поломке таблиц и восстановлению через innodb_force_recovery=5 с полным восстановлением всех таблиц из дампа. После этого обновились до MariaDB 10.4.7 в надежде что в релизной версии такого не будет.

      Sep 11 12:42:51 host_master mysqld[2609]: 2019-09-11 12:42:51 0x7f0e64663700  InnoDB: Assertion failure in file /home/buildbot/buildbot/build/mariadb-10.4.7/storage/innobase/row/row0mysql.cc line 188
      Sep 11 12:42:51 host_master mysqld[2609]: InnoDB: Failing assertion: len < 256
      Sep 11 12:42:51 host_master mysqld[2609]: InnoDB: We intentionally generate a memory trap.
      Sep 11 12:42:51 host_master mysqld[2609]: InnoDB: Submit a detailed bug report to https://jira.mariadb.org/
      Sep 11 12:42:51 host_master mysqld[2609]: InnoDB: If you get repeated assertion failures or crashes, even
      Sep 11 12:42:51 host_master mysqld[2609]: InnoDB: immediately after the mysqld startup, there may be
      Sep 11 12:42:51 host_master mysqld[2609]: InnoDB: corruption in the InnoDB tablespace. Please refer to
      Sep 11 12:42:51 host_master mysqld[2609]: InnoDB: https://mariadb.com/kb/en/library/innodb-recovery-modes/
      Sep 11 12:42:51 host_master mysqld[2609]: InnoDB: about forcing recovery.
      Sep 11 12:42:51 host_master mysqld[2609]: %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%190911 12:42:51 [ERROR] mysqld got signal 6 ;
      Sep 11 12:42:51 host_master mysqld[2609]: This could be because you hit a bug. It is also possible that this binary
      Sep 11 12:42:51 host_master mysqld[2609]: or one of the libraries it was linked against is corrupt, improperly built,
      Sep 11 12:42:51 host_master mysqld[2609]: or misconfigured. This error can also be caused by malfunctioning hardware.
      Sep 11 12:42:51 host_master mysqld[2609]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs
      Sep 11 12:42:51 host_master mysqld[2609]: We will try our best to scrape up some info that will hopefully help
      Sep 11 12:42:51 host_master mysqld[2609]: diagnose the problem, but since we have already crashed,
      Sep 11 12:42:51 host_master mysqld[2609]: something is definitely wrong and this may fail.
      Sep 11 12:42:51 host_master mysqld[2609]: Server version: 10.4.7-MariaDB-1:10.4.7+maria~stretch-log
      Sep 11 12:42:51 host_master mysqld[2609]: key_buffer_size=134217728
      Sep 11 12:42:51 host_master mysqld[2609]: read_buffer_size=2097152
      Sep 11 12:42:51 host_master mysqld[2609]: max_used_connections=248
      Sep 11 12:42:51 host_master mysqld[2609]: max_threads=502
      Sep 11 12:42:51 host_master mysqld[2609]: thread_count=239
      Sep 11 12:42:51 host_master mysqld[2609]: It is possible that mysqld could use up to
      Sep 11 12:42:51 host_master mysqld[2609]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 3227677 K  bytes of memory
      Sep 11 12:42:51 host_master mysqld[2609]: Hope that's ok; if not, decrease some variables in the equation.
      Sep 11 12:42:51 host_master mysqld[2609]: Thread pointer: 0x7f0e60040f88
      Sep 11 12:42:51 host_master mysqld[2609]: Attempting backtrace. You can use the following information to find out
      Sep 11 12:42:51 host_master mysqld[2609]: where mysqld died. If you see no messages after this, something went
      Sep 11 12:42:51 host_master mysqld[2609]: terribly wrong...
      Sep 11 12:42:51 host_master mysqld[2609]: stack_bottom = 0x7f0e64662cf8 thread_stack 0x49000
      Sep 11 12:42:52 host_master mysqld[2609]: /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x55a4e15d3b8e]
      Sep 11 12:42:52 host_master mysqld[2609]: /usr/sbin/mysqld(handle_fatal_signal+0x3af)[0x55a4e106379f]
      Sep 11 12:42:55 host_master mysqld[2609]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x110e0)[0x7f281e0be0e0]
      Sep 11 12:42:57 host_master mysqld[2609]: /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcf)[0x7f281c75dfff]
      Sep 11 12:42:57 host_master mysqld[2609]: /lib/x86_64-linux-gnu/libc.so.6(abort+0x16a)[0x7f281c75f42a]
      Sep 11 12:43:00 host_master mysqld[2609]: /usr/sbin/mysqld(+0x562cc8)[0x55a4e0d66cc8]
      Sep 11 12:43:00 host_master mysqld[2609]: /usr/sbin/mysqld(+0xacce68)[0x55a4e12d0e68]
      Sep 11 12:43:00 host_master mysqld[2609]: /usr/sbin/mysqld(+0xaebf98)[0x55a4e12eff98]
      Sep 11 12:43:00 host_master mysqld[2609]: /usr/sbin/mysqld(+0x561ccd)[0x55a4e0d65ccd]
      Sep 11 12:43:00 host_master mysqld[2609]: /usr/sbin/mysqld(+0x561f81)[0x55a4e0d65f81]
      Sep 11 12:43:00 host_master mysqld[2609]: /usr/sbin/mysqld(+0xaed3cf)[0x55a4e12f13cf]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(+0xa091e2)[0x55a4e120d1e2]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(+0x6901aa)[0x55a4e0e941aa]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(_Z10sub_selectP4JOINP13st_join_tableb+0x120)[0x55a4e0e89cc0]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(_ZN4JOIN10exec_innerEv+0xbcb)[0x55a4e0eab42b]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(_ZN4JOIN4execEv+0x33)[0x55a4e0eab693]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(_Z12mysql_selectP3THDP10TABLE_LISTjR4ListI4ItemEPS4_jP8st_orderS9_S7_S9_yP13select_resultP18st_select_lex_unitP13st_select_lex+0x186)[0x55a4e0ea9a66]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(_Z13handle_selectP3THDP3LEXP13select_resultm+0xf6)[0x55a4e0eaa3b6]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(+0x55351a)[0x55a4e0d5751a]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x1fa0)[0x55a4e0e4f140]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_statebb+0x23a)[0x55a4e0e55efa]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0x134b)[0x55a4e0e5840b]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(_Z10do_commandP3THD+0x11c)[0x55a4e0e59cec]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(_Z24do_handle_one_connectionP7CONNECT+0x281)[0x55a4e0f36431]
      Sep 11 12:43:01 host_master mysqld[2609]: /usr/sbin/mysqld(handle_one_connection+0x3d)[0x55a4e0f3655d]
      Sep 11 12:43:02 host_master mysqld[2609]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x74a4)[0x7f281e0b44a4]
      Sep 11 12:43:05 host_master mysqld[2609]: /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7f281c813d0f]
      Sep 11 12:43:05 host_master mysqld[2609]: Trying to get some variables.
      Sep 11 12:43:05 host_master mysqld[2609]: Some pointers may be invalid and cause the dump to abort.
      Sep 11 12:43:05 host_master mysqld[2609]: Query (0x7f0e60050e30): SELECT c.id,                         SUM(COALESCE(rcd.members_growth,0)) as members_growth,                         SUM(rcd.views_count) as views_count,                         SUM(rcd.views_growth) as views_growth,
      c.ci_index AS ic_count,                         rank as rank,                         ROUND(IF ((c.views_per_post / c.participants_count) * 100 < 1000, IF (c.participants_count > 30, (c.views_per_post / c.participants_count) * 100, NULL), NULL), 1) as perc
      FROM channels c                     LEFT JOIN rating_channels_daily rcd ON rcd.channel_id = c.id AND rcd.date >= '2019-09-05'                 WHERE  c.category_id = '8' AND MATCH(username
      , title, hash, about) AGAINST ('*peri* peri*' IN BOOLEAN MODE) AND c.language IN ('english') AND c.country IN ('ru')                 GROUP BY c.id
      ORDER BY participants_count asc                 LIMIT 100                 OFFSET 0
      Sep 11 12:43:05 host_master mysqld[2609]: Connection ID (thread ID): 3961639
      Sep 11 12:43:05 host_master mysqld[2609]: Status: NOT_KILLED
      Sep 11 12:43:05 host_master mysqld[2609]: Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firs
      tmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,j
      oin_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on
      Sep 11 12:43:05 host_master mysqld[2609]: The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
      Sep 11 12:43:05 host_master mysqld[2609]: information that should help you find out what is causing the crash.
      Sep 11 12:43:05 host_master mysqld[2609]: Writing a core file...
      Sep 11 12:43:05 host_master mysqld[2609]: Working directory at /var/lib/mysql
      Sep 11 12:43:05 host_master mysqld[2609]: Resource Limits:
      Sep 11 12:43:05 host_master mysqld[2609]: Limit                     Soft Limit           Hard Limit           Units
      Sep 11 12:43:05 host_master mysqld[2609]: Max cpu time              unlimited            unlimited            seconds
      Sep 11 12:43:05 host_master mysqld[2609]: Max file size             unlimited            unlimited            bytes
      Sep 11 12:43:05 host_master mysqld[2609]: Max data size             unlimited            unlimited            bytes
      Sep 11 12:43:05 host_master mysqld[2609]: Max stack size            8388608              unlimited            bytes
      Sep 11 12:43:05 host_master mysqld[2609]: Max core file size        0                    unlimited            bytes
      Sep 11 12:43:05 host_master mysqld[2609]: Max resident set          unlimited            unlimited            bytes
      Sep 11 12:43:05 host_master mysqld[2609]: Max processes             514387               514387               processes
      Sep 11 12:43:05 host_master mysqld[2609]: Max open files            16364                16364                files
      Sep 11 12:43:05 host_master mysqld[2609]: Max locked memory         65536                65536                bytes
      Sep 11 12:43:05 host_master mysqld[2609]: Max address space         unlimited            unlimited            bytes
      Sep 11 12:43:05 host_master mysqld[2609]: Max file locks            unlimited            unlimited            locks
      Sep 11 12:43:05 host_master mysqld[2609]: Max pending signals       514387               514387               signals
      Sep 11 12:43:05 host_master mysqld[2609]: Max msgqueue size         819200               819200               bytes
      Sep 11 12:43:05 host_master mysqld[2609]: Max nice priority         0                    0
      Sep 11 12:43:05 host_master mysqld[2609]: Max realtime priority     0                    0
      Sep 11 12:43:05 host_master mysqld[2609]: Max realtime timeout      unlimited            unlimited            us
      Sep 11 12:43:05 host_master mysqld[2609]: Core pattern: core
      Sep 11 12:43:10 host_master systemd[1]: mariadb.service: Main process exited, code=killed, status=6/ABRT
      Sep 11 12:43:10 host_master systemd[1]: mariadb.service: Unit entered failed state.
      Sep 11 12:43:10 host_master systemd[1]: mariadb.service: Failed with result 'signal'.
      Sep 11 12:43:15 host_master systemd[1]: mariadb.service: Service hold-off time over, scheduling restart.
      Sep 11 12:43:15 host_master systemd[1]: Stopped MariaDB 10.4.7 database server.
      Sep 11 12:43:15 host_master systemd[1]: Starting MariaDB 10.4.7 database server...
      
      

      Attachments

        Activity

          People

            vlad.lesin Vladislav Lesin
            yureccc Yury
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.