Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-10062

Random crash about once a week (mysqld got signal 11)

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • 10.1.12, 10.1.13, 10.1.16, 10.1.18
    • 10.1.22
    • Server
    • None

    Description

      Occasionally a couple of times a month the server part restarts with a crash of "mysqld got signal 11;".

      All our databases uses InnoDB tables. Also functions, triggers, views and events are used.

      I've only kept two backtraces so not much to go on but in both of them it seems to access method mysqld_show_create_get_fields.

      We have seen similar issues on development server when we use EXPLAIN query syntax, but only happens randomly there also.

      Here is the last backtrace:

      May 13 08:34:24 db-10 mysqld: 160513  8:34:24 [ERROR] mysqld got signal 11 ;
      May 13 08:34:24 db-10 mysqld: This could be because you hit a bug. It is also possible that this binary
      May 13 08:34:24 db-10 mysqld: or one of the libraries it was linked against is corrupt, improperly built,
      May 13 08:34:24 db-10 mysqld: or misconfigured. This error can also be caused by malfunctioning hardware.
      May 13 08:34:24 db-10 mysqld:
      May 13 08:34:24 db-10 mysqld: To report this bug, see http://kb.askmonty.org/en/reporting-bugs
      May 13 08:34:24 db-10 mysqld:
      May 13 08:34:24 db-10 mysqld: We will try our best to scrape up some info that will hopefully help
      May 13 08:34:24 db-10 mysqld: diagnose the problem, but since we have already crashed,
      May 13 08:34:24 db-10 mysqld: something is definitely wrong and this may fail.
      May 13 08:34:24 db-10 mysqld:
      May 13 08:34:24 db-10 mysqld: Server version: 10.1.12-MariaDB-1~trusty
      May 13 08:34:24 db-10 mysqld: key_buffer_size=134217728
      May 13 08:34:24 db-10 mysqld: read_buffer_size=2097152
      May 13 08:34:24 db-10 mysqld: max_used_connections=47
      May 13 08:34:24 db-10 mysqld: max_threads=102
      May 13 08:34:24 db-10 mysqld: thread_count=34
      May 13 08:34:24 db-10 mysqld: It is possible that mysqld could use up to
      May 13 08:34:24 db-10 mysqld: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 759828 K  bytes of memory
      May 13 08:34:24 db-10 mysqld: Hope that's ok; if not, decrease some variables in the equation.
      May 13 08:34:24 db-10 mysqld:
      May 13 08:34:24 db-10 mysqld: Thread pointer: 0x0x7f3e9d631008
      May 13 08:34:24 db-10 mysqld: Attempting backtrace. You can use the following information to find out
      May 13 08:34:24 db-10 mysqld: where mysqld died. If you see no messages after this, something went
      May 13 08:34:24 db-10 mysqld: terribly wrong...
      May 13 08:34:24 db-10 mysqld: stack_bottom = 0x7f4ac029a1f0 thread_stack 0x48400
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x7f4ac417405e]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(handle_fatal_signal+0x38d)[0x7f4ac3ca11bd]
      May 13 08:34:24 db-10 mysqld: /lib/x86_64-linux-gnu/libpthread.so.0(+0x10340)[0x7f4ac21f8340]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z19find_field_in_tableP3THDP5TABLEPKcjbPj+0x91)[0x7f4ac3ae09e1]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z23find_field_in_table_refP3THDP10TABLE_LISTPKcjS4_S4_S4_PP4ItembbPjbPS2_+0x878)[0x7f4ac3ae1468]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z20find_field_in_tablesP3THDP10Item_identP10TABLE_LISTS4_PP4Item27find_item_error_report_typebb+0x2d8)[0x7f4ac3ae19a8]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_ZN10Item_field10fix_fieldsEP3THDPP4Item+0x332)[0x7f4ac3cc0642]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_ZN9Item_func10fix_fieldsEP3THDPP4Item+0x19f)[0x7f4ac3cfb68f]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_ZN9Item_func10fix_fieldsEP3THDPP4Item+0x19f)[0x7f4ac3cfb68f]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z12setup_fieldsP3THDPP4ItemR4ListIS1_E17enum_mark_columnsPS5_b+0x17c)[0x7f4ac3ae24fc]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_ZN4JOIN7prepareEPPP4ItemP10TABLE_LISTjS1_jP8st_orderbS7_S1_S7_P13st_select_lexP18st_select_lex_unit+0x312)[0x7f4ac3b6b8b2]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_ZN30subselect_single_select_engine7prepareEv+0x6d9)[0x7f4ac3d314c9]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_ZN14Item_subselect10fix_fieldsEP3THDPP4Item+0xcd)[0x7f4ac3d35b6d]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_ZN9Item_func10fix_fieldsEP3THDPP4Item+0x19f)[0x7f4ac3cfb68f]
      May 13 08:34:24 db-10 mysqld: message repeated 2 times: [ /usr/sbin/mysqld(_ZN9Item_func10fix_fieldsEP3THDPP4Item+0x19f)[0x7f4ac3cfb68f]]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_ZN9Item_cond10fix_fieldsEP3THDPP4Item+0xb9)[0x7f4ac3cd1259]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z11setup_condsP3THDP10TABLE_LISTR4ListIS1_EPP4Item+0x18b)[0x7f4ac3ae3d4b]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_ZN4JOIN7prepareEPPP4ItemP10TABLE_LISTjS1_jP8st_orderbS7_S1_S7_P13st_select_lexP18st_select_lex_unit+0x3c4)[0x7f4ac3b6b964]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_ZN18st_select_lex_unit7prepareEP3THDP13select_resultm+0x968)[0x7f4ac3bb8788]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z21mysql_derived_prepareP3THDP3LEXP10TABLE_LIST+0x1ff)[0x7f4ac3afeccf]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z20mysql_handle_derivedP3LEXj+0x226)[0x7f4ac3aff7f6]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z29mysqld_show_create_get_fieldsP3THDP10TABLE_LISTP4ListI4ItemEP6String+0x856)[0x7f4ac3b81ff6]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z18mysqld_show_createP3THDP10TABLE_LIST+0xc0)[0x7f4ac3b824d0]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x3015)[0x7f4ac3b22685]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x26d)[0x7f4ac3b28fed]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x2460)[0x7f4ac3b2c330]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z10do_commandP3THD+0x169)[0x7f4ac3b2cae9]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(_Z24do_handle_one_connectionP3THD+0x18a)[0x7f4ac3bf00fa]
      May 13 08:34:24 db-10 mysqld: /usr/sbin/mysqld(handle_one_connection+0x40)[0x7f4ac3bf02d0]
      May 13 08:34:24 db-10 mysqld: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8182)[0x7f4ac21f0182]
      May 13 08:34:24 db-10 mysqld: /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f4ac191347d]
      May 13 08:34:24 db-10 mysqld:
      May 13 08:34:24 db-10 mysqld: Trying to get some variables.
      May 13 08:34:24 db-10 mysqld: Some pointers may be invalid and cause the dump to abort.
      May 13 08:34:24 db-10 mysqld: Query (0x7f3fbbc20020): is an invalid pointer
      May 13 08:34:24 db-10 mysqld: Connection ID (thread ID): 62004
      May 13 08:34:24 db-10 mysqld: Status: NOT_KILLED
      May 13 08:34:24 db-10 mysqld:
      May 13 08:34:24 db-10 mysqld: Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on
      May 13 08:34:24 db-10 mysqld:
      May 13 08:34:24 db-10 mysqld: The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
      May 13 08:34:24 db-10 mysqld: information that should help you find out what is causing the crash.
      May 13 08:34:24 db-10 mysqld_safe: Number of processes running now: 0
      May 13 08:34:24 db-10 mysqld_safe: mysqld restarted
      

      Attachments

        1. DB10-Crash-2016-09-01.txt
          10 kB
          Joachim Wickman
        2. DB10-Crash-2016-09-29.txt
          7 kB
          Joachim Wickman
        3. DB4-Crash-2016-08-05.txt
          7 kB
          Joachim Wickman
        4. DB4-Crash-2016-10-27.txt
          9 kB
          Joachim Wickman
        5. DB4-Crash-2016-11-24-2.txt
          8 kB
          Joachim Wickman
        6. mariadb.cnf
          0.6 kB
          Joachim Wickman
        7. MDEV-10062-Backtrace.txt
          51 kB
          Joachim Wickman
        8. my.cnf
          5 kB
          Joachim Wickman
        9. mysqld_safe_syslog.cnf
          0.0 kB
          Joachim Wickman
        10. query-2016-10-27.log
          46 kB
          Joachim Wickman
        11. tokudb.cnf
          0.3 kB
          Joachim Wickman
        12. trust.cnf
          0.0 kB
          Joachim Wickman

        Issue Links

          Activity

            People

              Unassigned Unassigned
              joachim Joachim Wickman
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.