Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-16194

Stack trace is not resolved on fulltest2

    XMLWordPrintable

Details

    • Bug
    • Status: Open (View Workflow)
    • Major
    • Resolution: Unresolved
    • 5.5, 10.0, 10.1, 10.2, 10.3
    • 10.4
    • Server
    • None

    Description

      http://buildbot.askmonty.org/buildbot/builders/kvm-fulltest2/builds/12815/steps/mtr_nm/logs/stdio

      stack_bottom = 0xacabe280 thread_stack 0x49000
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld(my_print_stacktrace+0x3b)[0x8e4384b]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld(handle_fatal_signal+0x404)[0x86acf80]
      addr2line: '': No such file
      [0xb77d2400]
      [0xb77d2424]
      /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xb72ae1ef]
      /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xb72b1835]
      /lib/i386-linux-gnu/libc.so.6(+0x27095)[0xb72a7095]
      /lib/i386-linux-gnu/libc.so.6(+0x27147)[0xb72a7147]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8a0d958]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8acf851]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8d6d63e]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8d6d88b]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8d6e24d]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8d71084]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8b6eb76]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8b6ed2c]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8ac3506]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8ac375d]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8ac3975]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8bd04b4]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8bd08ef]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x8b1c704]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x89d333c]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x89d3f01]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld(_ZN7handler9ha_createEPKcP5TABLEP14HA_CREATE_INFO+0x91)[0x86b92d3]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld(_Z15ha_create_tableP3THDPKcS2_S2_P14HA_CREATE_INFOP34st_mysql_const_unsigned_lex_string+0x2e2)[0x86ba3f6]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld(_Z16rea_create_tableP3THDP34st_mysql_const_unsigned_lex_stringPKcS4_S4_P14HA_CREATE_INFOP7handlerb+0x10a)[0x84ed3b1]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x849467b]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld(_Z26mysql_create_table_no_lockP3THDPK25st_mysql_const_lex_stringS3_P22Table_specification_stP10Alter_infoPbiP10TABLE_LIST+0x1e8)[0x8494d00]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld(_Z18mysql_create_tableP3THDP10TABLE_LISTP22Table_specification_stP10Alter_info+0x21e)[0x8494fd6]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld(_Z21mysql_execute_commandP3THD+0x309c)[0x83cf4bc]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld(_Z11mysql_parseP3THDPcjP12Parser_statebb+0x29b)[0x83dbd7b]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0xf9e)[0x83c884c]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld(_Z10do_commandP3THD+0x6be)[0x83c72d1]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld(_Z24do_handle_one_connectionP7CONNECT+0x1bf)[0x851e615]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld(handle_one_connection+0x38)[0x851e39b]
      /mnt/buildbot/build/mariadb-10.3.7/sql/mysqld[0x88c7901]
      /lib/i386-linux-gnu/libpthread.so.0(+0x6d4c)[0xb755ad4c]
      /lib/i386-linux-gnu/libc.so.6(clone+0x5e)[0xb736aace]
      

      Three problems here:
      1. addr2line: '': No such file
      2. server frames: only mangled function name printed (no file:line)
      3. InnoDB frames: not resolved at all (InnoDB is linked in statically)

      If I remove offset subtraction it looks much better (although not perfect):

      stack_bottom = 0xefdb5280 thread_stack 0x49000
      /root/build/sql/mysqld(my_print_stacktrace+0x3b)[0x8e4381f]
      /root/build/sql/mysqld(handle_fatal_signal+0x404)[0x86acf50]
      addr2line: '': No such file
      [0xf77d6bc0]
      [0xf77d6be9]
      /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf72b11ef]
      /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf72b4835]
      /lib/i386-linux-gnu/libc.so.6(+0x27095)[0xf72aa095]
      /lib/i386-linux-gnu/libc.so.6(+0x27147)[0xf72aa147]
      /root/build/sql/mysqld[0x8a801b0]
      /root/build/sql/mysqld[0x8b420a9]
      include/rem0rec.h:651(rec_offs_get_n_alloc(unsigned int const*))[0x8ddfe9a]
      rem/rem0rec.cc:870(rec_get_offsets_func(unsigned char const*, dict_index_t const*, unsigned int*, bool, unsigned int, char const*, unsigned int, mem_block_info_t**))[0x8de00e7]
      row/row0umod.cc:167(row_trx_id_offset)[0x8de0aa9]
      row/row0umod.cc:200(row_undo_mod_must_purge)[0x8de38e0]
      row/row0umod.cc:1326(row_undo_mod(undo_node_t*, que_thr_t*))[0x8be13ce]
      row/row0undo.cc:308(row_undo)[0x8be1584]
      row/row0undo.cc:362(row_undo_step(que_thr_t*))[0x8b35d5e]
      que/que0que.cc:1044(que_thr_step)[0x8b35fb5]
      que/que0que.cc:1108(que_run_threads_low)[0x8b361cd]
      que/que0que.cc:1150(que_run_threads(que_thr_t*))[0x8c42d0c]
      trx/trx0roll.cc:149(trx_rollback_to_savepoint_low)[0x8c43147]
      trx/trx0roll.cc:195(trx_rollback_to_savepoint(trx_t*, trx_savept_t*))[0x8b8ef5c]
      row/row0mysql.cc:2602(row_create_index_for_mysql(dict_index_t*, trx_t*, unsigned int const*))[0x8a45b94]
      handler/ha_innodb.cc:12426(create_table_info_t::create_table())[0x8a46759]
      handler/ha_innodb.cc:12707(ha_innobase::create(char const*, TABLE*, HA_CREATE_INFO*))[0x86b92a3]
      sql/handler.cc:4554(handler::ha_create(char const*, TABLE*, HA_CREATE_INFO*))[0x86ba3c6]
      sql/handler.cc:4926(ha_create_table(THD*, char const*, char const*, char const*, HA_CREATE_INFO*, st_mysql_const_unsigned_lex_string*))[0x84ed3b1]
      sql/unireg.cc:514(rea_create_table(THD*, st_mysql_const_unsigned_lex_string*, char const*, char const*, char const*, HA_CREATE_INFO*, handler*, bool))[0x849467b]
      sql/sql_table.cc:4966(create_table_impl)[0x8494d00]
      sql/sql_table.cc:5082(mysql_create_table_no_lock(THD*, st_mysql_const_lex_string const*, st_mysql_const_lex_string const*, Table_specification_st*, Alter_info*, bool*, int, TABLE_LIST*))[0x8494fd6]
      sql/sql_table.cc:5153(mysql_create_table(THD*, TABLE_LIST*, Table_specification_st*, Alter_info*))[0x83cf4bc]
      sql/sql_parse.cc:4278(mysql_execute_command(THD*))[0x83dbd7b]
      sql/sql_parse.cc:8019(mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x83c884c]
      sql/sql_parse.cc:1848(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool))[0x83c72d1]
      sql/sql_parse.cc:1391(do_command(THD*))[0x851e615]
      sql/sql_connect.cc:1402(do_handle_one_connection(CONNECT*))[0x851e39b]
      sql/sql_connect.cc:1309(handle_one_connection)[0x88c78d1]
      /lib/i386-linux-gnu/libpthread.so.0(+0x6d4c)[0xf755dd4c]
      /lib/i386-linux-gnu/libc.so.6(clone+0x5e)[0xf736dace]
      

      Real trace provided by gdb:

      Program terminated with signal 6, Aborted.
      #0  0xf77d6be9 in __kernel_vsyscall ()
      #0  0xf77d6be9 in __kernel_vsyscall ()
      #1  0xf7562aa2 in pthread_kill () from /lib/i386-linux-gnu/libpthread.so.0
      #2  0x08e43902 in my_write_core (sig=6) at /root/server/mysys/stacktrace.c:481
      #3  0x086ad313 in handle_fatal_signal (sig=6) at /root/server/sql/signal_handler.cc:305
      #4  <signal handler called>
      #5  0xf77d6be9 in __kernel_vsyscall ()
      #6  0xf72b11ef in raise () from /lib/i386-linux-gnu/libc.so.6
      #7  0xf72b4835 in abort () from /lib/i386-linux-gnu/libc.so.6
      #8  0xf72aa095 in ?? () from /lib/i386-linux-gnu/libc.so.6
      #9  0xf72aa147 in __assert_fail () from /lib/i386-linux-gnu/libc.so.6
      #10 0x08a801b0 in rec_offs_get_n_alloc (offsets=0xefdb0354) at /root/server/storage/innobase/include/rem0rec.h:649
      #11 0x08b420a9 in rec_get_offsets_func (rec=0xf06a8352 "test/t1", index=0xb82fc80, offsets=0xefdb0354, leaf=true, n_fields=2, file=0x922c460 "/root/server/storage/innobase/row/row0umod.cc", line=168, heap=0xefdb03ec) at /root/server/storage/innobase/rem/rem0rec.cc:870
      #12 0x08ddfe9a in row_trx_id_offset (rec=0xf06a8352 "test/t1", index=0xb82fc80) at /root/server/storage/innobase/row/row0umod.cc:167
      #13 0x08de00e7 in row_undo_mod_must_purge (node=0xe2a81238, mtr=0xefdb0574) at /root/server/storage/innobase/row/row0umod.cc:200
      #14 0x08de0aa9 in row_undo_mod_clust (node=0xe2a81238, thr=0xe2a811d0) at /root/server/storage/innobase/row/row0umod.cc:344
      #15 0x08de38e0 in row_undo_mod (node=0xe2a81238, thr=0xe2a811d0) at /root/server/storage/innobase/row/row0umod.cc:1326
      #16 0x08be13ce in row_undo (node=0xe2a81238, thr=0xe2a811d0) at /root/server/storage/innobase/row/row0undo.cc:308
      #17 0x08be1584 in row_undo_step (thr=0xe2a811d0) at /root/server/storage/innobase/row/row0undo.cc:362
      #18 0x08b35d5e in que_thr_step (thr=0xe2a811d0) at /root/server/storage/innobase/que/que0que.cc:1044
      #19 0x08b35fb5 in que_run_threads_low (thr=0xe2a811d0) at /root/server/storage/innobase/que/que0que.cc:1108
      #20 0x08b361cd in que_run_threads (thr=0xe2a811d0) at /root/server/storage/innobase/que/que0que.cc:1148
      #21 0x08c42d0c in trx_rollback_to_savepoint_low (trx=0xf221d45c, savept=0x0) at /root/server/storage/innobase/trx/trx0roll.cc:145
      #22 0x08c43147 in trx_rollback_to_savepoint (trx=0xf221d45c, savept=0x0) at /root/server/storage/innobase/trx/trx0roll.cc:193
      #23 0x08b8ef5c in row_create_index_for_mysql (index=0x0, trx=0xf221d45c, field_lengths=0x0) at /root/server/storage/innobase/row/row0mysql.cc:2599
      #24 0x08a45b94 in create_table_info_t::create_table (this=0xefdb0e78) at /root/server/storage/innobase/handler/ha_innodb.cc:12426
      #25 0x08a46759 in ha_innobase::create (this=0xe2941488, name=0xefdb380b "./test/t1", form=0xefdb135c, create_info=0xefdb3c28) at /root/server/storage/innobase/handler/ha_innodb.cc:12707
      #26 0x086b92a3 in handler::ha_create (this=0xe2941488, name=0xefdb380b "./test/t1", form=0xefdb135c, info_arg=0xefdb3c28) at /root/server/sql/handler.cc:4554
      #27 0x086ba3c6 in ha_create_table (thd=0xe29005d0, path=0xefdb380b "./test/t1", db=0xe29120d8 "test", table_name=0xe2911c50 "t1", create_info=0xefdb3c28, frm=0xefdb37ec) at /root/server/sql/handler.cc:4926
      #28 0x084ed3b1 in rea_create_table (thd=0xe29005d0, frm=0xefdb37ec, path=0xefdb380b "./test/t1", db=0xe29120d8 "test", table_name=0xe2911c50 "t1", create_info=0xefdb3c28, file=0xe2a7d620, no_ha_create_table=false) at /root/server/sql/unireg.cc:514
      #29 0x0849467b in create_table_impl (thd=0xe29005d0, orig_db=0xe2911c84, orig_table_name=0xe2911c8c, db=0xe2911c84, table_name=0xe2911c8c, path=0xefdb380b "./test/t1", options=..., create_info=0xefdb3c28, alter_info=0xefdb3d20, create_table_mode=0, is_trans=0xefdb3a7e, key_info=0xefdb37f4, key_count=0xefdb37f8, frm=0xefdb37ec) at /root/server/sql/sql_table.cc:4967
      #30 0x08494d00 in mysql_create_table_no_lock (thd=0xe29005d0, db=0xe2911c84, table_name=0xe2911c8c, create_info=0xefdb3c28, alter_info=0xefdb3d20, is_trans=0xefdb3a7e, create_table_mode=0, table_list=0xe2911c78) at /root/server/sql/sql_table.cc:5082
      #31 0x08494fd6 in mysql_create_table (thd=0xe29005d0, create_table=0xe2911c78, create_info=0xefdb3c28, alter_info=0xefdb3d20) at /root/server/sql/sql_table.cc:5157
      #32 0x083cf4bc in mysql_execute_command (thd=0xe29005d0) at /root/server/sql/sql_parse.cc:4278
      #33 0x083dbd7b in mysql_parse (thd=0xe29005d0, rawbuf=0xe2911210 "CREATE TABLE t1 (\nc01 char(200), c02 char(200), c03 char(200), c04 char(200), c05 char(200),\nc06 char(200), c07 char(200), c08 char(200), c09 char(200), c10 char(200),\nc11 char(200), c12 char(200), c1"..., length=1266, parser_state=0xefdb4b30, is_com_multi=false, is_next_command=false) at /root/server/sql/sql_parse.cc:8019
      #34 0x083c884c in dispatch_command (command=COM_QUERY, thd=0xe29005d0, packet=0xe2907fb1 "CREATE TABLE t1 (\nc01 char(200), c02 char(200), c03 char(200), c04 char(200), c05 char(200),\nc06 char(200), c07 char(200), c08 char(200), c09 char(200), c10 char(200),\nc11 char(200), c12 char(200), c1"..., packet_length=1266, is_com_multi=false, is_next_command=false) at /root/server/sql/sql_parse.cc:1846
      #35 0x083c72d1 in do_command (thd=0xe29005d0) at /root/server/sql/sql_parse.cc:1391
      #36 0x0851e615 in do_handle_one_connection (connect=0xb9ebae0) at /root/server/sql/sql_connect.cc:1402
      #37 0x0851e39b in handle_one_connection (arg=0xb9ebae0) at /root/server/sql/sql_connect.cc:1308
      #38 0x088c78d1 in pfs_spawn_thread (arg=0xb9b08f0) at /root/server/storage/perfschema/pfs.cc:1862
      #39 0xf755dd4c in start_thread () from /lib/i386-linux-gnu/libpthread.so.0
      #40 0xf736dace in clone () from /lib/i386-linux-gnu/libc.so.6
      

      Bad traces can be reproduced locally in docker (shawn/ubuntu-precise-i386).

      Attachments

        Issue Links

          Activity

            People

              cvicentiu Vicențiu Ciorbaru
              svoj Sergey Vojtovich
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.