[MDEV-19665] Server hangs on client connection with concurrent setting of server audit variable - Jira

Details

Type: Bug
Status: Open (View Workflow)
Priority: Major
Resolution: Unresolved
Affects Version/s: 5.5(EOL), 10.1(EOL), 10.2(EOL), 10.3(EOL), 10.4(EOL)
Fix Version/s: 10.4(EOL)
Component/s: Plugin - Audit
Labels:
None

Description

Important: The test case is for reproducing purposes only, don't put it into the test suite, create a deterministic one!

Note: Stored procedure is not important for the test case, it is just there to allow concurrent loops in MTR (in all versions).

Note: Possibly related to ~~MDEV-19614~~. Or not.

INSTALL SONAME 'server_audit';

--delimiter $

CREATE PROCEDURE pr()

BEGIN

  LOOP

    SET GLOBAL SERVER_AUDIT_EXCL_USERS = '';

  END LOOP;

END $

--delimiter ;

--connect (pr1,localhost,root,,)

--let $con1= `SELECT CONNECTION_ID()`

--send CALL pr()

--let $run= 1000

while ($run)

    --echo # Countdown: $run connections left

    --connect(con$run,localhost,root,,)

    --disconnect con$run

    --dec $run

# Cleanup

--connection default

--eval KILL $con1

DROP PROCEDURE pr;

UNINSTALL SONAME 'server_audit';

It fails for me withing ~20 first loops, but it can vary a lot on different machines and builds.

10.3 f98bb231
Thread 9 (Thread 0x7fe3c4d5b700 (LWP 31624)):
#0 __lll_lock_wait () at ../sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135
#1 0x00007fe3cc9f0ce6 in __GI___pthread_mutex_lock (mutex=0x563dafc6a348 <LOCK_global_system_variables+40>) at ../nptl/pthread_mutex_lock.c:135
#2 0x0000563daef0927b in safe_mutex_lock (mp=0x563dafc6a320 <LOCK_global_system_variables>, my_flags=0, file=0x563daf006d30 "/data/src/10.4/sql/sql_plugin.cc", line=3012) at /data/src/10.4/mysys/thr_mutex.c:293
#3 0x0000563dae416d89 in inline_mysql_mutex_lock (that=0x563dafc6a320 <LOCK_global_system_variables>, src_file=0x563daf006d30 "/data/src/10.4/sql/sql_plugin.cc", src_line=3012) at /data/src/10.4/include/mysql/psi/mysql_thread.h:695
#4 0x0000563dae41f51d in sync_dynamic_session_variables (thd=0x7fe3a0000b00, global_lock=true) at /data/src/10.4/sql/sql_plugin.cc:3012
#5 0x0000563dae41f839 in intern_sys_var_ptr (thd=0x7fe3a0000b00, offset=104, global_lock=true) at /data/src/10.4/sql/sql_plugin.cc:3079
#6 0x0000563dae41f9a4 in mysql_sys_var_str (thd=0x7fe3a0000b00, offset=104) at /data/src/10.4/sql/sql_plugin.cc:3126
#7 0x00007fe3c4df60f0 in get_loc_info (thd=0x7fe3a0000b00) at /data/src/10.4/plugin/server_audit/server_audit.c:924
#8 0x00007fe3c4df936f in auditing (thd=0x7fe3a0000b00, event_class=0, ev=0x7fe3c4d59920) at /data/src/10.4/plugin/server_audit/server_audit.c:2021
#9 0x0000563dae56e76b in plugins_dispatch (thd=0x7fe3a0000b00, plugin=0x7fe3a0011970, arg=0x7fe3c4d598c0) at /data/src/10.4/sql/sql_audit.cc:385
#10 0x0000563dae56e847 in mysql_audit_notify (thd=0x7fe3a0000b00, event_class=0, event=0x7fe3c4d59920) at /data/src/10.4/sql/sql_audit.cc:424
#11 0x0000563dae84caef in mysql_audit_general_log (thd=0x7fe3a0000b00, time=1559322495, user=0x7fe3c4d59a00 "[root] @ localhost []", userlen=21, cmd=0x563daf002f5e "Connect", cmdlen=7, query=0x7fe3c4d59c70 "root@localhost as anonymous on test", querylen=35) at /data/src/10.4/sql/sql_audit.h:134
#12 0x0000563dae84f882 in LOGGER::general_log_write (this=0x563dafc9eda0 <logger>, thd=0x7fe3a0000b00, command=COM_CONNECT, query=0x7fe3c4d59c70 "root@localhost as anonymous on test", query_length=35) at /data/src/10.4/sql/log.cc:1391
#13 0x0000563dae84faa0 in LOGGER::general_log_print (this=0x563dafc9eda0 <logger>, thd=0x7fe3a0000b00, command=COM_CONNECT, format=0x563daefe6ba3 "%s@%s as %s on %s", args=0x7fe3c4d5a0b8) at /data/src/10.4/sql/log.cc:1423
#14 0x0000563dae85ed55 in general_log_print (thd=0x7fe3a0000b00, command=COM_CONNECT, format=0x563daefe6ba3 "%s@%s as %s on %s") at /data/src/10.4/sql/log.cc:6655
#15 0x0000563dae3550e7 in acl_authenticate (thd=0x7fe3a0000b00, com_change_user_pkt_len=0) at /data/src/10.4/sql/sql_acl.cc:13772
#16 0x0000563dae571856 in check_connection (thd=0x7fe3a0000b00) at /data/src/10.4/sql/sql_connect.cc:1080
#17 0x0000563dae5719e6 in login_connection (thd=0x7fe3a0000b00) at /data/src/10.4/sql/sql_connect.cc:1149
#18 0x0000563dae571ffe in thd_prepare_connection (thd=0x7fe3a0000b00) at /data/src/10.4/sql/sql_connect.cc:1314
#19 0x0000563dae572231 in do_handle_one_connection (connect=0x563db1d51010) at /data/src/10.4/sql/sql_connect.cc:1391
#20 0x0000563dae571fd3 in handle_one_connection (arg=0x563db1d51010) at /data/src/10.4/sql/sql_connect.cc:1306
#21 0x0000563daee9bfef in pfs_spawn_thread (arg=0x563db1e7c0a0) at /data/src/10.4/storage/perfschema/pfs.cc:1862
#22 0x00007fe3cc9ee4a4 in start_thread (arg=0x7fe3c4d5b700) at pthread_create.c:456
#23 0x00007fe3caf36d0f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97

Thread 7 (Thread 0x7fe3c4df1700 (LWP 31622)):
#0 __lll_lock_wait () at ../sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135
#1 0x00007fe3cc9f0ce6 in __GI___pthread_mutex_lock (mutex=0x7fe3c5000308 <lock_operations+40>) at ../nptl/pthread_mutex_lock.c:135
#2 0x00007fe3c4dfa5c0 in update_excl_users (thd=0x7fe3a8000b00, var=0x7fe3c4ffe1e0 <mysql_sysvar_excl_users>, var_ptr=0x7fe3c4fff340 <excl_users>, save=0x7fe3a801be10) at /data/src/10.4/plugin/server_audit/server_audit.c:2722
#3 0x0000563dae420eba in sys_var_pluginvar::global_update (this=0x7fe3b412c808, thd=0x7fe3a8000b00, var=0x7fe3a801bdf0) at /data/src/10.4/sql/sql_plugin.cc:3542
#4 0x0000563dae2f2277 in sys_var::update (this=0x7fe3b412c808, thd=0x7fe3a8000b00, var=0x7fe3a801bdf0) at /data/src/10.4/sql/set_var.cc:208
#5 0x0000563dae2f3faa in set_var::update (this=0x7fe3a801bdf0, thd=0x7fe3a8000b00) at /data/src/10.4/sql/set_var.cc:837
#6 0x0000563dae2f3c38 in sql_set_variables (thd=0x7fe3a8000b00, var_list=0x7fe3a8020ba8, free=true) at /data/src/10.4/sql/set_var.cc:740
#7 0x0000563dae4057c0 in mysql_execute_command (thd=0x7fe3a8000b00) at /data/src/10.4/sql/sql_parse.cc:5206
#8 0x0000563dae31c989 in sp_instr_stmt::exec_core (this=0x7fe3a801be40, thd=0x7fe3a8000b00, nextp=0x7fe3c4dee684) at /data/src/10.4/sql/sp_head.cc:3607
#9 0x0000563dae31bce6 in sp_lex_keeper::reset_lex_and_exec_core (this=0x7fe3a801be88, thd=0x7fe3a8000b00, nextp=0x7fe3c4dee684, open_tables=false, instr=0x7fe3a801be40) at /data/src/10.4/sql/sp_head.cc:3335
#10 0x0000563dae31c52e in sp_instr_stmt::execute (this=0x7fe3a801be40, thd=0x7fe3a8000b00, nextp=0x7fe3c4dee684) at /data/src/10.4/sql/sp_head.cc:3513
#11 0x0000563dae31614e in sp_head::execute (this=0x7fe3a801ade8, thd=0x7fe3a8000b00, merge_da_on_success=true) at /data/src/10.4/sql/sp_head.cc:1346
#12 0x0000563dae318ac5 in sp_head::execute_procedure (this=0x7fe3a801ade8, thd=0x7fe3a8000b00, args=0x7fe3a80058d8) at /data/src/10.4/sql/sp_head.cc:2288
#13 0x0000563dae3fe4e8 in do_execute_sp (thd=0x7fe3a8000b00, sp=0x7fe3a801ade8) at /data/src/10.4/sql/sql_parse.cc:3005
#14 0x0000563dae3ff0da in Sql_cmd_call::execute (this=0x7fe3a8012718, thd=0x7fe3a8000b00) at /data/src/10.4/sql/sql_parse.cc:3247
#15 0x0000563dae40a757 in mysql_execute_command (thd=0x7fe3a8000b00) at /data/src/10.4/sql/sql_parse.cc:6354
#16 0x0000563dae40fa07 in mysql_parse (thd=0x7fe3a8000b00, rawbuf=0x7fe3a8012668 "CALL pr()", length=9, parser_state=0x7fe3c4df0180, is_com_multi=false, is_next_command=false) at /data/src/10.4/sql/sql_parse.cc:8164
#17 0x0000563dae3fb0e3 in dispatch_command (command=COM_QUERY, thd=0x7fe3a8000b00, packet=0x7fe3a8008311 "CALL pr()", packet_length=9, is_com_multi=false, is_next_command=false) at /data/src/10.4/sql/sql_parse.cc:1829
#18 0x0000563dae3f98a1 in do_command (thd=0x7fe3a8000b00) at /data/src/10.4/sql/sql_parse.cc:1362
#19 0x0000563dae57226f in do_handle_one_connection (connect=0x563db1d51010) at /data/src/10.4/sql/sql_connect.cc:1403
#20 0x0000563dae571fd3 in handle_one_connection (arg=0x563db1d51010) at /data/src/10.4/sql/sql_connect.cc:1306
#21 0x0000563daee9bfef in pfs_spawn_thread (arg=0x563db1d86740) at /data/src/10.4/storage/perfschema/pfs.cc:1862
#22 0x00007fe3cc9ee4a4 in start_thread (arg=0x7fe3c4df1700) at pthread_create.c:456
#23 0x00007fe3caf36d0f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97

Attachments

Issue Links

relates to

MDEV-29557 Assertion failure or server crash in test_plugin_options upon server audit installation

Open

MDEV-22647 Assertion `!check_audit_mask(mysql_global_audit_mask, event_class_mask)'

Closed

MDEV-25248 SET GLOBAL server_audit_logging=ON deadlock due to LOCK_global_system_variables

Confirmed

Activity

Bernardo Perez added a comment - 2019-10-23 18:05

Hello,

Seems that we have hit this bug two times today. Could you please confirm that this is the case?

Signatures:

Missing separate debuginfo for /lib64/libgcc_s.so.1
Try: yum --enablerepo='debug' install /usr/lib/debug/.build-id/3f/d5f89de59e124ab1419a0bd16775b4096e84fd.debug
207 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general(sql_audit.h:194),my_message_sql(mysqld.cc:3308),my_error(my_error.c:185),net_read_raw_loop(net_serv.cc:701),net_read_packet_header(net_serv.cc:701),net_read_packet(net_serv.cc:701),my_net_read(net_serv.cc:889),do_command(sql_parse.cc:1001),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
146 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general(sql_audit.h:194),dispatch_command(sql_audit.h:194),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
67 pthread_cond_wait,inline_mysql_cond_wait(mysql_thread.h:1162),block_until_new_connection(mysql_thread.h:1162),one_thread_per_connection_end(mysql_thread.h:1162),do_handle_one_connection(sql_connect.cc:1031),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
18 __io_getevents_0_4,io_getevents_0_4,os_aio_linux_collect(os0file.cc:4970),os_aio_linux_handle(os0file.cc:4970),fil_aio_wait(fil0fil.cc:5810),io_handler_thread(srv0start.cc:495),start_thread(libpthread.so.0),clone(libc.so.6)
6 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_print(log.cc:2179),acl_authenticate(sql_acl.cc:11896),check_connection(sql_connect.cc:718),login_connection(sql_connect.cc:787),thd_prepare_connection(sql_connect.cc:949),do_handle_one_connection(sql_connect.cc:949),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
4 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_print(log.cc:2179),mysqld_stmt_close(sql_prepare.cc:2933),dispatch_command(sql_parse.cc:1371),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
3 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),mysql_parse(sql_parse.cc:6542),dispatch_command(sql_parse.cc:1414),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
3 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),log_execute_line(sql_prepare.cc:314),Prepared_statement::execute(sql_prepare.cc:314),Prepared_statement::execute_loop(sql_prepare.cc:3707),mysqld_stmt_execute(sql_prepare.cc:2716),dispatch_command(sql_parse.cc:1351),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
2 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),Prepared_statement::prepare(sql_prepare.cc:3561),mysqld_stmt_prepare(sql_prepare.cc:2319),dispatch_command(sql_parse.cc:1366),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
1 sigwait(libpthread.so.0),signal_hand(mysqld.cc:3191),start_thread(libpthread.so.0),clone(libc.so.6)
1 select(libc.so.6),os_thread_sleep(os0thread.cc:287),srv_master_sleep(srv0srv.cc:2303),srv_master_thread(srv0srv.cc:2303),start_thread(libpthread.so.0),clone(libc.so.6)
1 select(libc.so.6),os_thread_sleep(os0thread.cc:287),page_cleaner_sleep_if_needed(buf0flu.cc:2373),buf_flush_page_cleaner_thread(buf0flu.cc:2373),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_wait,os_cond_wait(os0sync.cc:214),os_event_wait_low(os0sync.cc:214),srv_purge_coordinator_suspend(srv0srv.cc:2643),srv_purge_coordinator_thread(srv0srv.cc:2643),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_wait,os_cond_wait(os0sync.cc:214),os_event_wait_low(os0sync.cc:214),buf_dump_thread(buf0dump.cc:614),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),srv_monitor_thread(srv0srv.cc:1539),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),srv_error_monitor_thread(srv0srv.cc:1772),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),lock_wait_timeout_thread(lock0wait.cc:503),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),ib_wqueue_timedwait(ut0wqueue.cc:152),fts_optimize_thread(fts0opt.cc:3048),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),dict_stats_thread(dict0stats_bg.cc:349),start_thread(libpthread.so.0),clone(libc.so.6)
1 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),update_file_rotations(server_audit.c:2583),update_file_rotations(server_audit.c:2583),sys_var_pluginvar::global_update(sql_plugin.cc:3268),update(set_var.cc:193),set_var::update(set_var.cc:193),sql_set_variables(set_var.cc:573),mysql_execute_command(sql_parse.cc:3827),mysql_parse(sql_parse.cc:6598),dispatch_command(sql_parse.cc:1414),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
1 _lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),inline_mysql_mutex_lock(mysql_thread.h:690),THD::init(mysql_thread.h:690),THD::THD(sql_class.cc:1023),handle_connections_sockets(mysqld.cc:6456),mysqld_main(mysqld.cc:5716),_libc_start_main(libc.so.6),_start
1 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),inline_mysql_mutex_lock(mysql_thread.h:690),intern_sys_var_ptr(mysql_thread.h:690),mysql_sys_var_str(mysql_thread.h:690),get_loc_info(server_audit.c:906),auditing(server_audit.c:906),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),connection_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),close_connection(mysqld.cc:2600),do_handle_one_connection(sql_connect.cc:1030),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
1 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_print(log.cc:2179),dispatch_command(sql_parse.cc:1625),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)

Thread 441 (Thread 0x2ab549626700 (LWP 23012)):
#0 0x00002ab54a867f4d in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x00002ab54a863d38 in _L_lock_975 () from /lib64/libpthread.so.0
#2 0x00002ab54a863ce1 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00002ab54d005abc in update_file_rotations (thd=<optimized out>, var=<optimized out>, var_ptr=<optimized out>, save=<optimized out>) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:2583
#4 update_file_rotations (thd=<optimized out>, var=<optimized out>, var_ptr=<optimized out>, save=<optimized out>) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:2572
#5 0x00000000007ad47f in sys_var_pluginvar::global_update (this=<optimized out>, thd=0x2acfedc42800, var=0x2ad082224200) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc:3268
#6 0x0000000000718736 in update (var=0x2ad082224200, thd=0x2acfedc42800, this=0x2ab54b46b540) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/set_var.cc:193
#7 set_var::update (this=0x2ad082224200, thd=0x2acfedc42800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/set_var.cc:670
#8 0x0000000000718ff1 in sql_set_variables (thd=thd@entry=0x2acfedc42800, var_list=var_list@entry=0x2acfedc45240) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/set_var.cc:573
#9 0x00000000007a2d24 in mysql_execute_command (thd=thd@entry=0x2acfedc42800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:3827
#10 0x00000000007a6f80 in mysql_parse (thd=thd@entry=0x2acfedc42800, rawbuf=<optimized out>, length=<optimized out>, parser_state=parser_state@entry=0x2ab549625640) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:6598
#11 0x00000000007a8741 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x2acfedc42800, packet=packet@entry=0x2acfedd11241 "SET GLOBAL server_audit_file_rotations = 9", packet_length=packet_length@entry=42) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:1414
#12 0x00000000007aa5c6 in do_command (thd=0x2acfedc42800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:1071
#13 0x000000000076dcb5 in do_handle_one_connection (thd_arg=thd_arg@entry=0x2acfedc42800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:1024
#14 0x000000000076dda9 in handle_one_connection (arg=0x2acfedc42800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:941
#15 0x00002ab54a861dc5 in start_thread () from /lib64/libpthread.so.0
#16 0x00002ab54ab6cc9d in clone () from /lib64/libc.so.6

Thread 49 (Thread 0x2ad080082700 (LWP 8709)):
#0 0x00002ab54a867f4d in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x00002ab54a863d38 in _L_lock_975 () from /lib64/libpthread.so.0
#2 0x00002ab54a863ce1 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00000000007aee42 in inline_mysql_mutex_lock (src_file=0xf0a080 "/local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc", src_line=2702, that=<optimized out>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/include/mysql/psi/mysql_thread.h:690
#4 intern_sys_var_ptr (global_lock=true, offset=<optimized out>, thd=0x2ad0061e9000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc:2702
#5 mysql_sys_var_str (thd=0x2ad0061e9000, offset=<optimized out>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc:2800
#6 0x00002ab54d008d77 in get_loc_info (thd=0x2ad0061e9000) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:906
#7 auditing (thd=0x2ad0061e9000, event_class=1, ev=0x2ad080081b60) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:1989
#8 0x0000000000747f88 in plugins_dispatch (arg=0x2ad080081b50, plugin=<optimized out>, thd=0x2ad0061e9000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:455
#9 event_class_dispatch (event=0x2ad080081b60, event_class=1, thd=0x2ad0061e9000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:491
#10 connection_class_handler(THD *, uint, typedef __va_list_tag __va_list_tag *) (thd=0x2ad0061e9000, event_subclass=<optimized out>, ap=<optimized out>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:114
#11 0x0000000000748634 in mysql_audit_notify (thd=thd@entry=0x2ad0061e9000, event_class=event_class@entry=1, event_subtype=event_subtype@entry=1) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:217
#12 0x000000000064d6a2 in close_connection (thd=0x2ad0061e9000, sql_errno=sql_errno@entry=0) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/mysqld.cc:2600
#13 0x000000000076dc0b in do_handle_one_connection (thd_arg=thd_arg@entry=0x2acff7ba7000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:1030
#14 0x000000000076dda9 in handle_one_connection (arg=0x2acff7ba7000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:941
#15 0x00002ab54a861dc5 in start_thread () from /lib64/libpthread.so.0
#16 0x00002ab54ab6cc9d in clone () from /lib64/libc.so.6

Another occurrence:

Wed Oct 23 15:11:13 UTC 2019
Missing separate debuginfo for /lib64/libgcc_s.so.1
Try: yum --enablerepo='debug' install /usr/lib/debug/.build-id/3f/d5f89de59e124ab1419a0bd16775b4096e84fd.debug
884 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general(sql_audit.h:194),my_message_sql(mysqld.cc:3308),my_error(my_error.c:185),net_read_raw_loop(net_serv.cc:701),net_read_packet_header(net_serv.cc:701),net_read_packet(net_serv.cc:701),my_net_read(net_serv.cc:889),do_command(sql_parse.cc:1001),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
443 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general(sql_audit.h:194),dispatch_command(sql_audit.h:194),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
45 pthread_cond_wait,inline_mysql_cond_wait(mysql_thread.h:1162),block_until_new_connection(mysql_thread.h:1162),one_thread_per_connection_end(mysql_thread.h:1162),do_handle_one_connection(sql_connect.cc:1031),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
18 __io_getevents_0_4,io_getevents_0_4,os_aio_linux_collect(os0file.cc:4970),os_aio_linux_handle(os0file.cc:4970),fil_aio_wait(fil0fil.cc:5810),io_handler_thread(srv0start.cc:495),start_thread(libpthread.so.0),clone(libc.so.6)
11 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),mysql_parse(sql_parse.cc:6542),dispatch_command(sql_parse.cc:1414),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
9 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_print(log.cc:2179),acl_authenticate(sql_acl.cc:11896),check_connection(sql_connect.cc:718),login_connection(sql_connect.cc:787),thd_prepare_connection(sql_connect.cc:949),do_handle_one_connection(sql_connect.cc:949),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
8 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),Prepared_statement::prepare(sql_prepare.cc:3561),mysqld_stmt_prepare(sql_prepare.cc:2319),dispatch_command(sql_parse.cc:1366),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
3 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),log_execute_line(sql_prepare.cc:314),Prepared_statement::execute(sql_prepare.cc:314),Prepared_statement::execute_loop(sql_prepare.cc:3707),mysqld_stmt_execute(sql_prepare.cc:2716),dispatch_command(sql_parse.cc:1351),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
3 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_print(log.cc:2179),mysqld_stmt_close(sql_prepare.cc:2933),dispatch_command(sql_parse.cc:1371),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
2 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_print(log.cc:2179),dispatch_command(sql_parse.cc:1625),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
1 sigwait(libpthread.so.0),signal_hand(mysqld.cc:3191),start_thread(libpthread.so.0),clone(libc.so.6)
1 select(libc.so.6),os_thread_sleep(os0thread.cc:287),srv_master_sleep(srv0srv.cc:2303),srv_master_thread(srv0srv.cc:2303),start_thread(libpthread.so.0),clone(libc.so.6)
1 select(libc.so.6),os_thread_sleep(os0thread.cc:287),page_cleaner_sleep_if_needed(buf0flu.cc:2373),buf_flush_page_cleaner_thread(buf0flu.cc:2373),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_wait,os_cond_wait(os0sync.cc:214),os_event_wait_low(os0sync.cc:214),srv_purge_coordinator_suspend(srv0srv.cc:2643),srv_purge_coordinator_thread(srv0srv.cc:2643),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_wait,os_cond_wait(os0sync.cc:214),os_event_wait_low(os0sync.cc:214),buf_dump_thread(buf0dump.cc:614),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),srv_monitor_thread(srv0srv.cc:1539),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),srv_error_monitor_thread(srv0srv.cc:1772),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),lock_wait_timeout_thread(lock0wait.cc:503),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),ib_wqueue_timedwait(ut0wqueue.cc:152),fts_optimize_thread(fts0opt.cc:3048),start_thread(libpthread.so.0),clone(libc.so.6)
1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),dict_stats_thread(dict0stats_bg.cc:349),start_thread(libpthread.so.0),clone(libc.so.6)
1 poll(libc.so.6),vio_io_wait(viosocket.c:771),vio_socket_io_wait(viosocket.c:68),vio_read(viosocket.c:123),net_read_raw_loop(net_serv.cc:665),net_read_packet_header(net_serv.cc:665),net_read_packet(net_serv.cc:665),my_net_read(net_serv.cc:889),do_command(sql_parse.cc:1001),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
1 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),update_file_rotate_size(server_audit.c:2601),update_file_rotate_size(server_audit.c:2601),sys_var_pluginvar::global_update(sql_plugin.cc:3268),update(set_var.cc:193),set_var::update(set_var.cc:193),sql_set_variables(set_var.cc:573),mysql_execute_command(sql_parse.cc:3827),mysql_parse(sql_parse.cc:6598),dispatch_command(sql_parse.cc:1414),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)
1 _lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),inline_mysql_mutex_lock(mysql_thread.h:690),THD::init(mysql_thread.h:690),THD::THD(sql_class.cc:1023),handle_connections_sockets(mysqld.cc:6456),mysqld_main(mysqld.cc:5716),_libc_start_main(libc.so.6),_start
1 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),inline_mysql_mutex_lock(mysql_thread.h:690),intern_sys_var_ptr(mysql_thread.h:690),mysql_sys_var_str(mysql_thread.h:690),get_loc_info(server_audit.c:906),auditing(server_audit.c:906),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),mysql_parse(sql_parse.cc:6542),dispatch_command(sql_parse.cc:1414),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6)

Thread 4 (Thread 0x2afc8d40f700 (LWP 9680)):
#0 0x00002ae0f1998f4d in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x00002ae0f1994d38 in _L_lock_975 () from /lib64/libpthread.so.0
#2 0x00002ae0f1994ce1 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00000000007aee42 in inline_mysql_mutex_lock (src_file=0xf0a080 "/local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc", src_line=2702, that=<optimized out>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/include/mysql/psi/mysql_thread.h:690
#4 intern_sys_var_ptr (global_lock=true, offset=<optimized out>, thd=0x2afbab481000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc:2702
#5 mysql_sys_var_str (thd=0x2afbab481000, offset=<optimized out>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc:2800
#6 0x00002afdf7a48d77 in get_loc_info (thd=0x2afbab481000) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:906
#7 auditing (thd=0x2afbab481000, event_class=0, ev=0x2afc8d40dfb0) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:1989
#8 0x00000000007483b8 in plugins_dispatch (arg=0x2afc8d40dfa0, plugin=<optimized out>, thd=0x2afbab481000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:455
#9 event_class_dispatch (event=0x2afc8d40dfb0, event_class=0, thd=0x2afbab481000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:491
#10 general_class_handler(THD *, uint, typedef __va_list_tag __va_list_tag *) (thd=0x2afbab481000, event_subtype=<optimized out>, ap=<optimized out>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:90
#11 0x0000000000748634 in mysql_audit_notify (thd=thd@entry=0x2afbab481000, event_class=event_class@entry=0, event_subtype=event_subtype@entry=0) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:217
#12 0x00000000006fd606 in mysql_audit_general_log (thd=thd@entry=0x2afbab481000, cmd=0xed3802 "Query", cmdlen=5, query_str=query_str@entry=0x2afc2ae56010 "SET NAMES utf8mb4", query_len=query_len@entry=17) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.h:123
#13 0x0000000000701fc2 in log_command (query_length=17, query_str=0x2afc2ae56010 "SET NAMES utf8mb4", command=COM_QUERY, thd=thd@entry=0x2afbab481000, this=0x150e2a0 <logger>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/log.cc:2179
#14 general_log_write (thd=thd@entry=0x2afbab481000, command=command@entry=COM_QUERY, query=0x2afc2ae56010 "SET NAMES utf8mb4", query_length=query_length@entry=17) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/log.cc:2223
#15 0x00000000007a6ff3 in mysql_parse (thd=thd@entry=0x2afbab481000, rawbuf=<optimized out>, length=<optimized out>, parser_state=parser_state@entry=0x2afc8d40e640) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:6542
#16 0x00000000007a8741 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x2afbab481000, packet=packet@entry=0x2afbb4cc7bc1 "SET NAMES utf8mb4", packet_length=packet_length@entry=17) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:1414
#17 0x00000000007aa5c6 in do_command (thd=0x2afbab481000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:1071
#18 0x000000000076dcb5 in do_handle_one_connection (thd_arg=thd_arg@entry=0x2afbed1d0000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:1024
#19 0x000000000076dda9 in handle_one_connection (arg=0x2afbed1d0000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:941
#20 0x00002ae0f1992dc5 in start_thread () from /lib64/libpthread.so.0
#21 0x00002ae0f1c9dc9d in clone () from /lib64/libc.so.6

Thread 124 (Thread 0x2afc4da40700 (LWP 4495)):
#0 0x00002ae0f1998f4d in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x00002ae0f1994d38 in _L_lock_975 () from /lib64/libpthread.so.0
#2 0x00002ae0f1994ce1 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00002afdf7a45bbc in update_file_rotate_size (thd=<optimized out>, var=<optimized out>, var_ptr=<optimized out>, save=<optimized out>) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:2601
#4 update_file_rotate_size (thd=<optimized out>, var=<optimized out>, var_ptr=<optimized out>, save=<optimized out>) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:2589
#5 0x00000000007ad47f in sys_var_pluginvar::global_update (this=<optimized out>, thd=0x2afba56f5800, var=0x2afc32777a10) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc:3268
#6 0x0000000000718736 in update (var=0x2afc32777a10, thd=0x2afba56f5800, this=0x2ae0f246b438) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/set_var.cc:193
#7 set_var::update (this=0x2afc32777a10, thd=0x2afba56f5800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/set_var.cc:670
#8 0x0000000000718ff1 in sql_set_variables (thd=thd@entry=0x2afba56f5800, var_list=var_list@entry=0x2afba56f8240) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/set_var.cc:573
#9 0x00000000007a2d24 in mysql_execute_command (thd=thd@entry=0x2afba56f5800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:3827
#10 0x00000000007a6f80 in mysql_parse (thd=thd@entry=0x2afba56f5800, rawbuf=<optimized out>, length=<optimized out>, parser_state=parser_state@entry=0x2afc4da3f640) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:6598
#11 0x00000000007a8741 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x2afba56f5800, packet=packet@entry=0x2afbc4355401 "SET GLOBAL server_audit_file_rotate_size = 1000000", packet_length=packet_length@entry=50) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:1414
#12 0x00000000007aa5c6 in do_command (thd=0x2afba56f5800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:1071
#13 0x000000000076dcb5 in do_handle_one_connection (thd_arg=thd_arg@entry=0x2afbe41bb800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:1024
#14 0x000000000076dda9 in handle_one_connection (arg=0x2afbe41bb800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:941
#15 0x00002ae0f1992dc5 in start_thread () from /lib64/libpthread.so.0
#16 0x00002ae0f1c9dc9d in clone () from /lib64/libc.so.6

Bernardo Perez added a comment - 2019-10-23 18:05 Hello, Seems that we have hit this bug two times today. Could you please confirm that this is the case? Signatures: Missing separate debuginfo for /lib64/libgcc_s.so.1 Try: yum --enablerepo=' debug ' install /usr/lib/debug/.build-id/3f/d5f89de59e124ab1419a0bd16775b4096e84fd.debug 207 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general(sql_audit.h:194),my_message_sql(mysqld.cc:3308),my_error(my_error.c:185),net_read_raw_loop(net_serv.cc:701),net_read_packet_header(net_serv.cc:701),net_read_packet(net_serv.cc:701),my_net_read(net_serv.cc:889),do_command(sql_parse.cc:1001),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 146 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general(sql_audit.h:194),dispatch_command(sql_audit.h:194),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 67 pthread_cond_wait,inline_mysql_cond_wait(mysql_thread.h:1162),block_until_new_connection(mysql_thread.h:1162),one_thread_per_connection_end(mysql_thread.h:1162),do_handle_one_connection(sql_connect.cc:1031),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 18 __io_getevents_0_4,io_getevents_0_4,os_aio_linux_collect(os0file.cc:4970),os_aio_linux_handle(os0file.cc:4970),fil_aio_wait(fil0fil.cc:5810),io_handler_thread(srv0start.cc:495),start_thread(libpthread.so.0),clone(libc.so.6) 6 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_print(log.cc:2179),acl_authenticate(sql_acl.cc:11896),check_connection(sql_connect.cc:718),login_connection(sql_connect.cc:787),thd_prepare_connection(sql_connect.cc:949),do_handle_one_connection(sql_connect.cc:949),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 4 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_print(log.cc:2179),mysqld_stmt_close(sql_prepare.cc:2933),dispatch_command(sql_parse.cc:1371),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 3 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),mysql_parse(sql_parse.cc:6542),dispatch_command(sql_parse.cc:1414),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 3 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),log_execute_line(sql_prepare.cc:314),Prepared_statement::execute(sql_prepare.cc:314),Prepared_statement::execute_loop(sql_prepare.cc:3707),mysqld_stmt_execute(sql_prepare.cc:2716),dispatch_command(sql_parse.cc:1351),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 2 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),Prepared_statement::prepare(sql_prepare.cc:3561),mysqld_stmt_prepare(sql_prepare.cc:2319),dispatch_command(sql_parse.cc:1366),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 1 sigwait(libpthread.so.0),signal_hand(mysqld.cc:3191),start_thread(libpthread.so.0),clone(libc.so.6) 1 select(libc.so.6),os_thread_sleep(os0thread.cc:287),srv_master_sleep(srv0srv.cc:2303),srv_master_thread(srv0srv.cc:2303),start_thread(libpthread.so.0),clone(libc.so.6) 1 select(libc.so.6),os_thread_sleep(os0thread.cc:287),page_cleaner_sleep_if_needed(buf0flu.cc:2373),buf_flush_page_cleaner_thread(buf0flu.cc:2373),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_wait,os_cond_wait(os0sync.cc:214),os_event_wait_low(os0sync.cc:214),srv_purge_coordinator_suspend(srv0srv.cc:2643),srv_purge_coordinator_thread(srv0srv.cc:2643),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_wait,os_cond_wait(os0sync.cc:214),os_event_wait_low(os0sync.cc:214),buf_dump_thread(buf0dump.cc:614),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),srv_monitor_thread(srv0srv.cc:1539),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),srv_error_monitor_thread(srv0srv.cc:1772),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),lock_wait_timeout_thread(lock0wait.cc:503),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),ib_wqueue_timedwait(ut0wqueue.cc:152),fts_optimize_thread(fts0opt.cc:3048),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),dict_stats_thread(dict0stats_bg.cc:349),start_thread(libpthread.so.0),clone(libc.so.6) 1 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),update_file_rotations(server_audit.c:2583),update_file_rotations(server_audit.c:2583),sys_var_pluginvar::global_update(sql_plugin.cc:3268),update(set_var.cc:193),set_var::update(set_var.cc:193),sql_set_variables(set_var.cc:573),mysql_execute_command(sql_parse.cc:3827),mysql_parse(sql_parse.cc:6598),dispatch_command(sql_parse.cc:1414),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 1 _ lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),inline_mysql_mutex_lock(mysql_thread.h:690),THD::init(mysql_thread.h:690),THD::THD(sql_class.cc:1023),handle_connections_sockets(mysqld.cc:6456),mysqld_main(mysqld.cc:5716), _libc_start_main(libc.so.6),_start 1 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),inline_mysql_mutex_lock(mysql_thread.h:690),intern_sys_var_ptr(mysql_thread.h:690),mysql_sys_var_str(mysql_thread.h:690),get_loc_info(server_audit.c:906),auditing(server_audit.c:906),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),connection_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),close_connection(mysqld.cc:2600),do_handle_one_connection(sql_connect.cc:1030),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 1 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_print(log.cc:2179),dispatch_command(sql_parse.cc:1625),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) Thread 441 (Thread 0x2ab549626700 (LWP 23012)): #0 0x00002ab54a867f4d in __lll_lock_wait () from /lib64/libpthread.so.0 #1 0x00002ab54a863d38 in _L_lock_975 () from /lib64/libpthread.so.0 #2 0x00002ab54a863ce1 in pthread_mutex_lock () from /lib64/libpthread.so.0 #3 0x00002ab54d005abc in update_file_rotations (thd=<optimized out>, var=<optimized out>, var_ptr=<optimized out>, save=<optimized out>) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:2583 #4 update_file_rotations (thd=<optimized out>, var=<optimized out>, var_ptr=<optimized out>, save=<optimized out>) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:2572 #5 0x00000000007ad47f in sys_var_pluginvar::global_update (this=<optimized out>, thd=0x2acfedc42800, var=0x2ad082224200) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc:3268 #6 0x0000000000718736 in update (var=0x2ad082224200, thd=0x2acfedc42800, this=0x2ab54b46b540) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/set_var.cc:193 #7 set_var::update (this=0x2ad082224200, thd=0x2acfedc42800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/set_var.cc:670 #8 0x0000000000718ff1 in sql_set_variables (thd=thd@entry=0x2acfedc42800, var_list=var_list@entry=0x2acfedc45240) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/set_var.cc:573 #9 0x00000000007a2d24 in mysql_execute_command (thd=thd@entry=0x2acfedc42800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:3827 #10 0x00000000007a6f80 in mysql_parse (thd=thd@entry=0x2acfedc42800, rawbuf=<optimized out>, length=<optimized out>, parser_state=parser_state@entry=0x2ab549625640) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:6598 #11 0x00000000007a8741 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x2acfedc42800, packet=packet@entry=0x2acfedd11241 "SET GLOBAL server_audit_file_rotations = 9", packet_length=packet_length@entry=42) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:1414 #12 0x00000000007aa5c6 in do_command (thd=0x2acfedc42800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:1071 #13 0x000000000076dcb5 in do_handle_one_connection (thd_arg=thd_arg@entry=0x2acfedc42800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:1024 #14 0x000000000076dda9 in handle_one_connection (arg=0x2acfedc42800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:941 #15 0x00002ab54a861dc5 in start_thread () from /lib64/libpthread.so.0 #16 0x00002ab54ab6cc9d in clone () from /lib64/libc.so.6 Thread 49 (Thread 0x2ad080082700 (LWP 8709)): #0 0x00002ab54a867f4d in __lll_lock_wait () from /lib64/libpthread.so.0 #1 0x00002ab54a863d38 in _L_lock_975 () from /lib64/libpthread.so.0 #2 0x00002ab54a863ce1 in pthread_mutex_lock () from /lib64/libpthread.so.0 #3 0x00000000007aee42 in inline_mysql_mutex_lock (src_file=0xf0a080 "/local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc", src_line=2702, that=<optimized out>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/include/mysql/psi/mysql_thread.h:690 #4 intern_sys_var_ptr (global_lock=true, offset=<optimized out>, thd=0x2ad0061e9000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc:2702 #5 mysql_sys_var_str (thd=0x2ad0061e9000, offset=<optimized out>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc:2800 #6 0x00002ab54d008d77 in get_loc_info (thd=0x2ad0061e9000) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:906 #7 auditing (thd=0x2ad0061e9000, event_class=1, ev=0x2ad080081b60) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:1989 #8 0x0000000000747f88 in plugins_dispatch (arg=0x2ad080081b50, plugin=<optimized out>, thd=0x2ad0061e9000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:455 #9 event_class_dispatch (event=0x2ad080081b60, event_class=1, thd=0x2ad0061e9000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:491 #10 connection_class_handler(THD *, uint, typedef __va_list_tag __va_list_tag *) (thd=0x2ad0061e9000, event_subclass=<optimized out>, ap=<optimized out>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:114 #11 0x0000000000748634 in mysql_audit_notify (thd=thd@entry=0x2ad0061e9000, event_class=event_class@entry=1, event_subtype=event_subtype@entry=1) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:217 #12 0x000000000064d6a2 in close_connection (thd=0x2ad0061e9000, sql_errno=sql_errno@entry=0) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/mysqld.cc:2600 #13 0x000000000076dc0b in do_handle_one_connection (thd_arg=thd_arg@entry=0x2acff7ba7000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:1030 #14 0x000000000076dda9 in handle_one_connection (arg=0x2acff7ba7000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:941 #15 0x00002ab54a861dc5 in start_thread () from /lib64/libpthread.so.0 #16 0x00002ab54ab6cc9d in clone () from /lib64/libc.so.6 Another occurrence: Wed Oct 23 15:11:13 UTC 2019 Missing separate debuginfo for /lib64/libgcc_s.so.1 Try: yum --enablerepo=' debug ' install /usr/lib/debug/.build-id/3f/d5f89de59e124ab1419a0bd16775b4096e84fd.debug 884 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general(sql_audit.h:194),my_message_sql(mysqld.cc:3308),my_error(my_error.c:185),net_read_raw_loop(net_serv.cc:701),net_read_packet_header(net_serv.cc:701),net_read_packet(net_serv.cc:701),my_net_read(net_serv.cc:889),do_command(sql_parse.cc:1001),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 443 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general(sql_audit.h:194),dispatch_command(sql_audit.h:194),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 45 pthread_cond_wait,inline_mysql_cond_wait(mysql_thread.h:1162),block_until_new_connection(mysql_thread.h:1162),one_thread_per_connection_end(mysql_thread.h:1162),do_handle_one_connection(sql_connect.cc:1031),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 18 __io_getevents_0_4,io_getevents_0_4,os_aio_linux_collect(os0file.cc:4970),os_aio_linux_handle(os0file.cc:4970),fil_aio_wait(fil0fil.cc:5810),io_handler_thread(srv0start.cc:495),start_thread(libpthread.so.0),clone(libc.so.6) 11 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),mysql_parse(sql_parse.cc:6542),dispatch_command(sql_parse.cc:1414),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 9 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_print(log.cc:2179),acl_authenticate(sql_acl.cc:11896),check_connection(sql_connect.cc:718),login_connection(sql_connect.cc:787),thd_prepare_connection(sql_connect.cc:949),do_handle_one_connection(sql_connect.cc:949),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 8 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),Prepared_statement::prepare(sql_prepare.cc:3561),mysqld_stmt_prepare(sql_prepare.cc:2319),dispatch_command(sql_parse.cc:1366),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 3 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),log_execute_line(sql_prepare.cc:314),Prepared_statement::execute(sql_prepare.cc:314),Prepared_statement::execute_loop(sql_prepare.cc:3707),mysqld_stmt_execute(sql_prepare.cc:2716),dispatch_command(sql_parse.cc:1351),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 3 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_print(log.cc:2179),mysqld_stmt_close(sql_prepare.cc:2933),dispatch_command(sql_parse.cc:1371),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 2 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),auditing(server_audit.c:1962),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_print(log.cc:2179),dispatch_command(sql_parse.cc:1625),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 1 sigwait(libpthread.so.0),signal_hand(mysqld.cc:3191),start_thread(libpthread.so.0),clone(libc.so.6) 1 select(libc.so.6),os_thread_sleep(os0thread.cc:287),srv_master_sleep(srv0srv.cc:2303),srv_master_thread(srv0srv.cc:2303),start_thread(libpthread.so.0),clone(libc.so.6) 1 select(libc.so.6),os_thread_sleep(os0thread.cc:287),page_cleaner_sleep_if_needed(buf0flu.cc:2373),buf_flush_page_cleaner_thread(buf0flu.cc:2373),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_wait,os_cond_wait(os0sync.cc:214),os_event_wait_low(os0sync.cc:214),srv_purge_coordinator_suspend(srv0srv.cc:2643),srv_purge_coordinator_thread(srv0srv.cc:2643),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_wait,os_cond_wait(os0sync.cc:214),os_event_wait_low(os0sync.cc:214),buf_dump_thread(buf0dump.cc:614),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),srv_monitor_thread(srv0srv.cc:1539),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),srv_error_monitor_thread(srv0srv.cc:1772),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),lock_wait_timeout_thread(lock0wait.cc:503),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),ib_wqueue_timedwait(ut0wqueue.cc:152),fts_optimize_thread(fts0opt.cc:3048),start_thread(libpthread.so.0),clone(libc.so.6) 1 pthread_cond_timedwait,os_cond_wait_timed(os0sync.cc:177),os_event_wait_time_low(os0sync.cc:177),dict_stats_thread(dict0stats_bg.cc:349),start_thread(libpthread.so.0),clone(libc.so.6) 1 poll(libc.so.6),vio_io_wait(viosocket.c:771),vio_socket_io_wait(viosocket.c:68),vio_read(viosocket.c:123),net_read_raw_loop(net_serv.cc:665),net_read_packet_header(net_serv.cc:665),net_read_packet(net_serv.cc:665),my_net_read(net_serv.cc:889),do_command(sql_parse.cc:1001),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 1 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),update_file_rotate_size(server_audit.c:2601),update_file_rotate_size(server_audit.c:2601),sys_var_pluginvar::global_update(sql_plugin.cc:3268),update(set_var.cc:193),set_var::update(set_var.cc:193),sql_set_variables(set_var.cc:573),mysql_execute_command(sql_parse.cc:3827),mysql_parse(sql_parse.cc:6598),dispatch_command(sql_parse.cc:1414),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) 1 _ lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),inline_mysql_mutex_lock(mysql_thread.h:690),THD::init(mysql_thread.h:690),THD::THD(sql_class.cc:1023),handle_connections_sockets(mysqld.cc:6456),mysqld_main(mysqld.cc:5716), _libc_start_main(libc.so.6),_start 1 __lll_lock_wait(libpthread.so.0),_L_lock_975(libpthread.so.0),pthread_mutex_lock(libpthread.so.0),inline_mysql_mutex_lock(mysql_thread.h:690),intern_sys_var_ptr(mysql_thread.h:690),mysql_sys_var_str(mysql_thread.h:690),get_loc_info(server_audit.c:906),auditing(server_audit.c:906),plugins_dispatch(sql_audit.cc:455),event_class_dispatch(sql_audit.cc:455),general_class_handler(THD(sql_audit.cc:455),mysql_audit_notify(sql_audit.cc:217),mysql_audit_general_log(sql_audit.h:123),log_command(log.cc:2179),general_log_write(log.cc:2179),mysql_parse(sql_parse.cc:6542),dispatch_command(sql_parse.cc:1414),do_command(sql_parse.cc:1071),do_handle_one_connection(sql_connect.cc:1024),handle_one_connection(sql_connect.cc:941),start_thread(libpthread.so.0),clone(libc.so.6) Thread 4 (Thread 0x2afc8d40f700 (LWP 9680)): #0 0x00002ae0f1998f4d in __lll_lock_wait () from /lib64/libpthread.so.0 #1 0x00002ae0f1994d38 in _L_lock_975 () from /lib64/libpthread.so.0 #2 0x00002ae0f1994ce1 in pthread_mutex_lock () from /lib64/libpthread.so.0 #3 0x00000000007aee42 in inline_mysql_mutex_lock (src_file=0xf0a080 "/local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc", src_line=2702, that=<optimized out>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/include/mysql/psi/mysql_thread.h:690 #4 intern_sys_var_ptr (global_lock=true, offset=<optimized out>, thd=0x2afbab481000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc:2702 #5 mysql_sys_var_str (thd=0x2afbab481000, offset=<optimized out>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc:2800 #6 0x00002afdf7a48d77 in get_loc_info (thd=0x2afbab481000) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:906 #7 auditing (thd=0x2afbab481000, event_class=0, ev=0x2afc8d40dfb0) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:1989 #8 0x00000000007483b8 in plugins_dispatch (arg=0x2afc8d40dfa0, plugin=<optimized out>, thd=0x2afbab481000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:455 #9 event_class_dispatch (event=0x2afc8d40dfb0, event_class=0, thd=0x2afbab481000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:491 #10 general_class_handler(THD *, uint, typedef __va_list_tag __va_list_tag *) (thd=0x2afbab481000, event_subtype=<optimized out>, ap=<optimized out>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:90 #11 0x0000000000748634 in mysql_audit_notify (thd=thd@entry=0x2afbab481000, event_class=event_class@entry=0, event_subtype=event_subtype@entry=0) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.cc:217 #12 0x00000000006fd606 in mysql_audit_general_log (thd=thd@entry=0x2afbab481000, cmd=0xed3802 "Query", cmdlen=5, query_str=query_str@entry=0x2afc2ae56010 "SET NAMES utf8mb4", query_len=query_len@entry=17) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_audit.h:123 #13 0x0000000000701fc2 in log_command (query_length=17, query_str=0x2afc2ae56010 "SET NAMES utf8mb4", command=COM_QUERY, thd=thd@entry=0x2afbab481000, this=0x150e2a0 <logger>) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/log.cc:2179 #14 general_log_write (thd=thd@entry=0x2afbab481000, command=command@entry=COM_QUERY, query=0x2afc2ae56010 "SET NAMES utf8mb4", query_length=query_length@entry=17) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/log.cc:2223 #15 0x00000000007a6ff3 in mysql_parse (thd=thd@entry=0x2afbab481000, rawbuf=<optimized out>, length=<optimized out>, parser_state=parser_state@entry=0x2afc8d40e640) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:6542 #16 0x00000000007a8741 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x2afbab481000, packet=packet@entry=0x2afbb4cc7bc1 "SET NAMES utf8mb4", packet_length=packet_length@entry=17) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:1414 #17 0x00000000007aa5c6 in do_command (thd=0x2afbab481000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:1071 #18 0x000000000076dcb5 in do_handle_one_connection (thd_arg=thd_arg@entry=0x2afbed1d0000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:1024 #19 0x000000000076dda9 in handle_one_connection (arg=0x2afbed1d0000) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:941 #20 0x00002ae0f1992dc5 in start_thread () from /lib64/libpthread.so.0 #21 0x00002ae0f1c9dc9d in clone () from /lib64/libc.so.6 Thread 124 (Thread 0x2afc4da40700 (LWP 4495)): #0 0x00002ae0f1998f4d in __lll_lock_wait () from /lib64/libpthread.so.0 #1 0x00002ae0f1994d38 in _L_lock_975 () from /lib64/libpthread.so.0 #2 0x00002ae0f1994ce1 in pthread_mutex_lock () from /lib64/libpthread.so.0 #3 0x00002afdf7a45bbc in update_file_rotate_size (thd=<optimized out>, var=<optimized out>, var_ptr=<optimized out>, save=<optimized out>) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:2601 #4 update_file_rotate_size (thd=<optimized out>, var=<optimized out>, var_ptr=<optimized out>, save=<optimized out>) at /home/buildbot/buildbot/build/plugin/server_audit/server_audit.c:2589 #5 0x00000000007ad47f in sys_var_pluginvar::global_update (this=<optimized out>, thd=0x2afba56f5800, var=0x2afc32777a10) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_plugin.cc:3268 #6 0x0000000000718736 in update (var=0x2afc32777a10, thd=0x2afba56f5800, this=0x2ae0f246b438) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/set_var.cc:193 #7 set_var::update (this=0x2afc32777a10, thd=0x2afba56f5800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/set_var.cc:670 #8 0x0000000000718ff1 in sql_set_variables (thd=thd@entry=0x2afba56f5800, var_list=var_list@entry=0x2afba56f8240) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/set_var.cc:573 #9 0x00000000007a2d24 in mysql_execute_command (thd=thd@entry=0x2afba56f5800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:3827 #10 0x00000000007a6f80 in mysql_parse (thd=thd@entry=0x2afba56f5800, rawbuf=<optimized out>, length=<optimized out>, parser_state=parser_state@entry=0x2afc4da3f640) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:6598 #11 0x00000000007a8741 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x2afba56f5800, packet=packet@entry=0x2afbc4355401 "SET GLOBAL server_audit_file_rotate_size = 1000000", packet_length=packet_length@entry=50) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:1414 #12 0x00000000007aa5c6 in do_command (thd=0x2afba56f5800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_parse.cc:1071 #13 0x000000000076dcb5 in do_handle_one_connection (thd_arg=thd_arg@entry=0x2afbe41bb800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:1024 #14 0x000000000076dda9 in handle_one_connection (arg=0x2afbe41bb800) at /local/p4clients/pkgbuild-FdIZH/workspace/src/mysql/sql/sql_connect.cc:941 #15 0x00002ae0f1992dc5 in start_thread () from /lib64/libpthread.so.0 #16 0x00002ae0f1c9dc9d in clone () from /lib64/libc.so.6

People

Assignee:: Dmitry Shulga

Reporter:: Elena Stepanova

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 2019-05-31 17:15

Updated:: 2023-04-27 14:19

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.

MariaDB Server