running mariadb-upgrade on mariadb server with other user make it hangs forever (MDEV-27068)

[MDEV-27107] prevent two mariadb-upgrade running in parallel Created: 2021-11-22  Updated: 2023-03-26  Resolved: 2022-01-24

Status: Closed
Project: MariaDB Server
Component/s: Upgrades
Affects Version/s: None
Fix Version/s: 10.7.1, 10.2.42, 10.3.33, 10.4.23, 10.5.14, 10.6.6

Type: Technical task Priority: Major
Reporter: Faustin Lammler Assignee: Michael Widenius
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Blocks
blocks MDEV-27095 Simplify spider init queries Closed
Relates
relates to MDEV-30499 mariadb in-server upgrade Open

 Description   

For suggested approaches to achieve it see https://jira.mariadb.org/browse/MDEV-27068?focusedCommentId=206528&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-206528



 Comments   
Comment by Daniel Black [ 2021-11-23 ]

Yep, was also thinking of spider MDEV-27095 taking the same explicit lock in its init to deconflict until its better sorted out.

Comment by Faustin Lammler [ 2021-12-15 ]

Here is what monty suggests:
https://jira.mariadb.org/browse/MDEV-27068?focusedCommentId=208358

Comment by Daniel Black [ 2021-12-15 ]

Advisory locks on mysql_upgrade_info - sure, easy enough.

Explicit GET_LOCK('mariadb-upgrade') around system tables (only?) would assist the MDEV-27095 implementation as it could acquire the same GET_LOCK around critical aspects (or as a stop gap mechanism).

elenst is the ColumnStore situation described in the parent task the same in that its only concurrent system table changes and altering it to do a the same GET_LOCK would be an unobtrusive cross distro compatible change for ColumnStore?

Is this a useful enough interface to define for plugin implementers?

Comment by Elena Stepanova [ 2021-12-15 ]

I cannot answer this, I didn't investigate what's exactly happening inside Columnstore that makes it clash with mysql_upgrade. I just know they do, and often.
Redirecting the question to drrtuy.

Comment by Nayuta Yanagisawa (Inactive) [ 2021-12-28 ]

ralf.gebhardt@mariadb.com julien.fritsch The issue blocks fixing the deadlock between Spider and mysql_upgrade. I hope that the issue is given a higher priority and fixed soon.

Comment by Elena Stepanova [ 2021-12-28 ]

danblack,

Below are some details of a typical installation clash (although in this case with Spider, not Columnstore). I leave it to you to decide whether the planned solution would help here.

This is a clean installation of deb packages of a 10.5-based branch on Ubuntu 18.04.

Installing a bunch of MariaDB packages

17:21:53 ++ sudo DEBIAN_FRONTEND=noninteractive timeout 1200 apt-get install -y mariadb-plugin-spider mariadb-server <etc., whatever packages were produced> 
...
< usual installation process>
...
17:22:51 Populating the engine initial system catalog.
17:22:59 Processing triggers for systemd (237-3ubuntu10.52) ...
17:22:59 Processing triggers for man-db (2.8.3-2ubuntu0.1) ...
17:23:06 Processing triggers for ureadahead (0.100.0-21) ...
17:23:06 Processing triggers for libc-bin (2.27-3ubuntu1.4) ...
17:23:07 Processing triggers for mariadb-server-10.5 (1:10.5.13.9+maria~bionic) ...
<all done, prompt returned>

Checking for mysql_upgrade to avoid clashing with it

17:23:09 root      4879  4870  0 15:22 ?        00:00:00 /usr/bin/mysql_upgrade --defaults-extra-file=/etc/mysql/debian.cnf --version-check
17:23:09 root      5025  4879  0 15:22 ?        00:00:00 sh -c '/usr/bin/mysql' --defaults-file=/tmp/mysql_upgrade-8eUSWd --database=mysql --batch --force --silent < /tmp/sqlmA1EuZ 2>&1 
17:23:09 root      5026  5025  0 15:22 ?        00:00:00 /usr/bin/mysql --defaults-file=/tmp/mysql_upgrade-8eUSWd --database=mysql --batch --force --silent

... 1.5 hours later:

19:00:00 root      4879  4870  0 15:22 ?        00:00:00 /usr/bin/mysql_upgrade --defaults-extra-file=/etc/mysql/debian.cnf --version-check
19:00:00 root      5025  4879  0 15:22 ?        00:00:00 sh -c '/usr/bin/mysql' --defaults-file=/tmp/mysql_upgrade-8eUSWd --database=mysql --batch --force --silent < /tmp/sqlmA1EuZ 2>&1 
19:00:00 root      5026  5025  0 15:22 ?        00:00:00 /usr/bin/mysql --defaults-file=/tmp/mysql_upgrade-8eUSWd --database=mysql --batch --force --silent

Process list

MariaDB [(none)]> show processlist;
+----+-------------+-----------+-------+---------+------+----------------------------------------------------+----------------------------------------------------------------------------+----------+
| Id | User        | Host      | db    | Command | Time | State                                              | Info                                                                       | Progress |
+----+-------------+-----------+-------+---------+------+----------------------------------------------------+----------------------------------------------------------------------------+----------+
|  1 | system user |           | mysql | Query   | 5107 | Waiting for table level lock                       | create function spider_ping_table returns int        soname 'ha_spider.so' |    0.000 |
|  2 | system user |           | NULL  | Daemon  | NULL | Spider table background statistics action handler  | NULL                                                                       |    0.000 |
<skipping 7 as above>
| 10 | system user |           | NULL  | Daemon  | NULL | Spider table background statistics action handler  | NULL                                                                       |    0.000 |
| 11 | system user |           | NULL  | Daemon  | NULL | Spider table background cardinality action handler | NULL                                                                       |    0.000 |
<skipping 8 as above>
| 20 | system user |           | NULL  | Daemon  | NULL | Spider table background cardinality action handler | NULL                                                                       |    0.000 |
| 31 | root        | localhost | mysql | Query   | 5107 | Waiting for table metadata lock                    | alter table func comment='User defined functions'                          |    0.000 |
| 32 | root        | localhost | NULL  | Query   |    0 | starting                                           | show processlist                                                           |    0.000 |
+----+-------------+-----------+-------+---------+------+----------------------------------------------------+----------------------------------------------------------------------------+----------+
22 rows in set (0.000 sec)

threads

[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
0x00007f42602a2cb9 in __GI___poll (fds=0x7ffd0c2fc560, nfds=2, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
 
Thread 38 (Thread 0x7f425d3d8700 (LWP 4884)):
#0  0x00007f4260eb8065 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f425d3d38f0, expected=0, futex_word=0x7f4220011514) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
#1  __pthread_cond_wait_common (abstime=0x7f425d3d38f0, mutex=0x7f42200114b8, cond=0x7f42200114e8) at pthread_cond_wait.c:539
#2  __pthread_cond_timedwait (cond=0x7f42200114e8, mutex=0x7f42200114b8, abstime=0x7f425d3d38f0) at pthread_cond_wait.c:667
#3  0x000055b76a50d972 in MDL_wait::timed_wait(MDL_context_owner*, timespec*, bool, PSI_stage_info_v1 const*) ()
#4  0x000055b76a50f4ec in MDL_context::acquire_lock(MDL_request*, double) ()
#5  0x000055b76a51000f in MDL_context::upgrade_shared_lock(MDL_ticket*, enum_mdl_type, double) ()
#6  0x000055b76a3a68b5 in wait_while_table_is_used(THD*, TABLE*, ha_extra_function) ()
#7  0x000055b76a4acb75 in mysql_alter_table(THD*, st_mysql_const_lex_string const*, st_mysql_const_lex_string const*, HA_CREATE_INFO*, TABLE_LIST*, Alter_info*, unsigned int, st_order*, bool, bool) ()
#8  0x000055b76a50a16c in Sql_cmd_alter_table::execute(THD*) ()
#9  0x000055b76a40dc04 in mysql_execute_command(THD*) ()
#10 0x000055b76a41575c in mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool) ()
#11 0x000055b76a40a065 in dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool) ()
#12 0x000055b76a40808f in do_command(THD*) ()
#13 0x000055b76a5053dc in do_handle_one_connection(CONNECT*, bool) ()
#14 0x000055b76a5057a4 in handle_one_connection ()
#15 0x000055b76a85bcda in ?? ()
#16 0x00007f4260eb16db in start_thread (arg=0x7f425d3d8700) at pthread_create.c:463
#17 0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 37 (Thread 0x7f425d423700 (LWP 4864)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76b6ad028 <COND_manager+40>) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76b6ad040 <LOCK_manager>, cond=0x55b76b6ad000 <COND_manager>) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76b6ad000 <COND_manager>, mutex=0x55b76b6ad040 <LOCK_manager>) at pthread_cond_wait.c:655
#3  0x000055b76a40650b in handle_manager ()
#4  0x000055b76a85bcda in ?? ()
#5  0x00007f4260eb16db in start_thread (arg=0x7f425d423700) at pthread_create.c:463
#6  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 36 (Thread 0x7f425d882700 (LWP 4862)):
#0  0x00007f42601ce38c in __GI___sigtimedwait (set=<optimized out>, info=0x7f425d881d30, timeout=0x0) at ../sysdeps/unix/sysv/linux/sigtimedwait.c:42
#1  0x000055b76a341e1b in signal_hand ()
#2  0x000055b76a85bcda in ?? ()
#3  0x00007f4260eb16db in start_thread (arg=0x7f425d882700) at pthread_create.c:463
#4  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 35 (Thread 0x7f41eb3e9700 (LWP 4860)):
#0  0x00007f4260eb8065 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f41eb3e8da0, expected=0, futex_word=0x7f4247e08a70) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
#1  __pthread_cond_wait_common (abstime=0x7f41eb3e8da0, mutex=0x7f4247e08a18, cond=0x7f4247e08a48) at pthread_cond_wait.c:539
#2  __pthread_cond_timedwait (cond=0x7f4247e08a48, mutex=0x7f4247e08a18, abstime=0x7f41eb3e8da0) at pthread_cond_wait.c:667
#3  0x00007f4247728ef8 in ?? () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#4  0x00007f4247733bd9 in myrocks::Rdb_manual_compaction_thread::run() () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#5  0x00007f4247786cd2 in myrocks::Rdb_thread::thread_func(void*) () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#6  0x00007f4260eb16db in start_thread (arg=0x7f41eb3e9700) at pthread_create.c:463
#7  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 34 (Thread 0x7f41e5bde700 (LWP 4859)):
#0  0x00007f4260eb8065 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f41e5bddc70, expected=0, futex_word=0x7f4247e08770) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
#1  __pthread_cond_wait_common (abstime=0x7f41e5bddc70, mutex=0x7f4247e08718, cond=0x7f4247e08748) at pthread_cond_wait.c:539
#2  __pthread_cond_timedwait (cond=0x7f4247e08748, mutex=0x7f4247e08718, abstime=0x7f41e5bddc70) at pthread_cond_wait.c:667
#3  0x00007f4247728ef8 in ?? () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#4  0x00007f424773ea3d in myrocks::Rdb_drop_index_thread::run() () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#5  0x00007f4247786cd2 in myrocks::Rdb_thread::thread_func(void*) () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#6  0x00007f4260eb16db in start_thread (arg=0x7f41e5bde700) at pthread_create.c:463
#7  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 33 (Thread 0x7f41e53dd700 (LWP 4858)):
#0  0x00007f4260eb8065 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f41e53dcd80, expected=0, futex_word=0x7f4247e08b90) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
#1  __pthread_cond_wait_common (abstime=0x7f41e53dcd80, mutex=0x7f4247e08b38, cond=0x7f4247e08b68) at pthread_cond_wait.c:539
#2  __pthread_cond_timedwait (cond=0x7f4247e08b68, mutex=0x7f4247e08b38, abstime=0x7f41e53dcd80) at pthread_cond_wait.c:667
#3  0x00007f424773fc52 in myrocks::Rdb_background_thread::run() () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#4  0x00007f4247786cd2 in myrocks::Rdb_thread::thread_func(void*) () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#5  0x00007f4260eb16db in start_thread (arg=0x7f41e53dd700) at pthread_create.c:463
#6  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 32 (Thread 0x7f41e4bdc700 (LWP 4857)):
#0  0x00007f4260eb8065 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f41e4bdbcc0, expected=0, futex_word=0x55b76d8fdc18) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
#1  __pthread_cond_wait_common (abstime=0x7f41e4bdbcc0, mutex=0x55b76d8fdba8, cond=0x55b76d8fdbf0) at pthread_cond_wait.c:539
#2  __pthread_cond_timedwait (cond=0x55b76d8fdbf0, mutex=0x55b76d8fdba8, abstime=0x7f41e4bdbcc0) at pthread_cond_wait.c:667
#3  0x00007f4247a3bfae in rocksdb::port::CondVar::TimedWait(unsigned long) () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#4  0x00007f4247910517 in rocksdb::InstrumentedCondVar::TimedWaitInternal(unsigned long) () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#5  0x00007f4247910600 in rocksdb::InstrumentedCondVar::TimedWait(unsigned long) () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#6  0x00007f42477c16c3 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<rocksdb::RepeatableThread::RepeatableThread(std::function<void ()>, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::Env*, unsigned long, unsigned long)::{lambda()#1}> > >::_M_run() () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#7  0x00007f42609da6df in ?? () from target:/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#8  0x00007f4260eb16db in start_thread (arg=0x7f41e4bdc700) at pthread_create.c:463
#9  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 31 (Thread 0x7f41e43db700 (LWP 4856)):
#0  0x00007f4260eb8065 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f41e43dacc0, expected=0, futex_word=0x55b76d4714a8) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
#1  __pthread_cond_wait_common (abstime=0x7f41e43dacc0, mutex=0x55b76d471438, cond=0x55b76d471480) at pthread_cond_wait.c:539
#2  __pthread_cond_timedwait (cond=0x55b76d471480, mutex=0x55b76d471438, abstime=0x7f41e43dacc0) at pthread_cond_wait.c:667
#3  0x00007f4247a3bfae in rocksdb::port::CondVar::TimedWait(unsigned long) () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#4  0x00007f4247910517 in rocksdb::InstrumentedCondVar::TimedWaitInternal(unsigned long) () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#5  0x00007f4247910600 in rocksdb::InstrumentedCondVar::TimedWait(unsigned long) () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#6  0x00007f42477c16c3 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<rocksdb::RepeatableThread::RepeatableThread(std::function<void ()>, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::Env*, unsigned long, unsigned long)::{lambda()#1}> > >::_M_run() () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#7  0x00007f42609da6df in ?? () from target:/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#8  0x00007f4260eb16db in start_thread (arg=0x7f41e43db700) at pthread_create.c:463
#9  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 30 (Thread 0x7f41ebbea700 (LWP 4840)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d56c360) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d56c310, cond=0x55b76d56c338) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d56c338, mutex=0x55b76d56c310) at pthread_cond_wait.c:655
#3  0x00007f42609d48bc in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from target:/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#4  0x00007f42479d5f39 in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#5  0x00007f42479d62c6 in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#6  0x00007f42609da6df in ?? () from target:/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#7  0x00007f4260eb16db in start_thread (arg=0x7f41ebbea700) at pthread_create.c:463
#8  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 29 (Thread 0x7f41ec3eb700 (LWP 4839)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d56c020) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d56bfd0, cond=0x55b76d56bff8) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d56bff8, mutex=0x55b76d56bfd0) at pthread_cond_wait.c:655
#3  0x00007f42609d48bc in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from target:/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#4  0x00007f42479d5f39 in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#5  0x00007f42479d62c6 in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#6  0x00007f42609da6df in ?? () from target:/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#7  0x00007f4260eb16db in start_thread (arg=0x7f41ec3eb700) at pthread_create.c:463
#8  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 28 (Thread 0x7f41ecbec700 (LWP 4838)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76db21b80) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76db21a78, cond=0x55b76db21b58) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76db21b58, mutex=0x55b76db21a78) at pthread_cond_wait.c:655
#3  0x00007f4247a3bf2d in rocksdb::port::CondVar::Wait() () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#4  0x00007f4247910338 in rocksdb::InstrumentedCondVar::Wait() () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#5  0x00007f42478ef498 in rocksdb::DeleteScheduler::BackgroundEmptyTrash() () from target:/usr/lib/mysql/plugin/ha_rocksdb.so
#6  0x00007f42609da6df in ?? () from target:/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#7  0x00007f4260eb16db in start_thread (arg=0x7f41ecbec700) at pthread_create.c:463
#8  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 27 (Thread 0x7f41ed3ed700 (LWP 4837)):
#0  0x00007f4260eb8065 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f41ed3ecd20, expected=0, futex_word=0x55b76bee1048) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
#1  __pthread_cond_wait_common (abstime=0x7f41ed3ecd20, mutex=0x55b76bee1060, cond=0x55b76bee1020) at pthread_cond_wait.c:539
#2  __pthread_cond_timedwait (cond=0x55b76bee1020, mutex=0x55b76bee1060, abstime=0x7f41ed3ecd20) at pthread_cond_wait.c:667
#3  0x000055b76a7eb099 in ?? ()
#4  0x000055b76a7decf0 in ?? ()
#5  0x00007f4260eb16db in start_thread (arg=0x7f41ed3ed700) at pthread_create.c:463
#6  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 26 (Thread 0x7f41edbee700 (LWP 4836)):
#0  0x00007f4260eb8065 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f41edbedd40, expected=0, futex_word=0x55b76d60fb7c) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
#1  __pthread_cond_wait_common (abstime=0x7f41edbedd40, mutex=0x55b76d46e200, cond=0x55b76d60fb50) at pthread_cond_wait.c:539
#2  __pthread_cond_timedwait (cond=0x55b76d60fb50, mutex=0x55b76d46e200, abstime=0x7f41edbedd40) at pthread_cond_wait.c:667
#3  0x000055b76aba2576 in tpool::thread_pool_generic::wait_for_tasks(std::unique_lock<std::mutex>&, tpool::worker_data*) ()
#4  0x000055b76aba2c60 in tpool::thread_pool_generic::get_task(tpool::worker_data*, tpool::task**) ()
#5  0x000055b76aba433d in tpool::thread_pool_generic::worker_main(tpool::worker_data*) ()
#6  0x00007f42609da6df in ?? () from target:/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#7  0x00007f4260eb16db in start_thread (arg=0x7f41edbee700) at pthread_create.c:463
#8  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 25 (Thread 0x7f41f97fe700 (LWP 4828)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76b629fd8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76b629f40, cond=0x55b76b629fb0) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76b629fb0, mutex=0x55b76b629f40) at pthread_cond_wait.c:655
#3  0x000055b76aad10c8 in ?? ()
#4  0x00007f4260eb16db in start_thread (arg=0x7f41f97fe700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 24 (Thread 0x7f4203fff700 (LWP 4827)):
#0  syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38
#1  0x000055b76aba5f9d in tpool::aio_linux::getevent_thread_routine(tpool::aio_linux*) ()
#2  0x00007f42609da6df in ?? () from target:/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#3  0x00007f4260eb16db in start_thread (arg=0x7f4203fff700) at pthread_create.c:463
#4  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 23 (Thread 0x7f4238ff1700 (LWP 4825)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5cec70) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5cec80, cond=0x55b76d5cec48) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5cec48, mutex=0x55b76d5cec80) at pthread_cond_wait.c:655
#3  0x00007f424708824f in spider_table_bg_crd_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f4238ff1700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 22 (Thread 0x7f42397f2700 (LWP 4824)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5ceba0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5cebb0, cond=0x55b76d5ceb78) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ceb78, mutex=0x55b76d5cebb0) at pthread_cond_wait.c:655
#3  0x00007f424708824f in spider_table_bg_crd_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f42397f2700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 21 (Thread 0x7f4239ff3700 (LWP 4823)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5cead0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5ceae0, cond=0x55b76d5ceaa8) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ceaa8, mutex=0x55b76d5ceae0) at pthread_cond_wait.c:655
#3  0x00007f424708824f in spider_table_bg_crd_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f4239ff3700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 20 (Thread 0x7f423a7f4700 (LWP 4822)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5cea00) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5cea10, cond=0x55b76d5ce9d8) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ce9d8, mutex=0x55b76d5cea10) at pthread_cond_wait.c:655
#3  0x00007f424708824f in spider_table_bg_crd_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f423a7f4700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 19 (Thread 0x7f423aff5700 (LWP 4821)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5ce930) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5ce940, cond=0x55b76d5ce908) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ce908, mutex=0x55b76d5ce940) at pthread_cond_wait.c:655
#3  0x00007f424708824f in spider_table_bg_crd_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f423aff5700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 18 (Thread 0x7f423b7f6700 (LWP 4820)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5ce860) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5ce870, cond=0x55b76d5ce838) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ce838, mutex=0x55b76d5ce870) at pthread_cond_wait.c:655
#3  0x00007f424708824f in spider_table_bg_crd_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f423b7f6700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 17 (Thread 0x7f423bff7700 (LWP 4819)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5ce790) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5ce7a0, cond=0x55b76d5ce768) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ce768, mutex=0x55b76d5ce7a0) at pthread_cond_wait.c:655
#3  0x00007f424708824f in spider_table_bg_crd_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f423bff7700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 16 (Thread 0x7f423c7f8700 (LWP 4818)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5ce6c0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5ce6d0, cond=0x55b76d5ce698) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ce698, mutex=0x55b76d5ce6d0) at pthread_cond_wait.c:655
#3  0x00007f424708824f in spider_table_bg_crd_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f423c7f8700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 15 (Thread 0x7f423cff9700 (LWP 4817)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5ce5f0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5ce600, cond=0x55b76d5ce5c8) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ce5c8, mutex=0x55b76d5ce600) at pthread_cond_wait.c:655
#3  0x00007f424708824f in spider_table_bg_crd_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f423cff9700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 14 (Thread 0x7f423d7fa700 (LWP 4816)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5ce520) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5ce530, cond=0x55b76d5ce4f8) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ce4f8, mutex=0x55b76d5ce530) at pthread_cond_wait.c:655
#3  0x00007f424708824f in spider_table_bg_crd_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f423d7fa700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 13 (Thread 0x7f423dffb700 (LWP 4815)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5ce450) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5ce460, cond=0x55b76d5ce428) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ce428, mutex=0x55b76d5ce460) at pthread_cond_wait.c:655
#3  0x00007f424708711f in spider_table_bg_sts_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f423dffb700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 12 (Thread 0x7f423e7fc700 (LWP 4814)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5ce380) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5ce390, cond=0x55b76d5ce358) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ce358, mutex=0x55b76d5ce390) at pthread_cond_wait.c:655
#3  0x00007f424708711f in spider_table_bg_sts_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f423e7fc700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 11 (Thread 0x7f423effd700 (LWP 4813)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5ce2b0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5ce2c0, cond=0x55b76d5ce288) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ce288, mutex=0x55b76d5ce2c0) at pthread_cond_wait.c:655
#3  0x00007f424708711f in spider_table_bg_sts_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f423effd700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 10 (Thread 0x7f423f7fe700 (LWP 4812)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5ce1e0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5ce1f0, cond=0x55b76d5ce1b8) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ce1b8, mutex=0x55b76d5ce1f0) at pthread_cond_wait.c:655
#3  0x00007f424708711f in spider_table_bg_sts_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f423f7fe700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 9 (Thread 0x7f423ffff700 (LWP 4811)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5ce110) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5ce120, cond=0x55b76d5ce0e8) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ce0e8, mutex=0x55b76d5ce120) at pthread_cond_wait.c:655
#3  0x00007f424708711f in spider_table_bg_sts_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f423ffff700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 8 (Thread 0x7f4244942700 (LWP 4810)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5ce040) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5ce050, cond=0x55b76d5ce018) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5ce018, mutex=0x55b76d5ce050) at pthread_cond_wait.c:655
#3  0x00007f424708711f in spider_table_bg_sts_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f4244942700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 7 (Thread 0x7f4245143700 (LWP 4809)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5cdf70) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5cdf80, cond=0x55b76d5cdf48) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5cdf48, mutex=0x55b76d5cdf80) at pthread_cond_wait.c:655
#3  0x00007f424708711f in spider_table_bg_sts_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f4245143700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 6 (Thread 0x7f4245944700 (LWP 4808)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5cdea0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5cdeb0, cond=0x55b76d5cde78) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5cde78, mutex=0x55b76d5cdeb0) at pthread_cond_wait.c:655
#3  0x00007f424708711f in spider_table_bg_sts_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f4245944700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 5 (Thread 0x7f4246145700 (LWP 4807)):
#0  0x00007f4260eb7ad3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55b76d5cddd0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
#1  __pthread_cond_wait_common (abstime=0x0, mutex=0x55b76d5cdde0, cond=0x55b76d5cdda8) at pthread_cond_wait.c:502
#2  __pthread_cond_wait (cond=0x55b76d5cdda8, mutex=0x55b76d5cdde0) at pthread_cond_wait.c:655
#3  0x00007f424708711f in spider_table_bg_sts_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#4  0x00007f4260eb16db in start_thread (arg=0x7f4246145700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 4 (Thread 0x7f4246946700 (LWP 4806)):
#0  0x00007f4260eb8065 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f4246942400, expected=0, futex_word=0x7f4240000b50) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
#1  __pthread_cond_wait_common (abstime=0x7f4246942400, mutex=0x7f422003df48, cond=0x7f4240000b28) at pthread_cond_wait.c:539
#2  __pthread_cond_timedwait (cond=0x7f4240000b28, mutex=0x7f422003df48, abstime=0x7f4246942400) at pthread_cond_wait.c:667
#3  0x000055b76ac2098f in thr_multi_lock ()
#4  0x000055b76a707a7d in mysql_lock_tables(THD*, st_mysql_lock*, unsigned int) ()
#5  0x000055b76a7085f3 in mysql_lock_tables(THD*, TABLE**, unsigned int, unsigned int) ()
#6  0x000055b76a3a9f13 in open_ltable(THD*, TABLE_LIST*, thr_lock_type, unsigned int) ()
#7  0x000055b76a4b3d06 in ?? ()
#8  0x000055b76a4b4dcd in mysql_create_function(THD*, st_udf_func*) ()
#9  0x000055b76a40ec3c in mysql_execute_command(THD*) ()
#10 0x000055b76a36e765 in sp_instr_stmt::exec_core(THD*, unsigned int*) ()
#11 0x000055b76a3762f4 in sp_lex_keeper::reset_lex_and_exec_core(THD*, unsigned int*, bool, sp_instr*) ()
#12 0x000055b76a376d9e in sp_instr_stmt::execute(THD*, unsigned int*) ()
#13 0x000055b76a371bcf in sp_head::execute(THD*, bool) ()
#14 0x000055b76a37320b in sp_head::execute_procedure(THD*, List<Item>*) ()
#15 0x000055b76a40b765 in ?? ()
#16 0x000055b76a40be36 in Sql_cmd_call::execute(THD*) ()
#17 0x000055b76a40dc04 in mysql_execute_command(THD*) ()
#18 0x000055b76a41575c in mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool) ()
#19 0x000055b76a40a065 in dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool) ()
#20 0x00007f4247087263 in spider_table_bg_sts_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
#21 0x00007f4260eb16db in start_thread (arg=0x7f4246946700) at pthread_create.c:463
#22 0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 3 (Thread 0x7f424926a700 (LWP 4805)):
#0  0x00007f4260eb8065 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f4249269760, expected=0, futex_word=0x7f4250adb3b8 <joblist::JobStep::jobstepThreadPool+856>) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
#1  __pthread_cond_wait_common (abstime=0x7f4249269760, mutex=0x7f4250adb368 <joblist::JobStep::jobstepThreadPool+776>, cond=0x7f4250adb390 <joblist::JobStep::jobstepThreadPool+816>) at pthread_cond_wait.c:539
#2  __pthread_cond_timedwait (cond=0x7f4250adb390 <joblist::JobStep::jobstepThreadPool+816>, mutex=0x7f4250adb368 <joblist::JobStep::jobstepThreadPool+776>, abstime=0x7f4249269760) at pthread_cond_wait.c:667
#3  0x00007f424b896ae6 in threadpool::ThreadPool::pruneThread() () from target:/usr/lib/x86_64-linux-gnu/libthreadpool.so
#4  0x00007f424c9c3bcd in ?? () from target:/usr/lib/x86_64-linux-gnu/libboost_thread.so.1.65.1
#5  0x00007f4260eb16db in start_thread (arg=0x7f424926a700) at pthread_create.c:463
#6  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 2 (Thread 0x7f426283d700 (LWP 4803)):
#0  0x00007f4260eb8065 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f426283cdb0, expected=0, futex_word=0x55b76bf85b0c) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
#1  __pthread_cond_wait_common (abstime=0x7f426283cdb0, mutex=0x55b76bf85b20, cond=0x55b76bf85ae0) at pthread_cond_wait.c:539
#2  __pthread_cond_timedwait (cond=0x55b76bf85ae0, mutex=0x55b76bf85b20, abstime=0x7f426283cdb0) at pthread_cond_wait.c:667
#3  0x000055b76ac224f2 in ?? ()
#4  0x00007f4260eb16db in start_thread (arg=0x7f426283d700) at pthread_create.c:463
#5  0x00007f42602af71f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
 
Thread 1 (Thread 0x7f42629b8800 (LWP 4802)):
#0  0x00007f42602a2cb9 in __GI___poll (fds=0x7ffd0c2fc560, nfds=2, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
#1  0x000055b76a34a5bf in handle_connections_sockets() ()
#2  0x000055b76a34b868 in mysqld_main(int, char**) ()
#3  0x00007f42601afbf7 in __libc_start_main (main=0x55b76a30da30 <main>, argc=1, argv=0x7ffd0c2fc998, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7ffd0c2fc988) at ../csu/libc-start.c:310
#4  0x000055b76a33faea in _start ()

Comment by Daniel Black [ 2022-01-04 ]

Thanks elenst. I did look at this backtrace and tried to find the deadlock between create function (udf) and alter table func. There are safe paths though this combination, I just haven't found the bad one yet.

Comment by Michael Widenius [ 2022-01-24 ]

Fixed in 10.2 tree.

mysql_upgrade now locks the mysql_upgrade file with my_lock() (Advisory record locking). This ensures that two mysql_upgrades cannot be run in parallel.

Generated at Thu Feb 08 09:50:23 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.