Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-20179

Server hangs on shutdown during installation of Spider

Details

    Description

      Note: On certain platforms, e.g. Ubuntu Bionic, it currently happens upon almost every package installation test. Example: http://buildbot.askmonty.org/buildbot/builders/kvm-deb-bionic-amd64/builds/2432

      Last words in the log:

      2019-07-06 12:10:57 0 [Note] /usr/sbin/mysqld (initiated by: unknown): Normal shutdown
      2019-07-06 12:10:57 0 [Note] Event Scheduler: Purging the queue. 0 events
      2019-07-06 12:10:57 0 [Note] InnoDB: FTS optimize thread exiting.
      2019-07-06 12:11:17 0 [Warning] /usr/sbin/mysqld: Thread 49 (user : '') did not exit
      

      Example of stack trace:

      10.4 17794fb9

      Thread 23 (Thread 0x7f9d43fff700 (LWP 5438)):
      #0  0x00007f9db5b349f3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7f9d45768a40) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
      #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x7f9d45768a50, cond=0x7f9d45768a18) at pthread_cond_wait.c:502
      #2  __pthread_cond_wait (cond=0x7f9d45768a18, mutex=0x7f9d45768a50) at pthread_cond_wait.c:655
      #3  0x00007f9d80162fef in spider_table_bg_sts_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
      #4  0x00007f9db5b2e6db in start_thread (arg=0x7f9d43fff700) at pthread_create.c:463
      #5  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 22 (Thread 0x7f9db0df0700 (LWP 880)):
      #0  0x00007f9db4e4b26c in __GI___sigtimedwait (set=<optimized out>, set@entry=0x7f9db0defd20, info=info@entry=0x7f9db0defda0, timeout=timeout@entry=0x0) at ../sysdeps/unix/sysv/linux/sigtimedwait.c:42
      #1  0x00007f9db4e4b2e7 in __GI___sigwaitinfo (set=set@entry=0x7f9db0defd20, info=info@entry=0x7f9db0defda0) at ../sysdeps/unix/sysv/linux/sigwaitinfo.c:25
      #2  0x0000557321589a0b in my_sigwait (code=<synthetic pointer>, sig=0x7f9db0defd18, set=0x7f9db0defd20) at ./include/my_pthread.h:198
      #3  signal_hand (arg=<optimized out>) at ./sql/mysqld.cc:3249
      #4  0x00007f9db5b2e6db in start_thread (arg=0x7f9db0df0700) at pthread_create.c:463
      #5  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 21 (Thread 0x7f9d677fe700 (LWP 863)):
      #0  0x00007f9db5b349f3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x557323fe8eb0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
      #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x557323fe8e60, cond=0x557323fe8e88) at pthread_cond_wait.c:502
      #2  __pthread_cond_wait (cond=cond@entry=0x557323fe8e88, mutex=mutex@entry=0x557323fe8e60) at pthread_cond_wait.c:655
      #3  0x0000557321a7be50 in os_event::wait (this=0x557323fe8e50) at ./storage/innobase/os/os0event.cc:159
      #4  os_event::wait_low (reset_sig_count=1, this=0x557323fe8e50) at ./storage/innobase/os/os0event.cc:326
      #5  os_event_wait_low (event=0x557323fe8e50, reset_sig_count=reset_sig_count@entry=0) at ./storage/innobase/os/os0event.cc:515
      #6  0x0000557321b960e2 in buf_resize_thread () at ./storage/innobase/buf/buf0buf.cc:3207
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d677fe700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 20 (Thread 0x7f9d67fff700 (LWP 862)):
      #0  0x00007f9db5b38c60 in __GI___nanosleep (requested_time=requested_time@entry=0x7f9d67ffe730, remaining=remaining@entry=0x0) at ../sysdeps/unix/sysv/linux/nanosleep.c:28
      #1  0x0000557321a7c0a0 in os_thread_sleep (tm=tm@entry=1000000) at ./storage/innobase/os/os0thread.cc:225
      #2  0x0000557321b8774a in btr_defragment_thread () at ./storage/innobase/btr/btr0defragment.cc:719
      #3  0x00007f9db5b2e6db in start_thread (arg=0x7f9d67fff700) at pthread_create.c:463
      #4  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 19 (Thread 0x7f9d80ff9700 (LWP 861)):
      #0  0x00007f9db5b349f3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x557323fe8dd0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
      #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x557323fe8d80, cond=0x557323fe8da8) at pthread_cond_wait.c:502
      #2  __pthread_cond_wait (cond=cond@entry=0x557323fe8da8, mutex=mutex@entry=0x557323fe8d80) at pthread_cond_wait.c:655
      #3  0x0000557321a7be50 in os_event::wait (this=0x557323fe8d70) at ./storage/innobase/os/os0event.cc:159
      #4  os_event::wait_low (reset_sig_count=1, this=0x557323fe8d70) at ./storage/innobase/os/os0event.cc:326
      #5  os_event_wait_low (event=0x557323fe8d70, reset_sig_count=reset_sig_count@entry=0) at ./storage/innobase/os/os0event.cc:515
      #6  0x0000557321b9d5cc in buf_dump_thread () at ./storage/innobase/buf/buf0dump.cc:833
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d80ff9700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      ---Type <return> to continue, or q <return> to quit---
      Thread 18 (Thread 0x7f9d8a7f8700 (LWP 835)):
      #0  0x00007f9db5b38c60 in __GI___nanosleep (requested_time=requested_time@entry=0x7f9d8a7f7d60, remaining=remaining@entry=0x0) at ../sysdeps/unix/sysv/linux/nanosleep.c:28
      #1  0x0000557321a7c0a0 in os_thread_sleep (tm=tm@entry=1000000) at ./storage/innobase/os/os0thread.cc:225
      #2  0x0000557321b075b8 in srv_master_sleep () at ./storage/innobase/srv/srv0srv.cc:2334
      #3  srv_master_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0srv.cc:2375
      #4  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8a7f8700) at pthread_create.c:463
      #5  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 17 (Thread 0x7f9d88ff5700 (LWP 773)):
      #0  0x00007f9db5b34f85 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f9d88ff4d40, expected=0, futex_word=0x557323fe8d60) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
      #1  __pthread_cond_wait_common (abstime=0x7f9d88ff4d40, mutex=0x557323fe8d10, cond=0x557323fe8d38) at pthread_cond_wait.c:539
      #2  __pthread_cond_timedwait (cond=cond@entry=0x557323fe8d38, mutex=mutex@entry=0x557323fe8d10, abstime=abstime@entry=0x7f9d88ff4d40) at pthread_cond_wait.c:667
      #3  0x0000557321a7b672 in os_event::timed_wait (this=this@entry=0x557323fe8d00, abstime=abstime@entry=0x7f9d88ff4d40) at ./storage/innobase/os/os0event.cc:276
      #4  0x0000557321a7bd01 in os_event::wait_time_low (reset_sig_count=1, time_in_usec=5000000, this=0x557323fe8d00) at ./storage/innobase/os/os0event.cc:398
      #5  os_event_wait_time_low (event=0x557323fe8d00, time_in_usec=time_in_usec@entry=5000000, reset_sig_count=<optimized out>) at ./storage/innobase/os/os0event.cc:498
      #6  0x0000557321b0aeaf in srv_monitor_thread () at ./storage/innobase/srv/srv0srv.cc:1681
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d88ff5700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 16 (Thread 0x7f9d897f6700 (LWP 772)):
      #0  0x00007f9db5b34f85 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f9d897f5c40, expected=0, futex_word=0x557323fe8cf0) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
      #1  __pthread_cond_wait_common (abstime=0x7f9d897f5c40, mutex=0x557323fe8ca0, cond=0x557323fe8cc8) at pthread_cond_wait.c:539
      #2  __pthread_cond_timedwait (cond=cond@entry=0x557323fe8cc8, mutex=mutex@entry=0x557323fe8ca0, abstime=abstime@entry=0x7f9d897f5c40) at pthread_cond_wait.c:667
      #3  0x0000557321a7b672 in os_event::timed_wait (this=this@entry=0x557323fe8c90, abstime=abstime@entry=0x7f9d897f5c40) at ./storage/innobase/os/os0event.cc:276
      #4  0x0000557321a7bd01 in os_event::wait_time_low (reset_sig_count=1, time_in_usec=1000000, this=0x557323fe8c90) at ./storage/innobase/os/os0event.cc:398
      #5  os_event_wait_time_low (event=0x557323fe8c90, time_in_usec=time_in_usec@entry=1000000, reset_sig_count=<optimized out>) at ./storage/innobase/os/os0event.cc:498
      #6  0x0000557321b0657f in srv_error_monitor_thread () at ./storage/innobase/srv/srv0srv.cc:1845
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d897f6700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 15 (Thread 0x7f9d89ff7700 (LWP 771)):
      #0  0x00007f9db5b34f85 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f9d89ff6ce0, expected=0, futex_word=0x55732464d360) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
      #1  __pthread_cond_wait_common (abstime=0x7f9d89ff6ce0, mutex=0x55732464d310, cond=0x55732464d338) at pthread_cond_wait.c:539
      #2  __pthread_cond_timedwait (cond=cond@entry=0x55732464d338, mutex=mutex@entry=0x55732464d310, abstime=abstime@entry=0x7f9d89ff6ce0) at pthread_cond_wait.c:667
      #3  0x0000557321a7b672 in os_event::timed_wait (this=this@entry=0x55732464d300, abstime=abstime@entry=0x7f9d89ff6ce0) at ./storage/innobase/os/os0event.cc:276
      #4  0x0000557321a7bd01 in os_event::wait_time_low (reset_sig_count=1, time_in_usec=1000000, this=0x55732464d300) at ./storage/innobase/os/os0event.cc:398
      #5  os_event_wait_time_low (event=event@entry=0x55732464d300, time_in_usec=time_in_usec@entry=1000000, reset_sig_count=<optimized out>) at ./storage/innobase/os/os0event.cc:498
      #6  0x0000557321a52829 in lock_wait_timeout_thread () at ./storage/innobase/lock/lock0wait.cc:543
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d89ff7700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 14 (Thread 0x7f9d8aff9700 (LWP 737)):
      #0  0x00007f9db5b34f85 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f9d8aff8b70, expected=0, futex_word=0x557323fe8e44) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
      #1  __pthread_cond_wait_common (abstime=0x7f9d8aff8b70, mutex=0x557323fe8df0, cond=0x557323fe8e18) at pthread_cond_wait.c:539
      #2  __pthread_cond_timedwait (cond=cond@entry=0x557323fe8e18, mutex=mutex@entry=0x557323fe8df0, abstime=abstime@entry=0x7f9d8aff8b70) at pthread_cond_wait.c:667
      #3  0x0000557321a7b672 in os_event::timed_wait (this=this@entry=0x557323fe8de0, abstime=abstime@entry=0x7f9d8aff8b70) at ./storage/innobase/os/os0event.cc:276
      ---Type <return> to continue, or q <return> to quit---
      #4  0x0000557321a7bd01 in os_event::wait_time_low (reset_sig_count=2, time_in_usec=1000000, this=0x557323fe8de0) at ./storage/innobase/os/os0event.cc:398
      #5  os_event_wait_time_low (event=0x557323fe8de0, time_in_usec=time_in_usec@entry=1000000, reset_sig_count=reset_sig_count@entry=2) at ./storage/innobase/os/os0event.cc:498
      #6  0x0000557321ba7cd4 in pc_sleep_if_needed (cur_time=1564075984100, sig_count=2, next_loop_time=1564075985100) at ./storage/innobase/buf/buf0flu.cc:2641
      #7  buf_flush_page_cleaner_coordinator () at ./storage/innobase/buf/buf0flu.cc:3099
      #8  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8aff9700) at pthread_create.c:463
      #9  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 13 (Thread 0x7f9d8b7fa700 (LWP 736)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d8b7f9bf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d8b7f9bf0, m1=m1@entry=0x7f9d8b7f9c80, m2=m2@entry=0x7f9d8b7f9c88, request=request@entry=0x7f9d8b7f9c90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d8b7f9c90, m2=0x7f9d8b7f9c88, m1=0x7f9d8b7f9c80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=9, m1=m1@entry=0x7f9d8b7f9c80, m2=m2@entry=0x7f9d8b7f9c88, request=request@entry=0x7f9d8b7f9c90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=9) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8b7fa700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 12 (Thread 0x7f9d8bffb700 (LWP 735)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d8bffabf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d8bffabf0, m1=m1@entry=0x7f9d8bffac80, m2=m2@entry=0x7f9d8bffac88, request=request@entry=0x7f9d8bffac90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d8bffac90, m2=0x7f9d8bffac88, m1=0x7f9d8bffac80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=8, m1=m1@entry=0x7f9d8bffac80, m2=m2@entry=0x7f9d8bffac88, request=request@entry=0x7f9d8bffac90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=8) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8bffb700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 11 (Thread 0x7f9d8c7fc700 (LWP 734)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d8c7fbbf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d8c7fbbf0, m1=m1@entry=0x7f9d8c7fbc80, m2=m2@entry=0x7f9d8c7fbc88, request=request@entry=0x7f9d8c7fbc90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d8c7fbc90, m2=0x7f9d8c7fbc88, m1=0x7f9d8c7fbc80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=7, m1=m1@entry=0x7f9d8c7fbc80, m2=m2@entry=0x7f9d8c7fbc88, request=request@entry=0x7f9d8c7fbc90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=7) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8c7fc700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 10 (Thread 0x7f9d8cffd700 (LWP 733)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d8cffcbf0) at ./storage/innobase/os/os0file.cc:1809
      ---Type <return> to continue, or q <return> to quit---
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d8cffcbf0, m1=m1@entry=0x7f9d8cffcc80, m2=m2@entry=0x7f9d8cffcc88, request=request@entry=0x7f9d8cffcc90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d8cffcc90, m2=0x7f9d8cffcc88, m1=0x7f9d8cffcc80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=6, m1=m1@entry=0x7f9d8cffcc80, m2=m2@entry=0x7f9d8cffcc88, request=request@entry=0x7f9d8cffcc90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=6) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8cffd700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 9 (Thread 0x7f9d8d7fe700 (LWP 732)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d8d7fdbf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d8d7fdbf0, m1=m1@entry=0x7f9d8d7fdc80, m2=m2@entry=0x7f9d8d7fdc88, request=request@entry=0x7f9d8d7fdc90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d8d7fdc90, m2=0x7f9d8d7fdc88, m1=0x7f9d8d7fdc80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=5, m1=m1@entry=0x7f9d8d7fdc80, m2=m2@entry=0x7f9d8d7fdc88, request=request@entry=0x7f9d8d7fdc90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=5) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8d7fe700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 8 (Thread 0x7f9d8dfff700 (LWP 731)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d8dffebf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d8dffebf0, m1=m1@entry=0x7f9d8dffec80, m2=m2@entry=0x7f9d8dffec88, request=request@entry=0x7f9d8dffec90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d8dffec90, m2=0x7f9d8dffec88, m1=0x7f9d8dffec80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=4, m1=m1@entry=0x7f9d8dffec80, m2=m2@entry=0x7f9d8dffec88, request=request@entry=0x7f9d8dffec90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=4) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8dfff700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 7 (Thread 0x7f9d9cca1700 (LWP 730)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d9cca0bf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d9cca0bf0, m1=m1@entry=0x7f9d9cca0c80, m2=m2@entry=0x7f9d9cca0c88, request=request@entry=0x7f9d9cca0c90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d9cca0c90, m2=0x7f9d9cca0c88, m1=0x7f9d9cca0c80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=3, m1=m1@entry=0x7f9d9cca0c80, m2=m2@entry=0x7f9d9cca0c88, request=request@entry=0x7f9d9cca0c90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=3) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d9cca1700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 6 (Thread 0x7f9d9d4a2700 (LWP 729)):
      ---Type <return> to continue, or q <return> to quit---
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d9d4a1bf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d9d4a1bf0, m1=m1@entry=0x7f9d9d4a1c80, m2=m2@entry=0x7f9d9d4a1c88, request=request@entry=0x7f9d9d4a1c90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d9d4a1c90, m2=0x7f9d9d4a1c88, m1=0x7f9d9d4a1c80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=2, m1=m1@entry=0x7f9d9d4a1c80, m2=m2@entry=0x7f9d9d4a1c88, request=request@entry=0x7f9d9d4a1c90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=2) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d9d4a2700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 5 (Thread 0x7f9d9dca3700 (LWP 728)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d9dca2bf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d9dca2bf0, m1=m1@entry=0x7f9d9dca2c80, m2=m2@entry=0x7f9d9dca2c88, request=request@entry=0x7f9d9dca2c90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d9dca2c90, m2=0x7f9d9dca2c88, m1=0x7f9d9dca2c80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=1, m1=m1@entry=0x7f9d9dca2c80, m2=m2@entry=0x7f9d9dca2c88, request=request@entry=0x7f9d9dca2c90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=1) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d9dca3700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 4 (Thread 0x7f9db0be5700 (LWP 727)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9db0be4bf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9db0be4bf0, m1=m1@entry=0x7f9db0be4c80, m2=m2@entry=0x7f9db0be4c88, request=request@entry=0x7f9db0be4c90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9db0be4c90, m2=0x7f9db0be4c88, m1=0x7f9db0be4c80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=0, m1=m1@entry=0x7f9db0be4c80, m2=m2@entry=0x7f9db0be4c88, request=request@entry=0x7f9db0be4c90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=0) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9db0be5700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 3 (Thread 0x7f9db1c04700 (LWP 704)):
      #0  0x00007f9db5b34f85 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f9db1c03d60, expected=0, futex_word=0x5573230348a8 <COND_checkpoint+40>)
          at ../sysdeps/unix/sysv/linux/futex-internal.h:205
      #1  __pthread_cond_wait_common (abstime=0x7f9db1c03d60, mutex=0x5573230348c0 <LOCK_checkpoint>, cond=0x557323034880 <COND_checkpoint>) at pthread_cond_wait.c:539
      #2  __pthread_cond_timedwait (cond=cond@entry=0x557323034880 <COND_checkpoint>, mutex=mutex@entry=0x5573230348c0 <LOCK_checkpoint>, abstime=abstime@entry=0x7f9db1c03d60) at pthread_cond_wait.c:667
      #3  0x0000557321cb0a69 in inline_mysql_cond_timedwait (src_file=0x557321ff89a8 "/home/buildbot/buildbot/build/mariadb-10.4.7/storage/maria/ma_servicethread.c", src_line=116, abstime=0x7f9db1c03d60, 
          mutex=0x5573230348c0 <LOCK_checkpoint>, that=0x557323034880 <COND_checkpoint>) at ./include/mysql/psi/mysql_thread.h:1215
      #4  my_service_thread_sleep (control=control@entry=0x557322730560 <checkpoint_control>, sleep_time=sleep_time@entry=30000000000) at ./storage/maria/ma_servicethread.c:115
      #5  0x0000557321ca4ab0 in ma_checkpoint_background (arg=0x1e) at ./storage/maria/ma_checkpoint.c:707
      #6  0x00007f9db5b2e6db in start_thread (arg=0x7f9db1c04700) at pthread_create.c:463
      #7  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
      ---Type <return> to continue, or q <return> to quit---
       
      Thread 2 (Thread 0x7f9db4294700 (LWP 685)):
      #0  0x00007f9db5b34f85 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f9db4293df0, expected=0, futex_word=0x5573230448a8 <COND_timer+40>)
          at ../sysdeps/unix/sysv/linux/futex-internal.h:205
      #1  __pthread_cond_wait_common (abstime=0x7f9db4293df0, mutex=0x5573230448c0 <LOCK_timer>, cond=0x557323044880 <COND_timer>) at pthread_cond_wait.c:539
      #2  __pthread_cond_timedwait (cond=cond@entry=0x557323044880 <COND_timer>, mutex=mutex@entry=0x5573230448c0 <LOCK_timer>, abstime=abstime@entry=0x7f9db4293df0) at pthread_cond_wait.c:667
      #3  0x0000557321dec438 in inline_mysql_cond_timedwait (that=0x557323044880 <COND_timer>, mutex=0x5573230448c0 <LOCK_timer>, 
          src_file=0x55732200ea08 "/home/buildbot/buildbot/build/mariadb-10.4.7/mysys/thr_timer.c", src_line=292, abstime=0x7f9db4293df0) at ./include/mysql/psi/mysql_thread.h:1215
      #4  timer_handler (arg=<optimized out>) at ./mysys/thr_timer.c:292
      #5  0x00007f9db5b2e6db in start_thread (arg=0x7f9db4294700) at pthread_create.c:463
      #6  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 1 (Thread 0x7f9db73a8540 (LWP 680)):
      #0  0x00007f9db4f2203f in __GI___select (nfds=nfds@entry=0, readfds=readfds@entry=0x0, writefds=writefds@entry=0x0, exceptfds=exceptfds@entry=0x0, timeout=timeout@entry=0x7ffffa216150)
          at ../sysdeps/unix/sysv/linux/select.c:41
      #1  0x0000557321de528f in my_sleep (m_seconds=m_seconds@entry=1000) at ./mysys/my_sleep.c:29
      #2  0x0000557321594bba in close_connections () at ./sql/mysqld.cc:1798
      #3  mysqld_main (argc=<optimized out>, argv=<optimized out>) at ./sql/mysqld.cc:5916
      #4  0x00007f9db4e2cb97 in __libc_start_main (main=0x55732156f320 <main(int, char**)>, argc=1, argv=0x7ffffa2163c8, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, 
          stack_end=0x7ffffa2163b8) at ../csu/libc-start.c:310
      #5  0x00005573215876da in _start ()
      

      The problem apparently appeared in 10.4 tree with this commit:
      https://github.com/MariaDB/server/commit/fa7051c419a653a002282eaca60f8202c1066d61

      MDEV-19842 Crash while creating statistics for Spider table (#1355)
       
      Added checks of the number of columns of the system tables.
      Move install_spider.sql into source code except installing Spider
      

      Attachments

        Issue Links

          Activity

            Shutdown (main) thread is waiting for spider to destroy THD, while spider is waiting for some cond.
            Spider should probably set current_mutex and current_cond, similarly to e.g. InnoDB thd_destructor_proxy().

            svoj Sergey Vojtovich added a comment - Shutdown (main) thread is waiting for spider to destroy THD, while spider is waiting for some cond. Spider should probably set current_mutex and current_cond, similarly to e.g. InnoDB thd_destructor_proxy().

            People

              Kentoku Kentoku Shiba (Inactive)
              elenst Elena Stepanova
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.