Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-20179

Server hangs on shutdown during installation of Spider

    Details

      Description

      Note: On certain platforms, e.g. Ubuntu Bionic, it currently happens upon almost every package installation test. Example: http://buildbot.askmonty.org/buildbot/builders/kvm-deb-bionic-amd64/builds/2432

      Last words in the log:

      2019-07-06 12:10:57 0 [Note] /usr/sbin/mysqld (initiated by: unknown): Normal shutdown
      2019-07-06 12:10:57 0 [Note] Event Scheduler: Purging the queue. 0 events
      2019-07-06 12:10:57 0 [Note] InnoDB: FTS optimize thread exiting.
      2019-07-06 12:11:17 0 [Warning] /usr/sbin/mysqld: Thread 49 (user : '') did not exit
      

      Example of stack trace:

      10.4 17794fb9

      Thread 23 (Thread 0x7f9d43fff700 (LWP 5438)):
      #0  0x00007f9db5b349f3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7f9d45768a40) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
      #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x7f9d45768a50, cond=0x7f9d45768a18) at pthread_cond_wait.c:502
      #2  __pthread_cond_wait (cond=0x7f9d45768a18, mutex=0x7f9d45768a50) at pthread_cond_wait.c:655
      #3  0x00007f9d80162fef in spider_table_bg_sts_action(void*) () from target:/usr/lib/mysql/plugin/ha_spider.so
      #4  0x00007f9db5b2e6db in start_thread (arg=0x7f9d43fff700) at pthread_create.c:463
      #5  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 22 (Thread 0x7f9db0df0700 (LWP 880)):
      #0  0x00007f9db4e4b26c in __GI___sigtimedwait (set=<optimized out>, set@entry=0x7f9db0defd20, info=info@entry=0x7f9db0defda0, timeout=timeout@entry=0x0) at ../sysdeps/unix/sysv/linux/sigtimedwait.c:42
      #1  0x00007f9db4e4b2e7 in __GI___sigwaitinfo (set=set@entry=0x7f9db0defd20, info=info@entry=0x7f9db0defda0) at ../sysdeps/unix/sysv/linux/sigwaitinfo.c:25
      #2  0x0000557321589a0b in my_sigwait (code=<synthetic pointer>, sig=0x7f9db0defd18, set=0x7f9db0defd20) at ./include/my_pthread.h:198
      #3  signal_hand (arg=<optimized out>) at ./sql/mysqld.cc:3249
      #4  0x00007f9db5b2e6db in start_thread (arg=0x7f9db0df0700) at pthread_create.c:463
      #5  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 21 (Thread 0x7f9d677fe700 (LWP 863)):
      #0  0x00007f9db5b349f3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x557323fe8eb0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
      #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x557323fe8e60, cond=0x557323fe8e88) at pthread_cond_wait.c:502
      #2  __pthread_cond_wait (cond=cond@entry=0x557323fe8e88, mutex=mutex@entry=0x557323fe8e60) at pthread_cond_wait.c:655
      #3  0x0000557321a7be50 in os_event::wait (this=0x557323fe8e50) at ./storage/innobase/os/os0event.cc:159
      #4  os_event::wait_low (reset_sig_count=1, this=0x557323fe8e50) at ./storage/innobase/os/os0event.cc:326
      #5  os_event_wait_low (event=0x557323fe8e50, reset_sig_count=reset_sig_count@entry=0) at ./storage/innobase/os/os0event.cc:515
      #6  0x0000557321b960e2 in buf_resize_thread () at ./storage/innobase/buf/buf0buf.cc:3207
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d677fe700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 20 (Thread 0x7f9d67fff700 (LWP 862)):
      #0  0x00007f9db5b38c60 in __GI___nanosleep (requested_time=requested_time@entry=0x7f9d67ffe730, remaining=remaining@entry=0x0) at ../sysdeps/unix/sysv/linux/nanosleep.c:28
      #1  0x0000557321a7c0a0 in os_thread_sleep (tm=tm@entry=1000000) at ./storage/innobase/os/os0thread.cc:225
      #2  0x0000557321b8774a in btr_defragment_thread () at ./storage/innobase/btr/btr0defragment.cc:719
      #3  0x00007f9db5b2e6db in start_thread (arg=0x7f9d67fff700) at pthread_create.c:463
      #4  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 19 (Thread 0x7f9d80ff9700 (LWP 861)):
      #0  0x00007f9db5b349f3 in futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x557323fe8dd0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
      #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x557323fe8d80, cond=0x557323fe8da8) at pthread_cond_wait.c:502
      #2  __pthread_cond_wait (cond=cond@entry=0x557323fe8da8, mutex=mutex@entry=0x557323fe8d80) at pthread_cond_wait.c:655
      #3  0x0000557321a7be50 in os_event::wait (this=0x557323fe8d70) at ./storage/innobase/os/os0event.cc:159
      #4  os_event::wait_low (reset_sig_count=1, this=0x557323fe8d70) at ./storage/innobase/os/os0event.cc:326
      #5  os_event_wait_low (event=0x557323fe8d70, reset_sig_count=reset_sig_count@entry=0) at ./storage/innobase/os/os0event.cc:515
      #6  0x0000557321b9d5cc in buf_dump_thread () at ./storage/innobase/buf/buf0dump.cc:833
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d80ff9700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      ---Type <return> to continue, or q <return> to quit---
      Thread 18 (Thread 0x7f9d8a7f8700 (LWP 835)):
      #0  0x00007f9db5b38c60 in __GI___nanosleep (requested_time=requested_time@entry=0x7f9d8a7f7d60, remaining=remaining@entry=0x0) at ../sysdeps/unix/sysv/linux/nanosleep.c:28
      #1  0x0000557321a7c0a0 in os_thread_sleep (tm=tm@entry=1000000) at ./storage/innobase/os/os0thread.cc:225
      #2  0x0000557321b075b8 in srv_master_sleep () at ./storage/innobase/srv/srv0srv.cc:2334
      #3  srv_master_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0srv.cc:2375
      #4  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8a7f8700) at pthread_create.c:463
      #5  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 17 (Thread 0x7f9d88ff5700 (LWP 773)):
      #0  0x00007f9db5b34f85 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f9d88ff4d40, expected=0, futex_word=0x557323fe8d60) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
      #1  __pthread_cond_wait_common (abstime=0x7f9d88ff4d40, mutex=0x557323fe8d10, cond=0x557323fe8d38) at pthread_cond_wait.c:539
      #2  __pthread_cond_timedwait (cond=cond@entry=0x557323fe8d38, mutex=mutex@entry=0x557323fe8d10, abstime=abstime@entry=0x7f9d88ff4d40) at pthread_cond_wait.c:667
      #3  0x0000557321a7b672 in os_event::timed_wait (this=this@entry=0x557323fe8d00, abstime=abstime@entry=0x7f9d88ff4d40) at ./storage/innobase/os/os0event.cc:276
      #4  0x0000557321a7bd01 in os_event::wait_time_low (reset_sig_count=1, time_in_usec=5000000, this=0x557323fe8d00) at ./storage/innobase/os/os0event.cc:398
      #5  os_event_wait_time_low (event=0x557323fe8d00, time_in_usec=time_in_usec@entry=5000000, reset_sig_count=<optimized out>) at ./storage/innobase/os/os0event.cc:498
      #6  0x0000557321b0aeaf in srv_monitor_thread () at ./storage/innobase/srv/srv0srv.cc:1681
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d88ff5700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 16 (Thread 0x7f9d897f6700 (LWP 772)):
      #0  0x00007f9db5b34f85 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f9d897f5c40, expected=0, futex_word=0x557323fe8cf0) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
      #1  __pthread_cond_wait_common (abstime=0x7f9d897f5c40, mutex=0x557323fe8ca0, cond=0x557323fe8cc8) at pthread_cond_wait.c:539
      #2  __pthread_cond_timedwait (cond=cond@entry=0x557323fe8cc8, mutex=mutex@entry=0x557323fe8ca0, abstime=abstime@entry=0x7f9d897f5c40) at pthread_cond_wait.c:667
      #3  0x0000557321a7b672 in os_event::timed_wait (this=this@entry=0x557323fe8c90, abstime=abstime@entry=0x7f9d897f5c40) at ./storage/innobase/os/os0event.cc:276
      #4  0x0000557321a7bd01 in os_event::wait_time_low (reset_sig_count=1, time_in_usec=1000000, this=0x557323fe8c90) at ./storage/innobase/os/os0event.cc:398
      #5  os_event_wait_time_low (event=0x557323fe8c90, time_in_usec=time_in_usec@entry=1000000, reset_sig_count=<optimized out>) at ./storage/innobase/os/os0event.cc:498
      #6  0x0000557321b0657f in srv_error_monitor_thread () at ./storage/innobase/srv/srv0srv.cc:1845
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d897f6700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 15 (Thread 0x7f9d89ff7700 (LWP 771)):
      #0  0x00007f9db5b34f85 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f9d89ff6ce0, expected=0, futex_word=0x55732464d360) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
      #1  __pthread_cond_wait_common (abstime=0x7f9d89ff6ce0, mutex=0x55732464d310, cond=0x55732464d338) at pthread_cond_wait.c:539
      #2  __pthread_cond_timedwait (cond=cond@entry=0x55732464d338, mutex=mutex@entry=0x55732464d310, abstime=abstime@entry=0x7f9d89ff6ce0) at pthread_cond_wait.c:667
      #3  0x0000557321a7b672 in os_event::timed_wait (this=this@entry=0x55732464d300, abstime=abstime@entry=0x7f9d89ff6ce0) at ./storage/innobase/os/os0event.cc:276
      #4  0x0000557321a7bd01 in os_event::wait_time_low (reset_sig_count=1, time_in_usec=1000000, this=0x55732464d300) at ./storage/innobase/os/os0event.cc:398
      #5  os_event_wait_time_low (event=event@entry=0x55732464d300, time_in_usec=time_in_usec@entry=1000000, reset_sig_count=<optimized out>) at ./storage/innobase/os/os0event.cc:498
      #6  0x0000557321a52829 in lock_wait_timeout_thread () at ./storage/innobase/lock/lock0wait.cc:543
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d89ff7700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 14 (Thread 0x7f9d8aff9700 (LWP 737)):
      #0  0x00007f9db5b34f85 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f9d8aff8b70, expected=0, futex_word=0x557323fe8e44) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
      #1  __pthread_cond_wait_common (abstime=0x7f9d8aff8b70, mutex=0x557323fe8df0, cond=0x557323fe8e18) at pthread_cond_wait.c:539
      #2  __pthread_cond_timedwait (cond=cond@entry=0x557323fe8e18, mutex=mutex@entry=0x557323fe8df0, abstime=abstime@entry=0x7f9d8aff8b70) at pthread_cond_wait.c:667
      #3  0x0000557321a7b672 in os_event::timed_wait (this=this@entry=0x557323fe8de0, abstime=abstime@entry=0x7f9d8aff8b70) at ./storage/innobase/os/os0event.cc:276
      ---Type <return> to continue, or q <return> to quit---
      #4  0x0000557321a7bd01 in os_event::wait_time_low (reset_sig_count=2, time_in_usec=1000000, this=0x557323fe8de0) at ./storage/innobase/os/os0event.cc:398
      #5  os_event_wait_time_low (event=0x557323fe8de0, time_in_usec=time_in_usec@entry=1000000, reset_sig_count=reset_sig_count@entry=2) at ./storage/innobase/os/os0event.cc:498
      #6  0x0000557321ba7cd4 in pc_sleep_if_needed (cur_time=1564075984100, sig_count=2, next_loop_time=1564075985100) at ./storage/innobase/buf/buf0flu.cc:2641
      #7  buf_flush_page_cleaner_coordinator () at ./storage/innobase/buf/buf0flu.cc:3099
      #8  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8aff9700) at pthread_create.c:463
      #9  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 13 (Thread 0x7f9d8b7fa700 (LWP 736)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d8b7f9bf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d8b7f9bf0, m1=m1@entry=0x7f9d8b7f9c80, m2=m2@entry=0x7f9d8b7f9c88, request=request@entry=0x7f9d8b7f9c90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d8b7f9c90, m2=0x7f9d8b7f9c88, m1=0x7f9d8b7f9c80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=9, m1=m1@entry=0x7f9d8b7f9c80, m2=m2@entry=0x7f9d8b7f9c88, request=request@entry=0x7f9d8b7f9c90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=9) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8b7fa700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 12 (Thread 0x7f9d8bffb700 (LWP 735)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d8bffabf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d8bffabf0, m1=m1@entry=0x7f9d8bffac80, m2=m2@entry=0x7f9d8bffac88, request=request@entry=0x7f9d8bffac90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d8bffac90, m2=0x7f9d8bffac88, m1=0x7f9d8bffac80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=8, m1=m1@entry=0x7f9d8bffac80, m2=m2@entry=0x7f9d8bffac88, request=request@entry=0x7f9d8bffac90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=8) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8bffb700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 11 (Thread 0x7f9d8c7fc700 (LWP 734)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d8c7fbbf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d8c7fbbf0, m1=m1@entry=0x7f9d8c7fbc80, m2=m2@entry=0x7f9d8c7fbc88, request=request@entry=0x7f9d8c7fbc90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d8c7fbc90, m2=0x7f9d8c7fbc88, m1=0x7f9d8c7fbc80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=7, m1=m1@entry=0x7f9d8c7fbc80, m2=m2@entry=0x7f9d8c7fbc88, request=request@entry=0x7f9d8c7fbc90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=7) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8c7fc700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 10 (Thread 0x7f9d8cffd700 (LWP 733)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d8cffcbf0) at ./storage/innobase/os/os0file.cc:1809
      ---Type <return> to continue, or q <return> to quit---
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d8cffcbf0, m1=m1@entry=0x7f9d8cffcc80, m2=m2@entry=0x7f9d8cffcc88, request=request@entry=0x7f9d8cffcc90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d8cffcc90, m2=0x7f9d8cffcc88, m1=0x7f9d8cffcc80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=6, m1=m1@entry=0x7f9d8cffcc80, m2=m2@entry=0x7f9d8cffcc88, request=request@entry=0x7f9d8cffcc90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=6) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8cffd700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 9 (Thread 0x7f9d8d7fe700 (LWP 732)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d8d7fdbf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d8d7fdbf0, m1=m1@entry=0x7f9d8d7fdc80, m2=m2@entry=0x7f9d8d7fdc88, request=request@entry=0x7f9d8d7fdc90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d8d7fdc90, m2=0x7f9d8d7fdc88, m1=0x7f9d8d7fdc80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=5, m1=m1@entry=0x7f9d8d7fdc80, m2=m2@entry=0x7f9d8d7fdc88, request=request@entry=0x7f9d8d7fdc90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=5) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8d7fe700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 8 (Thread 0x7f9d8dfff700 (LWP 731)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d8dffebf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d8dffebf0, m1=m1@entry=0x7f9d8dffec80, m2=m2@entry=0x7f9d8dffec88, request=request@entry=0x7f9d8dffec90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d8dffec90, m2=0x7f9d8dffec88, m1=0x7f9d8dffec80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=4, m1=m1@entry=0x7f9d8dffec80, m2=m2@entry=0x7f9d8dffec88, request=request@entry=0x7f9d8dffec90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=4) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d8dfff700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 7 (Thread 0x7f9d9cca1700 (LWP 730)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d9cca0bf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d9cca0bf0, m1=m1@entry=0x7f9d9cca0c80, m2=m2@entry=0x7f9d9cca0c88, request=request@entry=0x7f9d9cca0c90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d9cca0c90, m2=0x7f9d9cca0c88, m1=0x7f9d9cca0c80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=3, m1=m1@entry=0x7f9d9cca0c80, m2=m2@entry=0x7f9d9cca0c88, request=request@entry=0x7f9d9cca0c90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=3) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d9cca1700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 6 (Thread 0x7f9d9d4a2700 (LWP 729)):
      ---Type <return> to continue, or q <return> to quit---
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d9d4a1bf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d9d4a1bf0, m1=m1@entry=0x7f9d9d4a1c80, m2=m2@entry=0x7f9d9d4a1c88, request=request@entry=0x7f9d9d4a1c90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d9d4a1c90, m2=0x7f9d9d4a1c88, m1=0x7f9d9d4a1c80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=2, m1=m1@entry=0x7f9d9d4a1c80, m2=m2@entry=0x7f9d9d4a1c88, request=request@entry=0x7f9d9d4a1c90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=2) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d9d4a2700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 5 (Thread 0x7f9d9dca3700 (LWP 728)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9d9dca2bf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9d9dca2bf0, m1=m1@entry=0x7f9d9dca2c80, m2=m2@entry=0x7f9d9dca2c88, request=request@entry=0x7f9d9dca2c90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9d9dca2c90, m2=0x7f9d9dca2c88, m1=0x7f9d9dca2c80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=1, m1=m1@entry=0x7f9d9dca2c80, m2=m2@entry=0x7f9d9dca2c88, request=request@entry=0x7f9d9dca2c90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=1) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9d9dca3700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 4 (Thread 0x7f9db0be5700 (LWP 727)):
      #0  0x00007f9db6d7363a in ?? () from target:/lib/x86_64-linux-gnu/libaio.so.1
      #1  0x0000557321a71ea1 in LinuxAIOHandler::collect (this=this@entry=0x7f9db0be4bf0) at ./storage/innobase/os/os0file.cc:1809
      #2  0x0000557321a72506 in LinuxAIOHandler::poll (this=this@entry=0x7f9db0be4bf0, m1=m1@entry=0x7f9db0be4c80, m2=m2@entry=0x7f9db0be4c88, request=request@entry=0x7f9db0be4c90)
          at ./storage/innobase/os/os0file.cc:1968
      #3  0x0000557321a76811 in os_aio_linux_handler (request=0x7f9db0be4c90, m2=0x7f9db0be4c88, m1=0x7f9db0be4c80, global_segment=<optimized out>) at ./storage/innobase/os/os0file.cc:2022
      #4  os_aio_handler (segment=segment@entry=0, m1=m1@entry=0x7f9db0be4c80, m2=m2@entry=0x7f9db0be4c88, request=request@entry=0x7f9db0be4c90) at ./storage/innobase/os/os0file.cc:5561
      #5  0x0000557321bf9ca8 in fil_aio_wait (segment=segment@entry=0) at ./storage/innobase/fil/fil0fil.cc:4349
      #6  0x0000557321b0be60 in io_handler_thread (arg=<optimized out>) at ./storage/innobase/srv/srv0start.cc:325
      #7  0x00007f9db5b2e6db in start_thread (arg=0x7f9db0be5700) at pthread_create.c:463
      #8  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 3 (Thread 0x7f9db1c04700 (LWP 704)):
      #0  0x00007f9db5b34f85 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f9db1c03d60, expected=0, futex_word=0x5573230348a8 <COND_checkpoint+40>)
          at ../sysdeps/unix/sysv/linux/futex-internal.h:205
      #1  __pthread_cond_wait_common (abstime=0x7f9db1c03d60, mutex=0x5573230348c0 <LOCK_checkpoint>, cond=0x557323034880 <COND_checkpoint>) at pthread_cond_wait.c:539
      #2  __pthread_cond_timedwait (cond=cond@entry=0x557323034880 <COND_checkpoint>, mutex=mutex@entry=0x5573230348c0 <LOCK_checkpoint>, abstime=abstime@entry=0x7f9db1c03d60) at pthread_cond_wait.c:667
      #3  0x0000557321cb0a69 in inline_mysql_cond_timedwait (src_file=0x557321ff89a8 "/home/buildbot/buildbot/build/mariadb-10.4.7/storage/maria/ma_servicethread.c", src_line=116, abstime=0x7f9db1c03d60, 
          mutex=0x5573230348c0 <LOCK_checkpoint>, that=0x557323034880 <COND_checkpoint>) at ./include/mysql/psi/mysql_thread.h:1215
      #4  my_service_thread_sleep (control=control@entry=0x557322730560 <checkpoint_control>, sleep_time=sleep_time@entry=30000000000) at ./storage/maria/ma_servicethread.c:115
      #5  0x0000557321ca4ab0 in ma_checkpoint_background (arg=0x1e) at ./storage/maria/ma_checkpoint.c:707
      #6  0x00007f9db5b2e6db in start_thread (arg=0x7f9db1c04700) at pthread_create.c:463
      #7  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
      ---Type <return> to continue, or q <return> to quit---
       
      Thread 2 (Thread 0x7f9db4294700 (LWP 685)):
      #0  0x00007f9db5b34f85 in futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f9db4293df0, expected=0, futex_word=0x5573230448a8 <COND_timer+40>)
          at ../sysdeps/unix/sysv/linux/futex-internal.h:205
      #1  __pthread_cond_wait_common (abstime=0x7f9db4293df0, mutex=0x5573230448c0 <LOCK_timer>, cond=0x557323044880 <COND_timer>) at pthread_cond_wait.c:539
      #2  __pthread_cond_timedwait (cond=cond@entry=0x557323044880 <COND_timer>, mutex=mutex@entry=0x5573230448c0 <LOCK_timer>, abstime=abstime@entry=0x7f9db4293df0) at pthread_cond_wait.c:667
      #3  0x0000557321dec438 in inline_mysql_cond_timedwait (that=0x557323044880 <COND_timer>, mutex=0x5573230448c0 <LOCK_timer>, 
          src_file=0x55732200ea08 "/home/buildbot/buildbot/build/mariadb-10.4.7/mysys/thr_timer.c", src_line=292, abstime=0x7f9db4293df0) at ./include/mysql/psi/mysql_thread.h:1215
      #4  timer_handler (arg=<optimized out>) at ./mysys/thr_timer.c:292
      #5  0x00007f9db5b2e6db in start_thread (arg=0x7f9db4294700) at pthread_create.c:463
      #6  0x00007f9db4f2c88f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
       
      Thread 1 (Thread 0x7f9db73a8540 (LWP 680)):
      #0  0x00007f9db4f2203f in __GI___select (nfds=nfds@entry=0, readfds=readfds@entry=0x0, writefds=writefds@entry=0x0, exceptfds=exceptfds@entry=0x0, timeout=timeout@entry=0x7ffffa216150)
          at ../sysdeps/unix/sysv/linux/select.c:41
      #1  0x0000557321de528f in my_sleep (m_seconds=m_seconds@entry=1000) at ./mysys/my_sleep.c:29
      #2  0x0000557321594bba in close_connections () at ./sql/mysqld.cc:1798
      #3  mysqld_main (argc=<optimized out>, argv=<optimized out>) at ./sql/mysqld.cc:5916
      #4  0x00007f9db4e2cb97 in __libc_start_main (main=0x55732156f320 <main(int, char**)>, argc=1, argv=0x7ffffa2163c8, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, 
          stack_end=0x7ffffa2163b8) at ../csu/libc-start.c:310
      #5  0x00005573215876da in _start ()
      

      The problem apparently appeared in 10.4 tree with this commit:
      https://github.com/MariaDB/server/commit/fa7051c419a653a002282eaca60f8202c1066d61

      MDEV-19842 Crash while creating statistics for Spider table (#1355)
       
      Added checks of the number of columns of the system tables.
      Move install_spider.sql into source code except installing Spider
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Kentoku Kentoku
                Reporter:
                elenst Elena Stepanova
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: