rocksdb.use_direct_reads_writes fails in buildbot, server crashes

rocksdb.use_direct_reads_writes          w2 [ fail ]  Found warnings/errors in server log file!

        Test ended at 2018-06-27 07:52:41

line

Attempting backtrace. You can use the following information to find out

^ Found warnings in /dev/shm/var/2/log/mysqld.1.err

ok

 - found 'core' (0/0)

Trying 'dbx' to get a backtrace

Trying 'gdb' to get a backtrace from coredump /dev/shm/var/2/log/rocksdb.use_direct_reads_writes/mysqld.1/data/core

Core generated by '/usr/sbin/mysqld'

Output from gdb follows. The first stack trace is from the failing thread.

The following stack traces are from all threads (so the failing one is

duplicated).

--------------------------

[New LWP 2311]

[Thread debugging using libthread_db enabled]

Using host libthread_db library "/lib/aarch64-linux-gnu/libthread_db.so.1".

Core was generated by `/usr/sbin/mysqld --defaults-group-suffix=.1 --defaults-file=/dev/shm/var/2/my.c'.

Program terminated with signal SIGSEGV, Segmentation fault.

#0  0x0000ffff850eb7c8 in kill () at ../sysdeps/unix/syscall-template.S:84

84	../sysdeps/unix/syscall-template.S: No such file or directory.

#0  0x0000ffff850eb7c8 in kill () at ../sysdeps/unix/syscall-template.S:84

#1  0x0000aaaad5b2ca44 in handle_fatal_signal (sig=11) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/signal_handler.cc:317

#2  <signal handler called>

#3  pthread_join (threadid=281472739979376, thread_return=0x0) at pthread_join.c:45

#4  0x0000ffff8536619c in std::thread::join() () from /usr/lib/aarch64-linux-gnu/libstdc++.so.6

#5  0x0000ffff7bec063c in rocksdb::ThreadPoolImpl::Impl::JoinThreads (this=0xaaaaf7c706c0, wait_for_jobs_to_complete=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/util/threadpool_imp.cc:159

#6  0x0000ffff7be6db5c in rocksdb::(anonymous namespace)::PosixEnv::~PosixEnv (this=0xffff7bffc908 <rocksdb::Env::Default()::default_env>, __in_chrg=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/env/env_posix.cc:134

#7  0x0000ffff850edf18 in __run_exit_handlers (status=status@entry=1, listp=0xffff851fb4d0 <__exit_funcs>, run_list_atexit=run_list_atexit@entry=true) at exit.c:82

#8  0x0000ffff850edf40 in __GI_exit (status=status@entry=1) at exit.c:104

#9  0x0000aaaad6026eec in start_addr2line_fork (binary_path=0xffffd1af0fad "/usr/sbin/mysqld") at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/my_addr_resolve.c:185

#10 0x0000aaaad6027180 in my_addr_resolve (ptr=0xaaaad600c718 <my_print_stacktrace+56>, loc=0x0, loc@entry=0xffffd1aeeb08) at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/my_addr_resolve.c:220

#11 0x0000aaaad600c8a4 in print_with_addr_resolve (n=<optimized out>, addrs=0xffffd1aeeb20) at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/stacktrace.c:254

#12 my_print_stacktrace (stack_bottom=<optimized out>, thread_stack=<optimized out>, silent=silent@entry=0 '\000') at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/stacktrace.c:273

#13 0x0000aaaad5b2cae4 in handle_fatal_signal (sig=6) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/signal_handler.cc:166

#14 <signal handler called>

#15 0x0000ffff8544a310 in __pthread_cond_wait (cond=cond@entry=0xaaaad6781a90 <COND_thread_count>, mutex=mutex@entry=0xaaaad6782140 <LOCK_thread_count>) at pthread_cond_wait.c:186

#16 0x0000aaaad58e37f4 in inline_mysql_cond_wait (that=0xaaaad6781a90 <COND_thread_count>, mutex=0xaaaad6782140 <LOCK_thread_count>, src_file=0xaaaad6085af0 "/home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc", src_line=6202) at /home/buildbot/buildbot/build/mariadb-10.3.8/include/mysql/psi/mysql_thread.h:1167

#17 mysqld_main (argc=0, argv=0x0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc:6202

#18 0x0000ffff850d98a0 in __libc_start_main (main=0x0, argc=0, argv=0x0, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=<optimized out>) at libc-start.c:291

#19 0x0000aaaad58d5990 in _start ()

Backtrace stopped: previous frame identical to this frame (corrupt stack?)

Thread 1 (Thread 0xffff84efa000 (LWP 2311)):

#0  0x0000ffff850eb7c8 in kill () at ../sysdeps/unix/syscall-template.S:84

#1  0x0000aaaad5b2ca44 in handle_fatal_signal (sig=11) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/signal_handler.cc:317

#2  <signal handler called>

#3  pthread_join (threadid=281472739979376, thread_return=0x0) at pthread_join.c:45

#4  0x0000ffff8536619c in std::thread::join() () from /usr/lib/aarch64-linux-gnu/libstdc++.so.6

#5  0x0000ffff7bec063c in rocksdb::ThreadPoolImpl::Impl::JoinThreads (this=0xaaaaf7c706c0, wait_for_jobs_to_complete=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/util/threadpool_imp.cc:159

#6  0x0000ffff7be6db5c in rocksdb::(anonymous namespace)::PosixEnv::~PosixEnv (this=0xffff7bffc908 <rocksdb::Env::Default()::default_env>, __in_chrg=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/env/env_posix.cc:134

#7  0x0000ffff850edf18 in __run_exit_handlers (status=status@entry=1, listp=0xffff851fb4d0 <__exit_funcs>, run_list_atexit=run_list_atexit@entry=true) at exit.c:82

#8  0x0000ffff850edf40 in __GI_exit (status=status@entry=1) at exit.c:104

#9  0x0000aaaad6026eec in start_addr2line_fork (binary_path=0xffffd1af0fad "/usr/sbin/mysqld") at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/my_addr_resolve.c:185

#10 0x0000aaaad6027180 in my_addr_resolve (ptr=0xaaaad600c718 <my_print_stacktrace+56>, loc=0x0, loc@entry=0xffffd1aeeb08) at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/my_addr_resolve.c:220

#11 0x0000aaaad600c8a4 in print_with_addr_resolve (n=<optimized out>, addrs=0xffffd1aeeb20) at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/stacktrace.c:254

#12 my_print_stacktrace (stack_bottom=<optimized out>, thread_stack=<optimized out>, silent=silent@entry=0 '\000') at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/stacktrace.c:273

#13 0x0000aaaad5b2cae4 in handle_fatal_signal (sig=6) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/signal_handler.cc:166

#14 <signal handler called>

#15 0x0000ffff8544a310 in __pthread_cond_wait (cond=cond@entry=0xaaaad6781a90 <COND_thread_count>, mutex=mutex@entry=0xaaaad6782140 <LOCK_thread_count>) at pthread_cond_wait.c:186

#16 0x0000aaaad58e37f4 in inline_mysql_cond_wait (that=0xaaaad6781a90 <COND_thread_count>, mutex=0xaaaad6782140 <LOCK_thread_count>, src_file=0xaaaad6085af0 "/home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc", src_line=6202) at /home/buildbot/buildbot/build/mariadb-10.3.8/include/mysql/psi/mysql_thread.h:1167

#17 mysqld_main (argc=0, argv=0x0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc:6202

#18 0x0000ffff850d98a0 in __libc_start_main (main=0x0, argc=0, argv=0x0, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=<optimized out>) at libc-start.c:291

#19 0x0000aaaad58d5990 in _start ()

Backtrace stopped: previous frame identical to this frame (corrupt stack?)