rocksdb.allow_no_primary_key_with_sk     w2 [ fail ]  Found warnings/errors in server log file!

        Test ended at 2018-06-21 22:41:23

line

Attempting backtrace. You can use the following information to find out

^ Found warnings in /run/shm/var/2/log/mysqld.1.err

ok

 - found 'core' (0/0)

Trying 'dbx' to get a backtrace

Trying 'gdb' to get a backtrace from coredump /run/shm/var/2/log/rocksdb.allow_no_primary_key_with_sk/mysqld.1/data/core

Core generated by '/usr/sbin/mysqld'

Output from gdb follows. The first stack trace is from the failing thread.

The following stack traces are from all threads (so the failing one is

duplicated).

--------------------------

[New LWP 9294]

[New LWP 9335]

[New LWP 9323]

[New LWP 9322]

[New LWP 9326]

[New LWP 9317]

[New LWP 9318]

[New LWP 9315]

[New LWP 9314]

[Thread debugging using libthread_db enabled]

Using host libthread_db library "/lib/powerpc64le-linux-gnu/libthread_db.so.1".

Can't read symbols from system-supplied DSO at 0x3fffa4ee0000: File truncated

Core was generated by `/usr/sbin/mysqld --defaults-group-suffix=.1 --defaults-file=/run/shm/var/2/my.c'.

Program terminated with signal SIGABRT, Aborted.

#0  0x00003fffa4affcc0 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

61	../nptl/sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.

#0  0x00003fffa4affcc0 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

#1  0x000000003acc9e10 in my_write_core ()

#2  0x000000003a5fdd44 in handle_fatal_signal ()

#3  <signal handler called>

#4  0x00003fffa4afe710 in __pthread_cond_wait (cond=0x3b4aa880 <COND_thread_count>, mutex=0x3b4aae68 <LOCK_thread_count>) at pthread_cond_wait.c:187

#5  0x000000003a2c3638 in mysqld_main(int, char**) ()

#6  0x000000003a296ef0 in main ()

Thread 9 (Thread 0x3fffa00bf180 (LWP 9314)):

#0  0x00003fffa4afeb94 in __pthread_cond_timedwait (cond=0x3bd606e8, mutex=0x3bd60680, abstime=0x3fffa00be6a8) at pthread_cond_timedwait.c:199

#1  0x000000003acd0888 in ?? ()

#2  0x000000003abf4e20 in ?? ()

Backtrace stopped: previous frame inner to this frame (corrupt stack?)

Thread 8 (Thread 0x3fff9f0bf180 (LWP 9315)):

#0  0x00003fffa4afe710 in __pthread_cond_wait (cond=0x10032f574e0, mutex=0x10032f57408) at pthread_cond_wait.c:187

#1  0x00003fff9f5e0298 in rocksdb::port::CondVar::Wait() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#2  0x00003fff9f4f8078 in rocksdb::InstrumentedCondVar::WaitInternal() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00003fff9f4f8348 in rocksdb::InstrumentedCondVar::Wait() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00003fff9f583dec in rocksdb::DeleteScheduler::BackgroundEmptyTrash() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00003fff9f584424 in std::thread::_Impl<std::_Bind_simple<std::_Mem_fn<void (rocksdb::DeleteScheduler::*)()> (rocksdb::DeleteScheduler*)> >::_M_run() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#6  0x00003fffa4a7c284 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6

#7  0x00003fffa4af89a4 in start_thread (arg=0x3fff9f0bf180) at pthread_create.c:314

#8  0x00003fffa47e2f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 7 (Thread 0x3fff9e0bf180 (LWP 9318)):

#0  0x00003fffa4afe710 in __pthread_cond_wait (cond=0x10032d02458, mutex=0x10032d02430) at pthread_cond_wait.c:187

#1  0x00003fffa4a76e4c in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6

#2  0x00003fff9f65ac10 in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00003fff9f65b138 in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00003fff9f65ca70 in std::thread::_Impl<std::_Bind_simple<void* (*(rocksdb::BGThreadMetadata*))(void*)> >::_M_run() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00003fffa4a7c284 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6

#6  0x00003fffa4af89a4 in start_thread (arg=0x3fff9e0bf180) at pthread_create.c:314

#7  0x00003fffa47e2f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 6 (Thread 0x3fff9e8bf180 (LWP 9317)):

#0  0x00003fffa4afe710 in __pthread_cond_wait (cond=0x10032d02118, mutex=0x10032d020f0) at pthread_cond_wait.c:187

#1  0x00003fffa4a76e4c in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6

#2  0x00003fff9f65ac10 in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00003fff9f65b138 in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00003fff9f65ca70 in std::thread::_Impl<std::_Bind_simple<void* (*(rocksdb::BGThreadMetadata*))(void*)> >::_M_run() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00003fffa4a7c284 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6

#6  0x00003fffa4af89a4 in start_thread (arg=0x3fff9e8bf180) at pthread_create.c:314

#7  0x00003fffa47e2f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 5 (Thread 0x3fff875a8180 (LWP 9326)):

#0  0x00003fffa4b043d0 in do_sigwait (sig=0x3fff875a7620, set=0x3fff875a7680) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:60

#1  __sigwait (set=<optimized out>, sig=0x3fff875a7620) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:97

#2  0x000000003a2b700c in signal_hand ()

#3  0x000000003abf4e20 in ?? ()

#4  0x00003fffa4af89a4 in start_thread (arg=0x3fff875a8180) at pthread_create.c:314

#5  0x00003fffa47e2f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 4 (Thread 0x3fff9d8bf180 (LWP 9322)):

#0  0x00003fffa4b026e8 in __lll_lock_wait (futex=0x200, private=0) at ../nptl/sysdeps/unix/sysv/linux/lowlevellock.c:43

#1  0x00003fffa4afb804 in __GI___pthread_mutex_lock (mutex=0x10032f6a8c8) at pthread_mutex_lock.c:79

#2  0x00003fff9f5e0068 in rocksdb::port::Mutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00003fff9f4f7cc8 in rocksdb::InstrumentedMutex::LockInternal() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00003fff9f4f7f98 in rocksdb::InstrumentedMutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00003fff9f40efd4 in rocksdb::DBImpl::SyncWAL() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#6  0x00003fff9f404098 in rocksdb::DBImpl::FlushWAL(bool) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#7  0x00003fff9f5c99fc in rocksdb::StackableDB::FlushWAL(bool) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#8  0x00003fff9f38a0cc in myrocks::Rdb_background_thread::run() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#9  0x00003fff9f3ec714 in myrocks::Rdb_thread::thread_func(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#10 0x000000003abf4e20 in ?? ()

#11 0x00003fffa4af89a4 in start_thread (arg=0x3fff9d8bf180) at pthread_create.c:314

#12 0x00003fffa47e2f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 3 (Thread 0x3fff9d0bf180 (LWP 9323)):

#0  0x00003fffa4b02698 in __lll_lock_wait (futex=0x10032f6a8c8, private=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/lowlevellock.c:46

#1  0x00003fffa4afb804 in __GI___pthread_mutex_lock (mutex=0x10032f6a8c8) at pthread_mutex_lock.c:79

#2  0x00003fff9f5e0068 in rocksdb::port::Mutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00003fff9f4f7cc8 in rocksdb::InstrumentedMutex::LockInternal() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00003fff9f4f7f98 in rocksdb::InstrumentedMutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00003fff9f60026c in ?? () from /usr/lib/mysql/plugin/ha_rocksdb.so

#6  0x00003fff9f6575a8 in rocksdb::ThreadLocalPtr::StaticMeta::OnThreadExit(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#7  0x00003fffa4af8604 in __nptl_deallocate_tsd () at pthread_create.c:158

#8  0x00003fffa4af89b8 in start_thread (arg=0x3fff9d0bf180) at pthread_create.c:325

#9  0x00003fffa47e2f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 2 (Thread 0x3fff87488180 (LWP 9335)):

#0  0x00003fffa4b02698 in __lll_lock_wait (futex=0x10032d01c58, private=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/lowlevellock.c:46

#1  0x00003fffa4afb804 in __GI___pthread_mutex_lock (mutex=0x10032d01c58) at pthread_mutex_lock.c:79

#2  0x00003fff9f5e0068 in rocksdb::port::Mutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00003fff9f658130 in rocksdb::ThreadLocalPtr::StaticMeta::Scrape(unsigned int, rocksdb::autovector<void*, 8ul>*, void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00003fff9f6582cc in rocksdb::ThreadLocalPtr::Scrape(rocksdb::autovector<void*, 8ul>*, void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00003fff9f6005d4 in rocksdb::ColumnFamilyData::ResetThreadLocalSuperVersions() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#6  0x00003fff9f600b4c in rocksdb::ColumnFamilyData::InstallSuperVersion(rocksdb::SuperVersionContext*, rocksdb::InstrumentedMutex*, rocksdb::MutableCFOptions const&) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#7  0x00003fff9f429fc4 in rocksdb::DBImpl::InstallSuperVersionAndScheduleWork(rocksdb::ColumnFamilyData*, rocksdb::SuperVersionContext*, rocksdb::MutableCFOptions const&) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#8  0x00003fff9f45126c in rocksdb::DBImpl::SwitchMemtable(rocksdb::ColumnFamilyData*, rocksdb::DBImpl::WriteContext*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#9  0x00003fff9f429888 in rocksdb::DBImpl::FlushMemTable(rocksdb::ColumnFamilyData*, rocksdb::FlushOptions const&, bool) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#10 0x00003fff9f429cf4 in rocksdb::DBImpl::Flush(rocksdb::FlushOptions const&, rocksdb::ColumnFamilyHandle*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#11 0x00003fff9f5c991c in rocksdb::StackableDB::Flush(rocksdb::FlushOptions const&, rocksdb::ColumnFamilyHandle*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#12 0x00003fff9f3886bc in ?? () from /usr/lib/mysql/plugin/ha_rocksdb.so

#13 0x00003fff9f38f3e8 in ?? () from /usr/lib/mysql/plugin/ha_rocksdb.so

#14 0x000000003a60176c in ha_finalize_handlerton(st_plugin_int*) ()

#15 0x000000003a3b8134 in ?? ()

#16 0x000000003a3bbe68 in ?? ()

#17 0x000000003a3bcc50 in plugin_shutdown() ()

#18 0x000000003a2b7f90 in ?? ()

#19 0x000000003a2b83b0 in unireg_end() ()

#20 0x000000003a2bc924 in ?? ()

#21 0x000000003a2bc988 in kill_server_thread ()

#22 0x000000003abf4e20 in ?? ()

#23 0x00003fffa4af89a4 in start_thread (arg=0x3fff87488180) at pthread_create.c:314

#24 0x00003fffa47e2f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 1 (Thread 0x3fffa4f47310 (LWP 9294)):

#0  0x00003fffa4affcc0 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

#1  0x000000003acc9e10 in my_write_core ()

#2  0x000000003a5fdd44 in handle_fatal_signal ()

#3  <signal handler called>

#4  0x00003fffa4afe710 in __pthread_cond_wait (cond=0x3b4aa880 <COND_thread_count>, mutex=0x3b4aae68 <LOCK_thread_count>) at pthread_cond_wait.c:187

#5  0x000000003a2c3638 in mysqld_main(int, char**) ()

#6  0x000000003a296ef0 in main ()

rocksdb.max_open_files                   w2 [ fail ]  Found warnings/errors in server log file!

        Test ended at 2018-06-25 12:23:03

line

Attempting backtrace. You can use the following information to find out

^ Found warnings in /run/shm/var/2/log/mysqld.1.err

ok

 - found 'core' (0/0)

Trying 'dbx' to get a backtrace

Trying 'gdb' to get a backtrace from coredump /run/shm/var/2/log/rocksdb.max_open_files/mysqld.1/data/core

Core generated by '/usr/sbin/mysqld'

Output from gdb follows. The first stack trace is from the failing thread.

The following stack traces are from all threads (so the failing one is

duplicated).

--------------------------

[New LWP 22786]

[New LWP 22803]

[New LWP 22802]

[New LWP 22838]

[New LWP 22805]

[New LWP 22801]

[New LWP 22800]

[New LWP 22799]

[New LWP 22798]

[Thread debugging using libthread_db enabled]

Using host libthread_db library "/lib/powerpc64le-linux-gnu/libthread_db.so.1".

Can't read symbols from system-supplied DSO at 0x3fff87c30000: File truncated

Core was generated by `/usr/sbin/mysqld --defaults-group-suffix=.1 --defaults-file=/run/shm/var/2/my.c'.

Program terminated with signal SIGABRT, Aborted.

#0  0x00003fff8784fcc0 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

61	../nptl/sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.

#0  0x00003fff8784fcc0 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

#1  0x0000000043fe9130 in my_write_core ()

#2  0x000000004391cee4 in handle_fatal_signal ()

#3  <signal handler called>

#4  0x00003fff8784e710 in __pthread_cond_wait (cond=0x447ba880 <COND_thread_count>, mutex=0x447bae68 <LOCK_thread_count>) at pthread_cond_wait.c:187

#5  0x00000000435e2c38 in mysqld_main(int, char**) ()

#6  0x00000000435b64f0 in main ()

Thread 9 (Thread 0x3fff82e0f180 (LWP 22798)):

#0  0x00003fff8784eb94 in __pthread_cond_timedwait (cond=0x450706e8, mutex=0x45070680, abstime=0x3fff82e0e6a8) at pthread_cond_timedwait.c:199

#1  0x0000000043fefba8 in ?? ()

#2  0x0000000043f14140 in ?? ()

Backtrace stopped: previous frame inner to this frame (corrupt stack?)

Thread 8 (Thread 0x3fff81e0f180 (LWP 22799)):

#0  0x00003fff8784e710 in __pthread_cond_wait (cond=0x1000bca74e0, mutex=0x1000bca7408) at pthread_cond_wait.c:187

#1  0x00003fff82330298 in rocksdb::port::CondVar::Wait() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#2  0x00003fff82248078 in rocksdb::InstrumentedCondVar::WaitInternal() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00003fff82248348 in rocksdb::InstrumentedCondVar::Wait() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00003fff822d3dec in rocksdb::DeleteScheduler::BackgroundEmptyTrash() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00003fff822d4424 in std::thread::_Impl<std::_Bind_simple<std::_Mem_fn<void (rocksdb::DeleteScheduler::*)()> (rocksdb::DeleteScheduler*)> >::_M_run() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#6  0x00003fff877cc284 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6

#7  0x00003fff878489a4 in start_thread (arg=0x3fff81e0f180) at pthread_create.c:314

#8  0x00003fff87532f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 7 (Thread 0x3fff8160f180 (LWP 22800)):

#0  0x00003fff8784e710 in __pthread_cond_wait (cond=0x1000ba52118, mutex=0x1000ba520f0) at pthread_cond_wait.c:187

#1  0x00003fff877c6e4c in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6

#2  0x00003fff823aac10 in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00003fff823ab138 in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00003fff823aca70 in std::thread::_Impl<std::_Bind_simple<void* (*(rocksdb::BGThreadMetadata*))(void*)> >::_M_run() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00003fff877cc284 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6

#6  0x00003fff878489a4 in start_thread (arg=0x3fff8160f180) at pthread_create.c:314

#7  0x00003fff87532f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 6 (Thread 0x3fff80e0f180 (LWP 22801)):

#0  0x00003fff8784e710 in __pthread_cond_wait (cond=0x1000ba52458, mutex=0x1000ba52430) at pthread_cond_wait.c:187

#1  0x00003fff877c6e4c in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6

#2  0x00003fff823aac10 in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00003fff823ab138 in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00003fff823aca70 in std::thread::_Impl<std::_Bind_simple<void* (*(rocksdb::BGThreadMetadata*))(void*)> >::_M_run() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00003fff877cc284 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6

#6  0x00003fff878489a4 in start_thread (arg=0x3fff80e0f180) at pthread_create.c:314

#7  0x00003fff87532f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 5 (Thread 0x3fff802c8180 (LWP 22805)):

#0  0x00003fff878543d0 in do_sigwait (sig=0x3fff802c7620, set=0x3fff802c7680) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:60

#1  __sigwait (set=<optimized out>, sig=0x3fff802c7620) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:97

#2  0x00000000435d660c in signal_hand ()

#3  0x0000000043f14140 in ?? ()

#4  0x00003fff878489a4 in start_thread (arg=0x3fff802c8180) at pthread_create.c:314

#5  0x00003fff87532f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 4 (Thread 0x3fff801a8180 (LWP 22838)):

#0  0x00003fff87852698 in __lll_lock_wait (futex=0x1000ba51c58, private=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/lowlevellock.c:46

#1  0x00003fff8784b804 in __GI___pthread_mutex_lock (mutex=0x1000ba51c58) at pthread_mutex_lock.c:79

#2  0x00003fff82330068 in rocksdb::port::Mutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00003fff823a8130 in rocksdb::ThreadLocalPtr::StaticMeta::Scrape(unsigned int, rocksdb::autovector<void*, 8ul>*, void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00003fff823a82cc in rocksdb::ThreadLocalPtr::Scrape(rocksdb::autovector<void*, 8ul>*, void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00003fff823505d4 in rocksdb::ColumnFamilyData::ResetThreadLocalSuperVersions() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#6  0x00003fff82350b4c in rocksdb::ColumnFamilyData::InstallSuperVersion(rocksdb::SuperVersionContext*, rocksdb::InstrumentedMutex*, rocksdb::MutableCFOptions const&) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#7  0x00003fff82179fc4 in rocksdb::DBImpl::InstallSuperVersionAndScheduleWork(rocksdb::ColumnFamilyData*, rocksdb::SuperVersionContext*, rocksdb::MutableCFOptions const&) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#8  0x00003fff821a126c in rocksdb::DBImpl::SwitchMemtable(rocksdb::ColumnFamilyData*, rocksdb::DBImpl::WriteContext*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#9  0x00003fff82179888 in rocksdb::DBImpl::FlushMemTable(rocksdb::ColumnFamilyData*, rocksdb::FlushOptions const&, bool) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#10 0x00003fff82179cf4 in rocksdb::DBImpl::Flush(rocksdb::FlushOptions const&, rocksdb::ColumnFamilyHandle*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#11 0x00003fff8231991c in rocksdb::StackableDB::Flush(rocksdb::FlushOptions const&, rocksdb::ColumnFamilyHandle*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#12 0x00003fff820d86bc in ?? () from /usr/lib/mysql/plugin/ha_rocksdb.so

#13 0x00003fff820df3e8 in ?? () from /usr/lib/mysql/plugin/ha_rocksdb.so

#14 0x000000004392090c in ha_finalize_handlerton(st_plugin_int*) ()

#15 0x00000000436d7734 in ?? ()

#16 0x00000000436db468 in ?? ()

#17 0x00000000436dc250 in plugin_shutdown() ()

#18 0x00000000435d7590 in ?? ()

#19 0x00000000435d79b0 in unireg_end() ()

#20 0x00000000435dbf24 in ?? ()

#21 0x00000000435dbf88 in kill_server_thread ()

#22 0x0000000043f14140 in ?? ()

#23 0x00003fff878489a4 in start_thread (arg=0x3fff801a8180) at pthread_create.c:314

#24 0x00003fff87532f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 3 (Thread 0x3fff73fff180 (LWP 22802)):

#0  0x00003fff8784e710 in __pthread_cond_wait (cond=0x3fff73ffe230, mutex=0x3fff73ffe200) at pthread_cond_wait.c:187

#1  0x00003fff877c6e4c in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6

#2  0x00003fff822385cc in rocksdb::WriteThread::BlockingAwaitState(rocksdb::WriteThread::Writer*, unsigned char) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00003fff822387c4 in rocksdb::WriteThread::AwaitState(rocksdb::WriteThread::Writer*, unsigned char, rocksdb::WriteThread::AdaptationContext*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00003fff82239208 in rocksdb::WriteThread::JoinBatchGroup(rocksdb::WriteThread::Writer*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00003fff821a5900 in rocksdb::DBImpl::WriteImpl(rocksdb::WriteOptions const&, rocksdb::WriteBatch*, rocksdb::WriteCallback*, unsigned long*, unsigned long, bool, unsigned long*, rocksdb::PreReleaseCallback*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#6  0x00003fff821a72e0 in rocksdb::DBImpl::Write(rocksdb::WriteOptions const&, rocksdb::WriteBatch*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#7  0x00003fff82125164 in myrocks::Rdb_dict_manager::commit(rocksdb::WriteBatch*, bool const&) const () from /usr/lib/mysql/plugin/ha_rocksdb.so

#8  0x00003fff821301b4 in myrocks::Rdb_ddl_manager::persist_stats(bool const&) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#9  0x00003fff820da154 in myrocks::Rdb_background_thread::run() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#10 0x00003fff8213c714 in myrocks::Rdb_thread::thread_func(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#11 0x0000000043f14140 in ?? ()

#12 0x00003fff878489a4 in start_thread (arg=0x3fff73fff180) at pthread_create.c:314

#13 0x00003fff87532f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 2 (Thread 0x3fff737ff180 (LWP 22803)):

#0  0x00003fff87852698 in __lll_lock_wait (futex=0x1000bcbc068, private=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/lowlevellock.c:46

#1  0x00003fff8784b804 in __GI___pthread_mutex_lock (mutex=0x1000bcbc068) at pthread_mutex_lock.c:79

#2  0x00003fff82330068 in rocksdb::port::Mutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00003fff82247cc8 in rocksdb::InstrumentedMutex::LockInternal() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00003fff82247f98 in rocksdb::InstrumentedMutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00003fff8235026c in ?? () from /usr/lib/mysql/plugin/ha_rocksdb.so

#6  0x00003fff823a75a8 in rocksdb::ThreadLocalPtr::StaticMeta::OnThreadExit(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#7  0x00003fff87848604 in __nptl_deallocate_tsd () at pthread_create.c:158

#8  0x00003fff878489b8 in start_thread (arg=0x3fff737ff180) at pthread_create.c:325

#9  0x00003fff87532f40 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104

Thread 1 (Thread 0x3fff87c97310 (LWP 22786)):

#0  0x00003fff8784fcc0 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

#1  0x0000000043fe9130 in my_write_core ()

#2  0x000000004391cee4 in handle_fatal_signal ()

#3  <signal handler called>

#4  0x00003fff8784e710 in __pthread_cond_wait (cond=0x447ba880 <COND_thread_count>, mutex=0x447bae68 <LOCK_thread_count>) at pthread_cond_wait.c:187

#5  0x00000000435e2c38 in mysqld_main(int, char**) ()

#6  0x00000000435b64f0 in main ()

Compressed file /run/shm/var/2/log/rocksdb.max_open_files/mysqld.1/data/core

 - saving '/run/shm/var/2/log/rocksdb.max_open_files/' to '/run/shm/var/log/rocksdb.max_open_files/'

rocksdb.mariadb_ignore_dirs              w3 [ fail ]  Found warnings/errors in server log file!

        Test ended at 2018-06-27 07:35:21

line

Attempting backtrace. You can use the following information to find out

^ Found warnings in /mnt/buildbot/build/mariadb-10.3.8/mysql-test/var/3/log/mysqld.1.err

ok

 - found 'core' (0/0)

Trying 'dbx' to get a backtrace

Trying 'gdb' to get a backtrace from coredump /mnt/buildbot/build/mariadb-10.3.8/mysql-test/var/3/log/rocksdb.mariadb_ignore_dirs/mysqld.1/data/core

Core generated by '/mnt/buildbot/build/mariadb-10.3.8/sql/mysqld'

Output from gdb follows. The first stack trace is from the failing thread.

The following stack traces are from all threads (so the failing one is

duplicated).

--------------------------

[New LWP 20862]

[New LWP 20868]

[New LWP 20867]

[New LWP 20866]

[New LWP 20865]

[New LWP 20864]

[New LWP 20874]

[New LWP 20863]

[New LWP 20870]

[Thread debugging using libthread_db enabled]

Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".

Core was generated by `/mnt/buildbot/build/mariadb-10.3.8/sql/mysqld --defaults-group-suffix=.1 --defa'.

Program terminated with signal SIGABRT, Aborted.

#0  0x00007f574d07059f in pthread_kill () from /lib/x86_64-linux-gnu/libpthread.so.0

[Current thread is 1 (Thread 0x7f574e5128c0 (LWP 20862))]

#0  0x00007f574d07059f in pthread_kill () from /lib/x86_64-linux-gnu/libpthread.so.0

#1  0x000055bbb3ddad37 in my_write_core (sig=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/stacktrace.c:481

#2  0x000055bbb3887762 in handle_fatal_signal (sig=6) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/signal_handler.cc:305

#3  <signal handler called>

#4  0x00007f574d06f360 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0

#5  0x000055bbb35fd779 in inline_mysql_cond_wait (that=0x55bbb474f260 <COND_thread_count>, mutex=0x55bbb474f9e0 <LOCK_thread_count>, src_file=0x55bbb3e62b28 "/home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc", src_line=6202) at /home/buildbot/buildbot/build/mariadb-10.3.8/include/mysql/psi/mysql_thread.h:1167

#6  mysqld_main (argc=154, argv=0x55bbb68bc9f8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc:6202

#7  0x00007f574c62e830 in __libc_start_main () from /lib/x86_64-linux-gnu/libc.so.6

#8  0x000055bbb35ef449 in _start ()

Thread 9 (Thread 0x7f574446a700 (LWP 20870)):

#0  0x00007f574d073156 in sigwait () from /lib/x86_64-linux-gnu/libpthread.so.0

#1  0x000055bbb35f22bb in signal_hand (arg=arg@entry=0x0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc:3553

#2  0x000055bbb3a1a231 in pfs_spawn_thread (arg=0x55bbb6dc6f68) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/perfschema/pfs.cc:1862

#3  0x00007f574d0696ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0

#4  0x00007f574c71482d in clone () from /lib/x86_64-linux-gnu/libc.so.6

Thread 8 (Thread 0x7f57473a9700 (LWP 20863)):

#0  0x00007f574d06f709 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0

#1  0x000055bbb3ddf8bd in inline_mysql_cond_timedwait (that=0x55bbb4fdf7e0 <COND_timer>, mutex=0x55bbb4fdf820 <LOCK_timer>, src_file=0x55bbb3fcc468 "/home/buildbot/buildbot/build/mariadb-10.3.8/mysys/thr_timer.c", src_line=292, abstime=0x7f57473a8ce0) at /home/buildbot/buildbot/build/mariadb-10.3.8/include/mysql/psi/mysql_thread.h:1204

#2  timer_handler (arg=arg@entry=0x0) at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/thr_timer.c:292

#3  0x000055bbb3a1a231 in pfs_spawn_thread (arg=0x55bbb69fdf98) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/perfschema/pfs.cc:1862

#4  0x00007f574d0696ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0

#5  0x00007f574c71482d in clone () from /lib/x86_64-linux-gnu/libc.so.6

Thread 7 (Thread 0x7f574438c700 (LWP 20874)):

#0  0x00007f574d07226d in __lll_lock_wait () from /lib/x86_64-linux-gnu/libpthread.so.0

#1  0x00007f574d06bdbd in pthread_mutex_lock () from /lib/x86_64-linux-gnu/libpthread.so.0

#2  0x00007f57467db021 in rocksdb::port::Mutex::Lock (this=this@entry=0x55bbb6a0a210) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/port/port_posix.cc:60

#3  0x00007f574683bf42 in rocksdb::MutexLock::MutexLock (mu=0x55bbb6a0a210, this=<synthetic pointer>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/util/mutexlock.h:32

#4  rocksdb::ThreadLocalPtr::StaticMeta::Scrape (this=0x55bbb6a0a160, id=2, ptrs=ptrs@entry=0x7f574438ac10, replacement=replacement@entry=0x0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/util/thread_local.cc:440

#5  0x00007f574683c064 in rocksdb::ThreadLocalPtr::Scrape (this=<optimized out>, ptrs=ptrs@entry=0x7f574438ac10, replacement=replacement@entry=0x0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/util/thread_local.cc:546

#6  0x00007f57467f8144 in rocksdb::ColumnFamilyData::ResetThreadLocalSuperVersions (this=this@entry=0x55bbb6c7d4c0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/db/column_family.cc:990

#7  0x00007f57467f8694 in rocksdb::ColumnFamilyData::InstallSuperVersion (this=this@entry=0x55bbb6c7d4c0, sv_context=sv_context@entry=0x7f574438b390, db_mutex=<optimized out>, mutable_cf_options=...) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/db/column_family.cc:985

#8  0x00007f5746646001 in rocksdb::DBImpl::InstallSuperVersionAndScheduleWork (this=this@entry=0x55bbb6c5b870, cfd=cfd@entry=0x55bbb6c7d4c0, sv_context=sv_context@entry=0x7f574438b390, mutable_cf_options=...) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/db/db_impl_compaction_flush.cc:1912

#9  0x00007f574666d206 in rocksdb::DBImpl::SwitchMemtable (this=this@entry=0x55bbb6c5b870, cfd=cfd@entry=0x55bbb6c7d4c0, context=context@entry=0x7f574438b390) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/db/db_impl_write.cc:1339

#10 0x00007f5746645c53 in rocksdb::DBImpl::FlushMemTable (this=this@entry=0x55bbb6c5b870, cfd=0x55bbb6c7d4c0, flush_options=..., writes_stopped=writes_stopped@entry=false) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/db/db_impl_compaction_flush.cc:963

#11 0x00007f5746645f83 in rocksdb::DBImpl::Flush (this=0x55bbb6c5b870, flush_options=..., column_family=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/db/db_impl_compaction_flush.cc:812

#12 0x00007f57465ba6d6 in myrocks::rocksdb_flush_all_memtables () at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/ha_rocksdb.cc:199

#13 0x00007f57465c1b01 in myrocks::rocksdb_done_func (p=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/ha_rocksdb.cc:4851

#14 0x000055bbb3889c86 in ha_finalize_handlerton (plugin=0x55bbb6a07918) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/handler.cc:470

#15 0x000055bbb36b9ca4 in plugin_deinitialize (plugin=0x55bbb6a07918, ref_check=ref_check@entry=true) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_plugin.cc:1235

#16 0x000055bbb36be9be in reap_plugins () at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_plugin.cc:1311

#17 0x000055bbb36bfa15 in plugin_shutdown () at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_plugin.cc:1977

#18 0x000055bbb35f31a6 in clean_up (print_message=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc:2248

#19 0x000055bbb35f349b in clean_up (print_message=true) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc:2122

#20 unireg_end () at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc:2116

#21 0x000055bbb35f62a8 in kill_server (sig_ptr=0x0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc:2043

#22 0x000055bbb35f656e in kill_server_thread (arg=arg@entry=0x7f5744469c38) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc:2066

#23 0x000055bbb3a1a231 in pfs_spawn_thread (arg=0x7f5720001028) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/perfschema/pfs.cc:1862

#24 0x00007f574d0696ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0

#25 0x00007f574c71482d in clone () from /lib/x86_64-linux-gnu/libc.so.6

Thread 6 (Thread 0x7f5745f2e700 (LWP 20864)):

#0  0x00007f574d06f360 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0

#1  0x00007f57467db12d in rocksdb::port::CondVar::Wait (this=this@entry=0x55bbb6c2b558) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/port/port_posix.cc:90

#2  0x00007f57467019e4 in rocksdb::InstrumentedCondVar::WaitInternal (this=this@entry=0x55bbb6c2b558) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/monitoring/instrumented_mutex.cc:60

#3  0x00007f5746701bc8 in rocksdb::InstrumentedCondVar::Wait (this=this@entry=0x55bbb6c2b558) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/monitoring/instrumented_mutex.cc:52

#4  0x00007f5746780d98 in rocksdb::DeleteScheduler::BackgroundEmptyTrash (this=0x55bbb6c2b468) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/util/delete_scheduler.cc:190

#5  0x00007f574cd98c80 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#6  0x00007f574d0696ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0

#7  0x00007f574c71482d in clone () from /lib/x86_64-linux-gnu/libc.so.6

Thread 5 (Thread 0x7f574572d700 (LWP 20865)):

#0  0x00007f574d06f360 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0

#1  0x00007f574cd9391c in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#2  0x00007f574683d1ee in rocksdb::ThreadPoolImpl::Impl::BGThread (this=this@entry=0x55bbb6a0e320, thread_id=thread_id@entry=0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/util/threadpool_imp.cc:183

#3  0x00007f574683d603 in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper (arg=0x55bbb6c5a160) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/util/threadpool_imp.cc:278

#4  0x00007f574cd98c80 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#5  0x00007f574d0696ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0

#6  0x00007f574c71482d in clone () from /lib/x86_64-linux-gnu/libc.so.6

Thread 4 (Thread 0x7f5744f2c700 (LWP 20866)):

#0  0x00007f574d06f360 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0

#1  0x00007f574cd9391c in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#2  0x00007f574683d1ee in rocksdb::ThreadPoolImpl::Impl::BGThread (this=this@entry=0x55bbb6a0e610, thread_id=thread_id@entry=0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/util/threadpool_imp.cc:183

#3  0x00007f574683d603 in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper (arg=0x55bbb6c5c5f0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/util/threadpool_imp.cc:278

#4  0x00007f574cd98c80 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#5  0x00007f574d0696ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0

#6  0x00007f574c71482d in clone () from /lib/x86_64-linux-gnu/libc.so.6

Thread 3 (Thread 0x7f573ff2f700 (LWP 20867)):

#0  0x00007f574d07226d in __lll_lock_wait () from /lib/x86_64-linux-gnu/libpthread.so.0

#1  0x00007f574d06bdbd in pthread_mutex_lock () from /lib/x86_64-linux-gnu/libpthread.so.0

#2  0x00007f57467db021 in rocksdb::port::Mutex::Lock (this=this@entry=0x55bbb6c5bd28) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/port/port_posix.cc:60

#3  0x00007f57467014e4 in rocksdb::InstrumentedMutex::LockInternal (this=this@entry=0x55bbb6c5bd28) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/monitoring/instrumented_mutex.cc:38

#4  0x00007f57467016c8 in rocksdb::InstrumentedMutex::Lock (this=this@entry=0x55bbb6c5bd28) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/monitoring/instrumented_mutex.cc:30

#5  0x00007f574662fd3f in rocksdb::InstrumentedMutexLock::InstrumentedMutexLock (mutex=0x55bbb6c5bd28, this=<synthetic pointer>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/monitoring/instrumented_mutex.h:56

#6  rocksdb::DBImpl::SyncWAL (this=0x55bbb6c5b870) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/db/db_impl.cc:686

#7  0x00007f5746627dc0 in rocksdb::DBImpl::FlushWAL (this=0x55bbb6c5b870, sync=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/db/db_impl.cc:677

#8  0x00007f57465d58a7 in rocksdb::StackableDB::FlushWAL (sync=true, this=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/include/rocksdb/utilities/stackable_db.h:273

#9  myrocks::Rdb_background_thread::run (this=0x7f5746b64340 <myrocks::rdb_bg_thread>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/ha_rocksdb.cc:12804

#10 0x00007f57466136fe in myrocks::Rdb_thread::thread_func (thread_ptr=thread_ptr@entry=0x7f5746b64340 <myrocks::rdb_bg_thread>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rdb_threads.cc:34

#11 0x000055bbb3a1a231 in pfs_spawn_thread (arg=0x55bbb6c72e48) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/perfschema/pfs.cc:1862

#12 0x00007f574d0696ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0

#13 0x00007f574c71482d in clone () from /lib/x86_64-linux-gnu/libc.so.6

Thread 2 (Thread 0x7f573f72e700 (LWP 20868)):

#0  0x00007f574d07226d in __lll_lock_wait () from /lib/x86_64-linux-gnu/libpthread.so.0

#1  0x00007f574d06bdbd in pthread_mutex_lock () from /lib/x86_64-linux-gnu/libpthread.so.0

#2  0x00007f57467db021 in rocksdb::port::Mutex::Lock (this=this@entry=0x55bbb6c5bd28) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/port/port_posix.cc:60

#3  0x00007f57467014e4 in rocksdb::InstrumentedMutex::LockInternal (this=this@entry=0x55bbb6c5bd28) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/monitoring/instrumented_mutex.cc:38

#4  0x00007f57467016c8 in rocksdb::InstrumentedMutex::Lock (this=0x55bbb6c5bd28) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/monitoring/instrumented_mutex.cc:30

#5  0x00007f57467f661c in rocksdb::(anonymous namespace)::SuperVersionUnrefHandle (ptr=0x55bbb6c9e6b0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/db/column_family.cc:348

#6  0x00007f574683b8d5 in rocksdb::ThreadLocalPtr::StaticMeta::OnThreadExit (ptr=0x7f5728000b90) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/rocksdb/rocksdb/util/thread_local.cc:298

#7  0x00007f574d068439 in __nptl_deallocate_tsd.part.4 () from /lib/x86_64-linux-gnu/libpthread.so.0

#8  0x00007f574d069870 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0

#9  0x00007f574c71482d in clone () from /lib/x86_64-linux-gnu/libc.so.6

Thread 1 (Thread 0x7f574e5128c0 (LWP 20862)):

#0  0x00007f574d07059f in pthread_kill () from /lib/x86_64-linux-gnu/libpthread.so.0

#1  0x000055bbb3ddad37 in my_write_core (sig=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/stacktrace.c:481

#2  0x000055bbb3887762 in handle_fatal_signal (sig=6) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/signal_handler.cc:305

#3  <signal handler called>

#4  0x00007f574d06f360 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0

#5  0x000055bbb35fd779 in inline_mysql_cond_wait (that=0x55bbb474f260 <COND_thread_count>, mutex=0x55bbb474f9e0 <LOCK_thread_count>, src_file=0x55bbb3e62b28 "/home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc", src_line=6202) at /home/buildbot/buildbot/build/mariadb-10.3.8/include/mysql/psi/mysql_thread.h:1167

#6  mysqld_main (argc=154, argv=0x55bbb68bc9f8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc:6202

#7  0x00007f574c62e830 in __libc_start_main () from /lib/x86_64-linux-gnu/libc.so.6

#8  0x000055bbb35ef449 in _start ()

rocksdb.autoinc_crash_safe_partition 'row' w4 [ fail ]  Found warnings/errors in server log file!

        Test ended at 2018-06-30 12:52:57

line

Attempting backtrace. You can use the following information to find out

Attempting backtrace. You can use the following information to find out

^ Found warnings in /dev/shm/var/4/log/mysqld.1.err

ok

 - found 'core' (0/0)

Trying 'dbx' to get a backtrace

Trying 'gdb' to get a backtrace from coredump /dev/shm/var/4/log/rocksdb.autoinc_crash_safe_partition-row/mysqld.1/data/core

Core generated by '/usr/sbin/mysqld'

Output from gdb follows. The first stack trace is from the failing thread.

The following stack traces are from all threads (so the failing one is

duplicated).

--------------------------

[New LWP 18818]

[New LWP 19904]

[New LWP 19921]

[New LWP 19922]

[New LWP 20052]

[New LWP 20051]

[New LWP 20199]

[New LWP 24179]

[New LWP 19857]

Warning: couldn't activate thread debugging using libthread_db: Cannot find new threads: debugger service failed

warning: File "/lib/x86_64-linux-gnu/libthread_db-1.0.so" auto-loading has been declined by your `auto-load safe-path' set to "$debugdir:$datadir/auto-load".

To enable execution of this file add

	add-auto-load-safe-path /lib/x86_64-linux-gnu/libthread_db-1.0.so

line to your configuration file "/home/buildbot/.gdbinit".

To completely disable this security protection add

	set auto-load safe-path /

line to your configuration file "/home/buildbot/.gdbinit".

For more information about this security protection see the

"Auto-loading safe path" section in the GDB manual.  E.g., run from the shell:

	info "(gdb)Auto-loading safe path"

warning: Unable to find libthread_db matching inferior's thread library, thread debugging will not be available.

Warning: couldn't activate thread debugging using libthread_db: Cannot find new threads: debugger service failed

warning: File "/lib/x86_64-linux-gnu/libthread_db-1.0.so" auto-loading has been declined by your `auto-load safe-path' set to "$debugdir:$datadir/auto-load".

warning: Unable to find libthread_db matching inferior's thread library, thread debugging will not be available.

Core was generated by `/usr/sbin/mysqld --defaults-group-suffix=.1 --defaults-file=/dev/shm/var/4/my.c'.

Program terminated with signal SIGABRT, Aborted.

#0  0x00007f3c25c2e0c1 in __pthread_kill (threadid=<optimized out>, signo=6) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

61	../nptl/sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.

#0  0x00007f3c25c2e0c1 in __pthread_kill (threadid=<optimized out>, signo=6) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

#1  0x00007f3c267e5542 in handle_fatal_signal ()

#2  <signal handler called>

#3  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#4  0x00007f3c2654c5cd in mysqld_main(int, char**) ()

#5  0x00007f3c23fa9b45 in __libc_start_main (main=0x7f3c26527e90 <main>, argc=24, argv=0x7ffd21f10708, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7ffd21f106f8) at libc-start.c:287

#6  0x00007f3c2653dfcd in _start ()

Thread 9 (LWP 19857):

#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238

#1  0x0000000000000000 in ?? ()

Thread 8 (LWP 24179):

#0  __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135

#1  0x00007f3c25c2b479 in _L_lock_909 () from /lib/x86_64-linux-gnu/libpthread.so.0

#2  0x00007f3c25c2b2a0 in __GI___pthread_mutex_lock (mutex=0x7f3c29008c80) at ../nptl/pthread_mutex_lock.c:79

#3  0x00007f3c1e375971 in rocksdb::port::Mutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00007f3c1e3d5c32 in rocksdb::ThreadLocalPtr::StaticMeta::Scrape(unsigned int, rocksdb::autovector<void*, 8ul>*, void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00007f3c1e390a84 in rocksdb::ColumnFamilyData::ResetThreadLocalSuperVersions() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#6  0x00007f3c1e390ed2 in rocksdb::ColumnFamilyData::InstallSuperVersion(rocksdb::SuperVersionContext*, rocksdb::InstrumentedMutex*, rocksdb::MutableCFOptions const&) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#7  0x00007f3c1e1e9002 in rocksdb::DBImpl::InstallSuperVersionAndScheduleWork(rocksdb::ColumnFamilyData*, rocksdb::SuperVersionContext*, rocksdb::MutableCFOptions const&) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#8  0x00007f3c1e20dd23 in rocksdb::DBImpl::SwitchMemtable(rocksdb::ColumnFamilyData*, rocksdb::DBImpl::WriteContext*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#9  0x00007f3c1e1e8b41 in rocksdb::DBImpl::FlushMemTable(rocksdb::ColumnFamilyData*, rocksdb::FlushOptions const&, bool) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#10 0x00007f3c1e1e8f83 in rocksdb::DBImpl::Flush(rocksdb::FlushOptions const&, rocksdb::ColumnFamilyHandle*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#11 0x00007f3c1e169c1e in ?? () from /usr/lib/mysql/plugin/ha_rocksdb.so

#12 0x00007f3c1e16e5bd in ?? () from /usr/lib/mysql/plugin/ha_rocksdb.so

#13 0x00007f3c267e7ab6 in ha_finalize_handlerton(st_plugin_int*) ()

#14 0x00007f3c2660d804 in ?? ()

#15 0x00007f3c266115fe in ?? ()

#16 0x00007f3c26612365 in plugin_shutdown() ()

#17 0x00007f3c26541af6 in ?? ()

#18 0x00007f3c26541e5b in unireg_end() ()

#19 0x00007f3c26544c38 in ?? ()

#20 0x00007f3c26544fee in kill_server_thread ()

#21 0x00007f3c26c08aa1 in ?? ()

#22 0x00007f3c25c29064 in start_thread (arg=0x7f3c0e009700) at pthread_create.c:309

#23 0x00007f3c2407062d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 7 (LWP 20199):

#0  do_sigwait (set=<optimized out>, sig=0x7f3c1c1edd78) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:63

#1  0x00007f3c25c30653 in __sigwait (set=0x7f3c1c1eddd0, sig=0x0) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:97

#2  0x00007f3c2654118b in signal_hand ()

#3  0x00007f3c26c08aa1 in ?? ()

#4  0x00007f3c25c29064 in start_thread (arg=0x7f3c1c1ee700) at pthread_create.c:309

#5  0x00007f3c2407062d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 6 (LWP 20051):

#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238

#1  0x00007f3c1e16b1b6 in myrocks::Rdb_background_thread::run() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#2  0x00007f3c1e1b577e in myrocks::Rdb_thread::thread_func(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00007f3c26c08aa1 in ?? ()

#4  0x00007f3c25c29064 in start_thread (arg=0x7f3c0ffff700) at pthread_create.c:309

#5  0x00007f3c2407062d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 5 (LWP 20052):

#0  __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135

#1  0x00007f3c25c2b479 in _L_lock_909 () from /lib/x86_64-linux-gnu/libpthread.so.0

#2  0x00007f3c25c2b2a0 in __GI___pthread_mutex_lock (mutex=0x7f3c29266c60) at ../nptl/pthread_mutex_lock.c:79

#3  0x00007f3c1e375971 in rocksdb::port::Mutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00007f3c1e2a5c78 in rocksdb::InstrumentedMutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00007f3c1e39085c in ?? () from /usr/lib/mysql/plugin/ha_rocksdb.so

#6  0x00007f3c1e3d57d5 in rocksdb::ThreadLocalPtr::StaticMeta::OnThreadExit(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#7  0x00007f3c25c28e22 in __nptl_deallocate_tsd () at pthread_create.c:157

#8  0x00007f3c25c29077 in start_thread (arg=0x7f3c0f7fe700) at pthread_create.c:322

#9  0x00007f3c2407062d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 4 (LWP 19922):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00007f3c246e6c7c in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#2  0x00007f3c1e3d73d9 in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00007f3c1e3d77cf in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00007f3c246ea970 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#5  0x00007f3c25c29064 in start_thread (arg=0x7f3c1ccfa700) at pthread_create.c:309

#6  0x00007f3c2407062d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 3 (LWP 19921):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00007f3c246e6c7c in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#2  0x00007f3c1e3d73d9 in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00007f3c1e3d77cf in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00007f3c246ea970 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#5  0x00007f3c25c29064 in start_thread (arg=0x7f3c1d4fb700) at pthread_create.c:309

#6  0x00007f3c2407062d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 2 (LWP 19904):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00007f3c1e375a7d in rocksdb::port::CondVar::Wait() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#2  0x00007f3c1e2a5f38 in rocksdb::InstrumentedCondVar::Wait() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00007f3c1e324898 in rocksdb::DeleteScheduler::BackgroundEmptyTrash() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00007f3c246ea970 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#5  0x00007f3c25c29064 in start_thread (arg=0x7f3c1dcfc700) at pthread_create.c:309

#6  0x00007f3c2407062d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 1 (LWP 18818):

#0  0x00007f3c25c2e0c1 in __pthread_kill (threadid=<optimized out>, signo=6) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

#1  0x00007f3c267e5542 in handle_fatal_signal ()

#2  <signal handler called>

#3  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#4  0x00007f3c2654c5cd in mysqld_main(int, char**) ()

#5  0x00007f3c23fa9b45 in __libc_start_main (main=0x7f3c26527e90 <main>, argc=24, argv=0x7ffd21f10708, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7ffd21f106f8) at libc-start.c:287

#6  0x00007f3c2653dfcd in _start ()

rocksdb_sys_vars.rocksdb_rate_limiter_bytes_per_sec_basic w1 [ fail ]  Found warnings/errors in server log file!

        Test ended at 2018-07-04 15:32:01

line

Attempting backtrace. You can use the following information to find out

^ Found warnings in /run/shm/var/1/log/mysqld.1.err

ok

 - found 'core' (0/0)

Trying 'dbx' to get a backtrace

Trying 'gdb' to get a backtrace from coredump /run/shm/var/1/log/rocksdb_sys_vars.rocksdb_rate_limiter_bytes_per_sec_basic/mysqld.1/data/core

Core generated by '/usr/sbin/mysqld'

Output from gdb follows. The first stack trace is from the failing thread.

The following stack traces are from all threads (so the failing one is

duplicated).

--------------------------

[New LWP 16471]

[New LWP 17644]

[New LWP 17643]

[New LWP 17529]

[New LWP 17594]

[New LWP 17789]

[New LWP 17790]

[New LWP 17904]

[New LWP 2555]

[Thread debugging using libthread_db enabled]

Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".

Core was generated by `/usr/sbin/mysqld --defaults-group-suffix=.1 --defaults-file=/run/shm/var/1/my.c'.

Program terminated with signal SIGABRT, Aborted.

#0  0x00007fbd7e1ef611 in __pthread_kill (threadid=<optimized out>, signo=6) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

61	../nptl/sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.

#0  0x00007fbd7e1ef611 in __pthread_kill (threadid=<optimized out>, signo=6) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

#1  0x00007fbd800412a2 in handle_fatal_signal ()

#2  <signal handler called>

#3  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#4  0x00007fbd7fdba0d4 in mysqld_main(int, char**) ()

#5  0x00007fbd7d830f45 in __libc_start_main (main=0x7fbd7fd92010 <main>, argc=21, argv=0x7fff09866c08, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7fff09866bf8) at libc-start.c:287

#6  0x00007fbd7fdad0cd in _start ()

Thread 9 (Thread 0x7fbd743d8700 (LWP 2555)):

#0  __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135

#1  0x00007fbd7e1ec649 in _L_lock_909 () from /lib/x86_64-linux-gnu/libpthread.so.0

#2  0x00007fbd7e1ec470 in __GI___pthread_mutex_lock (mutex=0x7fbd82ac0ef8) at ../nptl/pthread_mutex_lock.c:79

#3  0x00007fbd78548c51 in rocksdb::port::Mutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00007fbd785a6442 in rocksdb::ThreadLocalPtr::StaticMeta::Scrape(unsigned int, rocksdb::autovector<void*, 8ul>*, void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00007fbd785616c4 in rocksdb::ColumnFamilyData::ResetThreadLocalSuperVersions() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#6  0x00007fbd78561bc6 in rocksdb::ColumnFamilyData::InstallSuperVersion(rocksdb::SuperVersionContext*, rocksdb::InstrumentedMutex*, rocksdb::MutableCFOptions const&) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#7  0x00007fbd783e7032 in rocksdb::DBImpl::InstallSuperVersionAndScheduleWork(rocksdb::ColumnFamilyData*, rocksdb::SuperVersionContext*, rocksdb::MutableCFOptions const&) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#8  0x00007fbd7840ade3 in rocksdb::DBImpl::SwitchMemtable(rocksdb::ColumnFamilyData*, rocksdb::DBImpl::WriteContext*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#9  0x00007fbd783e6b42 in rocksdb::DBImpl::FlushMemTable(rocksdb::ColumnFamilyData*, rocksdb::FlushOptions const&, bool) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#10 0x00007fbd783e6fb3 in rocksdb::DBImpl::Flush(rocksdb::FlushOptions const&, rocksdb::ColumnFamilyHandle*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#11 0x00007fbd785379f9 in rocksdb::StackableDB::Flush(rocksdb::FlushOptions const&, rocksdb::ColumnFamilyHandle*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#12 0x00007fbd7836782c in ?? () from /usr/lib/mysql/plugin/ha_rocksdb.so

#13 0x00007fbd7836cefd in ?? () from /usr/lib/mysql/plugin/ha_rocksdb.so

#14 0x00007fbd80043636 in ha_finalize_handlerton(st_plugin_int*) ()

#15 0x00007fbd7fe79d64 in ?? ()

#16 0x00007fbd7fe7cc3e in ?? ()

#17 0x00007fbd7fe7d533 in plugin_shutdown() ()

#18 0x00007fbd7fdb0dca in ?? ()

#19 0x00007fbd7fdb10ab in unireg_end() ()

#20 0x00007fbd7fdb49d9 in ?? ()

#21 0x00007fbd7fdb4a1e in kill_server_thread ()

#22 0x00007fbd801edfed in ?? ()

#23 0x00007fbd7e1ea184 in start_thread (arg=0x7fbd743d8700) at pthread_create.c:312

#24 0x00007fbd7d90d03d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 8 (Thread 0x7fbd744b6700 (LWP 17904)):

#0  0x00007fbd7e1f20c1 in do_sigwait (sig=0x7fbd744b5d70, set=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:60

#1  __sigwait (set=0x7fbd744b5dd0, sig=0x7fbd744b5d70) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:97

#2  0x00007fbd7fdb036b in signal_hand ()

#3  0x00007fbd801edfed in ?? ()

#4  0x00007fbd7e1ea184 in start_thread (arg=0x7fbd744b6700) at pthread_create.c:312

#5  0x00007fbd7d90d03d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 7 (Thread 0x7fbd75f22700 (LWP 17790)):

#0  __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135

#1  0x00007fbd7e1ec649 in _L_lock_909 () from /lib/x86_64-linux-gnu/libpthread.so.0

#2  0x00007fbd7e1ec470 in __GI___pthread_mutex_lock (mutex=0x7fbd82d1d778) at ../nptl/pthread_mutex_lock.c:79

#3  0x00007fbd78548c51 in rocksdb::port::Mutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00007fbd784915b5 in rocksdb::InstrumentedMutex::Lock() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#5  0x00007fbd785614bc in ?? () from /usr/lib/mysql/plugin/ha_rocksdb.so

#6  0x00007fbd785a5e45 in rocksdb::ThreadLocalPtr::StaticMeta::OnThreadExit(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#7  0x00007fbd7e1e9f82 in __nptl_deallocate_tsd () at pthread_create.c:158

#8  0x00007fbd7e1ea197 in start_thread (arg=0x7fbd75f22700) at pthread_create.c:325

#9  0x00007fbd7d90d03d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 6 (Thread 0x7fbd76723700 (LWP 17789)):

#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238

#1  0x00007fbd78368956 in myrocks::Rdb_background_thread::run() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#2  0x00007fbd783b57ea in myrocks::Rdb_thread::thread_func(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00007fbd801edfed in ?? ()

#4  0x00007fbd7e1ea184 in start_thread (arg=0x7fbd76723700) at pthread_create.c:312

#5  0x00007fbd7d90d03d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 5 (Thread 0x7fbd77f26700 (LWP 17594)):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00007fbd78548d5d in rocksdb::port::CondVar::Wait() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#2  0x00007fbd784917d5 in rocksdb::InstrumentedCondVar::Wait() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00007fbd78503528 in rocksdb::DeleteScheduler::BackgroundEmptyTrash() () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00007fbd7df8fa60 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#5  0x00007fbd7e1ea184 in start_thread (arg=0x7fbd77f26700) at pthread_create.c:312

#6  0x00007fbd7d90d03d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 4 (Thread 0x7fbd791c3700 (LWP 17529)):

#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238

#1  0x00007fbd805a756a in ?? ()

#2  0x00007fbd801edfed in ?? ()

#3  0x00007fbd7e1ea184 in start_thread (arg=0x7fbd791c3700) at pthread_create.c:312

#4  0x00007fbd7d90d03d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 3 (Thread 0x7fbd77725700 (LWP 17643)):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00007fbd7df8c4dc in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#2  0x00007fbd785a7f63 in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00007fbd785a8337 in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00007fbd7df8fa60 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#5  0x00007fbd7e1ea184 in start_thread (arg=0x7fbd77725700) at pthread_create.c:312

#6  0x00007fbd7d90d03d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 2 (Thread 0x7fbd76f24700 (LWP 17644)):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00007fbd7df8c4dc in std::condition_variable::wait(std::unique_lock<std::mutex>&) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#2  0x00007fbd785a7f63 in rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#3  0x00007fbd785a8337 in rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*) () from /usr/lib/mysql/plugin/ha_rocksdb.so

#4  0x00007fbd7df8fa60 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6

#5  0x00007fbd7e1ea184 in start_thread (arg=0x7fbd76f24700) at pthread_create.c:312

#6  0x00007fbd7d90d03d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 1 (Thread 0x7fbd7f8b2780 (LWP 16471)):

#0  0x00007fbd7e1ef611 in __pthread_kill (threadid=<optimized out>, signo=6) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

#1  0x00007fbd800412a2 in handle_fatal_signal ()

#2  <signal handler called>

#3  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#4  0x00007fbd7fdba0d4 in mysqld_main(int, char**) ()

#5  0x00007fbd7d830f45 in __libc_start_main (main=0x7fbd7fd92010 <main>, argc=21, argv=0x7fff09866c08, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7fff09866bf8) at libc-start.c:287

#6  0x00007fbd7fdad0cd in _start ()

$ ./mysql-test-run --mysqld=--plugin-load-add=ha_rocksdb rocksdb.allow_no_primary_key_with_sk

Logging: /home/mlin/mariadb/server/mysql-test/mysql-test-run.pl  --mysqld=--plugin-load-add=ha_rocksdb rocksdb.allow_no_primary_key_with_sk

vardir: /home/mlin/mariadb/build/mysql-test/var

Checking leftover processes...

Removing old var directory...

Creating var directory '/home/mlin/mariadb/build/mysql-test/var'...

Checking supported features...

MariaDB Version 10.3.10-MariaDB-debug

 - SSL connections supported

 - binaries are debug compiled

Collecting tests...

Installing system database...

==============================================================================

TEST                                      RESULT   TIME (ms) or COMMENT

--------------------------------------------------------------------------

worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 16000..16019

rocksdb.allow_no_primary_key_with_sk     [ pass ]  19686

--------------------------------------------------------------------------

The servers were restarted 0 times

Spent 19.686 of 34 seconds executing testcases

Completed: All 1 tests were successful.