[MDEV-9272] apt-get upgrade to 10.1.9 fails on Debian Created: 2015-12-12  Updated: 2016-02-01  Resolved: 2016-02-01

Status: Closed
Project: MariaDB Server
Component/s: Storage Engine - InnoDB, Storage Engine - XtraDB
Affects Version/s: 10.1.9, 10.1.11
Fix Version/s: 10.1.9

Type: Bug Priority: Critical
Reporter: Daniel Norton Assignee: Jan Lindström (Inactive)
Resolution: Fixed Votes: 0
Labels: crash, debian, installer
Environment:

3.2.0-4-amd64 #1 SMP Debian 3.2.54-2 x86_64 GNU/Linux
Debian GNU/Linux 7.9 (wheezy)
VM at DigitalOcean

Issue Links:
Duplicate
duplicates MDEV-9177 upgrade from 10.1.8 to 10.1.9 crashes... Closed

 Description   

I am dead in the water. Downgrade attempts are failing

(I show install command instead of upgrade command because I have uninstalled / reinstalled with identical failure.)

# apt-get install mariadb-server
 
Reading package lists... Done
 
Building dependency tree
 
Reading state information... Done
 
The following packages were automatically installed and are no longer required:
 
  libphp5-embed mysql-common-5.6
 
Use 'apt-get autoremove' to remove them.
 
The following extra packages will be installed:
 
  libdbd-mysql-perl libmariadbclient18 libmysqlclient18 mariadb-client-10.1 mariadb-client-core-10.1 mariadb-common
 
  mariadb-server-10.1 mariadb-server-core-10.1
 
Suggested packages:
 
  mariadb-test netcat-openbsd socat tinyca
 
The following NEW packages will be installed:
 
  libdbd-mysql-perl libmariadbclient18 libmysqlclient18 mariadb-client-10.1 mariadb-client-core-10.1 mariadb-common mariadb-server
 
  mariadb-server-10.1 mariadb-server-core-10.1
 
0 upgraded, 9 newly installed, 0 to remove and 1 not upgraded.
 
Need to get 0 B/37.7 MB of archives.
 
After this operation, 132 MB of additional disk space will be used.
 
Do you want to continue [Y/n]?
 
Preconfiguring packages ...
 
Selecting previously unselected package mariadb-common.
 
(Reading database ... 59260 files and directories currently installed.)
 
Unpacking mariadb-common (from .../mariadb-common_10.1.9+maria-1~wheezy_all.deb) ...
 
Selecting previously unselected package libmariadbclient18.
 
Unpacking libmariadbclient18 (from .../libmariadbclient18_10.1.9+maria-1~wheezy_amd64.deb) ...
 
Selecting previously unselected package libmysqlclient18.
 
Unpacking libmysqlclient18 (from .../libmysqlclient18_10.1.9+maria-1~wheezy_amd64.deb) ...
 
Selecting previously unselected package libdbd-mysql-perl.
 
Unpacking libdbd-mysql-perl (from .../libdbd-mysql-perl_4.021-1+b1_amd64.deb) ...
 
Selecting previously unselected package mariadb-client-core-10.1.
 
Unpacking mariadb-client-core-10.1 (from .../mariadb-client-core-10.1_10.1.9+maria-1~wheezy_amd64.deb) ...
 
Selecting previously unselected package mariadb-client-10.1.
 
Unpacking mariadb-client-10.1 (from .../mariadb-client-10.1_10.1.9+maria-1~wheezy_amd64.deb) ...
 
Selecting previously unselected package mariadb-server-core-10.1.
 
Unpacking mariadb-server-core-10.1 (from .../mariadb-server-core-10.1_10.1.9+maria-1~wheezy_amd64.deb) ...
 
Processing triggers for man-db ...
 
Setting up mariadb-common (10.1.9+maria-1~wheezy) ...
 
Selecting previously unselected package mariadb-server-10.1.
 
(Reading database ... 59430 files and directories currently installed.)
 
Unpacking mariadb-server-10.1 (from .../mariadb-server-10.1_10.1.9+maria-1~wheezy_amd64.deb) ...
 
Stopping MariaDB database server: mysqld.
 
Selecting previously unselected package mariadb-server.
 
Unpacking mariadb-server (from .../mariadb-server_10.1.9+maria-1~wheezy_all.deb) ...
 
Processing triggers for man-db ...
 
Setting up libmysqlclient18 (10.1.9+maria-1~wheezy) ...
 
Setting up libdbd-mysql-perl (4.021-1+b1) ...
 
Setting up libmariadbclient18 (10.1.9+maria-1~wheezy) ...
 
Setting up mariadb-client-core-10.1 (10.1.9+maria-1~wheezy) ...
 
Setting up mariadb-client-10.1 (10.1.9+maria-1~wheezy) ...
 
Setting up mariadb-server-core-10.1 (10.1.9+maria-1~wheezy) ...
 
Setting up mariadb-server-10.1 (10.1.9+maria-1~wheezy) ...
 
Stopping MariaDB database server: mysqld.
 
/var/lib/dpkg/info/mariadb-server-10.1.postinst: line 241: deb-systemd-helper: command not found
 
Starting MariaDB database server: mysqld . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . failed!
 
invoke-rc.d: initscript mysql, action "start" failed.
 
dpkg: error processing mariadb-server-10.1 (--configure):
 
 subprocess installed post-installation script returned error exit status 1
 
dpkg: dependency problems prevent configuration of mariadb-server:
 
 mariadb-server depends on mariadb-server-10.1 (= 10.1.9+maria-1~wheezy); however:
 
  Package mariadb-server-10.1 is not configured yet.
 
 
 
dpkg: error processing mariadb-server (--configure):
 
 dependency problems - leaving unconfigured
 
Errors were encountered while processing:
 
 mariadb-server-10.1
 
 mariadb-server   
E: Sub-process /usr/bin/dpkg returned an error code (1)

====

2015-12-12 18:37:43 140389541214048 [Note] mysqld (mysqld 10.1.9-MariaDB-1~wheezy-log) starting as process 8650 ...
 
2015-12-12 18:37:43 140389541214048 [Note] Using unique option prefix 'myisam_recover' is error-prone and can break in the future. Please use the full name 'myisam-recover-options' instead.
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Using mutexes to ref count buffer pool pages
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: The InnoDB memory heap is disabled
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Memory barrier is not used
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Compressed tables use zlib 1.2.7
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Using Linux native AIO
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Using CPU crc32 instructions
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Initializing buffer pool, size = 256.0M
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Completed initialization of buffer pool
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Highest supported file format is Barracuda.
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Log scan progressed past the checkpoint lsn 536517802
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Database was not shutdown normally!
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Starting crash recovery.
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Reading tablespace information from the .ibd files...
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Restoring possible half-written data pages 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: from the doublewrite buffer...
 
InnoDB: Doing recovery: scanned up to log sequence number 536517812
 
InnoDB: Last MySQL binlog file position 0 215898, file name /var/log/mysql/mariadb-bin.000493
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: 128 rollback segment(s) are active.
 
2015-12-12 18:37:43 140389541214048 [Note] InnoDB: Waiting for purge to start
 
151212 18:37:43 [ERROR] mysqld got signal 11 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see http://kb.askmonty.org/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.1.9-MariaDB-1~wheezy-log
 
key_buffer_size=134217728
 
read_buffer_size=2097152
 
max_used_connections=0
 
max_threads=102
 
thread_count=0
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 759822 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0x0
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x0 thread_stack 0x48000
 
addr2line: 'mysqld': No such file
 
mysqld(my_print_stacktrace+0x2b)[0x7faefd64c1ab]
 
mysqld(handle_fatal_signal+0x475)[0x7faefd1ad1e5]
 
/lib/x86_64-linux-gnu/libpthread.so.0(+0xf0a0)[0x7faefc7a60a0]
 
mysqld(+0x85e5b7)[0x7faefd4335b7]
 
mysqld(+0x82da7f)[0x7faefd402a7f]
 
mysqld(+0x7f3f6f)[0x7faefd3c8f6f]
 
mysqld(+0x85ba71)[0x7faefd430a71]
 
mysqld(+0x84957d)[0x7faefd41e57d]
 
/lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50)[0x7faefc79db50]
 
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7faefac6895d]
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.



 Comments   
Comment by Daniel Norton [ 2015-12-12 ]

Also, here's /etc/apt/sources.list

deb http://mirrors.digitalocean.com/debian wheezy main
 
deb http://security.debian.org/ wheezy/updates main
 
deb http://nyc2.mirrors.digitalocean.com/mariadb/repo/10.1/debian wheezy main
 
deb-src http://nyc2.mirrors.digitalocean.com/mariadb/repo/10.1/debian wheezy main

Comment by Elena Stepanova [ 2015-12-16 ]

Do you upgrade from 10.1.8, or from 10.0?
If it's an upgrade from 10.1.8, it might be the problem that jplindst recently dealt with – Jan, does it look likely?

Comment by Jan Lindström (Inactive) [ 2015-12-16 ]

Yes, it looks likely if it was 10.1.8 or earlier 10.1.

Comment by Elena Stepanova [ 2016-01-14 ]

jplindst, could you please put here links to other issues in scope of which you worked on (presumably) the same problem? Hopefully they also have suggestions on how to work around the problem when it already happened.

Comment by Jan Lindström (Inactive) [ 2016-01-15 ]

Given information is not enough to verify is this same as MDEV-9177, if you get a core file, please open that with gdb or ddd and provide output from thread apply all bt

Comment by Daniel Norton [ 2016-01-31 ]

The output below is from running 10.1.11, built from source with debugging enabled. The same databases are used. It seems that the existing databases are triggering the crash.

cmake . -DCMAKE_BUILD_TYPE=Debug
 
make
 
make install

===

Program terminated with signal 11, Segmentation fault.
 
#0  0x00007ff2075ed55c in pthread_kill () from /lib/x86_64-linux-gnu/libpthread.so.0
 
(gdb) thread apply all bt

===

Thread 26 (Thread 0x7ff207a0a720 (LWP 6707)):
 
#0  0x00007ff205ad2d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
 
#1  0x00007ff207e66d7f in handle_connections_sockets () at /home/danorton/src/mariadb-10.1.11/sql/mysqld.cc:6527
 
#2  0x00007ff207e65cec in mysqld_main (argc=56, argv=0x7ff209c7a9e0) at /home/danorton/src/mariadb-10.1.11/sql/mysqld.cc:5952
 
#3  0x00007ff207e5ae00 in main (argc=9, argv=0x7fff9c444998) at /home/danorton/src/mariadb-10.1.11/sql/main.cc:25
 
 
 
Thread 25 (Thread 0x7ff1d34b9700 (LWP 6726)):
 
#0  0x00007ff205ad7453 in select () from /lib/x86_64-linux-gnu/libc.so.6
 
#1  0x00007ff208547303 in os_thread_sleep (tm=1000000) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0thread.cc:285
 
#2  0x00007ff208609f78 in srv_master_sleep () at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0srv.cc:3132
 
#3  0x00007ff20860a0b4 in srv_master_thread (arg=0x0) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0srv.cc:3180
 
#4  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#5  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#6  0x0000000000000000 in ?? ()
 
 
 
Thread 24 (Thread 0x7ff1d3cba700 (LWP 6725)):
 
#0  0x00007ff2075ec6bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#1  0x00007ff208545f8c in os_cond_wait_timed (cond=0x7ff1e803af90, fast_mutex=0x7ff1e803af50, abstime=0x7ff1d3cb9e30)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0sync.cc:177
 
#2  0x00007ff208546783 in os_event_wait_time_low (event=0x7ff1e803af50, time_in_usec=5000000, reset_sig_count=1)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0sync.cc:705
 
#3  0x00007ff2086080c7 in srv_monitor_thread (arg=0x0) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0srv.cc:2118
 
#4  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#5  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#6  0x0000000000000000 in ?? ()
 
 
 
Thread 23 (Thread 0x7ff1d44bb700 (LWP 6724)):
 
#0  0x00007ff2075ec6bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#1  0x00007ff208545f8c in os_cond_wait_timed (cond=0x7ff1e803af00, fast_mutex=0x7ff1e803aec0, abstime=0x7ff1d44bae00)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0sync.cc:177
 
#2  0x00007ff208546783 in os_event_wait_time_low (event=0x7ff1e803aec0, time_in_usec=1000000, reset_sig_count=1)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0sync.cc:705
 
#3  0x00007ff20860889d in srv_error_monitor_thread (arg=0x0) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0srv.cc:2394
 
#4  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#5  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#6  0x0000000000000000 in ?? ()
 
 
 
Thread 22 (Thread 0x7ff1d4cbd700 (LWP 6723)):
 
#0  0x00007ff2075ec6bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#1  0x00007ff208545f8c in os_cond_wait_timed (cond=0x7ff1e8ff1650, fast_mutex=0x7ff1e8ff1610, abstime=0x7ff1d4cbce60)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0sync.cc:177
 
#2  0x00007ff208546783 in os_event_wait_time_low (event=0x7ff1e8ff1610, time_in_usec=1000000, reset_sig_count=1)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0sync.cc:705
 
#3  0x00007ff208516c82 in lock_wait_timeout_thread (arg=0x0)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/lock/lock0wait.cc:534
 
#4  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#5  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#6  0x0000000000000000 in ?? ()
 
 
 
Thread 21 (Thread 0x7ff1d72ff700 (LWP 6717)):
 
#0  0x00007ff2073df6a4 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00007ff208543336 in os_aio_linux_collect (array=0x7ff1e80b8700, segment=0, seg_size=256)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5373
 
#2  0x00007ff208543708 in os_aio_linux_handle (global_seg=6, message1=0x7ff1d72fee48, message2=0x7ff1d72fee50, type=0x7ff1d72fee58, 
    space_id=0x7ff1d72fee60) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5526
 
#3  0x00007ff20871d633 in fil_aio_wait (segment=6) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/fil/fil0fil.cc:5998
 
#4  0x00007ff20860dc03 in io_handler_thread (arg=0x7ff209af3010)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0start.cc:542
 
#5  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#6  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#7  0x0000000000000000 in ?? ()
 
 
 
Thread 20 (Thread 0x7ff1ecb00700 (LWP 6716)):
 
#0  0x00007ff2073df6a4 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00007ff208543336 in os_aio_linux_collect (array=0x7ff1e8057eb0, segment=3, seg_size=256)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5373
 
#2  0x00007ff208543708 in os_aio_linux_handle (global_seg=5, message1=0x7ff1ecaffe48, message2=0x7ff1ecaffe50, type=0x7ff1ecaffe58, 
    space_id=0x7ff1ecaffe60) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5526
 
#3  0x00007ff20871d633 in fil_aio_wait (segment=5) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/fil/fil0fil.cc:5998
 
#4  0x00007ff20860dc03 in io_handler_thread (arg=0x7ff209af3008)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0start.cc:542
 
#5  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#6  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#7  0x0000000000000000 in ?? ()
 
 
 
Thread 19 (Thread 0x7ff1ed301700 (LWP 6715)):
 
#0  0x00007ff2073df6a4 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00007ff208543336 in os_aio_linux_collect (array=0x7ff1e8057eb0, segment=2, seg_size=256)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5373
 
#2  0x00007ff208543708 in os_aio_linux_handle (global_seg=4, message1=0x7ff1ed300e48, message2=0x7ff1ed300e50, type=0x7ff1ed300e58, 
    space_id=0x7ff1ed300e60) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5526
 
#3  0x00007ff20871d633 in fil_aio_wait (segment=4) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/fil/fil0fil.cc:5998
 
#4  0x00007ff20860dc03 in io_handler_thread (arg=0x7ff209af3000)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0start.cc:542
 
#5  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#6  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#7  0x0000000000000000 in ?? ()
 
 
 
Thread 18 (Thread 0x7ff1edb02700 (LWP 6714)):
 
#0  0x00007ff2073df6a4 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00007ff208543336 in os_aio_linux_collect (array=0x7ff1e8057eb0, segment=1, seg_size=256)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5373
 
#2  0x00007ff208543708 in os_aio_linux_handle (global_seg=3, message1=0x7ff1edb01e48, message2=0x7ff1edb01e50, type=0x7ff1edb01e58, 
    space_id=0x7ff1edb01e60) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5526
 
#3  0x00007ff20871d633 in fil_aio_wait (segment=3) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/fil/fil0fil.cc:5998
 
#4  0x00007ff20860dc03 in io_handler_thread (arg=0x7ff209af2ff8)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0start.cc:542
 
#5  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#6  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#7  0x0000000000000000 in ?? ()
 
 
 
Thread 17 (Thread 0x7ff1ef305700 (LWP 6711)):
 
#0  0x00007ff2073df6a4 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00007ff208543336 in os_aio_linux_collect (array=0x7ff1e80a8440, segment=0, seg_size=256)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5373
 
#2  0x00007ff208543708 in os_aio_linux_handle (global_seg=0, message1=0x7ff1ef304e48, message2=0x7ff1ef304e50, type=0x7ff1ef304e58, 
    space_id=0x7ff1ef304e60) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5526
 
#3  0x00007ff20871d633 in fil_aio_wait (segment=0) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/fil/fil0fil.cc:5998
 
#4  0x00007ff20860dc03 in io_handler_thread (arg=0x7ff209af2fe0)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0start.cc:542
 
#5  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#6  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#7  0x0000000000000000 in ?? ()
 
 
 
Thread 16 (Thread 0x7ff1f0763700 (LWP 6710)):
 
#0  0x00007ff2075ec6bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#1  0x00007ff2087ca341 in safe_cond_timedwait (cond=0x7ff209ac1e80, mp=0x7ff209ac1dc0, abstime=0x7ff1f0762e00, 
    file=0x7ff208a04490 "/home/danorton/src/mariadb-10.1.11/include/mysql/psi/mysql_thread.h", line=1202)
 
    at /home/danorton/src/mariadb-10.1.11/mysys/thr_mutex.c:547
 
#2  0x00007ff2083568d8 in inline_mysql_cond_timedwait (that=0x7ff209ac1e80, mutex=0x7ff209ac1dc0, abstime=0x7ff1f0762e00, 
    src_file=0x7ff208a044d8 "/home/danorton/src/mariadb-10.1.11/storage/maria/ma_servicethread.c", src_line=119)
 
    at /home/danorton/src/mariadb-10.1.11/include/mysql/psi/mysql_thread.h:1202
 
#3  0x00007ff208356d82 in my_service_thread_sleep (control=0x7ff2090d9650, sleep_time=29000000000)
 
    at /home/danorton/src/mariadb-10.1.11/storage/maria/ma_servicethread.c:118
 
#4  0x00007ff20834b914 in ma_checkpoint_background (arg=0x1e) at /home/danorton/src/mariadb-10.1.11/storage/maria/ma_checkpoint.c:711
 
#5  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#6  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#7  0x0000000000000000 in ?? ()
 
 
 
Thread 15 (Thread 0x7ff2011ce700 (LWP 6709)):
 
#0  0x00007ff2075ec6bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#1  0x00007ff2087ca341 in safe_cond_timedwait (cond=0x7ff209b0cca0, mp=0x7ff209b0cbe0, abstime=0x7ff2011cdeb0, 
    file=0x7ff208b27b50 "/home/danorton/src/mariadb-10.1.11/include/mysql/psi/mysql_thread.h", line=1202)
 
    at /home/danorton/src/mariadb-10.1.11/mysys/thr_mutex.c:547
 
#2  0x00007ff2087cb2dd in inline_mysql_cond_timedwait (that=0x7ff209b0cca0, mutex=0x7ff209b0cbe0, abstime=0x7ff2011cdeb0, 
    src_file=0x7ff208b27b98 "/home/danorton/src/mariadb-10.1.11/mysys/thr_timer.c", src_line=292)
 
    at /home/danorton/src/mariadb-10.1.11/include/mysql/psi/mysql_thread.h:1202
 
#3  0x00007ff2087cbdb7 in timer_handler (arg=0x0) at /home/danorton/src/mariadb-10.1.11/mysys/thr_timer.c:292
 
#4  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#5  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#6  0x0000000000000000 in ?? ()
 
 
 
Thread 14 (Thread 0x7ff1cfcb2700 (LWP 6734)):
 
#0  0x00007ff205ad7453 in select () from /lib/x86_64-linux-gnu/libc.so.6
 
#1  0x00007ff208547303 in os_thread_sleep (tm=1000000) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0thread.cc:285
 
#2  0x00007ff2086973b9 in btr_defragment_thread (arg=0x0)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/btr/btr0defragment.cc:758
 
#3  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#4  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#5  0x0000000000000000 in ?? ()
 
 
 
Thread 13 (Thread 0x7ff1d5afc700 (LWP 6720)):
 
#0  0x00007ff2073df6a4 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00007ff208543336 in os_aio_linux_collect (array=0x7ff1e80b8700, segment=3, seg_size=256)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5373
 
#2  0x00007ff208543708 in os_aio_linux_handle (global_seg=9, message1=0x7ff1d5afbe48, message2=0x7ff1d5afbe50, type=0x7ff1d5afbe58, 
    space_id=0x7ff1d5afbe60) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5526
 
#3  0x00007ff20871d633 in fil_aio_wait (segment=9) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/fil/fil0fil.cc:5998
 
#4  0x00007ff20860dc03 in io_handler_thread (arg=0x7ff209af3028)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0start.cc:542
 
#5  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#6  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#7  0x0000000000000000 in ?? ()
 
 
 
Thread 12 (Thread 0x7ff1d04b3700 (LWP 6733)):
 
#0  0x00007ff2075ec6bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#1  0x00007ff208545f8c in os_cond_wait_timed (cond=0x7ff1e94609d0, fast_mutex=0x7ff1e9460990, abstime=0x7ff1d04b2dd0)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0sync.cc:177
 
#2  0x00007ff208546783 in os_event_wait_time_low (event=0x7ff1e9460990, time_in_usec=5000000, reset_sig_count=1)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0sync.cc:705
 
#3  0x00007ff2086517eb in ib_wqueue_timedwait (wq=0x7ff1e9467e48, wait_in_usecs=5000000)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/ut/ut0wqueue.cc:154
 
#4  0x00007ff208755aac in fts_optimize_thread (arg=0x7ff1e9467e48)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/fts/fts0opt.cc:3000
 
#5  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#6  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#7  0x0000000000000000 in ?? ()
 
 
 
Thread 11 (Thread 0x7ff1d62fd700 (LWP 6719)):
 
#0  0x00007ff2073df6a4 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00007ff208543336 in os_aio_linux_collect (array=0x7ff1e80b8700, segment=2, seg_size=256)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5373
 
#2  0x00007ff208543708 in os_aio_linux_handle (global_seg=8, message1=0x7ff1d62fce48, message2=0x7ff1d62fce50, type=0x7ff1d62fce58, 
    space_id=0x7ff1d62fce60) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5526
 
#3  0x00007ff20871d633 in fil_aio_wait (segment=8) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/fil/fil0fil.cc:5998
 
#4  0x00007ff20860dc03 in io_handler_thread (arg=0x7ff209af3020)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0start.cc:542
 
#5  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#6  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#7  0x0000000000000000 in ?? ()
 
 
 
Thread 10 (Thread 0x7ff1d0cb4700 (LWP 6732)):
 
#0  0x00007ff2075ec6bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#1  0x00007ff208545f8c in os_cond_wait_timed (cond=0x7ff1e9299e60, fast_mutex=0x7ff1e9299e20, abstime=0x7ff1d0cb3e80)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0sync.cc:177
 
#2  0x00007ff208546783 in os_event_wait_time_low (event=0x7ff1e9299e20, time_in_usec=10000000, reset_sig_count=1)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0sync.cc:705
 
#3  0x00007ff208709763 in dict_stats_thread (arg=0x0) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/dict/dict0stats_bg.cc:546
 
#4  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#5  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#6  0x0000000000000000 in ?? ()
 
 
 
Thread 9 (Thread 0x7ff1d6afe700 (LWP 6718)):
 
#0  0x00007ff2073df6a4 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00007ff208543336 in os_aio_linux_collect (array=0x7ff1e80b8700, segment=1, seg_size=256)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5373
 
#2  0x00007ff208543708 in os_aio_linux_handle (global_seg=7, message1=0x7ff1d6afde48, message2=0x7ff1d6afde50, type=0x7ff1d6afde58, 
    space_id=0x7ff1d6afde60) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5526
 
#3  0x00007ff20871d633 in fil_aio_wait (segment=7) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/fil/fil0fil.cc:5998
 
#4  0x00007ff20860dc03 in io_handler_thread (arg=0x7ff209af3018)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0start.cc:542
 
#5  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#6  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#7  0x0000000000000000 in ?? ()
 
 
 
Thread 8 (Thread 0x7ff1d14b5700 (LWP 6731)):
 
#0  0x00007ff2075ec344 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#1  0x00007ff208546074 in os_cond_wait (cond=0x7ff1e803b020, fast_mutex=0x7ff1e803afe0)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0sync.cc:214
 
#2  0x00007ff2085465a6 in os_event_wait_low (event=0x7ff1e803afe0, reset_sig_count=1)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0sync.cc:592
 
#3  0x00007ff2086b0e5f in buf_dump_thread (arg=0x0) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/buf/buf0dump.cc:684
 
#4  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#5  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#6  0x0000000000000000 in ?? ()
 
 
 
Thread 7 (Thread 0x7ff1ee303700 (LWP 6713)):
 
#0  0x00007ff2073df6a4 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00007ff208543336 in os_aio_linux_collect (array=0x7ff1e8057eb0, segment=0, seg_size=256)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5373
 
#2  0x00007ff208543708 in os_aio_linux_handle (global_seg=2, message1=0x7ff1ee302e48, message2=0x7ff1ee302e50, type=0x7ff1ee302e58, 
    space_id=0x7ff1ee302e60) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5526
 
#3  0x00007ff20871d633 in fil_aio_wait (segment=2) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/fil/fil0fil.cc:5998
 
#4  0x00007ff20860dc03 in io_handler_thread (arg=0x7ff209af2ff0)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0start.cc:542
 
#5  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#6  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#7  0x0000000000000000 in ?? ()
 
 
 
Thread 6 (Thread 0x7ff1eeb04700 (LWP 6712)):
 
#0  0x00007ff2073df6a4 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00007ff208543336 in os_aio_linux_collect (array=0x7ff1e8098180, segment=0, seg_size=256)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5373
 
#2  0x00007ff208543708 in os_aio_linux_handle (global_seg=1, message1=0x7ff1eeb03e48, message2=0x7ff1eeb03e50, type=0x7ff1eeb03e58, 
    space_id=0x7ff1eeb03e60) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0file.cc:5526
 
#3  0x00007ff20871d633 in fil_aio_wait (segment=1) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/fil/fil0fil.cc:5998
 
#4  0x00007ff20860dc03 in io_handler_thread (arg=0x7ff209af2fe8)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0start.cc:542
 
#5  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#6  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#7  0x0000000000000000 in ?? ()
 
 
 
Thread 5 (Thread 0x7ff1d1cb6700 (LWP 6729)):
 
#0  0x00007ff205ad7453 in select () from /lib/x86_64-linux-gnu/libc.so.6
 
#1  0x00007ff208547303 in os_thread_sleep (tm=1000000) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0thread.cc:285
 
#2  0x00007ff2086b913b in page_cleaner_sleep_if_needed (next_loop_time=1454197736219)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/buf/buf0flu.cc:2644
 
#3  0x00007ff2086b9980 in buf_flush_lru_manager_thread (arg=0x0)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/buf/buf0flu.cc:2912
 
#4  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#5  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#6  0x0000000000000000 in ?? ()
 
 
 
Thread 4 (Thread 0x7ff2079bdb00 (LWP 6736)):
 
#0  0x00007ff2075efde7 in do_sigwait () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#1  0x00007ff2075efe67 in sigwait () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#2  0x00007ff207e612f2 in signal_hand (arg=0x0) at /home/danorton/src/mariadb-10.1.11/sql/mysqld.cc:3475
 
#3  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#4  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#5  0x0000000000000000 in ?? ()
 
 
 
Thread 3 (Thread 0x7ff207a07b00 (LWP 6735)):
 
#0  0x00007ff2075ec344 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#1  0x00007ff2087ca03a in safe_cond_wait (cond=0x7ff2092bed00, mp=0x7ff2092bec50, 
    file=0x7ff2089b5300 "/home/danorton/src/mariadb-10.1.11/include/mysql/psi/mysql_thread.h", line=1165)
 
    at /home/danorton/src/mariadb-10.1.11/mysys/thr_mutex.c:493
 
#2  0x00007ff20823d04a in inline_mysql_cond_wait (that=0x7ff2092bed00, mutex=0x7ff2092bec50, 
    src_file=0x7ff2089b5828 "/home/danorton/src/mariadb-10.1.11/sql/log.cc", src_line=9563)
 
    at /home/danorton/src/mariadb-10.1.11/include/mysql/psi/mysql_thread.h:1165
 
#3  0x00007ff20825506a in binlog_background_thread (arg=0x0) at /home/danorton/src/mariadb-10.1.11/sql/log.cc:9563
 
#4  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#5  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#6  0x0000000000000000 in ?? ()
 
 
 
Thread 2 (Thread 0x7ff1d24b7700 (LWP 6728)):
 
#0  0x00007ff205ad7453 in select () from /lib/x86_64-linux-gnu/libc.so.6
 
#1  0x00007ff208547303 in os_thread_sleep (tm=1000000) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/os/os0thread.cc:285
 
#2  0x00007ff2086b913b in page_cleaner_sleep_if_needed (next_loop_time=1454197736219)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/buf/buf0flu.cc:2644
 
#3  0x00007ff2086b93ff in buf_flush_page_cleaner_thread (arg=0x0)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/buf/buf0flu.cc:2763
 
#4  0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#5  0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#6  0x0000000000000000 in ?? ()
 
 
 
Thread 1 (Thread 0x7ff1d2cb8700 (LWP 6727)):
 
#0  0x00007ff2075ed55c in pthread_kill () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#1  0x00007ff2087c4aba in my_write_core (sig=11) at /home/danorton/src/mariadb-10.1.11/mysys/stacktrace.c:456
 
#2  0x00007ff20816aac6 in handle_fatal_signal (sig=11) at /home/danorton/src/mariadb-10.1.11/sql/signal_handler.cc:273
 
#3  <signal handler called>
 
#4  0x00007ff208628451 in mach_read_from_1 (b=0x7ff309d8a70a <Address 0x7ff309d8a70a out of bounds>)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/include/mach0data.ic:56
 
#5  0x00007ff208628896 in mach_read_compressed (b=0x7ff309d8a70a <Address 0x7ff309d8a70a out of bounds>)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/include/mach0data.ic:266
 
#6  0x00007ff20862f454 in trx_undo_update_rec_get_field_no (ptr=0x7ff309d8a70a <Address 0x7ff309d8a70a out of bounds>, 
    field_no=0x7ff1d2cb7be0) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/trx/trx0rec.cc:907
 
#7  0x00007ff20862f63a in trx_undo_update_rec_get_update (ptr=0x7ff309d8a70a <Address 0x7ff309d8a70a out of bounds>, 
    index=0x7ff209db27d8, type=12, trx_id=563898, roll_ptr=34902897142534376, info_bits=0, trx=0x7ff1e9449448, heap=0x7ff1e94836d0, 
    upd=0x7ff1e945d960) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/trx/trx0rec.cc:992
 
#8  0x00007ff2085d73c7 in row_purge_parse_undo_rec (node=0x7ff1e945d8f8, undo_rec=0x7ff209d9a3c8 "\r-\214", 
    updated_extern=0x7ff1d2cb7cee, thr=0x7ff1e94841e0) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/row/row0purge.cc:816
 
#9  0x00007ff2085d76e6 in row_purge (node=0x7ff1e945d8f8, undo_rec=0x7ff209d9a3c8 "\r-\214", thr=0x7ff1e94841e0)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/row/row0purge.cc:909
 
#10 0x00007ff2085d793d in row_purge_step (thr=0x7ff1e94841e0)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/row/row0purge.cc:992
 
#11 0x00007ff2085753ca in que_thr_step (thr=0x7ff1e94841e0) at /home/danorton/src/mariadb-10.1.11/storage/xtradb/que/que0que.cc:1089
 
#12 0x00007ff2085755cb in que_run_threads_low (thr=0x7ff1e94841e0)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/que/que0que.cc:1151
 
#13 0x00007ff20857575d in que_run_threads (thr=0x7ff1e94841e0)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/que/que0que.cc:1192
 
#14 0x00007ff208627ac6 in trx_purge (n_purge_threads=1, batch_size=300, truncate=false)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/trx/trx0purge.cc:1251
 
#15 0x00007ff20860a8c0 in srv_do_purge (n_threads=1, n_total_purged=0x7ff1d2cb7e88)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0srv.cc:3441
 
#16 0x00007ff20860af99 in srv_purge_coordinator_thread (arg=0x0)
 
    at /home/danorton/src/mariadb-10.1.11/storage/xtradb/srv/srv0srv.cc:3621
 
#17 0x00007ff2075e7b50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
 
#18 0x00007ff205add95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
#19 0x0000000000000000 in ?? ()

Comment by Daniel Norton [ 2016-01-31 ]

I have isolated the crash trigger to a single InnoDB database. Is there some way I can validate or otherwise diagnose the files, directly?

Comment by Daniel Norton [ 2016-02-01 ]

I managed to isolate the tables that were triggering the crash. Fortunately, they were cache tables and I simply replaced them with empty tables. So, I'm up and running, but the nasty bug is still lurking.

Comment by Jan Lindström (Inactive) [ 2016-02-01 ]

Based on stack dump this is MDEV-9177, MariaDB 10.1.0-10.1.8 had a bug that was fixed 10.1.9, unfortunately the bug was such that if you did migrate to earlier 10.1 version, you will be affected. Migrating from older MariaDB version e.g. to MariaDB 10.1.8 corrupted the database, even now that bug is fixed older 10.1 databases do not work.

Comment by Daniel Norton [ 2016-02-01 ]

Perhaps this is MDEV 9177, but it doesn't seem resolved, as there are two bugs:

  1. The bug that corrupts the database
  2. The bug that crashes the entire server.

Part 1 might have been fixed, but part 2 definitely persists in 10.1.11. It seems to me that a proper fix to #2 is to not crash the server. At worst, it might simply not open the offending database, but the other databases should remain fully operational.

Comment by Jan Lindström (Inactive) [ 2016-02-01 ]

My first questions is did you upgrade from earlier MariaDB/MySQL version, or did you create tables on < MariaDB 10.1.9 version ? If you did, your database is corrupted. Problem is that if database is corrupted, there is not much you can do, InnoDB traditionally has selected the crash option, not continue with what you got option. Continue with you got option has problem that further modifications to database could lead database more corrupted and inconsistent state. That is the reason InnoDB has selected stop option, naturally it could do it more controlled way (instead of assert and core), but shutdown normally also makes modifications to the persistent database (maybe messing things more up), so that is also hard.

Generated at Thu Feb 08 07:33:25 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.