[MDEV-20987] InnoDB fails to start when fts table has FK relation Created: 2019-11-05  Updated: 2019-12-05  Resolved: 2019-11-06

Status: Closed
Project: MariaDB Server
Component/s: Storage Engine - InnoDB, Storage Engine - XtraDB
Affects Version/s: 10.2.28, 10.1.42, 10.3.19, 10.4.9
Fix Version/s: 10.2.29, 10.1.43, 10.3.20, 10.4.10

Type: Bug Priority: Critical
Reporter: cPanel Senior Tech's Assignee: Thirunarayanan Balathandayuthapani
Resolution: Fixed Votes: 8
Labels: None
Environment:

OS: CloudLinux release 7.7 (Valery Bykovsky)
Kernel: 3.10.0-962.3.2.lve1.5.26.1.el7.x86_64
Arch: x86_64
Environment: standard
CPU: Intel Xeon CPU E5520 @ 2.27GHz w/ 16 core(s)
MySQL: mysql Ver 15.1 Distrib 10.2.28-MariaDB, for Linux (x86_64) using readline 5.1

OS: CentOS Linux release 7.7.1908 (Core)
Kernel: 3.10.0-1062.1.2.el7.x86_64
Arch: x86_64
Environment: kvm
CPU: Intel Xeon CPU E5-1650 v3 @ 3.50GHz w/ 12 core(s)
MySQL: mysql Ver 15.1 Distrib 10.1.42-MariaDB, for Linux (x86_64) using readline 5.1

OS: CloudLinux release 7.7 (Valery Bykovsky)
Kernel: 3.10.0-962.3.2.lve1.5.26.4.el7.x86_64
Arch: x86_64
Environment: standard
CPU: Intel Xeon CPU E3-1230 v3 @ 3.30GHz w/ 8 core(s)
MySQL: mysql Ver 15.1 Distrib 10.3.19-MariaDB, for Linux (x86_64) using readline 5.1

Attachments: PNG File image_2019_11_05T18_45_53_019Z.png    
Issue Links:
Blocks
blocks MDEV-21001 10.2.28 - Galera Cluster Joiner Fatality Closed
Duplicate
duplicates MDEV-20989 InnoDB: Assertion failure in file /ho... Closed
duplicates MDEV-20998 Servidor dejó de funcionar después de... Closed
duplicates MDEV-21001 10.2.28 - Galera Cluster Joiner Fatality Closed
is duplicated by MDEV-20988 191106 4:08:47 [ERROR] mysqld got sig... Closed
is duplicated by MDEV-20993 FTS Index Crash Closed
is duplicated by MDEV-20995 Server crashes on innodb assertion error Closed
Problem/Incident
is caused by MDEV-20621 FULLTEXT INDEX activity causes InnoDB... Closed
Relates
relates to MDEV-21230 Corrupt database with MariaDB 10.4.10... Closed
relates to MDEV-20991 MariaDB server is not starting after ... Closed

 Description   
Details

After the recent MariaDB update, we've had 11 reports and counting of MariaDB failing to start. This appears related to the FTS changes recently made, perhaps MDEV-19073 ?

# git log --oneline mariadb-10.1.41..mariadb-10.1.42|grep -i 'innodb\|fts'
 
5392b4a32c9 MDEV-20354 All but last insert ignored in InnoDB tables when table locked
 
84088d9458d add .clang-format file for InnoDB
 
a41d429765c MDEV-20621 FULLTEXT INDEX activity causes InnoDB hang
 
bd22650bbcb MDEV-19073 FTS row mismatch after crash recovery
 
5ef12244345 MDEV-20804 Speed up main.index_merge_innodb
 
8a79fa0e4d0 MDEV-19529	InnoDB hang on DROP FULLTEXT INDEX
 
031c695b8c8 MDEV-16594 ALTER DATA DIRECTORY in PARTITIONS of InnoDB storage does nothing silently
 
c738aa240e5 MDEV-20138 innodb.trx_id_future fails on big-endian

The full error is below(10.2.28):

$ /usr/sbin/mysqld
 
2019-11-06  0:44:59 139887440070848 [Note] /usr/sbin/mysqld (mysqld 10.2.28-MariaDB) starting as process 15243 ...
 
2019-11-06  0:44:59 139887440070848 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4198)
 
2019-11-06  0:44:59 139887440070848 [Warning] Changed limits: max_open_files: 1024  max_connections: 151 (was 151)  table_cache: 421 (was 2000)
 
2019-11-06  0:44:59 139887440070848 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
 
2019-11-06  0:44:59 139887440070848 [Note] InnoDB: Uses event mutexes
 
2019-11-06  0:44:59 139887440070848 [Note] InnoDB: Compressed tables use zlib 1.2.7
 
2019-11-06  0:44:59 139887440070848 [Note] InnoDB: Using Linux native AIO
 
2019-11-06  0:44:59 139887440070848 [Note] InnoDB: Number of pools: 1
 
2019-11-06  0:44:59 139887440070848 [Note] InnoDB: Using SSE2 crc32 instructions
 
2019-11-06  0:44:59 139887440070848 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
 
2019-11-06  0:44:59 139887440070848 [Note] InnoDB: Completed initialization of buffer pool
 
2019-11-06  0:44:59 139886879573760 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
 
2019-11-06  0:44:59 139887440070848 [Note] InnoDB: Highest supported file format is Barracuda.
 
2019-11-06 00:44:59 0x7f3a152c88c0  InnoDB: Assertion failure in file /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.2.28/storage/innobase/dict/dict0dict.cc line 1467
 
InnoDB: Failing assertion: table->can_be_evicted
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to https://jira.mariadb.org/
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mysqld startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: https://mariadb.com/kb/en/library/innodb-recovery-modes/
 
InnoDB: about forcing recovery.
 
191106  0:44:59 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed,
 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.2.28-MariaDB
 
key_buffer_size=134217728
 
read_buffer_size=131072
 
max_used_connections=0
 
max_threads=153
 
thread_count=0
 
It is possible that mysqld could use up to
 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 467243 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x0 thread_stack 0x49000
 
/usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x560bdda1472e]
 
/usr/sbin/mysqld(handle_fatal_signal+0x30d)[0x560bdd49905d]
 
addr2line: Dwarf Error: Offset (2433640) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (930971) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1678859) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1678490) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (6516329) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (6514020) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1434933) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1545930) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (3540451345) greater than or equal to .debug_info size (4458717).
 
addr2line: Dwarf Error: Unable to read alt ref 3540451345.
 
addr2line: Dwarf Error: Offset (6514020) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (6516329) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2806683648) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (5390925) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (617973782) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (6579297) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (6516329) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1697110) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (554609263) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (322837827) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Could not find abbrev number 123.
 
addr2line: Dwarf Error: Offset (312212791) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1762938) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1965228392) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1762938) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1944060204) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1749043) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1762938) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Could not find abbrev number 124.
 
addr2line: Dwarf Error: Offset (1280442740) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1749283) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (7173491) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2940076487) greater than or equal to .debug_str size (2507683).
 
sigaction.c:0(__restore_rt)[0x7f3a14eb9630]
 
linux/raise.c:55(__GI_raise)[0x7f3a13189377]
 
stdlib/abort.c:92(__GI_abort)[0x7f3a1318aa68]
 
/usr/sbin/mysqld(+0x431a59)[0x560bdd246a59]
 
/usr/sbin/mysqld(+0x9fe9e7)[0x560bdd8139e7]
 
/usr/sbin/mysqld(+0xa14bf2)[0x560bdd829bf2]
 
/usr/sbin/mysqld(+0xa1509d)[0x560bdd82a09d]
 
/usr/sbin/mysqld(+0xa16019)[0x560bdd82b019]
 
/usr/sbin/mysqld(+0x9fe480)[0x560bdd813480]
 
/usr/sbin/mysqld(+0xa632b8)[0x560bdd8782b8]
 
addr2line: Dwarf Error: Offset (2433640) greater than or equal to .debug_str size (121108).
 
/usr/sbin/mysqld(+0xa6bbad)[0x560bdd880bad]
 
addr2line: Dwarf Error: Offset (930971) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1678859) greater than or equal to .debug_str size (121108).
 
/usr/sbin/mysqld(+0x8820ca)[0x560bdd6970ca]
 
addr2line: Dwarf Error: Offset (1678490) greater than or equal to .debug_str size (121108).
 
/usr/sbin/mysqld(+0x93faaa)[0x560bdd754aaa]
 
addr2line: Dwarf Error: Offset (6516329) greater than or equal to .debug_str size (2507683).
 
/usr/sbin/mysqld(+0x824501)[0x560bdd639501]
 
/usr/sbin/mysqld(_Z24ha_initialize_handlertonP13st_plugin_int+0x64)[0x560bdd49b714]
 
addr2line: Dwarf Error: Offset (6514020) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1434933) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1545930) greater than or equal to .debug_str size (121108).
 
/usr/sbin/mysqld(+0x4fc1a0)[0x560bdd3111a0]
 
addr2line: Dwarf Error: Offset (3540451345) greater than or equal to .debug_info size (4458717).
 
addr2line: Dwarf Error: Unable to read alt ref 3540451345.
 
/usr/sbin/mysqld(_Z11plugin_initPiPPci+0x9a2)[0x560bdd312a72]
 
/usr/sbin/mysqld(+0x455241)[0x560bdd26a241]
 
/usr/sbin/mysqld(_Z11mysqld_mainiPPc+0x1e39)[0x560bdd26f7c9]
 
addr2line: Dwarf Error: Offset (6514020) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (6516329) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2806683648) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (5390925) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (617973782) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (6579297) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (6516329) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1697110) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (554609263) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (322837827) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Could not find abbrev number 123.
 
addr2line: Dwarf Error: Offset (312212791) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1762938) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1965228392) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1762938) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1944060204) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1749043) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (1762938) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Could not find abbrev number 124.
 
addr2line: Dwarf Error: Offset (1280442740) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1749283) greater than or equal to .debug_str size (121108).
 
addr2line: Dwarf Error: Offset (7173491) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2940076487) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3788374860) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3338672362) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (335613034) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2518090531) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1600717603) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2518090531) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1600717603) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1600717603) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1600717603) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2231566753) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (27853595) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1979736415) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (33424222) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1979736415) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (29819699) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1979736415) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (27853595) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1979736415) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (27853595) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1979736415) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (27853595) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1979736415) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (33424222) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1979736415) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (29819699) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1979736415) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (27853595) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1979736415) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (27853595) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1979736415) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (335613034) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (241843240) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (151192255) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2634118656) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (151192255) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2634118656) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (151192255) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2634118656) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (151192255) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2634118656) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1595278106) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (59638640) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (716701712) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (44892955) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (716701712) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1595278106) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2147681508) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3254977716) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2231567354) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2147681508) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3254977716) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2231567354) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1595278106) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (151192255) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2634118656) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3875738783) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (4079419832) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3609657826) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3875738783) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (17442586) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3609657826) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3875738783) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1797718414) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3875738783) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (4079419832) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3609657826) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3875738783) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (17442586) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3609657826) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3875738783) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1797718414) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3875738783) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3875738783) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3875738783) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (128910083) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (755180081) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3942851524) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3942851524) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (26945386) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1797718436) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (17442604) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (4079419854) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (4127400521) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (4177732573) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3707970070) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1258487858) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (33424222) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1979736415) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (29819699) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1979736415) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (27853595) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1979736415) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (341335298) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (257839874) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (257839874) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (341335298) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (257839874) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (257839874) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3942851524) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3707970070) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (755180081) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (755180081) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (755180081) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (38345984) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (38345984) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (486545358) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (70327552) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (26945386) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1797718436) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (17442604) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (4079419854) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (257839874) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (257839874) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (257839874) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (257839874) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3020097412) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3020097412) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1010107167) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1010107167) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (4077062581) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (4077062581) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (4077062581) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1010107167) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1010107167) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1010107167) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3506645869) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3506645869) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (33757982) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3506645869) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1010107167) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1010107167) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3389194694) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2416116146) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3316993) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3316993) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3316993) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3316993) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3316993) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3316993) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3707966902) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3707966902) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (50363905) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (50363905) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3556972974) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (50363905) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (50363905) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3707966902) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2315466965) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3657644453) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2852338165) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (4194515653) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3389209493) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2583903205) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1144798389) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2315466965) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2315466965) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3657644453) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3657644453) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2852338165) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2852338165) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (4194515653) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (4194515653) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3389209493) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3389209493) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2583903205) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2583903205) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1144798389) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1144798389) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3410952467) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (585595395) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (585595395) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (585595395) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3036879565) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2684556718) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3171095769) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3657636261) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1419510647) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3758299381) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2734889147) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3691190401) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3657636261) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1419510647) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3758299381) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2734889147) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3691190401) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3171095769) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (1598685992) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (27525390) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2770862350) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2214803694) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2483239358) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (2751675022) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3020110558) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3288546222) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3556981758) greater than or equal to .debug_str size (2507683).
 
addr2line: Dwarf Error: Offset (3825417420) greater than or equal to .debug_str size (2507683).
 
csu/libc-start.c:300(__libc_start_main)[0x7f3a13175545]
 
/usr/sbin/mysqld(+0x44e68d)[0x560bdd26368d]
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
Writing a core file...
 
Working directory at /homeSSD500GB1/mysql
 
Resource Limits:
 
Limit                     Soft Limit           Hard Limit           Units
 
Max cpu time              unlimited            unlimited            seconds
 
Max file size             unlimited            unlimited            bytes
 
Max data size             unlimited            unlimited            bytes
 
Max stack size            8388608              unlimited            bytes
 
Max core file size        0                    unlimited            bytes
 
Max resident set          unlimited            unlimited            bytes
 
Max processes             4096                 95627                processes
 
Max open files            1024                 4096                 files
 
Max locked memory         65536                65536                bytes
 
Max address space         unlimited            unlimited            bytes
 
Max file locks            unlimited            unlimited            locks
 
Max pending signals       95627                95627                signals
 
Max msgqueue size         819200               819200               bytes
 
Max nice priority         0                    0
 
Max realtime priority     0                    0
 
Max realtime timeout      unlimited            unlimited            us
 
Core pattern: core
 
 
 
Aborted

Configurations:

[mysqld]
 
default-storage-engine=MyISAM
 
innodb_file_per_table=1
 
performance-schema=0
 
max_allowed_packet=268435456
 
open_files_limit=50000
 
datadir=/mysql
 
socket=/mysql/mysql.sock

Step-by-Step Instructions

Unknown; I am unable to replicate this directly in a testing environment. It seems to be dependent on the databases.

Known work around(s)

Downgrading resolves the issue

 Comments   
Comment by cPanel Senior Tech's [ 2019-11-05 ]

I've uploaded MDEV20987-core.23634.gz to ftp.mariadb.com

Comment by Olorin Henderson [ 2019-11-05 ]

Also experiencing the same issue on 14 servers after MariaDB updates today. As per cPanel's comments, running a yum downgrade of the main mariadb-server package allows MariaDB to start and function normally.

2019-11-05 18:18:58 0 [Note] InnoDB: Using Linux native AIO
 
2019-11-05 18:18:58 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
 
2019-11-05 18:18:58 0 [Note] InnoDB: Uses event mutexes
 
2019-11-05 18:18:58 0 [Note] InnoDB: Compressed tables use zlib 1.2.7
 
2019-11-05 18:18:58 0 [Note] InnoDB: Number of pools: 1
 
2019-11-05 18:18:58 0 [Note] InnoDB: Using SSE2 crc32 instructions
 
2019-11-05 18:18:58 0 [Note] InnoDB: Initializing buffer pool, total size = 1G, instances = 1, chunk size = 128M
 
2019-11-05 18:18:58 0 [Note] InnoDB: Completed initialization of buffer pool
 
2019-11-05 18:18:58 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
 
2019-11-05 18:18:58 0x7f471dd948c0  InnoDB: Assertion failure in file /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.19/storage/innobase/dict/dict0dict.cc line 1443
 
InnoDB: Failing assertion: table->can_be_evicted
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to https://jira.mariadb.org/
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mysqld startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: https://mariadb.com/kb/en/library/innodb-recovery-modes/
 
InnoDB: about forcing recovery.
 
191105 18:18:58 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.3.19-MariaDB
 
key_buffer_size=134217728
 
read_buffer_size=2097152
 
max_used_connections=0
 
max_threads=302
 
thread_count=0
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 1374841 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x0 thread_stack 0x80000
 
/usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x55876980558e]
 
/usr/sbin/mysqld(handle_fatal_signal+0x30f)[0x5587692a254f]
 
sigaction.c:0(__restore_rt)[0x7f471d9835f0]
 
:0(__GI_raise)[0x7f471bc54337]
 
:0(__GI_abort)[0x7f471bc55a28]
 
/usr/sbin/mysqld(+0x4d3560)[0x558768fe2560]
 
/usr/sbin/mysqld(+0xaebf97)[0x5587695faf97]
 
/usr/sbin/mysqld(+0xb02603)[0x558769611603]
 
/usr/sbin/mysqld(+0xb02a1d)[0x558769611a1d]
 
/usr/sbin/mysqld(+0xb03976)[0x558769612976]
 
/usr/sbin/mysqld(+0xaf0d50)[0x5587695ffd50]
 
/usr/sbin/mysqld(+0xb4cd08)[0x55876965bd08]
 
/usr/sbin/mysqld(+0xb578f2)[0x5587696668f2]
 
/usr/sbin/mysqld(+0x984cf3)[0x558769493cf3]
 
/usr/sbin/mysqld(+0xa3b0e8)[0x55876954a0e8]
 
/usr/sbin/mysqld(+0x92a001)[0x558769439001]
 
/usr/sbin/mysqld(_Z24ha_initialize_handlertonP13st_plugin_int+0x64)[0x5587692a4dd4]
 
/usr/sbin/mysqld(+0x5c59f0)[0x5587690d49f0]
 
/usr/sbin/mysqld(_Z11plugin_initPiPPci+0x9ba)[0x5587690d5b7a]
 
/usr/sbin/mysqld(+0x4f8bf1)[0x558769007bf1]
 
/usr/sbin/mysqld(_Z11mysqld_mainiPPc+0x4ae)[0x55876900ddde]
 
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f471bc40505]
 
/usr/sbin/mysqld(+0x4f280d)[0x55876900180d]
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
Writing a core file...
 
Working directory at /var/lib/mysql
 
Resource Limits:
 
Limit                     Soft Limit           Hard Limit           Units     
Max cpu time              unlimited            unlimited            seconds   
Max file size             unlimited            unlimited            bytes     
Max data size             unlimited            unlimited            bytes     
Max stack size            8388608              unlimited            bytes     
Max core file size        0                    unlimited            bytes     
Max resident set          unlimited            unlimited            bytes     
Max processes             29775                29775                processes 
Max open files            10000                10000                files     
Max locked memory         65536                65536                bytes     
Max address space         unlimited            unlimited            bytes     
Max file locks            unlimited            unlimited            locks     
Max pending signals       29775                29775                signals   
Max msgqueue size         819200               819200               bytes     
Max nice priority         0                    0                    
Max realtime priority     0                    0                    
Max realtime timeout      unlimited            unlimited            us        
Core pattern: core

Comment by Jacques David Commarmond [ 2019-11-05 ]

Hi,
same here

Server running cloudlinux 7 and cpanel

Had to yum downgrade the following packages to make it work again

MariaDB-client-10.2.27-1.el7.centos.x86_64
MariaDB-shared-10.2.27-1.el7.centos.x86_64
MariaDB-devel-10.2.27-1.el7.centos.x86_64
MariaDB-server-10.2.27-1.el7.centos.x86_64
MariaDB-compat-10.2.27-1.el7.centos.x86_64
MariaDB-common-10.2.27-1.el7.centos.x86_64

Comment by burnley [ 2019-11-06 ]

Same here, seen on CentOS 7.7.1908 with:
MariaDB-common-10.1.42-1.el7.centos.x86_64
MariaDB-client-10.1.42-1.el7.centos.x86_64
MariaDB-server-10.1.42-1.el7.centos.x86_64
MariaDB-shared-10.1.42-1.el7.centos.x86_64

2019-11-06 10:22:10 46966050483264 [Note] InnoDB: Using mutexes to ref count buffer pool pages
 
2019-11-06 10:22:10 46966050483264 [Note] InnoDB: The InnoDB memory heap is disabled
 
2019-11-06 10:22:10 46966050483264 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
 
2019-11-06 10:22:10 46966050483264 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
 
2019-11-06 10:22:10 46966050483264 [Note] InnoDB: Compressed tables use zlib 1.2.7
 
2019-11-06 10:22:10 46966050483264 [Note] InnoDB: Using Linux native AIO
 
2019-11-06 10:22:10 46966050483264 [Note] InnoDB: Using SSE crc32 instructions
 
2019-11-06 10:22:10 46966050483264 [Note] InnoDB: Initializing buffer pool, size = 8.0G
 
2019-11-06 10:22:10 46966050483264 [Note] InnoDB: Completed initialization of buffer pool
 
2019-11-06 10:22:10 46966050483264 [Note] InnoDB: Highest supported file format is Barracuda.
 
2019-11-06 10:22:27 2ab722c16c40  InnoDB: Assertion failure in thread 46966050483264 in file dict0dict.cc line 1493
 
InnoDB: Failing assertion: table->can_be_evicted
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to https://jira.mariadb.org/
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mysqld startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: http://dev.mysql.com/doc/refman/5.6/en/forcing-innodb-recovery.html
 
InnoDB: about forcing recovery.
 
191106 10:22:27 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.1.42-MariaDB
 
key_buffer_size=402653184
 
read_buffer_size=2097152
 
max_used_connections=0
 
max_threads=153
 
thread_count=0
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 1336405 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x0 thread_stack 0x49000
 
/usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x557612da7a5e]
 
/usr/sbin/mysqld(handle_fatal_signal+0x305)[0x5576128ca455]
 
sigaction.c:0(__restore_rt)[0x2ab722e0b5f0]
 
:0(__GI_raise)[0x2ab724c0a337]
 
:0(__GI_abort)[0x2ab724c0ba28]
 
/usr/sbin/mysqld(+0x9e3db0)[0x557612ce6db0]
 
/usr/sbin/mysqld(+0x9f656b)[0x557612cf956b]
 
/usr/sbin/mysqld(+0x9f6f87)[0x557612cf9f87]
 
/usr/sbin/mysqld(+0x9e35e0)[0x557612ce65e0]
 
/usr/sbin/mysqld(+0xa430b5)[0x557612d460b5]
 
/usr/sbin/mysqld(+0x8b7f83)[0x557612bbaf83]
 
/usr/sbin/mysqld(+0x949ee9)[0x557612c4cee9]
 
/usr/sbin/mysqld(+0x866785)[0x557612b69785]
 
/usr/sbin/mysqld(_Z24ha_initialize_handlertonP13st_plugin_int+0x64)[0x5576128cc7c4]
 
/usr/sbin/mysqld(+0x44b630)[0x55761274e630]
 
/usr/sbin/mysqld(_Z11plugin_initPiPPci+0xa1a)[0x55761274ff2a]
 
/usr/sbin/mysqld(+0x3a1ba1)[0x5576126a4ba1]
 
/usr/sbin/mysqld(_Z11mysqld_mainiPPc+0x550)[0x5576126a8a80]
 
/lib64/libc.so.6(__libc_start_main+0xf5)[0x2ab724bf6505]
 
/usr/sbin/mysqld(+0x3990dd)[0x55761269c0dd]
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.

[mysqld]
skip_name_resolve=0
local-infile=0
symbolic-links=0
log-warnings=2
max_connect_errors=1000
slow_query_log = on
connect_timeout=600
net_read_timeout=600
net_write_timeout=120
max_user_connections=51
open-files-limit=4096
innodb_buffer_pool_size=8G
innodb_buffer_pool_instances=8
innodb_log_buffer_size=32M
net_buffer_length=1000000
query_cache_size = 32M
key_buffer_size = 384M
sort_buffer_size = 4M
read_buffer_size = 2M
thread_cache_size = 8
max_allowed_packet = 32M
tmpdir=/var/lib/mysql
server_id=3
replicate-do-db=pdns
lock_wait_timeout=900

Comment by burnley [ 2019-11-06 ]

If it helps: on one affected server I was only able to start mysqld with innodb_force_recovery=3, using 1 and 2 would still crash.

Comment by Jacques David Commarmond [ 2019-11-06 ]

Can someone at least remove the buggy versions off the repository please to
avoid hundreds of cpanel / centos servers to crash on autoupdate around the
world?

Comment by Dmitry Libenzon [ 2019-11-06 ]

We have a lot of affected servers with Plesk Panel already and the number continues to grow.
Please remove buggy versions from repositories.
Thanks,

Comment by Marko Mäkelä [ 2019-11-06 ]

This is a regression that was caused by the fix of MDEV-20621. MySQL 5.6 (and MariaDB 10.0) introduced eviction of tables from the InnoDB data dictionary cache. Tables that are connected to FOREIGN KEY constraints or FULLTEXT INDEX are exempt of the eviction. With the problematic change, a table that would already be exempt from eviction due to FOREIGN KEY would cause the problem if there also was a FULLTEXT INDEX defined on it.

Comment by cPanel Senior Tech's [ 2019-11-06 ]

Thank's for the quick fix @marko. Looking at your github, It seems like there may be build issues with the new fix or the version bumps?

Is there any ETA for release to the repo's? We're up to 42 cases now, with many clients no longer opening tickets with us for the issue due to our forward outreach(i.e. likely many more clients with failing MariaDB servers).

If the fix is not anticipated to hit the repo's anytime soon, is it possible to remove the problematic versions from the repo servers? Since this is causing downtime for many with no known workaround, and this is just a point release, I think it would be appropriate to pull the problematic versions from the repo's.

Comment by Marko Mäkelä [ 2019-11-07 ]

cPanelSTA, to my understanding, the affected packages were removed later yesterday, as soon as the office hours on the US East coast started. In the future, we should have people in Asian or European time zones who could do that.

I do not know which CI system you are referring to. The main one is buildbot.askmonty.org, and to me, it looked acceptable for the 10.1, 10.2, 10.3, and 10.4 branches. Sometimes, upgrade or installation tests fail due to connectivity glitches.

Comment by Sergei Golubchik [ 2019-11-07 ]

cPanelSTA, the fix pushed, it's on github. Bad versions were removed from repositories. We're doing a new release now, as I'm writing this comment.

Generated at Thu Feb 08 09:03:44 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.