[MDEV-13886] innodb.read_only_recovery failed in buildbot, server crash Created: 2017-09-22  Updated: 2023-11-29  Resolved: 2023-11-29

Status: Closed
Project: MariaDB Server
Component/s: Storage Engine - InnoDB, Tests
Affects Version/s: 10.2
Fix Version/s: 10.2.9, 10.3.2

Type: Bug Priority: Major
Reporter: Elena Stepanova Assignee: Marko Mäkelä
Resolution: Duplicate Votes: 0
Labels: None

Issue Links:
Duplicate
duplicates MDEV-13570 Assertion failure !srv_read_only_mode... Closed

 Description   

http://buildbot.askmonty.org/buildbot/builders/winx64-debug/builds/5051

innodb.read_only_recovery 'innodb'       w2 [ fail ]  Found warnings/errors in server log file!
        Test ended at 2017-08-30 08:58:48
line
170830  8:58:31 [ERROR] mysqld got exception 0x80000003 ;
Attempting backtrace. You can use the following information to find out
^ Found warnings in D:/winx64-debug/build/mysql-test/var/2/log/mysqld.1.err
ok
 
 - saving 'D:/winx64-debug/build/mysql-test/var/2/log/innodb.read_only_recovery-innodb/' to 'D:/winx64-debug/build/mysql-test/var/log/innodb.read_only_recovery-innodb/'
 - found 'mysqld.dmp' (0/5)
 
Trying 'cdb' to get a backtrace
Output from cdb follows. Faulting thread is printed twice,with and without function parameters
Search for STACK_TEXT to see the stack trace of 
the faulting thread. Callstacks of other threads are printed after it.
 
Microsoft (R) Windows Debugger Version 10.0.10586.567 AMD64
Copyright (c) Microsoft Corporation. All rights reserved.
 
 
Loading Dump File [D:\winx64-debug\build\mysql-test\var\log\innodb.read_only_recovery-innodb\mysqld.1\data\mysqld.dmp]
User Mini Dump File: Only registers, stack and portions of memory are available
 
 
Response                         Time (ms)     Location
OK                                             D:\winx64-debug\build\sql\Debug
OK                                             C:\Windows\System32
OK                                             .
 
Response                         Time (ms)     Location
OK                                             D:\winx64-debug\build\sql\Debug
OK                                             C:\Windows\System32
OK                                             .
Deferred                                       cache*C:\cdb_symbols
Symbol search path is: D:\winx64-debug\build\sql\Debug;C:\Windows\System32;.;cache*C:\cdb_symbols
Executable search path is: D:\winx64-debug\build\sql\Debug;C:\Windows\System32;.
Windows 8.1 Version 9600 MP (4 procs) Free x64
Product: Server, suite: TerminalServer DataCenter SingleUserTS
Built by: 6.3.9600.18217 (winblue_ltsb.160124-0053)
Machine Name:
Debug session time: Wed Aug 30 08:58:40.000 2017 (UTC + 0:00)
System Uptime: not available
Process Uptime: 0 days 0:00:12.000
.............................
This dump file has a breakpoint exception stored in it.
The stored exception information can be accessed via .ecxr.
ntdll!ZwGetContextThread:
             ret
0:007> cdb: Reading initial command '!sym prompts off; !analyze -v; .ecxr; !for_each_frame dv /t;!uniqstack -p;q'
quiet mode - symbol prompts off
 
 
 
Module name            Error
KERNELBASE             PDB not found : d:\winx64-debug\build\sql\debug\symbols\dll\kernelbase.pdb
                       PDB not found : c:\windows\system32\symbols\dll\kernelbase.pdb
                       PDB not found : .\symbols\dll\kernelbase.pdb
                       PDB not found : cache*c:\cdb_symbols
 
You can troubleshoot most symbol related issues by turning on symbol loading diagnostics (!sym noisy) and repeating the command that caused symbols to be loaded.
You should also verify that your symbol search path (.sympath) is correct.
 
DUMP_CLASS: 2
 
DUMP_QUALIFIER: 400
 
CONTEXT:  (.ecxr)
rax=00007ff67d192ed0 rbx=00007ff67f5cc430 rcx=0000000000000016
rdx=0000b762852721bd rsi=00007ff67dbc9501 rdi=0000000000000016
rip=00007ff67d0061c5 rsp=00000050b45de320 rbp=00000050b45de4e0
 r8=00000050b45de3b0  r9=00000050b45de3b8 r10=0000000000000000
r11=00000050b45de3a8 r12=0000000000000910 r13=0000000000000000
r14=00000000000007a4 r15=00007ff67d0061c0
iopl=0         nv up ei pl nz ac pe nc
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000212
mysqld!my_sigabrt_handler:
             int     3
Resetting default scope
 
FAULTING_IP: 
mysqld!my_sigabrt_handler+5 [d:\winx64-debug\build\src\mysys\my_thr_init.c @ 488]
             int     3
 
EXCEPTION_RECORD:  (.exr -1)
ExceptionAddress: 00007ff67d0061c5 (mysqld!my_sigabrt_handler)
   ExceptionCode: 80000003 (Break instruction exception)
  ExceptionFlags: 00000000
NumberParameters: 1
   Parameter[0]: 0000000000000000
 
BUGCHECK_STR:  59380775
 
WRONG_SYMBOLS_TIMESTAMP: 59380775
 
WRONG_SYMBOLS_SIZE: 1ad000
 
FAULTING_MODULE: 00007ffe499c0000 ntdll
 
DEBUG_FLR_IMAGE_TIMESTAMP:  59380775
 
ADDITIONAL_DEBUG_TEXT:  
You can run '.symfix; .reload' to try to fix the symbol path and load symbols. ; Followup set based on attribute [Is_ChosenCrashFollowupThread] from Frame:[0] on thread:[PSEUDO_THREAD]
 
LAST_CONTROL_TRANSFER:  from 0000000000000000 to 0000000000000000
 
ANALYSIS_SESSION_HOST:  MARIADB-02
 
ANALYSIS_SESSION_TIME:  08-30-2017 08:58:51.0126
 
ANALYSIS_VERSION: 10.0.10586.567 amd64fre
 
STACK_TEXT:  
wrong_symbols!WRONG_SYMBOLS
 
 
STACK_COMMAND:  .ecxr ; kb ; ** Pseudo Context ** ; kb
 
THREAD_SHA1_HASH_MOD_FUNC:  8b50e467776d7660ec74f0fcf6059a449f38bc9a
 
THREAD_SHA1_HASH_MOD_FUNC_OFFSET:  386be9b62a7535c96acfda43762924bd7c0bcb71
 
THREAD_SHA1_HASH_MOD:  1c9266d4d33f329668e953be351439450e48d114
 
SYMBOL_STACK_INDEX:  0
 
FOLLOWUP_NAME:  MachineOwner
 
EXCEPTION_CODE: (NTSTATUS) 0x59380775 - <Unable to get error code text>
 
EXCEPTION_CODE_STR:  59380775
 
FAILURE_EXCEPTION_CODE:  59380775
 
EXCEPTION_STR:  PRIVATE_SYMBOLS
 
PROCESS_NAME:  ntdll.wrong.symbols.dll
 
IMAGE_NAME:  ntdll.wrong.symbols.dll
 
MODULE_NAME: ntdll_wrong_symbols
 
SYMBOL_NAME:  ntdll_wrong_symbols!593807751AD000
 
BUCKET_ID:  PRIVATE_SYMBOLS_X64_6.3.9600.17415_(winblue_r4.141028-1500)_TIMESTAMP_170607-140229
 
DEFAULT_BUCKET_ID:  PRIVATE_SYMBOLS_X64_6.3.9600.17415_(winblue_r4.141028-1500)_TIMESTAMP_170607-140229
 
PRIMARY_PROBLEM_CLASS:  PRIVATE_SYMBOLS
 
BUCKET_ID_OFFSET:  0
 
BUCKET_ID_MODULE_STR:  ntdll_wrong_symbols
 
BUCKET_ID_MODVER_STR:  
 
BUCKET_ID_PREFIX_STR:  PRIVATE_SYMBOLS_X64_6.3.9600.17415_(winblue_r4.141028-1500)_TIMESTAMP_170607-140229
 
FAILURE_PROBLEM_CLASS:  PRIVATE_SYMBOLS_X64_6.3.9600.17415_(winblue_r4.141028-1500)_TIMESTAMP_170607-140229
 
FAILURE_IMAGE_NAME:  ntdll.wrong.symbols.dll
 
FAILURE_FUNCTION_NAME:  593807751AD000
 
BUCKET_ID_FUNCTION_STR:  593807751AD000
 
FAILURE_SYMBOL_NAME:  ntdll.wrong.symbols.dll!593807751AD000
 
FAILURE_BUCKET_ID:  PRIVATE_SYMBOLS_X64_6.3.9600.17415_(winblue_r4.141028-1500)_TIMESTAMP_170607-140229_59380775_ntdll.wrong.symbols.dll!593807751AD000
 
TARGET_TIME:  2017-08-30T08:58:40.000Z
 
OSBUILD:  9600
 
OSSERVICEPACK:  17415
 
SERVICEPACK_NUMBER: 0
 
OS_REVISION: 0
 
SUITE_MASK:  400
 
PRODUCT_TYPE:  3
 
OSPLATFORM_TYPE:  x64
 
OSNAME:  Windows 8.1
 
OSEDITION:  Windows 8.1 Server TerminalServer DataCenter SingleUserTS
 
OS_LOCALE:  
 
USER_LCID:  0
 
OSBUILD_TIMESTAMP:  2014-10-29 02:45:30
 
BUILDDATESTAMP_STR:  141028-1500
 
BUILDLAB_STR:  winblue_r4
 
BUILDOSVER_STR:  6.3.9600.17415
 
ANALYSIS_SESSION_ELAPSED_TIME: 754
 
ANALYSIS_SOURCE:  UM
 
FAILURE_ID_HASH_STRING:  um:private_symbols_x64_6.3.9600.17415_(winblue_r4.141028-1500)_timestamp_170607-140229_59380775_ntdll.wrong.symbols.dll!593807751ad000
 
FAILURE_ID_HASH:  {62d20533-53a0-965f-f808-ae1c5ce08158}
 
Followup:     MachineOwner
---------
 
rax=00007ff67d192ed0 rbx=00007ff67f5cc430 rcx=0000000000000016
rdx=0000b762852721bd rsi=00007ff67dbc9501 rdi=0000000000000016
rip=00007ff67d0061c5 rsp=00000050b45de320 rbp=00000050b45de4e0
 r8=00000050b45de3b0  r9=00000050b45de3b8 r10=0000000000000000
r11=00000050b45de3a8 r12=0000000000000910 r13=0000000000000000
r14=00000000000007a4 r15=00007ff67d0061c0
iopl=0         nv up ei pl nz ac pe nc
cs=0033  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000212
mysqld!my_sigabrt_handler:
             int     3
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!my_sigabrt_handler [d:\winx64-debug\build\src\mysys\my_thr_init.c @ 488]
int sig = 0n22
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!raise [d:\th\minkernel\crts\ucrt\src\appcrt\misc\signal.cpp @ 516]
int signum = 0n22
int old_fpecode = 0n0
struct _EXCEPTION_POINTERS * old_pxcptinfoptrs = 0x00000000`00000000
bool return0 = false
bool action_is_global = true
<function> * action = 0x00007ff6`7d0061c0
struct __acrt_ptd * ptd = 0x00000000`00000000
<function> ** action_pointer = 0x00007ff6`7f5cc430
struct __crt_signal_action_t * local_action = <value unavailable>
int _Expr_val = <value unavailable>
struct __crt_signal_action_t * last = <value unavailable>
struct __crt_signal_action_t * first = <value unavailable>
struct __crt_signal_action_t * p = 0x00000050`b45de390
unsigned int64 __acrt_signal_action_table_count = <value unavailable>
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!abort [d:\th\minkernel\crts\ucrt\src\appcrt\startup\abort.cpp @ 71]
<function> * sigabrt_action = 0x00007ff6`7d192ed0
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!common_assert_to_stderr<wchar_t> [d:\th\minkernel\crts\ucrt\src\appcrt\startup\assert.cpp @ 149]
wchar_t * expression = 0x00007ff6`7dbc9618 "!srv_read_only_mode"
wchar_t * file_name = 0x00007ff6`7dbc95a0 "D:\winx64-debug\build\src\storage\innobase\log\log0log.cc"
unsigned int line_number = 0x7a4
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
(Inline Function) --------`-------- mysqld!common_assert [d:\th\minkernel\crts\ucrt\src\appcrt\startup\assert.cpp @ 383]
void * return_address = 0x00007ff6`7cbdb7ce
int current_error_mode = <value unavailable>
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!_wassert [d:\th\minkernel\crts\ucrt\src\appcrt\startup\assert.cpp @ 404]
wchar_t * expression = 0x00007ff6`7dbc9618 "!srv_read_only_mode"
wchar_t * file_name = 0x00007ff6`7dbc95a0 "D:\winx64-debug\build\src\storage\innobase\log\log0log.cc"
unsigned int line_number = 0x7a4
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!logs_empty_and_mark_files_at_shutdown [d:\winx64-debug\build\src\storage\innobase\log\log0log.cc @ 1956]
bool freed = true
unsigned int64 count = 1
unsigned int64 lsn = 0xcccccccc`cccccccc
char * thread_name = 0x00007ff6`7dbc8d40 "buf_resize_thread"
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!innodb_shutdown [d:\winx64-debug\build\src\storage\innobase\srv\srv0start.cc @ 2822]
unsigned int64 n_threads = 0xcccccccc`cccccccc
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!innobase_end [d:\winx64-debug\build\src\storage\innobase\handler\ha_innodb.cc @ 4543]
class THD * thd = 0x00000000`00000000
struct handlerton * __formal = 0x00000050`b19d47a8
ha_panic_function __formal = HA_PANIC_CLOSE (0n0)
struct _db_stack_frame_ _db_stack_frame_ = struct _db_stack_frame_
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!ha_finalize_handlerton [d:\winx64-debug\build\src\sql\handler.cc @ 453]
struct st_plugin_int * plugin = 0x00000050`b19c1c18
struct handlerton * hton = 0x00000050`b19d47a8
struct _db_stack_frame_ _db_stack_frame_ = struct _db_stack_frame_
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!plugin_deinitialize [d:\winx64-debug\build\src\sql\sql_plugin.cc @ 1215]
struct st_plugin_int * plugin = 0x00000050`b19c1c18
bool ref_check = true
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!reap_plugins [d:\winx64-debug\build\src\sql\sql_plugin.cc @ 1292]
struct st_plugin_int ** list = 0x00000050`b45df8b0
struct st_plugin_int ** reap = 0x00000050`b45df968
unsigned int count = 0x33
struct st_plugin_int * plugin = 0x00000050`b19c1c18
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!plugin_shutdown [d:\winx64-debug\build\src\sql\sql_plugin.cc @ 1951]
unsigned int i = 0x33
unsigned int count = 0x33
struct _db_stack_frame_ _db_stack_frame_ = struct _db_stack_frame_
struct st_plugin_int ** plugins = 0xcccccccc`cccccccc
struct st_plugin_int * plugin = 0x00000050`b18b7c80
struct st_plugin_dl ** dl = 0xcccccccc`cccccccc
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!clean_up [d:\winx64-debug\build\src\sql\mysqld.cc @ 2214]
bool print_message = true
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!unireg_end [d:\winx64-debug\build\src\sql\mysqld.cc @ 2089]
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!kill_server [d:\winx64-debug\build\src\sql\mysqld.cc @ 2018]
int sig_ptr = 0n15
int sig = 0n15
struct _db_stack_frame_ _db_stack_frame_ = struct _db_stack_frame_
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!handle_shutdown [d:\winx64-debug\build\src\sql\mysqld.cc @ 3676]
void * arg = 0x00000000`00000000
struct tagMSG msg = {msg=0xcccccccc wp=0xcccccccccccccccc lp=0xcccccccccccccccc}
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!pfs_spawn_thread [d:\winx64-debug\build\src\storage\perfschema\pfs.cc @ 1864]
void * arg = 0x00000050`b1e142b8
struct PFS_thread * pfs = 0x00000050`af03e5d0
struct PFS_thread_class * klass = 0x00000050`acfe9ff0
<function> * user_start_routine = 0x00007ff6`7c6c6e20
void * user_arg = 0x00000000`00000000
struct PFS_spawn_thread_arg * typed_arg = 0x00000050`b1e142b8
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!pthread_start [d:\winx64-debug\build\src\mysys\my_winthread.c @ 61]
void * p = 0x00000050`ae09e570
void * arg = 0x00000050`b1e142b8
<function> * func = 0x00007ff6`7cfad550
struct thread_start_parameter * par = 0x00000050`ae09e570
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
(Inline Function) --------`-------- mysqld!invoke_thread_procedure [d:\th\minkernel\crts\ucrt\src\appcrt\startup\thread.cpp @ 91]
void * context = 0x00000050`ae09e570
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!thread_start<unsigned int (__cdecl*)(void * __ptr64)> [d:\th\minkernel\crts\ucrt\src\appcrt\startup\thread.cpp @ 115]
void * parameter = 0x00007ff6`7d1c9a80
<function> * procedure = 0x00007ff6`7d0597c0
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
kernel32!BaseThreadInitThunk
Unable to enumerate locals, HRESULT 0x80004005
Private symbols (symbols.pri) are required for locals.
Type ".hh dbgerr005" for details.
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
ntdll!RtlUserThreadStart
Unable to enumerate locals, Win32 error 0n318
Private symbols (symbols.pri) are required for locals.
Type ".hh dbgerr005" for details.
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!my_sigabrt_handler [d:\winx64-debug\build\src\mysys\my_thr_init.c @ 488]
Processing 9 threads, please wait
 
.  0  Id: 115c.388 Suspend: 0 Teb: 00007ff6`7be8e000 Unfrozen
      Priority: 0  Priority class: 32
 
ntdll!NtWaitForAlertByThreadId
ntdll!RtlSleepConditionVariableCS
KERNELBASE!SleepConditionVariableCS
mysqld!pthread_cond_timedwait(struct _RTL_CONDITION_VARIABLE * cond = 0x00007ff6`7ed419d8, struct _RTL_CRITICAL_SECTION * mutex = 0x00007ff6`7ed417c8, struct timespec * abstime = 0x00000000`00000000) [d:\winx64-debug\build\src\mysys\my_wincond.c @ 82]
mysqld!pthread_cond_wait(struct _RTL_CONDITION_VARIABLE * cond = 0x00007ff6`7ed419d8, struct _RTL_CRITICAL_SECTION * mutex = 0x00007ff6`7ed417c8) [d:\winx64-debug\build\src\mysys\my_wincond.c @ 91]
mysqld!inline_mysql_cond_wait(struct st_mysql_cond * that = 0x00007ff6`7ed419d8, struct st_mysql_mutex * mutex = 0x00007ff6`7ed417c8, char * src_file = 0x00007ff6`7d4951e0 "D:\winx64-debug\build\src\sql\mysqld.cc", unsigned int src_line = 0x17b4) [d:\winx64-debug\build\src\include\mysql\psi\mysql_thread.h @ 1138]
mysqld!win_main(int argc = 0n147, char ** argv = 0x00000050`acfd4a48) [d:\winx64-debug\build\src\sql\mysqld.cc @ 6068]
mysqld!mysql_service(void * p = 0x00000000`00000000) [d:\winx64-debug\build\src\sql\mysqld.cc @ 6107]
mysqld!mysqld_main(int argc = 0n24, char ** argv = 0x00000050`acfc1f70) [d:\winx64-debug\build\src\sql\mysqld.cc @ 6300]
mysqld!main(int argc = 0n24, char ** argv = 0x00000050`acfc1f70) [d:\winx64-debug\build\src\sql\main.cc @ 26]
(Inline Function) --------`-------- mysqld!invoke_main [f:\dd\vctools\crt\vcstartup\src\startup\exe_common.inl @ 64]
mysqld!__scrt_common_main_seh(void) [f:\dd\vctools\crt\vcstartup\src\startup\exe_common.inl @ 259]
kernel32!BaseThreadInitThunk
ntdll!RtlUserThreadStart
 
.  1  Id: 115c.13a4 Suspend: 0 Teb: 00007ff6`7be8c000 Unfrozen
      Priority: 0  Priority class: 32
 
ntdll!NtWaitForAlertByThreadId
ntdll!RtlSleepConditionVariableCS
KERNELBASE!SleepConditionVariableCS
mysqld!pthread_cond_timedwait(struct _RTL_CONDITION_VARIABLE * cond = 0x00007ff6`7f5bfa58, struct _RTL_CRITICAL_SECTION * mutex = 0x00007ff6`7f5bfa28, struct timespec * abstime = 0x00000050`b209f6e8) [d:\winx64-debug\build\src\mysys\my_wincond.c @ 82]
mysqld!inline_mysql_cond_timedwait(struct st_mysql_cond * that = 0x00007ff6`7f5bfa58, struct st_mysql_mutex * mutex = 0x00007ff6`7f5bfa28, struct timespec * abstime = 0x00000050`b209f6e8, char * src_file = 0x00007ff6`7eb4d1f8 "--- memory read error at address 0x00007ff6`7eb4d1f8 ---", unsigned int src_line = 0x124) [d:\winx64-debug\build\src\include\mysql\psi\mysql_thread.h @ 1175]
mysqld!timer_handler(void * arg = 0x00000000`00000000) [d:\winx64-debug\build\src\mysys\thr_timer.c @ 293]
mysqld!pfs_spawn_thread(void * arg = 0x00000050`acfb5f18) [d:\winx64-debug\build\src\storage\perfschema\pfs.cc @ 1864]
mysqld!pthread_start(void * p = 0x00000050`ae09e770) [d:\winx64-debug\build\src\mysys\my_winthread.c @ 61]
(Inline Function) --------`-------- mysqld!invoke_thread_procedure [d:\th\minkernel\crts\ucrt\src\appcrt\startup\thread.cpp @ 91]
mysqld!thread_start<unsigned int (void * parameter = 0x00007ff6`7d1c9a80) [d:\th\minkernel\crts\ucrt\src\appcrt\startup\thread.cpp @ 115]
kernel32!BaseThreadInitThunk
ntdll!RtlUserThreadStart
 
.  2  Id: 115c.1058 Suspend: 0 Teb: 00007ff6`7be8a000 Unfrozen
      Priority: 0  Priority class: 32
 
ntdll!NtRemoveIoCompletion
KERNELBASE!GetQueuedCompletionStatus
mysqld!os_aio_windows_handler(unsigned int64 segment = 0, unsigned int64 pos = 0, struct fil_node_t ** m1 = 0x00000050`b323f7a8, void ** m2 = 0x00000050`b323f7f8, class IORequest * type = 0x00000050`b323f7c8) [d:\winx64-debug\build\src\storage\innobase\os\os0file.cc @ 6465]
mysqld!os_aio_handler(unsigned int64 segment = 0, struct fil_node_t ** m1 = 0x00000050`b323f7a8, void ** m2 = 0x00000050`b323f7f8, class IORequest * request = 0x00000050`b323f7c8) [d:\winx64-debug\build\src\storage\innobase\os\os0file.cc @ 5660]
mysqld!fil_aio_wait(unsigned int64 segment = 0) [d:\winx64-debug\build\src\storage\innobase\fil\fil0fil.cc @ 5443]
mysqld!io_handler_thread(void * arg = 0x00007ff6`7edae000) [d:\winx64-debug\build\src\storage\innobase\srv\srv0start.cc @ 344]
kernel32!BaseThreadInitThunk
ntdll!RtlUserThreadStart
 
.  6  Id: 115c.1068 Suspend: 0 Teb: 00007ff6`7bd5a000 Unfrozen
      Priority: 0  Priority class: 32
 
ntdll!ZwWaitForWorkViaWorkerFactory
ntdll!RtlFreeUnicodeString
kernel32!BaseThreadInitThunk
ntdll!RtlUserThreadStart
 
.  7  Id: 115c.138c Suspend: 0 Teb: 00007ff6`7bd58000 Unfrozen
      Priority: 0  Priority class: 32
 
ntdll!ZwGetContextThread
 
Total threads: 9
Duplicate callstacks: 4 (windbg thread #s follow):
3, 4, 5, 8
quit:



 Comments   
Comment by Marko Mäkelä [ 2023-11-29 ]

I did not find newer failures in a main branch than the one in the Description:

10.2 acaac7c233ef608bed28ab57e6631303

innodb.read_only_recovery 'innodb'       w2 [ fail ]  Found warnings/errors in server log file!
        Test ended at 2017-08-30 08:58:48
line
170830  8:58:31 [ERROR] mysqld got exception 0x80000003 ;
mysqld!_wassert [d:\th\minkernel\crts\ucrt\src\appcrt\startup\assert.cpp @ 404]
wchar_t * expression = 0x00007ff6`7dbc9618 "!srv_read_only_mode"
wchar_t * file_name = 0x00007ff6`7dbc95a0 "D:\winx64-debug\build\src\storage\innobase\log\log0log.cc"
unsigned int line_number = 0x7a4
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!logs_empty_and_mark_files_at_shutdown [d:\winx64-debug\build\src\storage\innobase\log\log0log.cc @ 1956]
bool freed = true
unsigned int64 count = 1
unsigned int64 lsn = 0xcccccccc`cccccccc
char * thread_name = 0x00007ff6`7dbc8d40 "buf_resize_thread"

The failing assertion would be the following:

        if (thread_name) {
                ut_ad(!srv_read_only_mode);

It looks like the buffer pool resize thread shutdown took a long time.

This failure also occurred in the "10.2½" branch that a major customer was using:

bb-10.2-ext 2f3968d98f8d90a9a9747e5b89c8f07e

innodb.read_only_recovery 'innodb'       w1 [ fail ]  Found warnings/errors in server log file!
        Test ended at 2017-09-01 13:07:42
line
170901 13:07:22 [ERROR] mysqld got exception 0x80000003 ;
Attempting backtrace. You can use the following information to find out
mysqld!_wassert [d:\th\minkernel\crts\ucrt\src\appcrt\startup\assert.cpp @ 404]
wchar_t * expression = <value unavailable>
wchar_t * file_name = <value unavailable>
unsigned int line_number = <value unavailable>
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
mysqld!logs_empty_and_mark_files_at_shutdown [d:\win32-debug\build\src\storage\innobase\log\log0log.cc @ 1956]
bool freed = true
unsigned int count = 1
unsigned int64 lsn = 0xcccccccc`cccccccc
char * thread_name = 0x02874544 "buf_resize_thread"

Generated at Thu Feb 08 08:09:08 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.