[MDEV-31595] Using MariaDB with Nextcloud on docker gives fatal IO error Created: 2023-06-30  Updated: 2023-10-02

Status: Open
Project: MariaDB Server
Component/s: Storage Engine - InnoDB
Affects Version/s: 11.0.2
Fix Version/s: 11.0

Type: Bug Priority: Major
Reporter: Jay Schieber Assignee: Unassigned
Resolution: Unresolved Votes: 0
Labels: crash
Environment:

Docker running in Ubuntu


Attachments: Text File _mariadbnextcloud_logs.txt     File nextcloud_docker_compose.yaml    
Issue Links:
Relates
relates to MDEV-31256 fil_node_open_file() releases fil_sys... Closed
relates to MDEV-31347 fil_ibd_create() may hijack the file ... Closed

 Description   

Sorry,I known nothing about databases, but MariaDB has stopped working for a few days, and showing the attached logs, with some alarming messages. I could find no similar logs in the reported issues (I tried to follow the instructions here). It was running great for at least a year, and started crashing without any updates, afaicr. Also attached is my docker-compose.yaml file.



 Comments   
Comment by Marko Mäkelä [ 2023-06-30 ]

In _mariadbnextcloud_logs.txt I find the following:

mariadb-11.0.2

2023-06-30 16:04:00 0 [ERROR] [FATAL] InnoDB: IO Error: 22 during async write of 16384 bytes, for file 10, returned 0

Error 22 is EINVAL, and a possible reason is that the file descriptor 10 had been closed. This might be a duplicate of MDEV-31256 or MDEV-31347, or a similar other error.

Comment by Daniel Black [ 2023-06-30 ]

As both bugs Marko mentioned have been fixed, you can try quay.io/mariadb-foundation/mariadb-devel:11.0 as a image that has both of those fixed. This follows the reviewed and fixed MariaDB codebase for the 11.0 branch and is build the same way as the mariadb Docker Official Image. Please confirm if this runs correctly.

Also, after confirming it works correctly, from [https://mariadb.com/kb/en/mariadb-server-docker-official-image-environment-variables/#mariadb_auto_upgrade-mariadb_disable_upgrade_backup|envionment variables], recommend MARIADB_AUTO_UPGRADE=1 since you are following mariadb:latest as an image.

Comment by Jay Schieber [ 2023-07-09 ]

Thanks Daniel, the 11.0 version works! However, I am not sure that I understand the second paragraph. I went back to the old image (mariadb) and added the environment you suggested. But this crashes with:

2023-07-09 16:52:42+00:00 [ERROR] [Entrypoint]: Unable to start server.
 
2023-07-09 16:52:42+00:00 [Note] [Entrypoint]: Entrypoint script for MariaDB Server 1:11.0.2+maria~ubu2204 started.
 
2023-07-09 16:52:43+00:00 [Note] [Entrypoint]: Switching to dedicated user 'mysql'
 
2023-07-09 16:52:43+00:00 [Note] [Entrypoint]: Entrypoint script for MariaDB Server 1:11.0.2+maria~ubu2204 started.
 
2023-07-09 16:52:43+00:00 [Note] [Entrypoint]: MariaDB upgrade information missing, assuming required
 
2023-07-09 16:52:43+00:00 [Note] [Entrypoint]: Starting temporary server
 
2023-07-09 16:52:43+00:00 [Note] [Entrypoint]: Waiting for server startup
 
2023-07-09 16:52:43 0 [Note] Starting MariaDB 11.0.2-MariaDB-1:11.0.2+maria~ubu2204 source revision 0005f2f06c8e1aea4915887decad67885108a929 as process 55
 
2023-07-09 16:52:43 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
 
2023-07-09 16:52:43 0 [Note] InnoDB: Number of transaction pools: 1
 
2023-07-09 16:52:43 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
 
2023-07-09 16:52:43 0 [Note] mariadbd: O_TMPFILE is not supported on /tmp (disabling future attempts)
 
2023-07-09 16:52:43 0 [Note] InnoDB: Initializing buffer pool, total size = 128.000MiB, chunk size = 2.000MiB
 
2023-07-09 16:52:43 0 [Note] InnoDB: Completed initialization of buffer pool
 
2023-07-09 16:52:43 0 [ERROR] InnoDB: Inconsistent tablespace ID in file .//undo001
 
2023-07-09 16:52:43 0 [ERROR] InnoDB: Unable to read first page of file .//undo001
 
2023-07-09 16:52:43 0 [ERROR] InnoDB: Inconsistent tablespace ID in file .//undo002
 
2023-07-09 16:52:43 0 [ERROR] InnoDB: Unable to read first page of file .//undo002
 
2023-07-09 16:52:43 0x7f7ab6cfb880  InnoDB: Assertion failure in file ./storage/innobase/srv/srv0start.cc line 804
 
InnoDB: Failing assertion: !i || prev_id + 1 == space_id
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to https://jira.mariadb.org/
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mariadbd startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: https://mariadb.com/kb/en/library/innodb-recovery-modes/
 
InnoDB: about forcing recovery.
 
230709 16:52:43 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
 
something is definitely wrong and this may fail.
 
Server version: 11.0.2-MariaDB-1:11.0.2+maria~ubu2204 source revision: 0005f2f06c8e1aea4915887decad67885108a929
 
key_buffer_size=134217728
 
read_buffer_size=131072
 
max_used_connections=0
 
max_threads=153
 
thread_count=0
 
It is possible that mysqld could use up to 
 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 468023 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
Thread pointer: 0x0
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x0 thread_stack 0x49000
 
Printing to addr2line failed
 
mariadbd(my_print_stacktrace+0x32)[0x561d710f7a62]
 
mariadbd(handle_fatal_signal+0x488)[0x561d70bcae28]
 
/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f7ab7074520]
 
/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f7ab70c8a7c]
 
/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f7ab7074476]
 
/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f7ab705a7f3]
 
mariadbd(+0x6970f3)[0x561d707df0f3]
 
mariadbd(+0x68e841)[0x561d707d6841]
 
mariadbd(+0x690e34)[0x561d707d8e34]
 
mariadbd(+0xd7aad9)[0x561d70ec2ad9]
 
mariadbd(_Z24ha_initialize_handlertonP13st_plugin_int+0x86)[0x561d70bce0b6]
 
mariadbd(+0x83d686)[0x561d70985686]
 
mariadbd(_Z11plugin_initPiPPci+0x91d)[0x561d7098684d]
 
mariadbd(+0x70bb91)[0x561d70853b91]
 
mariadbd(_Z11mysqld_mainiPPc+0x424)[0x561d70859324]
 
/lib/x86_64-linux-gnu/libc.so.6(+0x29d90)[0x7f7ab705bd90]
 
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x80)[0x7f7ab705be40]
 
mariadbd(_start+0x25)[0x561d7084db05]
 
The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains
 
information that should help you find out what is causing the crash.
 
Writing a core file...
 
Working directory at /var/lib/mysql
 
Resource Limits:
 
Limit                     Soft Limit           Hard Limit           Units     
 
Max cpu time              unlimited            unlimited            seconds   
 
Max file size             unlimited            unlimited            bytes     
 
Max data size             unlimited            unlimited            bytes     
 
Max stack size            8388608              unlimited            bytes     
 
Max core file size        unlimited            unlimited            bytes     
 
Max resident set          unlimited            unlimited            bytes     
 
Max processes             unlimited            unlimited            processes 
 
Max open files            1048576              1048576              files     
 
Max locked memory         65536                65536                bytes     
 
Max address space         unlimited            unlimited            bytes     
 
Max file locks            unlimited            unlimited            locks     
 
Max pending signals       127584               127584               signals   
 
Max msgqueue size         819200               819200               bytes     
 
Max nice priority         0                    0                    
 
Max realtime priority     0                    0                    
 
Max realtime timeout      unlimited            unlimited            us        
 
Core pattern: |/usr/share/apport/apport -p%p -s%s -c%c -d%d -P%P -u%u -g%g -- %E
 
Kernel version: Linux version 5.15.0-75-generic (buildd@bos03-amd64-059) (gcc (Ubuntu 11.3.0-1ubuntu1~22.04.1) 11.3.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #82-Ubuntu SMP Tue Jun 6 23:10:23 UTC 2023
 
/usr/local/bin/docker-entrypoint.sh: line 135:    55 Aborted                 (core dumped) "$@" --skip-networking --default-time-zone=SYSTEM --socket="${SOCKET}" --wsrep_on=OFF --expire-logs-days=0 --loose-innodb_buffer_pool_load_at_startup=0

Comment by Jay Schieber [ 2023-07-09 ]

Hmmm. Now going back to what was working fails. Maybe it was repairing something that hadn't finished before? No idea, really.

2023-07-09 16:59:17+00:00 [Note] [Entrypoint]: Entrypoint script for MariaDB Server 1:11.0.3+maria~ubu2204 started.
 
2023-07-09 16:59:17+00:00 [Note] [Entrypoint]: Switching to dedicated user 'mysql'
 
2023-07-09 16:59:17+00:00 [Note] [Entrypoint]: Entrypoint script for MariaDB Server 1:11.0.3+maria~ubu2204 started.
 
2023-07-09 16:59:17+00:00 [Note] [Entrypoint]: MariaDB upgrade information missing, assuming required
 
2023-07-09 16:59:17+00:00 [Note] [Entrypoint]: MariaDB upgrade (mariadb-upgrade) required, but skipped due to $MARIADB_AUTO_UPGRADE setting
 
2023-07-09 16:59:17 0 [Note] Starting MariaDB 11.0.3-MariaDB-1:11.0.3+maria~ubu2204 source revision 313c5a1dfb744aaef10586526dda89d2b4a50651 as process 1
 
2023-07-09 16:59:17 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
 
2023-07-09 16:59:17 0 [Note] InnoDB: Number of transaction pools: 1
 
2023-07-09 16:59:17 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
 
2023-07-09 16:59:17 0 [Note] mariadbd: O_TMPFILE is not supported on /tmp (disabling future attempts)
 
2023-07-09 16:59:17 0 [Note] InnoDB: Initializing buffer pool, total size = 128.000MiB, chunk size = 2.000MiB
 
2023-07-09 16:59:17 0 [Note] InnoDB: Completed initialization of buffer pool
 
2023-07-09 16:59:17 0 [ERROR] InnoDB: Inconsistent tablespace ID in file .//undo001
 
2023-07-09 16:59:17 0 [ERROR] InnoDB: Unable to read first page of file .//undo001
 
2023-07-09 16:59:17 0 [ERROR] InnoDB: Inconsistent tablespace ID in file .//undo002
 
2023-07-09 16:59:17 0 [ERROR] InnoDB: Unable to read first page of file .//undo002
 
2023-07-09 16:59:17 0x7fe6680a8880  InnoDB: Assertion failure in file ./storage/innobase/srv/srv0start.cc line 804
 
InnoDB: Failing assertion: !i || prev_id + 1 == space_id
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to https://jira.mariadb.org/
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mariadbd startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: https://mariadb.com/kb/en/library/innodb-recovery-modes/
 
InnoDB: about forcing recovery.
 
230709 16:59:17 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
 
something is definitely wrong and this may fail.
 
Server version: 11.0.3-MariaDB-1:11.0.3+maria~ubu2204 source revision: 313c5a1dfb744aaef10586526dda89d2b4a50651
 
key_buffer_size=134217728
 
read_buffer_size=131072
 
max_used_connections=0
 
max_threads=153
 
thread_count=0
 
It is possible that mysqld could use up to 
 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 468025 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
Thread pointer: 0x0
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x0 thread_stack 0x49000
 
Printing to addr2line failed
 
mariadbd(my_print_stacktrace+0x32)[0x560b88cc6622]
 
mariadbd(handle_fatal_signal+0x488)[0x560b88795668]
 
/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7fe668421520]
 
/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7fe668475a7c]
 
/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7fe668421476]
 
/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7fe6684077f3]
 
mariadbd(+0x697713)[0x560b883a8713]
 
mariadbd(+0x68eeb1)[0x560b8839feb1]
 
mariadbd(+0x6914a4)[0x560b883a24a4]
 
mariadbd(+0xd7d009)[0x560b88a8e009]
 
mariadbd(_Z24ha_initialize_handlertonP13st_plugin_int+0x86)[0x560b88798996]
 
mariadbd(+0x83dce6)[0x560b8854ece6]
 
mariadbd(_Z11plugin_initPiPPci+0x91d)[0x560b8854fead]
 
mariadbd(+0x70be30)[0x560b8841ce30]
 
mariadbd(_Z11mysqld_mainiPPc+0x424)[0x560b88422554]
 
/lib/x86_64-linux-gnu/libc.so.6(+0x29d90)[0x7fe668408d90]
 
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x80)[0x7fe668408e40]
 
mariadbd(_start+0x25)[0x560b88416d85]
 
The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains
 
information that should help you find out what is causing the crash.
 
Writing a core file...
 
Working directory at /var/lib/mysql
 
Resource Limits:
 
Limit                     Soft Limit           Hard Limit           Units     
 
Max cpu time              unlimited            unlimited            seconds   
 
Max file size             unlimited            unlimited            bytes     
 
Max data size             unlimited            unlimited            bytes     
 
Max stack size            8388608              unlimited            bytes     
 
Max core file size        unlimited            unlimited            bytes     
 
Max resident set          unlimited            unlimited            bytes     
 
Max processes             unlimited            unlimited            processes 
 
Max open files            1048576              1048576              files     
 
Max locked memory         65536                65536                bytes     
 
Max address space         unlimited            unlimited            bytes     
 
Max file locks            unlimited            unlimited            locks     
 
Max pending signals       127584               127584               signals   
 
Max msgqueue size         819200               819200               bytes     
 
Max nice priority         0                    0                    
 
Max realtime priority     0                    0                    
 
Max realtime timeout      unlimited            unlimited            us        
 
Core pattern: |/usr/share/apport/apport -p%p -s%s -c%c -d%d -P%P -u%u -g%g -- %E
 
Kernel version: Linux version 5.15.0-75-generic (buildd@bos03-amd64-059) (gcc (Ubuntu 11.3.0-1ubuntu1~22.04.1) 11.3.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #82-Ubuntu SMP Tue Jun 6 23:10:23 UTC 2023
 
Fatal signal 11 while backtracing

Comment by Daniel Black [ 2023-07-09 ]

The code of the MARIADB_AUTO_UPGRADE=1 didn't run, and it relates to with updating the system tables more than anything innodb specific. Use once you're sure that you don't need to downgrade as it blocks some downgrade paths between major versions.

This new assertion is MDEV-31487, which is fixed in the 11.0.3-313c5a1dfb744aaef10586526dda89d2b4a50651. The assertions in MDEV-31487 / MDEV-31488 (its duplicate) are related to multiple instances on the same datadir (and mariabackup, which uses the same innodb code). The container entrypoint has a kill and a wait $MARIADB_PID so it seems unlike to be the same instance within a container. There's no inherent protection against two containers starting on the same datadir. Only very recently was MDEV-31568 added some further protections there against multiple instances running. Could two instances running on the same datadir be what happened here?

Comment by Marko Mäkelä [ 2023-07-10 ]

jds, like danblack says, the crash on recovery was fixed in MDEV-31487. The good news is that the data should not be corrupted, and upgrading to a build that contains the fix should work.

Comment by Jay Schieber [ 2023-07-10 ]

Sorry, but I don't understand all of this. I currently have no 'docker-compose.yaml' files that runs successfully. When I ran one using the image 'quay.io/mariadb-foundation/mariadb-devel:11.0', it originally worked, but when what (I think) was the final fix, it crashed with different complaints (see my last log above). Now, that dev image no longer works either. Could I get more specific instructions of the docker-compose setting necessary to get the version to test. Apologies for my ignorance here. If it is relevant, I am not aware of any multiple instances running here.

Comment by Jay Schieber [ 2023-07-26 ]

I have been without the database (and nextcloud) for nearly a month now, and really stuck about how to fix it. I have the latest of both, but MariaDB still won't run in docker. It currently throws the error below. Is there any way to salvage the situation?

2023-07-26 15:19:31+00:00 [Note] [Entrypoint]: Entrypoint script for MariaDB Server 1:11.0.2+maria~ubu2204 started.
 
2023-07-26 15:19:31+00:00 [Note] [Entrypoint]: Switching to dedicated user 'mysql'
 
2023-07-26 15:19:31+00:00 [Note] [Entrypoint]: Entrypoint script for MariaDB Server 1:11.0.2+maria~ubu2204 started.
 
2023-07-26 15:19:32+00:00 [Note] [Entrypoint]: MariaDB upgrade information missing, assuming required
 
2023-07-26 15:19:32+00:00 [Note] [Entrypoint]: MariaDB upgrade (mariadb-upgrade) required, but skipped due to $MARIADB_AUTO_UPGRADE setting
 
2023-07-26 15:19:32 0 [Note] Starting MariaDB 11.0.2-MariaDB-1:11.0.2+maria~ubu2204 source revision 0005f2f06c8e1aea4915887decad67885108a929 as process 1
 
2023-07-26 15:19:32 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
 
2023-07-26 15:19:32 0 [Note] InnoDB: Number of transaction pools: 1
 
2023-07-26 15:19:32 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
 
2023-07-26 15:19:32 0 [Note] mariadbd: O_TMPFILE is not supported on /tmp (disabling future attempts)
 
2023-07-26 15:19:32 0 [Note] InnoDB: Initializing buffer pool, total size = 128.000MiB, chunk size = 2.000MiB
 
2023-07-26 15:19:32 0 [Note] InnoDB: Completed initialization of buffer pool
 
2023-07-26 15:19:32 0 [ERROR] InnoDB: Inconsistent tablespace ID in file .//undo001
 
2023-07-26 15:19:32 0 [ERROR] InnoDB: Unable to read first page of file .//undo001
 
2023-07-26 15:19:32 0 [ERROR] InnoDB: Inconsistent tablespace ID in file .//undo002
 
2023-07-26 15:19:32 0 [ERROR] InnoDB: Unable to read first page of file .//undo002
 
2023-07-26 15:19:32 0x7f315470d880  InnoDB: Assertion failure in file ./storage/innobase/srv/srv0start.cc line 804
 
InnoDB: Failing assertion: !i || prev_id + 1 == space_id
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to https://jira.mariadb.org/
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mariadbd startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: https://mariadb.com/kb/en/library/innodb-recovery-modes/
 
InnoDB: about forcing recovery.
 
230726 15:19:32 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
 
something is definitely wrong and this may fail.
 
Server version: 11.0.2-MariaDB-1:11.0.2+maria~ubu2204 source revision: 0005f2f06c8e1aea4915887decad67885108a929
 
key_buffer_size=134217728
 
read_buffer_size=131072
 
max_used_connections=0
 
max_threads=153
 
thread_count=0
 
It is possible that mysqld could use up to 
 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 468023 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
Thread pointer: 0x0
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x0 thread_stack 0x49000
 
Printing to addr2line failed
 
mariadbd(my_print_stacktrace+0x32)[0x5597984d7a62]
 
mariadbd(handle_fatal_signal+0x488)[0x559797faae28]
 
/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f3154a86520]
 
/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f3154adaa7c]
 
/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f3154a86476]
 
/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f3154a6c7f3]
 
mariadbd(+0x6970f3)[0x559797bbf0f3]
 
mariadbd(+0x68e841)[0x559797bb6841]
 
mariadbd(+0x690e34)[0x559797bb8e34]
 
mariadbd(+0xd7aad9)[0x5597982a2ad9]
 
mariadbd(_Z24ha_initialize_handlertonP13st_plugin_int+0x86)[0x559797fae0b6]
 
mariadbd(+0x83d686)[0x559797d65686]
 
mariadbd(_Z11plugin_initPiPPci+0x91d)[0x559797d6684d]
 
mariadbd(+0x70bb91)[0x559797c33b91]
 
mariadbd(_Z11mysqld_mainiPPc+0x424)[0x559797c39324]
 
/lib/x86_64-linux-gnu/libc.so.6(+0x29d90)[0x7f3154a6dd90]
 
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x80)[0x7f3154a6de40]
 
mariadbd(_start+0x25)[0x559797c2db05]
 
The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains
 
information that should help you find out what is causing the crash.
 
Writing a core file...
 
Working directory at /var/lib/mysql
 
Resource Limits:
 
Limit                     Soft Limit           Hard Limit           Units     
 
Max cpu time              unlimited            unlimited            seconds   
 
Max file size             unlimited            unlimited            bytes     
 
Max data size             unlimited            unlimited            bytes     
 
Max stack size            8388608              unlimited            bytes     
 
Max core file size        unlimited            unlimited            bytes     
 
Max resident set          unlimited            unlimited            bytes     
 
Max processes             unlimited            unlimited            processes 
 
Max open files            1048576              1048576              files     
 
Max locked memory         65536                65536                bytes     
 
Max address space         unlimited            unlimited            bytes     
 
Max file locks            unlimited            unlimited            locks     
 
Max pending signals       127584               127584               signals   
 
Max msgqueue size         819200               819200               bytes     
 
Max nice priority         0                    0                    
 
Max realtime priority     0                    0                    
 
Max realtime timeout      unlimited            unlimited            us        
 
Core pattern: |/usr/share/apport/apport -p%p -s%s -c%c -d%d -P%P -u%u -g%g -- %E
 
Kernel version: Linux version 5.15.0-76-generic (buildd@lcy02-amd64-028) (gcc (Ubuntu 11.3.0-1ubuntu1~22.04.1) 11.3.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #83-Ubuntu SMP Thu Jun 15 19:16:32 UTC 2023
 
Fatal signal 11 while backtracing

Comment by Marko Mäkelä [ 2023-08-28 ]

jds, the intentional crash following the message

mariadb-11.0.2

InnoDB: Failing assertion: !i || prev_id + 1 == space_id

should have been fixed in MDEV-31487, which was included in the MariaDB Server 11.0.3 release.

If you are unable to start up the database after upgrading to 11.0.3, you could try setting innodb_force_recovery=5 to prevent any undo logs from being accessed. That should allow you to use a tool like mariadb-dump to create a logical backup of the database contents. This will be using the transaction isolation level READ UNCOMMITTED. Then you could load the dump into a newly initialized database.

Comment by Marko Mäkelä [ 2023-10-02 ]

Another cause for that assertion failure is MDEV-31851.

Generated at Thu Feb 08 10:25:03 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.