[MDEV-16563] encryption.innodb-read-only failed in buildbot with crash on startup Created: 2018-06-25  Updated: 2023-11-29  Resolved: 2023-11-29

Status: Closed
Project: MariaDB Server
Component/s: Encryption, Storage Engine - InnoDB, Tests
Affects Version/s: 10.1
Fix Version/s: N/A

Type: Bug Priority: Major
Reporter: Elena Stepanova Assignee: Marko Mäkelä
Resolution: Cannot Reproduce Votes: 0
Labels: None


 Description   

http://buildbot.askmonty.org/buildbot/builders/kvm-zyp-sles114-amd64/builds/2143/steps/mtr/logs/stdio

encryption.innodb-read-only 'cbc,innodb_plugin' w4 [ fail ]
        Test ended at 2018-06-12 21:01:33
 
CURRENT_TEST: encryption.innodb-read-only
 
 
Failed to start mysqld.1
mysqltest failed but provided no output

CURRENT_TEST: encryption.innodb-read-only
2018-06-12 20:58:32 140107583522592 [Note] /usr/sbin/mysqld (mysqld 10.1.34-MariaDB) starting as process 30476 ...
2018-06-12 20:58:32 140107583522592 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4182)
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'partition' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'SEQUENCE' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: Using mutexes to ref count buffer pool pages
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: The InnoDB memory heap is disabled
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: GCC builtin __sync_synchronize() is used for memory barrier
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: Compressed tables use zlib 1.2.7
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: Using Linux native AIO
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: Using generic crc32 instructions
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: Initializing buffer pool, size = 8.0M
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: Completed initialization of buffer pool
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: Highest supported file format is Barracuda.
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: 128 rollback segment(s) are active.
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: Waiting for purge to start
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: 5.6.40 started; log sequence number 1629415
2018-06-12 20:58:32 140107316934400 [Note] InnoDB: Dumping buffer pool(s) not yet started
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: Creating #1 encryption thread id 140107308541696 total threads 4.
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: Creating #2 encryption thread id 140107300148992 total threads 4.
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: Creating #3 encryption thread id 140107291756288 total threads 4.
2018-06-12 20:58:32 140107583522592 [Note] InnoDB: Creating #4 encryption thread id 140107283363584 total threads 4.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_CMP' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'XTRADB_READ_VIEW' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'XTRADB_RSEG' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_FT_DELETED' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_LOCK_WAITS' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'CHANGED_PAGE_BITMAPS' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_SYS_FIELDS' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'XTRADB_INTERNAL_HASH_TABLES' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_MUTEXES' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'FEEDBACK' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_CMP_RESET' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_SYS_COLUMNS' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled.
2018-06-12 20:58:32 140107583522592 [Note] Plugin 'INNODB_SYS_INDEXES' is disabled.
2018-06-12 20:58:32 140107583522592 [Warning] /usr/sbin/mysqld: unknown variable 'loose-feedback-debug-startup-interval=20'
2018-06-12 20:58:32 140107583522592 [Warning] /usr/sbin/mysqld: unknown variable 'loose-feedback-debug-first-interval=60'
2018-06-12 20:58:32 140107583522592 [Warning] /usr/sbin/mysqld: unknown variable 'loose-feedback-debug-interval=60'
2018-06-12 20:58:32 140107583522592 [Warning] /usr/sbin/mysqld: unknown option '--loose-pam-debug'
2018-06-12 20:58:32 140107583522592 [Warning] /usr/sbin/mysqld: unknown option '--loose-skip-plugin-innodb-changed-pages'
2018-06-12 20:58:32 140107583522592 [Warning] /usr/sbin/mysqld: unknown variable 'loose-debug-sync-timeout=300'
180612 20:58:32 [ERROR] mysqld got signal 6 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
Server version: 10.1.34-MariaDB
key_buffer_size=1048576
read_buffer_size=131072
max_used_connections=0
max_threads=153
thread_count=0
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 62940 K  bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
 
Thread pointer: 0x0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0x0 thread_stack 0x48400
CURRENT_TEST: encryption.innodb-read-only



 Comments   
Comment by Marko Mäkelä [ 2023-11-29 ]

There have been a few failures of this test, including provided no output, but not very often in main branches. The latest ones look like something specific to a Linux kernel bug MDEV-30728, and so does the latest main-branch failure:

11.0 a6874341ddfde31a161501993224f453875a2bd9

encryption.innodb-read-only 'cbc,innodb' w4 [ fail ]
        Test ended at 2023-02-17 09:30:55
Version: '11.0.1-MariaDB-log'  socket: '/home/buildbot/ppc64le-rhel-9/build/mysql-test/var/tmp/4/mysqld.1.sock'  port: 16120  Source distribution
2023-02-17  9:30:55 0 [ERROR] [FATAL] InnoDB: IO Error: 9 during async write of 16384 bytes, for file -2113912832, returned 0
230217  9:30:55 [ERROR] mysqld got signal 6 ;

This io_uring related crash would have been fixed by MDEV-27593.

But the original crash must have been something completely different. Without a stack trace, it is hard to say anything.

Generated at Thu Feb 08 08:29:51 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.