[MDEV-20488] rocksdb.allow_to_start_after_corruption fails with timeout Created: 2019-09-04  Updated: 2023-04-27

Status: Open
Project: MariaDB Server
Component/s: Storage Engine - RocksDB, Tests
Affects Version/s: 10.2, 10.3, 10.4, 10.5, 10.6, 10.7, 10.8
Fix Version/s: 10.4, 10.5, 10.6

Type: Bug Priority: Major
Reporter: Sergei Petrunia Assignee: Sergei Petrunia
Resolution: Unresolved Votes: 0
Labels: None


 Description   

The test rocksdb.allow_to_start_after_corruption periodically fails in BuildBot:

Example: http://buildbot.askmonty.org/buildbot/builders/kvm-rpm-centos74-amd64-debug/builds/2575/steps/mtr/logs/stdio

rocksdb.allow_to_start_after_corruption 'write_committed' w4 [ fail ]  timeout after 900 seconds
        Test ended at 2019-09-03 20:33:16
 
Test case timeout after 900 seconds
 
== /dev/shm/var/4/log/allow_to_start_after_corruption.log == 
1	1
set session debug_dbug= "+d,rocksdb_return_status_corrupted";
select * from t1 where pk=1;
ERROR HY000: Lost connection to MySQL server during query
FOUND 1 /data corruption detected/ in allow_to_start_after_corruption_debug.err
#
#  The same for scan queries
#
select * from t1;
pk	col1
1	1
2	2
3	3
set session debug_dbug= "+d,rocksdb_return_status_corrupted";
select * from t1;
ERROR HY000: Lost connection to MySQL server during query
FOUND 1 /data corruption detected/ in allow_to_start_after_corruption_debug.err
#
#  Test restart failure. The server is shutdown at this point.



 Comments   
Comment by Sergei Petrunia [ 2019-09-05 ]
  • The test requires a debug non-valgrind build
  • I haven't been able to reproduce so far
  • studying the output in MTR doesn't give any clue
Comment by Elena Stepanova [ 2022-05-28 ]

The test has been failing nearly deterministically on that builder for years and nothing has been done about it. Each time it takes 1 extra hour of execution time (two combinations failing with 15-min timeout upon the initial run and retry).

From now on the test will be skipped on this builder.
When you fix the failure, please create a TODO task for re-enabling the test.

Generated at Thu Feb 08 08:59:51 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.