[MDEV-14375] rocksdb.bulk_load_unsorted fails Created: 2017-11-13  Updated: 2018-05-14  Resolved: 2018-05-14

Status: Closed
Project: MariaDB Server
Component/s: Storage Engine - RocksDB, Tests
Affects Version/s: 10.2
Fix Version/s: 10.2.15

Type: Bug Priority: Major
Reporter: Sergei Petrunia Assignee: Sergei Petrunia
Resolution: Fixed Votes: 0
Labels: None


 Description   

http://buildbot.askmonty.org/buildbot/builders/p8-rhel71-bintar-debug/builds/2348/steps/test/logs/stdio

rocksdb.bulk_load_unsorted               w2 [ fail ]  timeout after 900 seconds
 
== /home/buildbot/maria-slave/power8-vlp06-bintar-debug/build/mysql-test/var/2/log/bulk_load_unsorted.log == 
test.t2	analyze	status	OK
test.t3	analyze	status	OK
SHOW TABLE STATUS WHERE name LIKE 't%';
Name	Engine	Version	Row_format	Rows	Avg_row_length	Data_length	Max_data_length	Index_length	Data_free	Auto_increment	Create_time	Update_time	Check_time	Collation	Checksum	Create_options	Comment
t1	ROCKSDB	10	Fixed	5000000	#	#	#	#	0	NULL	NULL	NULL	NULL	latin1_swedish_ci	NULL		
t2	ROCKSDB	10	Fixed	5000000	#	#	#	#	0	NULL	NULL	NULL	NULL	latin1_swedish_ci	NULL		
t3	ROCKSDB	10	Fixed	5000000	#	#	#	#	0	NULL	NULL	NULL	NULL	latin1_swedish_ci	NULL	partitioned	
select count(a) from t1;
count(a)
5000000
select count(b) from t1;
count(b)
5000000
select count(a) from t2;
count(a)
5000000
select count(b) from t2;
count(b)
5000000
select count(a) from t3;



 Comments   
Comment by Sergei Petrunia [ 2017-11-13 ]

Note that it has almost made it.
Looking at the .result file I can see that there was only one big query left:

select count(b) from t3;
count(b)
5000000

Comment by Sergei Petrunia [ 2017-11-13 ]

Test run times on my machine:

rocksdb.bulk_load                        [ pass ]  746,492
rocksdb.bulk_load_unsorted               [ pass ]  153,006

Comment by Sergei Petrunia [ 2017-11-13 ]

Possible solutions:

  • "Scale down" the test
  • Mark the test as "big".
Comment by Sergei Petrunia [ 2018-04-20 ]

t2.2xlarge, release build:

rocksdb.bulk_load_unsorted               [ pass ]  47,032
rocksdb.bulk_load                        [ pass ]  153,462

Comment by Sergei Petrunia [ 2018-05-11 ]

Elenst's windows builder, debug build: bulk_load_unsorted took 821 seconds.

Comment by Sergei Petrunia [ 2018-05-11 ]

A t2.2xlarge instance, and current 10.2

debug build:

rocksdb.bulk_load_unsorted               [ pass ]  582,258

release build:

rocksdb.bulk_load_unsorted               [ pass ]  46,926

Comment by Sergei Petrunia [ 2018-05-14 ]

Down-scaled the test by a factor of 2x

Generated at Thu Feb 08 08:13:03 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.