[MDEV-13669] Some MyRocks test take a long time (in debug?) (on windows?) Created: 2017-08-29  Updated: 2018-04-17

Status: Open
Project: MariaDB Server
Component/s: Storage Engine - RocksDB, Tests
Affects Version/s: 10.2
Fix Version/s: 10.4

Type: Bug Priority: Major
Reporter: Sergei Petrunia Assignee: Sergei Petrunia
Resolution: Unresolved Votes: 0
Labels: None

Attachments: PNG File Relative slowdown.png     PNG File chart.png     File mdev13669-test-times.ods     PNG File test time on winx64-debug.png     PNG File test-time-fulltest.png     PNG File testing-time-bintar-trusty.png    

 Description   

This is based on the observations of elenst and wlad. It is not immediately clear if there is some issue, or tests are really that big, etc.

I picked a few MyRocks and non-MyRocks tests and collected a sample:

http://buildbot.askmonty.org/buildbot/builders/kvm-fulltest/builds/9993/steps/test_2/logs/stdio

innodb.innodb_bug30423        1393
 
innodb.innodb_bug12902967     2717
 
main.alter_table              1394
 
main.count_distinct2          1120
 
main.mysql_client_test_comp  33391


                            
rocksdb.cardinality          25322
 
rocksdb.drop_table2          80187
 
rocksdb.drop_table3           9401 
rocksdb.singledelete         12128

https://buildbot.askmonty.org/buildbot/builders/winx64-debug/builds/5035/steps/test/logs/stdio

innodb.innodb_bug30423        56543
 
innodb.innodb_bug12902967      6405
 
main.alter_table              36630
 
main.count_distinct2          15793
 
main.mysql_client_test_comp   56441
 
rocksdb.cardinality           558667
 
rocksdb.drop_table2           346562
 
rocksdb.drop_table3           186081
 
rocksdb.singledelete          117123

http://buildbot.askmonty.org/buildbot/builders/winx64-packages/builds/4631/steps/test/logs/stdio

innodb.innodb_bug30423       1883
 
innodb.innodb_bug12902967     2822
 
main.alter_table               4256
 
main.count_distinct2           1441
 
main.mysql_client_test_comp   37063
 
rocksdb.cardinality           56590
 
rocksdb.drop_table2           92738
 
rocksdb.drop_table3           32669
 
rocksdb.singledelete          26345

http://buildbot.askmonty.org/buildbot/builders/p8-rhel71-bintar-debug/builds/2147/steps/test/logs/stdio

innodb.innodb_bug30423        34027
 
innodb.innodb_bug12902967      4174
 
main.alter_table              16342
 
main.count_distinct2           4832
 
main.mysql_client_test_comp   40623
 
rocksdb.cardinality           193451
 
rocksdb.drop_table2           131493
 
rocksdb.drop_table3           46349
 
rocksdb.singledelete          65065



 Comments   
Comment by Sergei Petrunia [ 2017-08-29 ]

mdev13669-test-times.ods

Comment by Sergei Petrunia [ 2017-08-29 ]

Comment by Sergei Petrunia [ 2017-08-29 ]

Observations

  • Indeed there is a huge slowdown on winx64-debug.
  • Release windows build doesn't suffer, look at winx64-packages.
  • Debug build on linux (p8-...) is also slower for RocksDB but the slowdown is not remotely as big as on Windows?
Comment by Sergei Petrunia [ 2017-08-29 ]

Comment by Sergei Petrunia [ 2017-08-29 ]
  • Some tests do not pay a debug build penalty, and some do.
  • Debug build penalty is consistently higher on windows
  • There is no specifically high debug build penalty for MyRocks tests (They
    just tend to be longer and so produce higher total run time)
Comment by Sergei Petrunia [ 2017-08-30 ]

Comment by Sergei Petrunia [ 2017-08-30 ]

Comment by Sergei Petrunia [ 2017-08-30 ]

Comment by Sergei Petrunia [ 2017-08-30 ]

Pushed a patch to make rocksdb.cardinality go almost 2x faster.

Comment by Sergei Petrunia [ 2017-08-31 ]

Pushed a patch to make rocksdb.bloomfilter* tests 1.8x faster
https://github.com/MariaDB/server/commit/0e45edf35014506b891ccb030df9b21a9490a1f4

Generated at Thu Feb 08 08:07:24 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.