[MDEV-20227] rocksdb.rocksdb_concurrent_delete fails on windows Created: 2019-08-01  Updated: 2019-08-04  Resolved: 2019-08-04

Status: Closed
Project: MariaDB Server
Component/s: Storage Engine - RocksDB
Affects Version/s: None
Fix Version/s: 10.2.27, 10.3.18, 10.4.8

Type: Bug Priority: Major
Reporter: Oleksandr Byelkin Assignee: Sergei Petrunia
Resolution: Fixed Votes: 0
Labels: affects-tests


 Description    

rocksdb.rocksdb_concurrent_delete 'write_prepared' w3 [ fail ]
 
        Test ended at 2019-08-01 08:51:08
 
 
 
CURRENT_TEST: rocksdb.rocksdb_concurrent_delete
 
 
 
 
 
Failed to start mysqld.1
 
mysqltest failed but provided no output
 
 
 
 
 
 - saving 'D:/a/1/s/win_build/mysql-test/var/3/log/rocksdb.rocksdb_concurrent_delete-write_prepared/' to 'D:/a/1/s/win_build/mysql-test/var/log/rocksdb.rocksdb_concurrent_delete-write_prepared/'
 
 
 
Retrying test rocksdb.rocksdb_concurrent_delete, attempt(2/3)...
 
 
 
***Warnings generated in error logs during shutdown after running tests: rocksdb.rocksdb_concurrent_delete
 
 
 
2019-08-01  8:51:08 0 [ERROR] Aborting
 
 
 
rocksdb.rocksdb_concurrent_delete 'write_committed' w4 [ skipped ]  debug_sync is not available
 
worker[3] mysql-test-run: WARNING: Process [mysqld.1 - pid: 1880, winpid: 1880, exit: 256] died after mysql-test-run waited 0.4 seconds for D:/a/1/s/win_build/mysql-test/var/3/run/mysqld.1.pid to be created.
 
rocksdb.rocksdb_concurrent_delete 'write_prepared' w3 [ retry-fail ]
 
        Test ended at 2019-08-01 08:51:09
 
 
 
CURRENT_TEST: rocksdb.rocksdb_concurrent_delete
 
CURRENT_TEST: rocksdb.rocksdb_concurrent_delete
 
 
 
 
 
Failed to start mysqld.1
 
 
 
 
 
 - skipping 'D:/a/1/s/win_build/mysql-test/var/3/log/rocksdb.rocksdb_concurrent_delete-write_prepared/'
 
 
 
Test rocksdb.rocksdb_concurrent_delete has failed 2 times, no more retries!
 
 
 
***Warnings generated in error logs during shutdown after running tests: rocksdb.rocksdb_concurrent_delete
 
 
 
2019-08-01  8:51:09 0 [ERROR] Aborting

Also see:
http://buildbot.askmonty.org/buildbot/reports/cross_reference#branch=&revision=&platform=&dt=&bbnum=&typ=&info=&fail_name=rocksdb.rocksdb_concurrent_delete&fail_variant=&fail_info_short=&fail_info_full=&limit=100

 Comments   
Comment by Sergei Petrunia [ 2019-08-04 ]

Some more details:

It only fails on winx64-packages.

Last failure: https://buildbot.askmonty.org/buildbot/builders/winx64-packages/builds/14604/steps/test/logs/stdio

It looks odd:

...
 
rocksdb.rocksdb_concurrent_delete 'write_committed' w4 [ fail ]
 
        Test ended at 2019-08-04 15:24:16
 
 
 
CURRENT_TEST: rocksdb.rocksdb_concurrent_delete
 
 
 
 
 
Failed to start mysqld.1
 
mysqltest failed but provided no output
 
 
 
 
 
 - saving 'D:/winx64-packages/build/mysql-test/var/4/log/rocksdb.rocksdb_concurrent_delete-write_committed/' to 'D:/winx64-packages/build/mysql-test/var/log/rocksdb.rocksdb_concurrent_delete-write_committed/'


Retrying test rocksdb.rocksdb_concurrent_delete, attempt(2/3)...
 
***Warnings generated in error logs during shutdown after running tests: rocksdb.rocksdb_concurrent_delete
 
 
 
2019-08-04 15:24:16 11392 [ERROR] Aborting
 
 
 
worker[4] mysql-test-run: WARNING: Process [mysqld.1 - pid: 1256, winpid: 1256, exit: 512] died after mysql-test-run waited 0.4 seconds for D:/winx64-packages/build/mysql-test/var/4/run/mysqld.1.pid to be created.
 
worker[4] > Restart  - not started
 
rocksdb.rocksdb_concurrent_delete 'write_committed' w4 [ skipped ]  debug_sync is not available
 
 
 
Retrying test rocksdb.rocksdb_concurrent_delete, attempt(3/3)...
 
worker[4] > Restart [mysqld.1 - pid: 9200, winpid: 9200] - running with different options ...


rocksdb.rocksdb_concurrent_delete 'write_prepared' w4 [ skipped ]  debug_sync is not available

...

rocksdb.rocksdb_concurrent_delete 'write_committed' w4 [ skipped ]  debug_sync is not available

Comment by Sergei Petrunia [ 2019-08-04 ]

Looking at the MTR run in the above URL..

Right before the 

rocksdb.rocksdb_concurrent_delete 'write_committed' w4 [ fail ]

line, there is a really long line starting with:

worker[4] > Restart [mysqld.1 - pid: 10924, winpid: 10924] - running with different options '--loose-rocksdb_write_policy=write_com...

Breaking apart this really long line:

worker[4] > Restart [mysqld.1 - pid: 10924, winpid: 10924] - running with different options 
 
 
'--loose-rocksdb_write_policy=write_committed 
 --plugin-load=ha_rocksdb.dll 
 --default-storage-engine=rocksdb
 
 
 
 --loose-enable-rocksdb
 
 --loose-enable-rocksdb_global_info
 
 --loose-enable-rocksdb_ddl
 
 --loose-enable-rocksdb_cf_options
 
 --loose-enable_rocksdb_perf_context
 
 --loose-enable_rocksdb_perf_context_global
 
 --loose-enable-rocksdb_index_file_map
 
 --loose-enable-rocksdb_dbstats
 
 --loose-enable-rocksdb_cfstats
 
 --loose-enable-rocksdb_lock_info
 
 --loose-enable-rocksdb_trx
 
 --loose-enable-rocksdb_locks

... The above group of 12 lines repeats 16 times ...

!= 


 '--loose-rocksdb_write_policy=write_committed
 
 --plugin-load=ha_rocksdb.dll
 
 --default-storage-engine=rocksdb
 
 
 
 --loose-enable-rocksdb
 
 --loose-enable-rocksdb_global_info
 
 --loose-enable-rocksdb_ddl
 
 --loose-enable-rocksdb_cf_options
 
 --loose-enable_rocksdb_perf_context
 
 --loose-enable_rocksdb_perf_context_global
 
 --loose-enable-rocksdb_index_file_map
 
 --loose-enable-rocksdb_dbstats
 
 --loose-enable-rocksdb_cfstats
 
 --loose-enable-rocksdb_lock_info
 
 --loose-enable-rocksdb_trx
 
 --loose-enable-rocksdb_locks
 
 
 
 --loose-enable-partition
 
 --loose-enable-partition'

Comment by Sergei Petrunia [ 2019-08-04 ]

This build doesn't seem to support Debug Sync. Other tests that use debug sync are not run, e.g. one can see:

main.xa_sync                             w3 [ skipped ]  debug_sync is not available
 
main.quick_select_4161                   w1 [ skipped ]  debug_sync is not available

rocksdb_concurrent_delete has no -master.opt file, it requests debug sync in the same way as other tests do:

--source include/have_debug_sync.inc

Comment by Sergei Petrunia [ 2019-08-04 ]

Tests that Worker #4 has run prior to that:

rocksdb.mariadb_port_rpl 'write_committed' w4 [ pass ]     55
 
rocksdb.read_only_tx 'write_committed'   w4 [ pass ]   7079
 
rocksdb.shutdown 'write_committed'       w4 [ pass ]   2071
 
rocksdb.mariadb_misc_binlog 'write_committed' w4 [ pass ]     54
 
rocksdb.innodb_i_s_tables_disabled 'write_committed' w4 [ pass ]     24
 
rocksdb.bulk_load_unsorted 'write_committed' w4 [ pass ]  41835
 
rocksdb.rocksdb_concurrent_delete 'write_committed' w4 [ fail ]
 
rocksdb.rocksdb_concurrent_delete 'write_committed' w4 [ skipped ]  debug_sync is not available
 
rocksdb.rocksdb_concurrent_delete 'write_prepared' w4 [ skipped ]  debug_sync is not available
 
rocksdb.rocksdb_concurrent_delete 'write_committed' w4 [ skipped ]  debug_sync is not available

Comment by Sergei Petrunia [ 2019-08-04 ]

Looking at the 

worker[4] > Restart [mysqld.1 - pid: 10924, winpid: 10924] - running with different options '-

line, the command line to start mysqld is very long (and repetitive). Could this be an issue?

The line length is 6685 characters...

Comment by Sergei Petrunia [ 2019-08-04 ]

And this is how it has failed with manual mtr run Wlad's box

worker[1] mysql-test-run: WARNING: Process [mysqld.1 - pid: 14308, winpid: 14308, exit: 512] died after mysql-test-run waited 0.3 seconds for D:/psergey/10.2/mysql-test/var/1/run/mysqld.1.pid to
 
rocksdb.rocksdb_concurrent_delete 'write_committed' w1 [ fail ]
 
        Test ended at 2019-07-19 18:25:37
 
 
 
CURRENT_TEST: rocksdb.rocksdb_concurrent_delete
 
 
 
 
 
Failed to start mysqld.1
 
mysqltest failed but provided no output
 
 
 
 
 
 - saving 'D:/psergey/10.2/mysql-test/var/1/log/rocksdb.rocksdb_concurrent_delete-write_committed/' to 'D:/psergey/10.2/mysql-test/var/log/rocksdb.rocksdb_concurrent_delete-write_committed/'
 
***Warnings generated in error logs during shutdown after running tests: rocksdb.rocksdb_concurrent_delete
 
 
 
2019-07-19 18:25:37 13672 [ERROR] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '----loose-enab--core-file'
 
2019-07-19 18:25:37 13672 [ERROR] Aborting
 
 
 
worker[1] mysql-test-run: WARNING: Process [mysqld.1 - pid: 15004, winpid: 15004, exit: 512] died after mysql-test-run waited 0.4 seconds for D:/psergey/10.2/mysql-test/var/1/run/mysqld.1.pid to
 
rocksdb.rocksdb_concurrent_delete 'write_prepared' w1 [ fail ]
 
        Test ended at 2019-07-19 18:25:37
 
 
 
CURRENT_TEST: rocksdb.rocksdb_concurrent_delete
 
CURRENT_TEST: rocksdb.rocksdb_concurrent_delete
 
 
 
 
 
Failed to start mysqld.1
 
 
 
 
 
 - saving 'D:/psergey/10.2/mysql-test/var/1/log/rocksdb.rocksdb_concurrent_delete-write_prepared/' to 'D:/psergey/10.2/mysql-test/var/log/rocksdb.rocksdb_concurrent_delete-write_prepared/'
 
***Warnings generated in error logs during shutdown after running tests: rocksdb.rocksdb_concurrent_delete
 
 
 
2019-07-19 18:25:37 15964 [ERROR] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '----loose-enab--core-file'
 
2019-07-19 18:25:37 15964 [ERROR] Aborting
 
 
 
rocksdb.loaddata 'write_committed'       w1 [ pass ]     40

Test command: D:\psergey\10.2\mysql-test>perl mysql-test-run.pl --suite=rocksdb --parallel=3 --force�

Comment by Sergei Petrunia [ 2019-08-04 ]

More details from mysqld.1.err file : 

CURRENT_TEST: rocksdb.rocksdb_concurrent_delete
 
2019-08-04 19:25:26 1268 [Note] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe (mysqld 10.2.26-MariaDB-log) starting as process 672 ...
 
2019-08-04 19:25:26 1268 [Note] RocksDB: Got ENOENT when listing column families
 
2019-08-04 19:25:26 1268 [Note] RocksDB:   assuming that we're creating a new database
 
2019-08-04 19:25:26 1268 [Note] RocksDB: Column Families at start:
 
2019-08-04 19:25:26 1268 [Note]   cf=default
 
2019-08-04 19:25:26 1268 [Note]     write_buffer_size=67108864
 
2019-08-04 19:25:26 1268 [Note]     target_file_size_base=67108864
 
2019-08-04 19:25:26 1268 [Note] RocksDB: creating a column family __system__
 
2019-08-04 19:25:26 1268 [Note]     write_buffer_size=67108864
 
2019-08-04 19:25:26 1268 [Note]     target_file_size_base=67108864
 
2019-08-04 19:25:26 1268 [Note] RocksDB: Table_store: loaded DDL data for 0 tables
 
2019-08-04 19:25:26 1268 [Note] RocksDB: global statistics using thread_id_indexer_t indexer
 
2019-08-04 19:25:26 1268 [Note] MyRocks storage engine plugin has been successfully initialized.
 
2019-08-04 19:25:26 1268 [Note] Plugin 'partition' is disabled.
 
2019-08-04 19:25:26 1268 [Note] Plugin 'InnoDB' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'SEQUENCE' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_LOCKS' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_MUTEXES' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_CMPMEM' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_CMP_PER_INDEX' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_CMP' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_CMP_RESET' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_SYS_INDEXES' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_BUFFER_PAGE_LRU' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_SYS_COLUMNS' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_SYS_FOREIGN_COLS' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_TRX' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_SYS_TABLES' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_SYS_FIELDS' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_METRICS' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_FT_DELETED' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'user_variables' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_BUFFER_POOL_STATS' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_LOCK_WAITS' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_SYS_FOREIGN' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_SYS_VIRTUAL' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'INNODB_BUFFER_PAGE' is disabled.
 
2019-08-04 19:25:27 1268 [Note] Plugin 'FEEDBACK' is disabled.
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown variable 'loose-feedback-debug-startup-interval=20'
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown variable 'loose-feedback-debug-first-interval=60'
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown variable 'loose-feedback-debug-interval=60'
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '--loose-pam-debug'
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '--loose-enable-rocksdb_lock_info'
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '--loose-enable-rocksdb_lock_info'
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '--loose-enable-rocksdb_lock_info'
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '--loose-enable-rocksdb_lock_info'
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '--loose-enable-rocksdb_lock_info'
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '--loose-enable-rocksdb_lock_info'
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '--loose-enable-rocksdb_lock_info'
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '--loose-enable-rocksdb_lock_info'
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '--loose-enable-rocksdb_lock_info'
 
2019-08-04 19:25:27 1268 [Warning] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '--loose-enable-rocksdb_lock_info'
 
2019-08-04 19:25:27 1268 [ERROR] D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe: unknown option '----loose-enab--core-file'
 
2019-08-04 19:25:27 1268 [ERROR] Aborting

Comment by Sergei Petrunia [ 2019-08-04 ] 

==== mysqld args ====
 
  argv[0]=D:/psergey/10.2/sql//RelWithDebInfo/mysqld.exe
 
  argv[1]=--defaults-group-suffix=.1
 
  argv[2]=--defaults-file=D:/psergey/10.2/mysql-test/var/3/my.cnf
 
  argv[3]=--log-output=file
 
  argv[4]=--loose-rocksdb_write_policy=write_committed
 
  argv[5]=--plugin-load=ha_rocksdb.dll
 
  argv[6]=--default-storage-engine=rocksdb
 
  argv[7]=--loose-enable-rocksdb
 
  argv[8]=--loose-enable-rocksdb_global_info
 
  argv[9]=--loose-enable-rocksdb_ddl
 
  argv[10]=--loose-enable-rocksdb_cf_options
 
  argv[11]=--loose-enable_rocksdb_perf_context
 
  argv[12]=--loose-enable_rocksdb_perf_context_global
 
  argv[13]=--loose-enable-rocksdb_index_file_map
 
  argv[14]=--loose-enable-rocksdb_dbstats
 
  argv[15]=--loose-enable-rocksdb_cfstats
 
  argv[16]=--loose-enable-rocksdb_lock_info
 
  argv[17]=--loose-enable-rocksdb_trx
 
  argv[18]=--loose-enable-rocksdb_locks
 
  argv[19]=--loose-enable-rocksdb
 
  argv[20]=--loose-enable-rocksdb_global_info
 
  argv[21]=--loose-enable-rocksdb_ddl
 
  argv[22]=--loose-enable-rocksdb_cf_options
 
  argv[23]=--loose-enable_rocksdb_perf_context
 
  argv[24]=--loose-enable_rocksdb_perf_context_global
 
  argv[25]=--loose-enable-rocksdb_index_file_map
 
  argv[26]=--loose-enable-rocksdb_dbstats
 
  argv[27]=--loose-enable-rocksdb_cfstats
 
  argv[28]=--loose-enable-rocksdb_lock_info
 
  argv[29]=--loose-enable-rocksdb_trx
 
  argv[30]=--loose-enable-rocksdb_locks
 
  argv[31]=--loose-enable-rocksdb
 
  argv[32]=--loose-enable-rocksdb_global_info
 
  argv[33]=--loose-enable-rocksdb_ddl
 
  argv[34]=--loose-enable-rocksdb_cf_options
 
  argv[35]=--loose-enable_rocksdb_perf_context
 
  argv[36]=--loose-enable_rocksdb_perf_context_global
 
  argv[37]=--loose-enable-rocksdb_index_file_map
 
  argv[38]=--loose-enable-rocksdb_dbstats
 
  argv[39]=--loose-enable-rocksdb_cfstats
 
  argv[40]=--loose-enable-rocksdb_lock_info
 
  argv[41]=--loose-enable-rocksdb_trx
 
  argv[42]=--loose-enable-rocksdb_locks
 
  argv[43]=--loose-enable-rocksdb
 
  argv[44]=--loose-enable-rocksdb_global_info
 
  argv[45]=--loose-enable-rocksdb_ddl
 
  argv[46]=--loose-enable-rocksdb_cf_options
 
  argv[47]=--loose-enable_rocksdb_perf_context
 
  argv[48]=--loose-enable_rocksdb_perf_context_global
 
  argv[49]=--loose-enable-rocksdb_index_file_map
 
  argv[50]=--loose-enable-rocksdb_dbstats
 
  argv[51]=--loose-enable-rocksdb_cfstats
 
  argv[52]=--loose-enable-rocksdb_lock_info
 
  argv[53]=--loose-enable-rocksdb_trx
 
  argv[54]=--loose-enable-rocksdb_locks
 
  argv[55]=--loose-enable-rocksdb
 
  argv[56]=--loose-enable-rocksdb_global_info
 
  argv[57]=--loose-enable-rocksdb_ddl
 
  argv[58]=--loose-enable-rocksdb_cf_options
 
  argv[59]=--loose-enable_rocksdb_perf_context
 
  argv[60]=--loose-enable_rocksdb_perf_context_global
 
  argv[61]=--loose-enable-rocksdb_index_file_map
 
  argv[62]=--loose-enable-rocksdb_dbstats
 
  argv[63]=--loose-enable-rocksdb_cfstats
 
  argv[64]=--loose-enable-rocksdb_lock_info
 
  argv[65]=--loose-enable-rocksdb_trx
 
  argv[66]=--loose-enable-rocksdb_locks
 
  argv[67]=--loose-enable-rocksdb
 
  argv[68]=--loose-enable-rocksdb_global_info
 
  argv[69]=--loose-enable-rocksdb_ddl
 
  argv[70]=--loose-enable-rocksdb_cf_options
 
  argv[71]=--loose-enable_rocksdb_perf_context
 
  argv[72]=--loose-enable_rocksdb_perf_context_global
 
  argv[73]=--loose-enable-rocksdb_index_file_map
 
  argv[74]=--loose-enable-rocksdb_dbstats
 
  argv[75]=--loose-enable-rocksdb_cfstats
 
  argv[76]=--loose-enable-rocksdb_lock_info
 
  argv[77]=--loose-enable-rocksdb_trx
 
  argv[78]=--loose-enable-rocksdb_locks
 
  argv[79]=--loose-enable-rocksdb
 
  argv[80]=--loose-enable-rocksdb_global_info
 
  argv[81]=--loose-enable-rocksdb_ddl
 
  argv[82]=--loose-enable-rocksdb_cf_options
 
  argv[83]=--loose-enable_rocksdb_perf_context
 
  argv[84]=--loose-enable_rocksdb_perf_context_global
 
  argv[85]=--loose-enable-rocksdb_index_file_map
 
  argv[86]=--loose-enable-rocksdb_dbstats
 
  argv[87]=--loose-enable-rocksdb_cfstats
 
  argv[88]=--loose-enable-rocksdb_lock_info
 
  argv[89]=--loose-enable-rocksdb_trx
 
  argv[90]=--loose-enable-rocksdb_locks
 
  argv[91]=--loose-enable-rocksdb
 
  argv[92]=--loose-enable-rocksdb_global_info
 
  argv[93]=--loose-enable-rocksdb_ddl
 
  argv[94]=--loose-enable-rocksdb_cf_options
 
  argv[95]=--loose-enable_rocksdb_perf_context
 
  argv[96]=--loose-enable_rocksdb_perf_context_global
 
  argv[97]=--loose-enable-rocksdb_index_file_map
 
  argv[98]=--loose-enable-rocksdb_dbstats
 
  argv[99]=--loose-enable-rocksdb_cfstats
 
  argv[100]=--loose-enable-rocksdb_lock_info
 
  argv[101]=--loose-enable-rocksdb_trx
 
  argv[102]=--loose-enable-rocksdb_locks
 
  argv[103]=--loose-enable-rocksdb
 
  argv[104]=--loose-enable-rocksdb_global_info
 
  argv[105]=--loose-enable-rocksdb_ddl
 
  argv[106]=--loose-enable-rocksdb_cf_options
 
  argv[107]=--loose-enable_rocksdb_perf_context
 
  argv[108]=--loose-enable_rocksdb_perf_context_global
 
  argv[109]=--loose-enable-rocksdb_index_file_map
 
  argv[110]=--loose-enable-rocksdb_dbstats
 
  argv[111]=--loose-enable-rocksdb_cfstats
 
  argv[112]=--loose-enable-rocksdb_lock_info
 
  argv[113]=--loose-enable-rocksdb_trx
 
  argv[114]=--loose-enable-rocksdb_locks
 
  argv[115]=--loose-enable-rocksdb
 
  argv[116]=--loose-enable-rocksdb_global_info
 
  argv[117]=--loose-enable-rocksdb_ddl
 
  argv[118]=--loose-enable-rocksdb_cf_options
 
  argv[119]=--loose-enable_rocksdb_perf_context
 
  argv[120]=--loose-enable_rocksdb_perf_context_global
 
  argv[121]=--loose-enable-rocksdb_index_file_map
 
  argv[122]=--loose-enable-rocksdb_dbstats
 
  argv[123]=--loose-enable-rocksdb_cfstats
 
  argv[124]=--loose-enable-rocksdb_lock_info
 
  argv[125]=----loose-enab--core-file
 
  argv[126]=-b­¿8
 
==== mysqld args end ====

It looks like there is a limit of 127 command line arguments. If we run over the the limit, we get garbage data as an argument.

Comment by Sergei Petrunia [ 2019-08-04 ]

I'm not sure why rocksdb's command line arguments occur multiple times in the argument list.
The duplication can be observed when one runs just one test, too.

I suspect that each occurrence of --source include/have_rocksdb.inc in the test file and included files causes the testsuite's arguments to be added to server's arguments list. rocksdb_concurrent_delete includes multiple .inc files, each of which has --source include/have_rocksdb.inc

# rocksdb_concurrent_delete.test
 
# --source include/have_rocksdb.inc
 
 
 
2x: source rocksdb_concurrent_delete_main.inc
 
  --source include/have_rocksdb.inc
 
 
 
  4x: --source rocksdb_concurrent_delete.inc
 
    --source include/have_rocksdb.inc
 
 
 
  1x: --source rocksdb_concurrent_delete_sk.inc
 
    --source include/have_rocksdb.inc
 
 
 
  2x: --source rocksdb_concurrent_delete_range.inc
 
    --source include/have_rocksdb.inc

Comment by Sergei Petrunia [ 2019-08-04 ]

So:

  • lots of include'd test files where each has --source include/have_rocksdb.inc
  • For each such occurrence, MTR adds testsuite's arguments into args
  • Which hits some limit on the length of argv array on Windows.
Generated at Thu Feb 08 08:57:50 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.