TPS by Thread Count - SELECT_SIMPLE

TPS by Thread Count - SELECT_SIMPLE_RANGES

MDEV-39364 - deeper look

Comparison: TPS

Threads	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
16	111401.530	109904.736	109519.602	108294.934	110062.384	111332.120
32	144376.544	143222.920	142279.956	139469.276	142574.050	141202.522
64	120980.624	119917.884	119052.694	117981.940	119592.366	118513.094
128	111305.008	111419.494	109353.692	109562.444	109139.240	108525.238
256	104994.516	105449.010	103986.780	104066.882	103781.734	103263.448

System Info (per dataset)

Property	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Host	hz-bench-jeb	hz-bench-jeb	hz-bench-jeb	hz-bench-jeb	hz-bench-jeb	hz-bench-jeb
CPU	13th Gen Intel(R) Core(TM) i5-13500	13th Gen Intel(R) Core(TM) i5-13500	13th Gen Intel(R) Core(TM) i5-13500	13th Gen Intel(R) Core(TM) i5-13500	13th Gen Intel(R) Core(TM) i5-13500	13th Gen Intel(R) Core(TM) i5-13500
CPU Count	20	20	20	20	20	20
Core Count	14	14	14	14	14	14
Socket Count	1	1	1	1	1	1
OS	Linux	Linux	Linux	Linux	Linux	Linux
RAM	62.33 GB	62.33 GB	62.33 GB	62.33 GB	62.33 GB	62.33 GB
Disk	unknown	unknown	unknown	unknown	unknown	unknown

Database Info (per dataset)

Property	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Database Maker	mariadb	mariadb	mariadb	mariadb	mariadb	mariadb
Database Version	11.8.6-MariaDB	12.0.0-MariaDB	12.0.1-MariaDB	12.1.2-MariaDB	12.2.1-MariaDB	12.3.1-MariaDB
Engine	innodb	innodb	innodb	innodb	innodb	innodb
Install Dir	/home/jeb/taf-perl/database_software_installs/mariadb-11.8.6-linux-systemd-x86_64	/home/jeb/taf-perl/database_software_installs/mariadb-12.0.0-linux-systemd-x86_64	/home/jeb/taf-perl/database_software_installs/mariadb-12.0.1-linux-systemd-x86_64	/home/jeb/taf-perl/database_software_installs/mariadb-12.1.2-linux-systemd-x86_64	/home/jeb/taf-perl/database_software_installs/mariadb-12.2.1-linux-systemd-x86_64	/home/jeb/taf-perl/database_software_installs/mariadb-12.3.1-linux-systemd-x86_64
Config File	/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf	/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf	/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf	/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf	/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf	/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf
Config Contents	innodb_undo_log_truncate=ON aria_sort_buffer_size=128M open_files_limit=65535 performance_schema=OFF table_open_cache=4000 character_set_server=utf8mb4 innodb_flush_method=O_DIRECT innodb_undo_tablespaces=2 innodb_io_capacity=2000 innodb_buffer_pool_size=30G aria_pagecache_buffer_size=128M innodb_io_capacity_max=4000 innodb_flush_neighbors=0 tls_version=TLSv1.2,TLSv1.3 innodb_write_io_threads=8 sync_master_info=0 innodb_flush_log_at_trx_commit=1 thread_cache_size=128 slow_query_log=OFF default_storage_engine=InnoDB general_log=OFF sync_relay_log=0 max_connections=200 innodb_file_per_table=1 innodb_log_file_size=8G innodb_doublewrite=1 innodb_compression_algorithm=none sync_relay_log_info=0 innodb_compression_level=0 default_authentication_plugin=mysql_native_password innodb_read_io_threads=8 collation_server=utf8mb4_general_ci innodb_default_row_format=dynamic sync_binlog=0	innodb_undo_log_truncate=ON aria_sort_buffer_size=128M open_files_limit=65535 performance_schema=OFF table_open_cache=4000 character_set_server=utf8mb4 innodb_flush_method=O_DIRECT innodb_undo_tablespaces=2 innodb_io_capacity=2000 innodb_buffer_pool_size=30G aria_pagecache_buffer_size=128M innodb_io_capacity_max=4000 innodb_flush_neighbors=0 tls_version=TLSv1.2,TLSv1.3 innodb_write_io_threads=8 sync_master_info=0 innodb_flush_log_at_trx_commit=1 thread_cache_size=128 slow_query_log=OFF default_storage_engine=InnoDB general_log=OFF sync_relay_log=0 max_connections=200 innodb_file_per_table=1 innodb_log_file_size=8G innodb_doublewrite=1 innodb_compression_algorithm=none sync_relay_log_info=0 innodb_compression_level=0 default_authentication_plugin=mysql_native_password innodb_read_io_threads=8 collation_server=utf8mb4_general_ci innodb_default_row_format=dynamic sync_binlog=0	innodb_undo_log_truncate=ON aria_sort_buffer_size=128M open_files_limit=65535 performance_schema=OFF table_open_cache=4000 character_set_server=utf8mb4 innodb_flush_method=O_DIRECT innodb_undo_tablespaces=2 innodb_io_capacity=2000 innodb_buffer_pool_size=30G aria_pagecache_buffer_size=128M innodb_io_capacity_max=4000 innodb_flush_neighbors=0 tls_version=TLSv1.2,TLSv1.3 innodb_write_io_threads=8 sync_master_info=0 innodb_flush_log_at_trx_commit=1 thread_cache_size=128 slow_query_log=OFF default_storage_engine=InnoDB general_log=OFF sync_relay_log=0 max_connections=200 innodb_file_per_table=1 innodb_log_file_size=8G innodb_doublewrite=1 innodb_compression_algorithm=none sync_relay_log_info=0 innodb_compression_level=0 default_authentication_plugin=mysql_native_password innodb_read_io_threads=8 collation_server=utf8mb4_general_ci innodb_default_row_format=dynamic sync_binlog=0	innodb_undo_log_truncate=ON aria_sort_buffer_size=128M open_files_limit=65535 performance_schema=OFF table_open_cache=4000 character_set_server=utf8mb4 innodb_flush_method=O_DIRECT innodb_undo_tablespaces=2 innodb_io_capacity=2000 innodb_buffer_pool_size=30G aria_pagecache_buffer_size=128M innodb_io_capacity_max=4000 innodb_flush_neighbors=0 tls_version=TLSv1.2,TLSv1.3 innodb_write_io_threads=8 sync_master_info=0 innodb_flush_log_at_trx_commit=1 thread_cache_size=128 slow_query_log=OFF default_storage_engine=InnoDB general_log=OFF sync_relay_log=0 max_connections=200 innodb_file_per_table=1 innodb_log_file_size=8G innodb_doublewrite=1 innodb_compression_algorithm=none sync_relay_log_info=0 innodb_compression_level=0 default_authentication_plugin=mysql_native_password innodb_read_io_threads=8 collation_server=utf8mb4_general_ci innodb_default_row_format=dynamic sync_binlog=0	innodb_undo_log_truncate=ON aria_sort_buffer_size=128M open_files_limit=65535 performance_schema=OFF table_open_cache=4000 character_set_server=utf8mb4 innodb_flush_method=O_DIRECT innodb_undo_tablespaces=2 innodb_io_capacity=2000 innodb_buffer_pool_size=30G aria_pagecache_buffer_size=128M innodb_io_capacity_max=4000 innodb_flush_neighbors=0 tls_version=TLSv1.2,TLSv1.3 innodb_write_io_threads=8 sync_master_info=0 innodb_flush_log_at_trx_commit=1 thread_cache_size=128 slow_query_log=OFF default_storage_engine=InnoDB general_log=OFF sync_relay_log=0 max_connections=200 innodb_file_per_table=1 innodb_log_file_size=8G innodb_doublewrite=1 innodb_compression_algorithm=none sync_relay_log_info=0 innodb_compression_level=0 default_authentication_plugin=mysql_native_password innodb_read_io_threads=8 collation_server=utf8mb4_general_ci innodb_default_row_format=dynamic sync_binlog=0	innodb_undo_log_truncate=ON aria_sort_buffer_size=128M open_files_limit=65535 performance_schema=OFF table_open_cache=4000 character_set_server=utf8mb4 innodb_flush_method=O_DIRECT innodb_undo_tablespaces=2 innodb_io_capacity=2000 innodb_buffer_pool_size=30G aria_pagecache_buffer_size=128M innodb_io_capacity_max=4000 innodb_flush_neighbors=0 tls_version=TLSv1.2,TLSv1.3 innodb_write_io_threads=8 sync_master_info=0 innodb_flush_log_at_trx_commit=1 thread_cache_size=128 slow_query_log=OFF default_storage_engine=InnoDB general_log=OFF sync_relay_log=0 max_connections=200 innodb_file_per_table=1 innodb_log_file_size=8G innodb_doublewrite=1 innodb_compression_algorithm=none sync_relay_log_info=0 innodb_compression_level=0 default_authentication_plugin=mysql_native_password innodb_read_io_threads=8 collation_server=utf8mb4_general_ci innodb_default_row_format=dynamic sync_binlog=0

Property

Mariadb 11.8.6-MariaDB

Mariadb 12.0.0-MariaDB

Mariadb 12.0.1-MariaDB

Mariadb 12.1.2-MariaDB

Mariadb 12.2.1-MariaDB

Mariadb 12.3.1-MariaDB

Database Maker

mariadb

Database Version

11.8.6-MariaDB

12.0.0-MariaDB

12.0.1-MariaDB

12.1.2-MariaDB

12.2.1-MariaDB

12.3.1-MariaDB

Engine

innodb

Install Dir

/home/jeb/taf-perl/database_software_installs/mariadb-11.8.6-linux-systemd-x86_64

/home/jeb/taf-perl/database_software_installs/mariadb-12.0.0-linux-systemd-x86_64

/home/jeb/taf-perl/database_software_installs/mariadb-12.0.1-linux-systemd-x86_64

/home/jeb/taf-perl/database_software_installs/mariadb-12.1.2-linux-systemd-x86_64

/home/jeb/taf-perl/database_software_installs/mariadb-12.2.1-linux-systemd-x86_64

/home/jeb/taf-perl/database_software_installs/mariadb-12.3.1-linux-systemd-x86_64

Config File

/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf

Config Contents

innodb_undo_log_truncate=ON
aria_sort_buffer_size=128M
open_files_limit=65535
performance_schema=OFF
table_open_cache=4000
character_set_server=utf8mb4
innodb_flush_method=O_DIRECT
innodb_undo_tablespaces=2
innodb_io_capacity=2000
innodb_buffer_pool_size=30G
aria_pagecache_buffer_size=128M
innodb_io_capacity_max=4000
innodb_flush_neighbors=0
tls_version=TLSv1.2,TLSv1.3
innodb_write_io_threads=8
sync_master_info=0
innodb_flush_log_at_trx_commit=1
thread_cache_size=128
slow_query_log=OFF
default_storage_engine=InnoDB
general_log=OFF
sync_relay_log=0
max_connections=200
innodb_file_per_table=1
innodb_log_file_size=8G
innodb_doublewrite=1
innodb_compression_algorithm=none
sync_relay_log_info=0
innodb_compression_level=0
default_authentication_plugin=mysql_native_password
innodb_read_io_threads=8
collation_server=utf8mb4_general_ci
innodb_default_row_format=dynamic
sync_binlog=0

Test Info (per dataset)

Property	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Test Suite	sysbench-lua	sysbench-lua	sysbench-lua	sysbench-lua	sysbench-lua	sysbench-lua
Test Name	SELECT_SIMPLE_RANGES	SELECT_SIMPLE_RANGES	SELECT_SIMPLE_RANGES	SELECT_SIMPLE_RANGES	SELECT_SIMPLE_RANGES	SELECT_SIMPLE_RANGES
Duration	480	480	480	480	480	480
Iterations	5	5	5	5	5	5
Db driver	mariadb	mariadb	mariadb	mariadb	mariadb	mariadb
Debug sysbench	false	false	false	false	false	false
Intermediate result	2	2	2	2	2	2
Number of rows	1000000	1000000	1000000	1000000	1000000	1000000
Number of tables	8	8	8	8	8	8
Timestamp	2026-4-28 18:44:12	2026-4-29 19:33:20	2026-4-30 09:41:09	2026-4-30 23:48:56	2026-5-1 13:56:42	2026-5-2 15:39:25

Property

Mariadb 11.8.6-MariaDB

Mariadb 12.0.0-MariaDB

Mariadb 12.0.1-MariaDB

Mariadb 12.1.2-MariaDB

Mariadb 12.2.1-MariaDB

Mariadb 12.3.1-MariaDB

Test Suite

sysbench-lua

Test Name

SELECT_SIMPLE_RANGES

Duration

480

Iterations

Db driver

mariadb

Debug sysbench

false

Intermediate result

Number of rows

1000000

Number of tables

Timestamp

2026-4-28 18:44:12

2026-4-29 19:33:20

2026-4-30 09:41:09

2026-4-30 23:48:56

2026-5-1 13:56:42

2026-5-2 15:39:25

Thread Count: 16

Metric	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Mean	111401.53	109904.74	109519.60	108294.93	110062.38	111332.12
Max	112735.68	110537.86	110081.99	108797.74	111600.35	112063.47
Min	110459.34	109591.61	109155.29	107769.62	109265.27	110833.79
StdDev	765.66	359.58	343.51	344.72	837.30	436.36
CoV	0.01	0.00	0.00	0.00	0.01	0.00
Median (p50)	111328.31	109688.35	109377.29	108223.79	109661.29	111398.66
p95	112501.37	110444.55	110012.76	108740.00	111334.41	111936.14
p99	112688.82	110519.20	110068.14	108786.19	111547.16	112038.00
Skewness	0.64	0.85	0.58	-0.05	0.99	0.50
Iteration 1	110459.34	109634.54	109377.29	108223.79	109514.35	110937.86
Iteration 2	111564.14	110537.86	110081.99	108174.49	109265.27	110833.79
Iteration 3	111328.31	109591.61	109735.83	108509.03	110270.66	111426.82
Iteration 4	112735.68	109688.35	109155.29	108797.74	109661.29	111398.66
Iteration 5	110920.18	110071.32	109247.61	107769.62	111600.35	112063.47

Thread Count: 32

Metric	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Mean	144376.54	143222.92	142279.96	139469.28	142574.05	141202.52
Max	145983.46	143600.62	142912.43	139836.02	143400.46	141414.90
Min	142865.78	142940.08	141661.74	139231.73	141987.53	140969.78
StdDev	1185.65	238.82	498.54	216.06	535.90	152.99
CoV	0.01	0.00	0.00	0.00	0.00	0.00
Median (p50)	144842.40	143130.59	142448.33	139373.47	142508.69	141160.52
p95	145795.05	143557.69	142858.83	139784.92	143305.98	141395.42
p99	145945.78	143592.03	142901.71	139825.80	143381.56	141411.00
Skewness	-0.09	0.44	-0.15	0.66	0.34	-0.10
Iteration 1	145983.46	142940.08	141661.74	139231.73	143400.46	140969.78
Iteration 2	143149.68	143600.62	142448.33	139324.64	142508.69	141149.89
Iteration 3	145041.40	143130.59	141732.85	139580.52	142045.49	141317.52
Iteration 4	144842.40	143057.36	142912.43	139836.02	142928.08	141160.52
Iteration 5	142865.78	143385.95	142644.43	139373.47	141987.53	141414.90

Thread Count: 64

Metric	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Mean	120980.62	119917.88	119052.69	117981.94	119592.37	118513.09
Max	121078.42	120242.68	119280.75	118595.10	120027.85	120767.90
Min	120894.00	119398.22	118771.25	117531.14	119079.23	117275.69
StdDev	63.24	331.02	215.00	361.26	411.80	1244.73
CoV	0.00	0.00	0.00	0.00	0.00	0.01
Median (p50)	120991.50	120028.99	119100.50	117984.68	119687.31	118280.79
p95	121063.82	120242.04	119279.88	118490.52	120026.86	120362.47
p99	121075.50	120242.55	119280.58	118574.18	120027.65	120686.81
Skewness	0.16	-0.47	-0.19	0.52	-0.18	0.88
Iteration 1	121078.42	120028.99	119276.39	117726.60	120022.90	118740.75
Iteration 2	121005.42	120239.48	118771.25	118595.10	119687.31	120767.90
Iteration 3	120991.50	120242.68	119280.75	117984.68	120027.85	118280.79
Iteration 4	120894.00	119398.22	119100.50	118072.18	119079.23	117275.69
Iteration 5	120933.78	119680.05	118834.58	117531.14	119144.54	117500.34

Thread Count: 128

Metric	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Mean	111305.01	111419.49	109353.69	109562.44	109139.24	108525.24
Max	113953.81	114317.08	110784.99	110212.82	110421.63	109732.97
Min	110568.41	108880.59	108026.02	108146.78	107998.12	107654.52
StdDev	1325.84	1736.55	1049.34	811.38	945.48	897.28
CoV	0.01	0.02	0.01	0.01	0.01	0.01
Median (p50)	110693.84	111288.51	109450.15	110094.01	109526.70	107923.33
p95	113308.56	113776.90	110661.20	110211.45	110269.32	109685.93
p99	113824.76	114209.04	110760.23	110212.55	110391.17	109723.56
Skewness	1.49	0.30	0.02	-0.83	-0.08	0.40
Iteration 1	110568.41	111288.51	110784.99	110094.01	110421.63	107654.52
Iteration 2	110693.84	108880.59	109450.15	110212.82	108089.68	109497.75
Iteration 3	110581.44	110995.10	108341.27	108146.78	109660.07	107923.33
Iteration 4	113953.81	114317.08	108026.02	110205.96	107998.12	107817.62
Iteration 5	110727.54	111616.19	110166.03	109152.65	109526.70	109732.97

Thread Count: 256

Metric	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Mean	104994.52	105449.01	103986.78	104066.88	103781.73	103263.45
Max	106223.80	106002.63	104616.34	104697.48	104699.95	104451.15
Min	103687.38	104004.60	103101.97	103308.73	103175.04	102465.75
StdDev	1012.60	730.81	570.52	576.49	687.28	891.10
CoV	0.01	0.01	0.01	0.01	0.01	0.01
Median (p50)	105352.93	105758.97	104299.54	104232.58	103299.13	102645.34
p95	106136.39	105966.03	104568.19	104682.53	104667.81	104410.50
p99	106206.32	105995.31	104606.71	104694.49	104693.52	104443.02
Skewness	-0.21	-1.41	-0.48	-0.23	0.41	0.41
Iteration 1	105352.93	105758.97	103540.45	103472.89	103195.32	102645.34
Iteration 2	106223.80	106002.63	104375.60	104622.73	103175.04	102507.08
Iteration 3	103687.38	105659.24	103101.97	103308.73	104699.95	102465.75
Iteration 4	103921.70	105819.61	104299.54	104232.58	103299.13	104451.15
Iteration 5	105786.77	104004.60	104616.34	104697.48	104539.23	104247.92