TPS by Thread Count - SELECT_SUM

TPS by Thread Count - SELECT_SUM_RANGES

MDEV-39364 - deeper look

Comparison: TPS

Threads	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
16	147451.698	145820.818	144683.830	143937.872	144363.304	148959.060
32	199486.310	195203.446	193960.326	190479.978	195878.296	189452.016
64	172041.096	171359.940	170558.472	170604.194	171358.626	170876.538
128	164465.324	163255.198	162669.420	161582.038	162519.158	159981.994
256	152044.270	150577.112	149459.790	148444.206	150201.948	148214.500

System Info (per dataset)

Property	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Host	hz-bench-jeb	hz-bench-jeb	hz-bench-jeb	hz-bench-jeb	hz-bench-jeb	hz-bench-jeb
CPU	13th Gen Intel(R) Core(TM) i5-13500	13th Gen Intel(R) Core(TM) i5-13500	13th Gen Intel(R) Core(TM) i5-13500	13th Gen Intel(R) Core(TM) i5-13500	13th Gen Intel(R) Core(TM) i5-13500	13th Gen Intel(R) Core(TM) i5-13500
CPU Count	20	20	20	20	20	20
Core Count	14	14	14	14	14	14
Socket Count	1	1	1	1	1	1
OS	Linux	Linux	Linux	Linux	Linux	Linux
RAM	62.33 GB	62.33 GB	62.33 GB	62.33 GB	62.33 GB	62.33 GB
Disk	unknown	unknown	unknown	unknown	unknown	unknown

Database Info (per dataset)

Property	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Database Maker	mariadb	mariadb	mariadb	mariadb	mariadb	mariadb
Database Version	11.8.6-MariaDB	12.0.0-MariaDB	12.0.1-MariaDB	12.1.2-MariaDB	12.2.1-MariaDB	12.3.1-MariaDB
Engine	innodb	innodb	innodb	innodb	innodb	innodb
Install Dir	/home/jeb/taf-perl/database_software_installs/mariadb-11.8.6-linux-systemd-x86_64	/home/jeb/taf-perl/database_software_installs/mariadb-12.0.0-linux-systemd-x86_64	/home/jeb/taf-perl/database_software_installs/mariadb-12.0.1-linux-systemd-x86_64	/home/jeb/taf-perl/database_software_installs/mariadb-12.1.2-linux-systemd-x86_64	/home/jeb/taf-perl/database_software_installs/mariadb-12.2.1-linux-systemd-x86_64	/home/jeb/taf-perl/database_software_installs/mariadb-12.3.1-linux-systemd-x86_64
Config File	/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf	/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf	/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf	/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf	/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf	/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf
Config Contents	open_files_limit=65535 default_authentication_plugin=mysql_native_password innodb_default_row_format=dynamic innodb_io_capacity_max=4000 innodb_undo_tablespaces=2 sync_master_info=0 innodb_flush_method=O_DIRECT general_log=OFF innodb_undo_log_truncate=ON sync_relay_log_info=0 innodb_doublewrite=1 performance_schema=OFF innodb_flush_neighbors=0 innodb_read_io_threads=8 innodb_compression_level=0 sync_binlog=0 character_set_server=utf8mb4 innodb_buffer_pool_size=30G innodb_flush_log_at_trx_commit=1 default_storage_engine=InnoDB innodb_write_io_threads=8 thread_cache_size=128 tls_version=TLSv1.2,TLSv1.3 innodb_file_per_table=1 aria_sort_buffer_size=128M slow_query_log=OFF aria_pagecache_buffer_size=128M innodb_io_capacity=2000 innodb_log_file_size=8G collation_server=utf8mb4_general_ci innodb_compression_algorithm=none table_open_cache=4000 max_connections=200 sync_relay_log=0	open_files_limit=65535 default_authentication_plugin=mysql_native_password innodb_default_row_format=dynamic innodb_io_capacity_max=4000 innodb_undo_tablespaces=2 sync_master_info=0 innodb_flush_method=O_DIRECT general_log=OFF innodb_undo_log_truncate=ON sync_relay_log_info=0 innodb_doublewrite=1 performance_schema=OFF innodb_flush_neighbors=0 innodb_read_io_threads=8 innodb_compression_level=0 sync_binlog=0 character_set_server=utf8mb4 innodb_buffer_pool_size=30G innodb_flush_log_at_trx_commit=1 default_storage_engine=InnoDB innodb_write_io_threads=8 thread_cache_size=128 tls_version=TLSv1.2,TLSv1.3 innodb_file_per_table=1 aria_sort_buffer_size=128M slow_query_log=OFF aria_pagecache_buffer_size=128M innodb_io_capacity=2000 innodb_log_file_size=8G collation_server=utf8mb4_general_ci innodb_compression_algorithm=none table_open_cache=4000 max_connections=200 sync_relay_log=0	open_files_limit=65535 default_authentication_plugin=mysql_native_password innodb_default_row_format=dynamic innodb_io_capacity_max=4000 innodb_undo_tablespaces=2 sync_master_info=0 innodb_flush_method=O_DIRECT general_log=OFF innodb_undo_log_truncate=ON sync_relay_log_info=0 innodb_doublewrite=1 performance_schema=OFF innodb_flush_neighbors=0 innodb_read_io_threads=8 innodb_compression_level=0 sync_binlog=0 character_set_server=utf8mb4 innodb_buffer_pool_size=30G innodb_flush_log_at_trx_commit=1 default_storage_engine=InnoDB innodb_write_io_threads=8 thread_cache_size=128 tls_version=TLSv1.2,TLSv1.3 innodb_file_per_table=1 aria_sort_buffer_size=128M slow_query_log=OFF aria_pagecache_buffer_size=128M innodb_io_capacity=2000 innodb_log_file_size=8G collation_server=utf8mb4_general_ci innodb_compression_algorithm=none table_open_cache=4000 max_connections=200 sync_relay_log=0	open_files_limit=65535 default_authentication_plugin=mysql_native_password innodb_default_row_format=dynamic innodb_io_capacity_max=4000 innodb_undo_tablespaces=2 sync_master_info=0 innodb_flush_method=O_DIRECT general_log=OFF innodb_undo_log_truncate=ON sync_relay_log_info=0 innodb_doublewrite=1 performance_schema=OFF innodb_flush_neighbors=0 innodb_read_io_threads=8 innodb_compression_level=0 sync_binlog=0 character_set_server=utf8mb4 innodb_buffer_pool_size=30G innodb_flush_log_at_trx_commit=1 default_storage_engine=InnoDB innodb_write_io_threads=8 thread_cache_size=128 tls_version=TLSv1.2,TLSv1.3 innodb_file_per_table=1 aria_sort_buffer_size=128M slow_query_log=OFF aria_pagecache_buffer_size=128M innodb_io_capacity=2000 innodb_log_file_size=8G collation_server=utf8mb4_general_ci innodb_compression_algorithm=none table_open_cache=4000 max_connections=200 sync_relay_log=0	open_files_limit=65535 default_authentication_plugin=mysql_native_password innodb_default_row_format=dynamic innodb_io_capacity_max=4000 innodb_undo_tablespaces=2 sync_master_info=0 innodb_flush_method=O_DIRECT general_log=OFF innodb_undo_log_truncate=ON sync_relay_log_info=0 innodb_doublewrite=1 performance_schema=OFF innodb_flush_neighbors=0 innodb_read_io_threads=8 innodb_compression_level=0 sync_binlog=0 character_set_server=utf8mb4 innodb_buffer_pool_size=30G innodb_flush_log_at_trx_commit=1 default_storage_engine=InnoDB innodb_write_io_threads=8 thread_cache_size=128 tls_version=TLSv1.2,TLSv1.3 innodb_file_per_table=1 aria_sort_buffer_size=128M slow_query_log=OFF aria_pagecache_buffer_size=128M innodb_io_capacity=2000 innodb_log_file_size=8G collation_server=utf8mb4_general_ci innodb_compression_algorithm=none table_open_cache=4000 max_connections=200 sync_relay_log=0	open_files_limit=65535 default_authentication_plugin=mysql_native_password innodb_default_row_format=dynamic innodb_io_capacity_max=4000 innodb_undo_tablespaces=2 sync_master_info=0 innodb_flush_method=O_DIRECT general_log=OFF innodb_undo_log_truncate=ON sync_relay_log_info=0 innodb_doublewrite=1 performance_schema=OFF innodb_flush_neighbors=0 innodb_read_io_threads=8 innodb_compression_level=0 sync_binlog=0 character_set_server=utf8mb4 innodb_buffer_pool_size=30G innodb_flush_log_at_trx_commit=1 default_storage_engine=InnoDB innodb_write_io_threads=8 thread_cache_size=128 tls_version=TLSv1.2,TLSv1.3 innodb_file_per_table=1 aria_sort_buffer_size=128M slow_query_log=OFF aria_pagecache_buffer_size=128M innodb_io_capacity=2000 innodb_log_file_size=8G collation_server=utf8mb4_general_ci innodb_compression_algorithm=none table_open_cache=4000 max_connections=200 sync_relay_log=0

Property

Mariadb 11.8.6-MariaDB

Mariadb 12.0.0-MariaDB

Mariadb 12.0.1-MariaDB

Mariadb 12.1.2-MariaDB

Mariadb 12.2.1-MariaDB

Mariadb 12.3.1-MariaDB

Database Maker

mariadb

Database Version

11.8.6-MariaDB

12.0.0-MariaDB

12.0.1-MariaDB

12.1.2-MariaDB

12.2.1-MariaDB

12.3.1-MariaDB

Engine

innodb

Install Dir

/home/jeb/taf-perl/database_software_installs/mariadb-11.8.6-linux-systemd-x86_64

/home/jeb/taf-perl/database_software_installs/mariadb-12.0.0-linux-systemd-x86_64

/home/jeb/taf-perl/database_software_installs/mariadb-12.0.1-linux-systemd-x86_64

/home/jeb/taf-perl/database_software_installs/mariadb-12.1.2-linux-systemd-x86_64

/home/jeb/taf-perl/database_software_installs/mariadb-12.2.1-linux-systemd-x86_64

/home/jeb/taf-perl/database_software_installs/mariadb-12.3.1-linux-systemd-x86_64

Config File

/home/jeb/taf-perl/database_config_files/mariadb_cache.cnf

Config Contents

open_files_limit=65535
default_authentication_plugin=mysql_native_password
innodb_default_row_format=dynamic
innodb_io_capacity_max=4000
innodb_undo_tablespaces=2
sync_master_info=0
innodb_flush_method=O_DIRECT
general_log=OFF
innodb_undo_log_truncate=ON
sync_relay_log_info=0
innodb_doublewrite=1
performance_schema=OFF
innodb_flush_neighbors=0
innodb_read_io_threads=8
innodb_compression_level=0
sync_binlog=0
character_set_server=utf8mb4
innodb_buffer_pool_size=30G
innodb_flush_log_at_trx_commit=1
default_storage_engine=InnoDB
innodb_write_io_threads=8
thread_cache_size=128
tls_version=TLSv1.2,TLSv1.3
innodb_file_per_table=1
aria_sort_buffer_size=128M
slow_query_log=OFF
aria_pagecache_buffer_size=128M
innodb_io_capacity=2000
innodb_log_file_size=8G
collation_server=utf8mb4_general_ci
innodb_compression_algorithm=none
table_open_cache=4000
max_connections=200
sync_relay_log=0

Test Info (per dataset)

Property	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Test Suite	sysbench-lua	sysbench-lua	sysbench-lua	sysbench-lua	sysbench-lua	sysbench-lua
Test Name	SELECT_SUM_RANGES	SELECT_SUM_RANGES	SELECT_SUM_RANGES	SELECT_SUM_RANGES	SELECT_SUM_RANGES	SELECT_SUM_RANGES
Duration	480	480	480	480	480	480
Iterations	5	5	5	5	5	5
Db driver	mariadb	mariadb	mariadb	mariadb	mariadb	mariadb
Debug sysbench	false	false	false	false	false	false
Intermediate result	2	2	2	2	2	2
Number of rows	1000000	1000000	1000000	1000000	1000000	1000000
Number of tables	8	8	8	8	8	8
Timestamp	2026-4-28 22:15:55	2026-4-29 23:05:04	2026-4-30 13:12:52	2026-5-1 03:20:39	2026-5-1 17:28:25	2026-5-2 19:11:08

Property

Mariadb 11.8.6-MariaDB

Mariadb 12.0.0-MariaDB

Mariadb 12.0.1-MariaDB

Mariadb 12.1.2-MariaDB

Mariadb 12.2.1-MariaDB

Mariadb 12.3.1-MariaDB

Test Suite

sysbench-lua

Test Name

SELECT_SUM_RANGES

Duration

480

Iterations

Db driver

mariadb

Debug sysbench

false

Intermediate result

Number of rows

1000000

Number of tables

Timestamp

2026-4-28 22:15:55

2026-4-29 23:05:04

2026-4-30 13:12:52

2026-5-1 03:20:39

2026-5-1 17:28:25

2026-5-2 19:11:08

Thread Count: 16

Metric	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Mean	147451.70	145820.82	144683.83	143937.87	144363.30	148959.06
Max	148185.95	147090.87	144965.17	144397.93	144645.89	149181.16
Min	146851.69	145422.06	144380.82	143656.53	143899.17	148467.67
StdDev	521.30	638.48	202.78	263.89	284.32	255.57
CoV	0.00	0.00	0.00	0.00	0.00	0.00
Median (p50)	147245.76	145506.54	144649.01	143799.43	144442.18	149050.58
p95	148137.34	146796.86	144939.78	144329.24	144643.78	149169.76
p99	148176.23	147032.07	144960.09	144384.19	144645.47	149178.88
Skewness	0.30	1.46	-0.07	0.76	-0.54	-1.23
Iteration 1	147942.88	145463.79	144838.23	143780.98	144193.95	148467.67
Iteration 2	147245.76	145422.06	144649.01	143799.43	144635.33	149050.58
Iteration 3	146851.69	147090.87	144585.92	143656.53	144442.18	149181.16
Iteration 4	148185.95	145506.54	144965.17	144397.93	143899.17	148971.72
Iteration 5	147032.21	145620.83	144380.82	144054.49	144645.89	149124.17

Thread Count: 32

Metric	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Mean	199486.31	195203.45	193960.33	190479.98	195878.30	189452.02
Max	199862.51	195448.33	194387.55	190827.92	196184.34	190134.43
Min	199329.27	194877.93	193604.95	190166.10	195427.13	188715.08
StdDev	199.27	192.94	293.24	281.09	281.07	498.11
CoV	0.00	0.00	0.00	0.00	0.00	0.00
Median (p50)	199389.47	195196.98	193939.24	190449.98	195856.07	189545.04
p95	199792.65	195426.15	194345.90	190817.01	196180.68	190060.79
p99	199848.54	195443.89	194379.22	190825.74	196183.61	190119.70
Skewness	1.14	-0.49	0.19	0.09	-0.37	-0.15
Iteration 1	199389.47	195196.98	193690.61	190449.98	195856.07	189766.23
Iteration 2	199329.27	194877.93	193604.95	190827.92	196166.04	189099.30
Iteration 3	199513.19	195448.33	193939.24	190182.50	195427.13	188715.08
Iteration 4	199337.11	195337.44	194387.55	190773.39	195757.90	190134.43
Iteration 5	199862.51	195156.55	194179.28	190166.10	196184.34	189545.04

Thread Count: 64

Metric	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Mean	172041.10	171359.94	170558.47	170604.19	171358.63	170876.54
Max	172141.68	171804.61	170674.74	170844.69	171700.26	171188.42
Min	171991.18	170845.17	170319.33	170390.34	170893.92	170553.31
StdDev	53.77	412.00	128.07	150.54	329.67	210.50
CoV	0.00	0.00	0.00	0.00	0.00	0.00
Median (p50)	172015.70	171600.18	170596.01	170619.27	171527.54	170893.66
p95	172123.24	171777.89	170671.21	170805.57	171687.54	171145.21
p99	172137.99	171799.27	170674.03	170836.87	171697.72	171179.78
Skewness	1.08	-0.33	-1.06	0.21	-0.38	-0.08
Iteration 1	172015.70	171804.61	170657.08	170390.34	170893.92	170972.37
Iteration 2	172007.44	171670.99	170545.20	170517.59	171034.74	170893.66
Iteration 3	171991.18	171600.18	170674.74	170619.27	171636.67	170774.93
Iteration 4	172141.68	170845.17	170319.33	170649.08	171527.54	170553.31
Iteration 5	172049.48	170878.75	170596.01	170844.69	171700.26	171188.42

Thread Count: 128

Metric	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Mean	164465.32	163255.20	162669.42	161582.04	162519.16	159981.99
Max	164659.25	163360.96	163035.55	161705.58	163496.96	160271.69
Min	164335.84	163091.13	162326.75	161409.88	162067.82	159610.28
StdDev	125.12	95.87	227.23	102.19	527.13	260.45
CoV	0.00	0.00	0.00	0.00	0.00	0.00
Median (p50)	164402.99	163265.36	162686.85	161575.30	162362.63	159997.22
p95	164640.26	163356.10	162968.78	161697.12	163316.67	160268.31
p99	164655.45	163359.99	163022.20	161703.89	163460.90	160271.01
Skewness	0.49	-0.62	0.14	-0.51	1.02	-0.18
Iteration 1	164402.99	163265.36	163035.55	161663.28	163496.96	160254.78
Iteration 2	164335.84	163336.65	162701.70	161575.30	162362.63	159997.22
Iteration 3	164659.25	163091.13	162326.75	161705.58	162072.86	159776.00
Iteration 4	164364.24	163221.89	162596.25	161556.15	162067.82	159610.28
Iteration 5	164564.30	163360.96	162686.85	161409.88	162595.52	160271.69

Thread Count: 256

Metric	Mariadb 11.8.6-MariaDB	Mariadb 12.0.0-MariaDB	Mariadb 12.0.1-MariaDB	Mariadb 12.1.2-MariaDB	Mariadb 12.2.1-MariaDB	Mariadb 12.3.1-MariaDB
Mean	152044.27	150577.11	149459.79	148444.21	150201.95	148214.50
Max	152113.08	150886.90	149786.34	148637.37	150290.90	148316.91
Min	151952.02	150286.36	149246.49	147991.28	150091.02	148138.89
StdDev	61.94	192.06	177.05	232.84	79.12	65.30
CoV	0.00	0.00	0.00	0.00	0.00	0.00
Median (p50)	152077.44	150557.73	149421.26	148557.02	150251.87	148199.65
p95	152108.13	150833.40	149716.10	148623.54	150283.12	148305.05
p99	152112.09	150876.20	149772.29	148634.60	150289.34	148314.54
Skewness	-0.41	0.15	0.90	-1.30	-0.36	0.40
Iteration 1	151990.46	150886.90	149786.34	148557.02	150251.87	148199.65
Iteration 2	152088.35	150535.18	149435.16	148568.20	150091.02	148138.89
Iteration 3	152077.44	150619.39	149421.26	147991.28	150252.01	148159.42
Iteration 4	152113.08	150286.36	149409.70	148637.37	150123.94	148257.63
Iteration 5	151952.02	150557.73	149246.49	148467.16	150290.90	148316.91