To enable better control of the InnoDB purge subsystem, it would be good if the maximum number of purge tasks were settable by the user while the server is running:
SETGLOBAL innodb_purge_threads=1;
# run a heavy workload
# let the history be discarded faster while the server is less busy
SETGLOBAL innodb_purge_threads=32;
Independently of this, MDEV-16260 or MDEV-26356 may improve the way how the purge threads are scheduled. This task would only make the maximum number of concurrent purge tasks configurable.
# 2021-09-14T11:37:12 [1318743] | [rr 1321150 22022]safe_mutex: Trying to lock mutex at /data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc, line 1245, when the mutex was already locked at /data/Server/bb-10.7-MDEV-26520/sql/sys_vars_shared.h, line 56 in thread T@18
# 2021-09-14T11:37:12 [1318743] | #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
# 2021-09-14T11:37:12 [1318743] | #1 0x00007fb31d4fd859 in __GI_abort () at abort.c:79
# 2021-09-14T11:37:12 [1318743] | #2 0x0000556d791546fa in safe_mutex_lock (mp=0x556d7b38f900 <LOCK_global_system_variables>, my_flags=0, file=0x556d7962c2a0 "/data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc", line=1245) at /data/Server/bb-10.7-MDEV-26520/mysys/thr_mutex.c:262
# 2021-09-14T11:37:12 [1318743] | #3 0x0000556d77642142 in inline_mysql_mutex_lock (that=0x556d7b38f900 <LOCK_global_system_variables>, src_file=0x556d7962c2a0 "/data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc", src_line=1245) at /data/Server/bb-10.7-MDEV-26520/include/mysql/psi/mysql_thread.h:750
# 2021-09-14T11:37:12 [1318743] | #4 0x0000556d7764badd in THD::init (this=0x62b0000b6218) at /data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc:1245
# 2021-09-14T11:37:12 [1318743] | #5 0x0000556d77649018 in THD::THD (this=0x62b0000b6218, id=0, is_wsrep_applier=false) at /data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc:849
# 2021-09-14T11:37:12 [1318743] | #6 0x0000556d7766636e in create_background_thd () at /data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc:4915
# 2021-09-14T11:37:12 [1318743] | #7 0x0000556d78793791 in innobase_create_background_thd (name=0x556d79fed300 "InnoDB purge worker") at /data/Server/bb-10.7-MDEV-26520/storage/innobase/handler/ha_innodb.cc:1794
# 2021-09-14T11:37:12 [1318743] | #8 0x0000556d78bfc488 in purge_create_background_thds (n=8) at /data/Server/bb-10.7-MDEV-26520/storage/innobase/srv/srv0srv.cc:1810
# 2021-09-14T11:37:12 [1318743] | #9 0x0000556d78bfbd9d in srv_update_purge_thread_count (n=8) at /data/Server/bb-10.7-MDEV-26520/storage/innobase/srv/srv0srv.cc:1707
# 2021-09-14T11:37:12 [1318743] | #10 0x0000556d787e77bb in innodb_purge_threads_update (save=0x6290001b8418) at /data/Server/bb-10.7-MDEV-26520/storage/innobase/handler/ha_innodb.cc:18750
# 2021-09-14T11:37:12 [1318743] | #11 0x0000556d777ea942 in sys_var_pluginvar::global_update (this=0x625000009698, thd=0x62b0000af218, var=0x6290001b83f8) at /data/Server/bb-10.7-MDEV-26520/sql/sql_plugin.cc:3622
# 2021-09-14T11:37:12 [1318743] | #12 0x0000556d774fdad8 in sys_var::update (this=0x625000009698, thd=0x62b0000af218, var=0x6290001b83f8) at /data/Server/bb-10.7-MDEV-26520/sql/set_var.cc:207
# 2021-09-14T11:37:12 [1318743] | #13 0x0000556d77502494 in set_var::update (this=0x6290001b83f8, thd=0x62b0000af218) at /data/Server/bb-10.7-MDEV-26520/sql/set_var.cc:863
# 2021-09-14T11:37:12 [1318743] | #14 0x0000556d77501900 in sql_set_variables (thd=0x62b0000af218, var_list=0x62b0000b4288, free=true) at /data/Server/bb-10.7-MDEV-26520/sql/set_var.cc:745
# 2021-09-14T11:37:12 [1318743] | #15 0x0000556d7777f94e in mysql_execute_command (thd=0x62b0000af218, is_called_from_prepared_stmt=false) at /data/Server/bb-10.7-MDEV-26520/sql/sql_parse.cc:5036
# 2021-09-14T11:37:12 [1318743] | #16 0x0000556d777928de in mysql_parse (thd=0x62b0000af218, rawbuf=0x6290001b8238 "SET GLOBAL innodb_purge_threads = 8 /* E_R Thread1 QNO 12 CON_ID 15 */", length=71, parser_state=0x7fb2eec68b20) at /data/Server/bb-10.7-MDEV-26520/sql/sql_parse.cc:8036
# 2021-09-14T11:37:12 [1318743] | #17 0x0000556d7776aac5 in dispatch_command (command=COM_QUERY, thd=0x62b0000af218, packet=0x629000d66219 " SET GLOBAL innodb_purge_threads = 8 /* E_R Thread1 QNO 12 CON_ID 15 */ ", packet_length=73, blocking=true) at /data/Server/bb-10.7-MDEV-26520/sql/sql_parse.cc:1896
# 2021-09-14T11:37:12 [1318743] | #18 0x0000556d77767e9d in do_command (thd=0x62b0000af218, blocking=true) at /data/Server/bb-10.7-MDEV-26520/sql/sql_parse.cc:1404
# 2021-09-14T11:37:12 [1318743] | #19 0x0000556d77b92d4d in do_handle_one_connection (connect=0x608000002db8, put_in_cache=true) at /data/Server/bb-10.7-MDEV-26520/sql/sql_connect.cc:1418
# 2021-09-14T11:37:12 [1318743] | #20 0x0000556d77b925de in handle_one_connection (arg=0x608000002ab8) at /data/Server/bb-10.7-MDEV-26520/sql/sql_connect.cc:1312
# 2021-09-14T11:37:12 [1318743] | #21 0x00007fb31da24609 in start_thread (arg=<optimized out>) at pthread_create.c:477
# 2021-09-14T11:37:12 [1318743] | #22 0x00007fb31d5fa293 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
I would like to add something of the test code and output.
But the grandious JIRA does not seem to have a mode where I can easy add raw code
containing an "at sign".
So please look into the uploaded
- test MDEV-26520.test and run it
- output.txt == What I get from my MTR test with backtrace ...
Already
SET GLOBAL innodb_purge_threads = <value >= 5> leads to crash
Matthias Leich
added a comment - - edited
origin/bb-10.7-MDEV-26520 2a6739a650489ad34f5abfea938cd0442fa665cd 2021-09-07T22:10:41+02:00
A RQG test invoking rr harvests
# 2021-09-14T11:37:12 [1318743] | [rr 1321150 22022]safe_mutex: Trying to lock mutex at /data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc, line 1245, when the mutex was already locked at /data/Server/bb-10.7-MDEV-26520/sql/sys_vars_shared.h, line 56 in thread T@18
# 2021-09-14T11:37:12 [1318743] | [rr 1321150 22041]210914 11:35:07 [rr 1321150 22044][ERROR] mysqld got signal 6 ;
# 2021-09-14T11:37:12 [1318743] | Thread 3 (Thread 1321150.1321940):
# 2021-09-14T11:37:12 [1318743] | #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
# 2021-09-14T11:37:12 [1318743] | #1 0x00007fb31d4fd859 in __GI_abort () at abort.c:79
# 2021-09-14T11:37:12 [1318743] | #2 0x0000556d791546fa in safe_mutex_lock (mp=0x556d7b38f900 <LOCK_global_system_variables>, my_flags=0, file=0x556d7962c2a0 "/data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc", line=1245) at /data/Server/bb-10.7-MDEV-26520/mysys/thr_mutex.c:262
# 2021-09-14T11:37:12 [1318743] | #3 0x0000556d77642142 in inline_mysql_mutex_lock (that=0x556d7b38f900 <LOCK_global_system_variables>, src_file=0x556d7962c2a0 "/data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc", src_line=1245) at /data/Server/bb-10.7-MDEV-26520/include/mysql/psi/mysql_thread.h:750
# 2021-09-14T11:37:12 [1318743] | #4 0x0000556d7764badd in THD::init (this=0x62b0000b6218) at /data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc:1245
# 2021-09-14T11:37:12 [1318743] | #5 0x0000556d77649018 in THD::THD (this=0x62b0000b6218, id=0, is_wsrep_applier=false) at /data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc:849
# 2021-09-14T11:37:12 [1318743] | #6 0x0000556d7766636e in create_background_thd () at /data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc:4915
# 2021-09-14T11:37:12 [1318743] | #7 0x0000556d78793791 in innobase_create_background_thd (name=0x556d79fed300 "InnoDB purge worker") at /data/Server/bb-10.7-MDEV-26520/storage/innobase/handler/ha_innodb.cc:1794
# 2021-09-14T11:37:12 [1318743] | #8 0x0000556d78bfc488 in purge_create_background_thds (n=8) at /data/Server/bb-10.7-MDEV-26520/storage/innobase/srv/srv0srv.cc:1810
# 2021-09-14T11:37:12 [1318743] | #9 0x0000556d78bfbd9d in srv_update_purge_thread_count (n=8) at /data/Server/bb-10.7-MDEV-26520/storage/innobase/srv/srv0srv.cc:1707
# 2021-09-14T11:37:12 [1318743] | #10 0x0000556d787e77bb in innodb_purge_threads_update (save=0x6290001b8418) at /data/Server/bb-10.7-MDEV-26520/storage/innobase/handler/ha_innodb.cc:18750
# 2021-09-14T11:37:12 [1318743] | #11 0x0000556d777ea942 in sys_var_pluginvar::global_update (this=0x625000009698, thd=0x62b0000af218, var=0x6290001b83f8) at /data/Server/bb-10.7-MDEV-26520/sql/sql_plugin.cc:3622
# 2021-09-14T11:37:12 [1318743] | #12 0x0000556d774fdad8 in sys_var::update (this=0x625000009698, thd=0x62b0000af218, var=0x6290001b83f8) at /data/Server/bb-10.7-MDEV-26520/sql/set_var.cc:207
# 2021-09-14T11:37:12 [1318743] | #13 0x0000556d77502494 in set_var::update (this=0x6290001b83f8, thd=0x62b0000af218) at /data/Server/bb-10.7-MDEV-26520/sql/set_var.cc:863
# 2021-09-14T11:37:12 [1318743] | #14 0x0000556d77501900 in sql_set_variables (thd=0x62b0000af218, var_list=0x62b0000b4288, free=true) at /data/Server/bb-10.7-MDEV-26520/sql/set_var.cc:745
# 2021-09-14T11:37:12 [1318743] | #15 0x0000556d7777f94e in mysql_execute_command (thd=0x62b0000af218, is_called_from_prepared_stmt=false) at /data/Server/bb-10.7-MDEV-26520/sql/sql_parse.cc:5036
# 2021-09-14T11:37:12 [1318743] | #16 0x0000556d777928de in mysql_parse (thd=0x62b0000af218, rawbuf=0x6290001b8238 "SET GLOBAL innodb_purge_threads = 8 /* E_R Thread1 QNO 12 CON_ID 15 */", length=71, parser_state=0x7fb2eec68b20) at /data/Server/bb-10.7-MDEV-26520/sql/sql_parse.cc:8036
# 2021-09-14T11:37:12 [1318743] | #17 0x0000556d7776aac5 in dispatch_command (command=COM_QUERY, thd=0x62b0000af218, packet=0x629000d66219 " SET GLOBAL innodb_purge_threads = 8 /* E_R Thread1 QNO 12 CON_ID 15 */ ", packet_length=73, blocking=true) at /data/Server/bb-10.7-MDEV-26520/sql/sql_parse.cc:1896
# 2021-09-14T11:37:12 [1318743] | #18 0x0000556d77767e9d in do_command (thd=0x62b0000af218, blocking=true) at /data/Server/bb-10.7-MDEV-26520/sql/sql_parse.cc:1404
# 2021-09-14T11:37:12 [1318743] | #19 0x0000556d77b92d4d in do_handle_one_connection (connect=0x608000002db8, put_in_cache=true) at /data/Server/bb-10.7-MDEV-26520/sql/sql_connect.cc:1418
# 2021-09-14T11:37:12 [1318743] | #20 0x0000556d77b925de in handle_one_connection (arg=0x608000002ab8) at /data/Server/bb-10.7-MDEV-26520/sql/sql_connect.cc:1312
# 2021-09-14T11:37:12 [1318743] | #21 0x00007fb31da24609 in start_thread (arg=<optimized out>) at pthread_create.c:477
# 2021-09-14T11:37:12 [1318743] | #22 0x00007fb31d5fa293 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
I would like to add something of the test code and output.
But the grandious JIRA does not seem to have a mode where I can easy add raw code
containing an "at sign".
So please look into the uploaded
- test MDEV-26520.test and run it
- output.txt == What I get from my MTR test with backtrace ...
Already
SET GLOBAL innodb_purge_threads = <value >= 5> leads to crash
I decided to preallocate all possibly needed THDs at startup, since other variations did not work out well.
I added a test for "set global innodb_purge_threads={0,1 -1,32,33}" , too
Vladislav Vaintroub
added a comment - - edited I decided to preallocate all possibly needed THDs at startup, since other variations did not work out well.
I added a test for "set global innodb_purge_threads={0,1 -1,32,33}" , too
Matthias Leich
added a comment -
The corresponding development tree
origin/bb-10.7-MDEV-26520 6e8ef61814d659b9e3c791570b1912f453138bb7 2021-09-14T19:01:26+02:00
behaved well in RQG testing.
People
Vladislav Vaintroub
Marko Mäkelä
Votes:
0Vote for this issue
Watchers:
6Start watching this issue
Dates
Created:
Updated:
Resolved:
Git Integration
Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.
{"report":{"fcp":1473.2000000476837,"ttfb":447.7000000476837,"pageVisibility":"visible","entityId":102454,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"c1e59d6f-e7c7-4f97-80fa-2de1a4ff3992","navigationType":0,"readyForUser":1564.6000001430511,"redirectCount":0,"resourceLoadedEnd":2028.7999999523163,"resourceLoadedStart":455.7999999523163,"resourceTiming":[{"duration":390.40000009536743,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":455.7999999523163,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":455.7999999523163,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":846.2000000476837,"responseStart":0,"secureConnectionStart":0},{"duration":390.5,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":456.10000014305115,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":456.10000014305115,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":846.6000001430511,"responseStart":0,"secureConnectionStart":0},{"duration":457.80000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":456.2999999523163,"connectEnd":456.2999999523163,"connectStart":456.2999999523163,"domainLookupEnd":456.2999999523163,"domainLookupStart":456.2999999523163,"fetchStart":456.2999999523163,"redirectEnd":0,"redirectStart":0,"requestStart":456.2999999523163,"responseEnd":914.1000001430511,"responseStart":914.1000001430511,"secureConnectionStart":456.2999999523163},{"duration":521.0999999046326,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":456.60000014305115,"connectEnd":456.60000014305115,"connectStart":456.60000014305115,"domainLookupEnd":456.60000014305115,"domainLookupStart":456.60000014305115,"fetchStart":456.60000014305115,"redirectEnd":0,"redirectStart":0,"requestStart":456.60000014305115,"responseEnd":977.7000000476837,"responseStart":977.6000001430511,"secureConnectionStart":456.60000014305115},{"duration":525.2999999523163,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":456.7000000476837,"connectEnd":456.7000000476837,"connectStart":456.7000000476837,"domainLookupEnd":456.7000000476837,"domainLookupStart":456.7000000476837,"fetchStart":456.7000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":456.7000000476837,"responseEnd":982,"responseStart":982,"secureConnectionStart":456.7000000476837},{"duration":525.5999999046326,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":456.90000009536743,"connectEnd":456.90000009536743,"connectStart":456.90000009536743,"domainLookupEnd":456.90000009536743,"domainLookupStart":456.90000009536743,"fetchStart":456.90000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":456.90000009536743,"responseEnd":982.5,"responseStart":982.5,"secureConnectionStart":456.90000009536743},{"duration":525.7999999523163,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":457.10000014305115,"connectEnd":457.10000014305115,"connectStart":457.10000014305115,"domainLookupEnd":457.10000014305115,"domainLookupStart":457.10000014305115,"fetchStart":457.10000014305115,"redirectEnd":0,"redirectStart":0,"requestStart":457.10000014305115,"responseEnd":982.9000000953674,"responseStart":982.9000000953674,"secureConnectionStart":457.10000014305115},{"duration":641.1000001430511,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":457.2999999523163,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":457.2999999523163,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1098.4000000953674,"responseStart":0,"secureConnectionStart":0},{"duration":525.7999999523163,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":457.5,"connectEnd":457.5,"connectStart":457.5,"domainLookupEnd":457.5,"domainLookupStart":457.5,"fetchStart":457.5,"redirectEnd":0,"redirectStart":0,"requestStart":457.5,"responseEnd":983.2999999523163,"responseStart":983.2999999523163,"secureConnectionStart":457.5},{"duration":640.9000000953674,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":457.7000000476837,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":457.7000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1098.6000001430511,"responseStart":0,"secureConnectionStart":0},{"duration":526.2000000476837,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":457.7999999523163,"connectEnd":457.7999999523163,"connectStart":457.7999999523163,"domainLookupEnd":457.7999999523163,"domainLookupStart":457.7999999523163,"fetchStart":457.7999999523163,"redirectEnd":0,"redirectStart":0,"requestStart":457.7999999523163,"responseEnd":984,"responseStart":984,"secureConnectionStart":457.7999999523163},{"duration":1563.4000000953674,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":465,"connectEnd":465,"connectStart":465,"domainLookupEnd":465,"domainLookupStart":465,"fetchStart":465,"redirectEnd":0,"redirectStart":0,"requestStart":465,"responseEnd":2028.4000000953674,"responseStart":2028.4000000953674,"secureConnectionStart":465},{"duration":1563.6999998092651,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":465.10000014305115,"connectEnd":465.10000014305115,"connectStart":465.10000014305115,"domainLookupEnd":465.10000014305115,"domainLookupStart":465.10000014305115,"fetchStart":465.10000014305115,"redirectEnd":0,"redirectStart":0,"requestStart":465.10000014305115,"responseEnd":2028.7999999523163,"responseStart":2028.7999999523163,"secureConnectionStart":465.10000014305115},{"duration":681.0999999046326,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":1122.6000001430511,"connectEnd":1122.6000001430511,"connectStart":1122.6000001430511,"domainLookupEnd":1122.6000001430511,"domainLookupStart":1122.6000001430511,"fetchStart":1122.6000001430511,"redirectEnd":0,"redirectStart":0,"requestStart":1122.6000001430511,"responseEnd":1803.7000000476837,"responseStart":1803.7000000476837,"secureConnectionStart":1122.6000001430511},{"duration":583.2999999523163,"initiatorType":"script","name":"https://www.google-analytics.com/analytics.js","startTime":1450.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":1450.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":2033.7999999523163,"responseStart":0,"secureConnectionStart":0}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":283,"responseStart":447,"responseEnd":456,"domLoading":454,"domInteractive":2071,"domContentLoadedEventStart":2071,"domContentLoadedEventEnd":2147,"domComplete":2627,"loadEventStart":2627,"loadEventEnd":2627,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":2036.9000000953674},{"name":"bigPipe.sidebar-id.end","time":2037.7000000476837},{"name":"bigPipe.activity-panel-pipe-id.start","time":2037.9000000953674},{"name":"bigPipe.activity-panel-pipe-id.end","time":2040.2999999523163},{"name":"activityTabFullyLoaded","time":2215.7000000476837}],"measures":[],"correlationId":"5d4f15b4881d7","effectiveType":"4g","downlink":9.1,"rtt":0,"serverDuration":105,"dbReadsTimeInMs":15,"dbConnsTimeInMs":23,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Task
Major
MDEV-16260 Scale the purge effort according to the workload
MDEV-26356 Performance regression after dict_sys.mutex removal
origin/bb-10.7-MDEV-26520 2a6739a650489ad34f5abfea938cd0442fa665cd 2021-09-07T22:10:41+02:00A RQG test invoking rr harvests# 2021-09-14T11:37:12 [1318743] | [rr 1321150 22022]safe_mutex: Trying to lock mutex at /data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc, line 1245, when the mutex was already locked at /data/Server/bb-10.7-MDEV-26520/sql/sys_vars_shared.h, line 56 in thread T@18# 2021-09-14T11:37:12 [1318743] | [rr 1321150 22041]210914 11:35:07 [rr 1321150 22044][ERROR] mysqld got signal 6 ;# 2021-09-14T11:37:12 [1318743] | Thread 3 (Thread 1321150.1321940):# 2021-09-14T11:37:12 [1318743] | #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50# 2021-09-14T11:37:12 [1318743] | #1 0x00007fb31d4fd859 in __GI_abort () at abort.c:79# 2021-09-14T11:37:12 [1318743] | #2 0x0000556d791546fa in safe_mutex_lock (mp=0x556d7b38f900 <LOCK_global_system_variables>, my_flags=0, file=0x556d7962c2a0 "/data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc", line=1245) at /data/Server/bb-10.7-MDEV-26520/mysys/thr_mutex.c:262# 2021-09-14T11:37:12 [1318743] | #3 0x0000556d77642142 in inline_mysql_mutex_lock (that=0x556d7b38f900 <LOCK_global_system_variables>, src_file=0x556d7962c2a0 "/data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc", src_line=1245) at /data/Server/bb-10.7-MDEV-26520/include/mysql/psi/mysql_thread.h:750# 2021-09-14T11:37:12 [1318743] | #4 0x0000556d7764badd in THD::init (this=0x62b0000b6218) at /data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc:1245# 2021-09-14T11:37:12 [1318743] | #5 0x0000556d77649018 in THD::THD (this=0x62b0000b6218, id=0, is_wsrep_applier=false) at /data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc:849# 2021-09-14T11:37:12 [1318743] | #6 0x0000556d7766636e in create_background_thd () at /data/Server/bb-10.7-MDEV-26520/sql/sql_class.cc:4915# 2021-09-14T11:37:12 [1318743] | #7 0x0000556d78793791 in innobase_create_background_thd (name=0x556d79fed300 "InnoDB purge worker") at /data/Server/bb-10.7-MDEV-26520/storage/innobase/handler/ha_innodb.cc:1794# 2021-09-14T11:37:12 [1318743] | #8 0x0000556d78bfc488 in purge_create_background_thds (n=8) at /data/Server/bb-10.7-MDEV-26520/storage/innobase/srv/srv0srv.cc:1810# 2021-09-14T11:37:12 [1318743] | #9 0x0000556d78bfbd9d in srv_update_purge_thread_count (n=8) at /data/Server/bb-10.7-MDEV-26520/storage/innobase/srv/srv0srv.cc:1707# 2021-09-14T11:37:12 [1318743] | #10 0x0000556d787e77bb in innodb_purge_threads_update (save=0x6290001b8418) at /data/Server/bb-10.7-MDEV-26520/storage/innobase/handler/ha_innodb.cc:18750# 2021-09-14T11:37:12 [1318743] | #11 0x0000556d777ea942 in sys_var_pluginvar::global_update (this=0x625000009698, thd=0x62b0000af218, var=0x6290001b83f8) at /data/Server/bb-10.7-MDEV-26520/sql/sql_plugin.cc:3622# 2021-09-14T11:37:12 [1318743] | #12 0x0000556d774fdad8 in sys_var::update (this=0x625000009698, thd=0x62b0000af218, var=0x6290001b83f8) at /data/Server/bb-10.7-MDEV-26520/sql/set_var.cc:207# 2021-09-14T11:37:12 [1318743] | #13 0x0000556d77502494 in set_var::update (this=0x6290001b83f8, thd=0x62b0000af218) at /data/Server/bb-10.7-MDEV-26520/sql/set_var.cc:863# 2021-09-14T11:37:12 [1318743] | #14 0x0000556d77501900 in sql_set_variables (thd=0x62b0000af218, var_list=0x62b0000b4288, free=true) at /data/Server/bb-10.7-MDEV-26520/sql/set_var.cc:745# 2021-09-14T11:37:12 [1318743] | #15 0x0000556d7777f94e in mysql_execute_command (thd=0x62b0000af218, is_called_from_prepared_stmt=false) at /data/Server/bb-10.7-MDEV-26520/sql/sql_parse.cc:5036# 2021-09-14T11:37:12 [1318743] | #16 0x0000556d777928de in mysql_parse (thd=0x62b0000af218, rawbuf=0x6290001b8238 "SET GLOBAL innodb_purge_threads = 8 /* E_R Thread1 QNO 12 CON_ID 15 */", length=71, parser_state=0x7fb2eec68b20) at /data/Server/bb-10.7-MDEV-26520/sql/sql_parse.cc:8036# 2021-09-14T11:37:12 [1318743] | #17 0x0000556d7776aac5 in dispatch_command (command=COM_QUERY, thd=0x62b0000af218, packet=0x629000d66219 " SET GLOBAL innodb_purge_threads = 8 /* E_R Thread1 QNO 12 CON_ID 15 */ ", packet_length=73, blocking=true) at /data/Server/bb-10.7-MDEV-26520/sql/sql_parse.cc:1896# 2021-09-14T11:37:12 [1318743] | #18 0x0000556d77767e9d in do_command (thd=0x62b0000af218, blocking=true) at /data/Server/bb-10.7-MDEV-26520/sql/sql_parse.cc:1404# 2021-09-14T11:37:12 [1318743] | #19 0x0000556d77b92d4d in do_handle_one_connection (connect=0x608000002db8, put_in_cache=true) at /data/Server/bb-10.7-MDEV-26520/sql/sql_connect.cc:1418# 2021-09-14T11:37:12 [1318743] | #20 0x0000556d77b925de in handle_one_connection (arg=0x608000002ab8) at /data/Server/bb-10.7-MDEV-26520/sql/sql_connect.cc:1312# 2021-09-14T11:37:12 [1318743] | #21 0x00007fb31da24609 in start_thread (arg=<optimized out>) at pthread_create.c:477# 2021-09-14T11:37:12 [1318743] | #22 0x00007fb31d5fa293 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95I would like to add something of the test code and output.But the grandious JIRA does not seem to have a mode where I can easy add raw codecontaining an "at sign".So please look into the uploaded- test MDEV-26520.test and run it- output.txt == What I get from my MTR test with backtrace ...AlreadySET GLOBAL innodb_purge_threads = <value >= 5> leads to crash