Type:
Priority:
Resolution:
Unresolved
Affects Version/s:
10.2(EOL) , 10.3(EOL) , 10.4(EOL) , 10.5 , 10.6 , 10.7(EOL)
10.4 470e9a9fb6
2018-12-05 18:38:27 0 [Note] /home/travis/server/10.4/bin/mysqld (mysqld 10.4.1-MariaDB-debug-log) starting as process 21315 ...
2018-12-05 18:38:27 0 [Note] mysqld: Aria engine: starting recovery
recovered pages: 0% 10% 9% 19% 29%
2018-12-05 18:38:33 0 [ERROR] mysqld: failed to decrypt './test/oltp46' rc: -1 dstlen: 0 size: 8172
Got error 192 when executing record redo_new_row_head
2018-12-05 18:38:33 0 [ERROR] mysqld: Aria engine: Redo phase failed
tables to flush: 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0
2018-12-05 18:38:33 0 [ERROR] mysqld: Aria recovery failed. Please run aria_chk -r on all Aria tables and delete all aria_log.######## files
2018-12-05 18:38:33 0 [ERROR] Plugin 'Aria' init function returned error.
2018-12-05 18:38:33 0 [ERROR] Plugin 'Aria' registration as a STORAGE ENGINE failed.
2018-12-05 18:38:33 0 [Note] InnoDB: Using Linux native AIO
2018-12-05 18:38:33 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!!
2018-12-05 18:38:33 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2018-12-05 18:38:33 0 [Note] InnoDB: Uses event mutexes
2018-12-05 18:38:33 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2018-12-05 18:38:33 0 [Note] InnoDB: Number of pools: 1
2018-12-05 18:38:33 0 [Note] InnoDB: Using SSE2 crc32 instructions
2018-12-05 18:38:33 0 [Note] mysqld: O_TMPFILE is not supported on /home/travis/logs/vardir/tmp (disabling future attempts)
2018-12-05 18:38:33 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
2018-12-05 18:38:33 0 [Note] InnoDB: Completed initialization of buffer pool
2018-12-05 18:38:33 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2018-12-05 18:38:33 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=139812
2018-12-05 18:38:34 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
2018-12-05 18:38:34 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2018-12-05 18:38:34 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2018-12-05 18:38:34 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2018-12-05 18:38:34 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2018-12-05 18:38:34 0 [Note] InnoDB: Waiting for purge to start
2018-12-05 18:38:34 0 [Note] InnoDB: 10.4.1 started; log sequence number 139821; transaction id 21
2018-12-05 18:38:34 0 [Note] InnoDB: Loading buffer pool(s) from /dev/shm/vardir/data/ib_buffer_pool
2018-12-05 18:38:34 0 [Note] Plugin 'FEEDBACK' is disabled.
2018-12-05 18:38:34 0 [ERROR] Could not open mysql.plugin table. Some plugins may be not loaded
2018-12-05 18:38:34 0 [ERROR] Failed to initialize plugins.
2018-12-05 18:38:34 0 [ERROR] Aborting
The datadir after the initial crash, before any attempt to recover, is here: ftp://ftp.askmonty.org/public/mdev17912-data.tar.gz
Unpack and start the server with
--aria-encrypt-tables=1 --plugin-load-add=file_key_management --file-key-management-filename=`pwd`/mysql-test/std_data/keys.txt
Adjust the path to keys.txt if needed.
The test to run the complete flow (might require several trials):
https://github.com/MariaDB/randgen --branch elenst-jira-refs b1facb0360
perl ./runall-new.pl --basedir=/data/bld/10.2 --vardir=/dev/shm/vardir --duration=250 --threads=6 --scenario=CrashUpgrade --redefine=conf/mariadb/bulk_insert.yy --engine=Aria --grammar=conf/mariadb/generic-dml.yy --gendata=conf/mariadb/oltp-aria.zz --mysqld=--aria-encrypt-tables=1 --grammar=conf/mariadb/generic-dml.yy --gendata=conf/mariadb/oltp-aria.zz --mysqld=--plugin-load-add=file_key_management --mysqld=--file-key-management-filename=/data/bld/keys.txt
RQG branch and revision are important here, you might not have some of the required files in other branches.Adjust the paths to basedir and keys file on the command line.
Couldn't reproduce on 10.1 with the given test, but possibly there is some difference in the test flow.
Transition
Time In Source Status
Execution Times
Open
In Progress
173d 18h 43m
1
In Progress
Stalled
1653d 22h 37m
1
{"report":{"fcp":991.4000000953674,"ttfb":300.90000009536743,"pageVisibility":"visible","entityId":71240,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":0.5,"journeyId":"197e0708-07cf-45d8-b58d-12f942debc7c","navigationType":0,"readyForUser":1128,"redirectCount":0,"resourceLoadedEnd":1212,"resourceLoadedStart":306.80000019073486,"resourceTiming":[{"duration":183.2999997138977,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":306.80000019073486,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":306.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":490.09999990463257,"responseStart":0,"secureConnectionStart":0},{"duration":183.19999980926514,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":307.2000002861023,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":307.2000002861023,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":490.40000009536743,"responseStart":0,"secureConnectionStart":0},{"duration":192.30000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/0917945aaa57108d00c5076fea35e069-CDN/lu2cib/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":307.40000009536743,"connectEnd":307.40000009536743,"connectStart":307.40000009536743,"domainLookupEnd":307.40000009536743,"domainLookupStart":307.40000009536743,"fetchStart":307.40000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":307.40000009536743,"responseEnd":499.7000002861023,"responseStart":499.7000002861023,"secureConnectionStart":307.40000009536743},{"duration":257.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/2d8175ec2fa4c816e8023260bd8c1786-CDN/lu2cib/820016/12ta74/494e4c556ecbb29f90a3d3b4f09cb99c/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":307.5,"connectEnd":307.5,"connectStart":307.5,"domainLookupEnd":307.5,"domainLookupStart":307.5,"fetchStart":307.5,"redirectEnd":0,"redirectStart":0,"requestStart":307.5,"responseEnd":565,"responseStart":565,"secureConnectionStart":307.5},{"duration":261.40000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/a9324d6758d385eb45c462685ad88f1d-CDN/lu2cib/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":307.80000019073486,"connectEnd":307.80000019073486,"connectStart":307.80000019073486,"domainLookupEnd":307.80000019073486,"domainLookupStart":307.80000019073486,"fetchStart":307.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":307.80000019073486,"responseEnd":569.2000002861023,"responseStart":569.2000002861023,"secureConnectionStart":307.80000019073486},{"duration":262.40000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":308,"connectEnd":308,"connectStart":308,"domainLookupEnd":308,"domainLookupStart":308,"fetchStart":308,"redirectEnd":0,"redirectStart":0,"requestStart":308,"responseEnd":570.4000000953674,"responseStart":570.4000000953674,"secureConnectionStart":308},{"duration":262.8999996185303,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":308.2000002861023,"connectEnd":308.2000002861023,"connectStart":308.2000002861023,"domainLookupEnd":308.2000002861023,"domainLookupStart":308.2000002861023,"fetchStart":308.2000002861023,"redirectEnd":0,"redirectStart":0,"requestStart":308.2000002861023,"responseEnd":571.0999999046326,"responseStart":571.0999999046326,"secureConnectionStart":308.2000002861023},{"duration":338.69999980926514,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2cib/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":308.30000019073486,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":308.30000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":647,"responseStart":0,"secureConnectionStart":0},{"duration":263.09999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":308.5,"connectEnd":308.5,"connectStart":308.5,"domainLookupEnd":308.5,"domainLookupStart":308.5,"fetchStart":308.5,"redirectEnd":0,"redirectStart":0,"requestStart":308.5,"responseEnd":571.5999999046326,"responseStart":571.5999999046326,"secureConnectionStart":308.5},{"duration":338.6000003814697,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":308.59999990463257,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":308.59999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":647.2000002861023,"responseStart":0,"secureConnectionStart":0},{"duration":263.2999997138977,"initiatorType":"script","name":"https://jira.mariadb.org/s/5d5e8fe91fbc506585e83ea3b62ccc4b-CDN/lu2cib/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":308.80000019073486,"connectEnd":308.80000019073486,"connectStart":308.80000019073486,"domainLookupEnd":308.80000019073486,"domainLookupStart":308.80000019073486,"fetchStart":308.80000019073486,"redirectEnd":0,"redirectStart":0,"requestStart":308.80000019073486,"responseEnd":572.0999999046326,"responseStart":572.0999999046326,"secureConnectionStart":308.80000019073486},{"duration":500.09999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":309.90000009536743,"connectEnd":309.90000009536743,"connectStart":309.90000009536743,"domainLookupEnd":309.90000009536743,"domainLookupStart":309.90000009536743,"fetchStart":309.90000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":309.90000009536743,"responseEnd":810,"responseStart":810,"secureConnectionStart":309.90000009536743},{"duration":901.0999999046326,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":309.90000009536743,"connectEnd":309.90000009536743,"connectStart":309.90000009536743,"domainLookupEnd":309.90000009536743,"domainLookupStart":309.90000009536743,"fetchStart":309.90000009536743,"redirectEnd":0,"redirectStart":0,"requestStart":309.90000009536743,"responseEnd":1211,"responseStart":1210.9000000953674,"secureConnectionStart":309.90000009536743},{"duration":151.19999980926514,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":659.3000001907349,"connectEnd":659.3000001907349,"connectStart":659.3000001907349,"domainLookupEnd":659.3000001907349,"domainLookupStart":659.3000001907349,"fetchStart":659.3000001907349,"redirectEnd":0,"redirectStart":0,"requestStart":659.3000001907349,"responseEnd":810.5,"responseStart":810.5,"secureConnectionStart":659.3000001907349},{"duration":286.7000002861023,"initiatorType":"link","name":"https://jira.mariadb.org/s/d5715adaadd168a9002b108b2b039b50-CDN/lu2cib/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/css/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":925.0999999046326,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":925.0999999046326,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1211.8000001907349,"responseStart":0,"secureConnectionStart":0},{"duration":286.2999997138977,"initiatorType":"link","name":"https://jira.mariadb.org/s/50bc9be5bfead1a25e72c1a9338c94f6-CDN/lu2cib/820016/12ta74/e108c7645258ccb43280ed3404e3e949/_/download/contextbatch/css/com.atlassian.jira.plugins.jira-development-integration-plugin:0,-_super,-jira.view.issue,-jira.global,-jira.general,-jira.browse.project,-project.issue.navigator,-atl.general/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":925.7000002861023,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":925.7000002861023,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":1212,"responseStart":0,"secureConnectionStart":0},{"duration":321.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2cib/820016/12ta74/e65b778d185daf5aee24936755b43da6/_/download/contextbatch/js/browser-metrics-plugin.contrib,-_super,-project.issue.navigator,-jira.view.issue,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true&whisper-enabled=true","startTime":926.5999999046326,"connectEnd":926.5999999046326,"connectStart":926.5999999046326,"domainLookupEnd":926.5999999046326,"domainLookupStart":926.5999999046326,"fetchStart":926.5999999046326,"redirectEnd":0,"redirectStart":0,"requestStart":926.5999999046326,"responseEnd":1248.0999999046326,"responseStart":1248.0999999046326,"secureConnectionStart":926.5999999046326},{"duration":335.2000002861023,"initiatorType":"script","name":"https://jira.mariadb.org/s/097ae97cb8fbec7d6ea4bbb1f26955b9-CDN/lu2cib/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/js/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":927,"connectEnd":927,"connectStart":927,"domainLookupEnd":927,"domainLookupStart":927,"fetchStart":927,"redirectEnd":0,"redirectStart":0,"requestStart":927,"responseEnd":1262.2000002861023,"responseStart":1262.2000002861023,"secureConnectionStart":927},{"duration":336.19999980926514,"initiatorType":"script","name":"https://jira.mariadb.org/s/e0bf5781d46ea69fb123572974cf39de-CDN/lu2cib/820016/12ta74/e108c7645258ccb43280ed3404e3e949/_/download/contextbatch/js/com.atlassian.jira.plugins.jira-development-integration-plugin:0,-_super,-jira.view.issue,-jira.global,-jira.general,-jira.browse.project,-project.issue.navigator,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true&whisper-enabled=true","startTime":927.3000001907349,"connectEnd":927.3000001907349,"connectStart":927.3000001907349,"domainLookupEnd":927.3000001907349,"domainLookupStart":927.3000001907349,"fetchStart":927.3000001907349,"redirectEnd":0,"redirectStart":0,"requestStart":927.3000001907349,"responseEnd":1263.5,"responseStart":1263.5,"secureConnectionStart":927.3000001907349}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":95,"responseStart":301,"responseEnd":303,"domLoading":305,"domInteractive":1232,"domContentLoadedEventStart":1232,"domContentLoadedEventEnd":1275,"domComplete":1907,"loadEventStart":1907,"loadEventEnd":1908,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":1212.9000000953674},{"name":"bigPipe.sidebar-id.end","time":1213.8000001907349},{"name":"bigPipe.activity-panel-pipe-id.start","time":1214},{"name":"bigPipe.activity-panel-pipe-id.end","time":1215.2000002861023},{"name":"activityTabFullyLoaded","time":1290.0999999046326}],"measures":[],"correlationId":"af4f0ea8801f97","effectiveType":"4g","downlink":9.7,"rtt":0,"serverDuration":131,"dbReadsTimeInMs":26,"dbConnsTimeInMs":37,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}
Technical task
Critical
MDEV-17864 Run regular crash recovery tests for Aria tables (system and user tables)
MDEV-17913 Encrypted transactional Aria tables remain corrupt after crash recovery, automatic repairment does not work
