The failure looks in buildbot like this:
http://buildbot.askmonty.org/buildbot/builders/kvm-bintar-centos5-amd64/builds/4574/steps/test/logs/stdio
innodb.log_file 'innodb' w3 [ fail ]
|
Test ended at 2017-01-30 19:08:42
|
|
CURRENT_TEST: innodb.log_file
|
sh: line 1: 29096 Aborted /usr/local/mariadb-10.2.4-linux-x86_64/bin/mysqld --defaults-file=/usr/local/mariadb-10.2.4-linux-x86_64/mysql-test/var/3/tmp/log_file/my.cnf --loose-console > /usr/local/mariadb-10.2.4-linux-x86_64/mysql-test/var/3/tmp/log_file/my_restart.err 2>&1
|
NOT FOUND /\[ERROR\] InnoDB: Could not create undo tablespace '.*undo002'/ in my_restart.err
|
mysqltest: In included file "./include/search_pattern_in_file.inc":
|
included from /usr/local/mariadb-10.2.4-linux-x86_64/mysql-test/suite/innodb/t/log_file.test at line 46:
|
At line 61: command "perl" failed with error: 255 my_errno: 0 errno: 0
|
|
The result from queries just before the failure was:
|
# Testcase for the following bugs
|
# Bug#16691130 - ASSERT WHEN INNODB_LOG_GROUP_HOME_DIR DOES NOT EXIST
|
# Bug#16418661 - CHANGING NAME IN FOR INNODB_DATA_FILE_PATH SHOULD NOT SUCCEED WITH LOG FILES
|
# Write tmp/log_file/my.cnf
|
# Start mysqld without the possibility to create innodb_undo_tablespaces
|
Reproducible reliably on the corresponding VM (vm-centos5-amd64-install) reliably, but only if the test is run in shm.
The error log from the intermediate attempt to start the server looks like this:
2017-01-31 1:11:59 47545700325168 [Note] /home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld (mysqld 10.2.4-MariaDB) starting as process 19553 ...
|
2017-01-31 1:11:59 47545700325168 [Note] Plugin 'Aria' is disabled.
|
2017-01-31 1:11:59 47545700325168 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
|
2017-01-31 1:11:59 47545700325168 [Note] InnoDB: Uses event mutexes
|
2017-01-31 1:11:59 47545700325168 [Note] InnoDB: Compressed tables use zlib 1.2.3
|
2017-01-31 1:11:59 47545700325168 [Note] InnoDB: Using Linux native AIO
|
2017-01-31 1:11:59 47545700325168 [Note] InnoDB: Number of pools: 1
|
2017-01-31 1:11:59 47545700325168 [Note] InnoDB: Using generic crc32 instructions
|
2017-01-31 1:11:59 47545700325168 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
|
2017-01-31 1:11:59 47545700325168 [Note] InnoDB: Completed initialization of buffer pool
|
2017-01-31 1:11:59 1203657024 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
|
2017-01-31 1:11:59 47545700325168 [Note] InnoDB: The first innodb_system data file 'ibdata1' did not exist. A new tablespace will be created!
|
2017-01-31 1:11:59 47545700325168 [Note] InnoDB: Need to create a new innodb_system data file 'ibdata2'.
|
2017-01-31 1:11:59 47545700325168 [Note] InnoDB: Setting file '/home/buildbot/mariadb-10.2.4-linux-x86_64/mysql-test/var/tmp/log_file/ibdata1' size to 10 MB. Physically writing the file full; Please wait ...
|
2017-01-31 1:11:59 47545700325168 [Note] InnoDB: File '/home/buildbot/mariadb-10.2.4-linux-x86_64/mysql-test/var/tmp/log_file/ibdata1' size is now 10 MB.
|
2017-01-31 1:11:59 47545700325168 [Note] InnoDB: Setting file '/home/buildbot/mariadb-10.2.4-linux-x86_64/mysql-test/var/tmp/log_file/ibdata2' size to 10 MB. Physically writing the file full; Please wait ...
|
2017-01-31 1:12:00 47545700325168 [Note] InnoDB: File '/home/buildbot/mariadb-10.2.4-linux-x86_64/mysql-test/var/tmp/log_file/ibdata2' size is now 10 MB.
|
2017-01-31 1:12:00 47545700325168 [Note] InnoDB: Setting log file ./ib_logfile101 size to 48 MB
|
2017-01-31 1:12:00 47545700325168 [Note] InnoDB: Setting log file ./ib_logfile1 size to 48 MB
|
2017-01-31 1:12:00 47545700325168 [Note] InnoDB: Setting log file ./ib_logfile2 size to 48 MB
|
2017-01-31 1:12:00 47545700325168 [ERROR] InnoDB: Operating system error number 22 in a file operation.
|
2017-01-31 1:12:00 47545700325168 [ERROR] InnoDB: Error number 22 means 'Invalid argument'
|
2017-01-31 1:12:00 47545700325168 [Note] InnoDB: Some operating system error numbers are described at http://dev.mysql.com/doc/refman/5.7/en/operating-system-error-codes.html
|
2017-01-31 1:12:00 47545700325168 [ERROR] InnoDB: File ./ib_logfile101: 'aio write' returned OS error 222. Cannot continue operation
|
170131 1:12:00 [ERROR] mysqld got signal 6 ;
|
This could be because you hit a bug. It is also possible that this binary
|
or one of the libraries it was linked against is corrupt, improperly built,
|
or misconfigured. This error can also be caused by malfunctioning hardware.
|
|
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
|
|
We will try our best to scrape up some info that will hopefully help
|
diagnose the problem, but since we have already crashed,
|
something is definitely wrong and this may fail.
|
|
Server version: 10.2.4-MariaDB
|
key_buffer_size=134217728
|
read_buffer_size=131072
|
max_used_connections=0
|
max_threads=153
|
thread_count=0
|
It is possible that mysqld could use up to
|
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 467201 K bytes of memory
|
Hope that's ok; if not, decrease some variables in the equation.
|
|
Thread pointer: 0x0x0
|
Attempting backtrace. You can use the following information to find out
|
where mysqld died. If you see no messages after this, something went
|
terribly wrong...
|
stack_bottom = 0x0 thread_stack 0x48c00
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld(my_print_stacktrace+0x2e)[0xdde5ce]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld(handle_fatal_signal+0x4cc)[0x7cfefc]
|
/lib64/libpthread.so.0[0x340220e4c0]
|
/lib64/libc.so.6(gsignal+0x35)[0x3401a30215]
|
/lib64/libc.so.6(abort+0x110)[0x3401a31cc0]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld[0xa62a55]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld[0xa643d1]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld[0xc388da]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld[0xa3d4fc]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld[0xa41551]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld[0xa420ac]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld[0xa46876]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld[0xb1222f]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld[0xb16a00]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld[0x9e0be7]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld(_Z24ha_initialize_handlertonP13st_plugin_int+0x5e)[0x7d562e]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld[0x5fb42a]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld(_Z11plugin_initPiPPci+0xba1)[0x5fdd01]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld[0x54994d]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld(_Z11mysqld_mainiPPc+0x99f)[0x54ad6f]
|
/lib64/libc.so.6(__libc_start_main+0xf4)[0x3401a1d974]
|
/home/buildbot/mariadb-10.2.4-linux-x86_64/bin/mysqld(__gxx_personality_v0+0x3e9)[0x540289]
|
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
|
information that should help you find out what is causing the crash.
|
I have a remembrance of a problem between aio and tmpfs in some old kernel. Disabling aio in the config file for the intermediate server makes the test failure go away:
https://github.com/MariaDB/server/commit/1e722e214ad1c52aa886dd1737e5c89ab789e6e7
but maybe it makes sense to look into the crash as such, as I don't think it's supposed to happen anymore.
{"report":{"fcp":675.7999999523163,"ttfb":150.89999985694885,"pageVisibility":"visible","entityId":60044,"key":"jira.project.issue.view-issue","isInitial":true,"threshold":1000,"elementTimings":{},"userDeviceMemory":8,"userDeviceProcessors":64,"apdex":1,"journeyId":"afc46ec1-9072-4d07-82ba-34b3c7054579","navigationType":0,"readyForUser":746.7999999523163,"redirectCount":0,"resourceLoadedEnd":764.2999999523163,"resourceLoadedStart":158.89999985694885,"resourceTiming":[{"duration":5.900000095367432,"initiatorType":"link","name":"https://jira.mariadb.org/s/2c21342762a6a02add1c328bed317ffd-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/css/_super/batch.css","startTime":158.89999985694885,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":158.89999985694885,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":164.79999995231628,"responseStart":0,"secureConnectionStart":0},{"duration":5.599999904632568,"initiatorType":"link","name":"https://jira.mariadb.org/s/7ebd35e77e471bc30ff0eba799ebc151-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/css/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":159.20000004768372,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":159.20000004768372,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":164.79999995231628,"responseStart":0,"secureConnectionStart":0},{"duration":63.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/fbf975c0cce4b1abf04784eeae9ba1f4-CDN/lu2bu7/820016/12ta74/0a8bac35585be7fc6c9cc5a0464cd4cf/_/download/contextbatch/js/_super/batch.js?locale=en","startTime":159.29999995231628,"connectEnd":159.29999995231628,"connectStart":159.29999995231628,"domainLookupEnd":159.29999995231628,"domainLookupStart":159.29999995231628,"fetchStart":159.29999995231628,"redirectEnd":0,"redirectStart":0,"requestStart":159.29999995231628,"responseEnd":222.79999995231628,"responseStart":222.79999995231628,"secureConnectionStart":159.29999995231628},{"duration":136.79999995231628,"initiatorType":"script","name":"https://jira.mariadb.org/s/099b33461394b8015fc36c0a4b96e19f-CDN/lu2bu7/820016/12ta74/8679b4946efa1a0bb029a3a22206fb5d/_/download/contextbatch/js/jira.browse.project,project.issue.navigator,jira.view.issue,jira.general,jira.global,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":159.79999995231628,"connectEnd":159.79999995231628,"connectStart":159.79999995231628,"domainLookupEnd":159.79999995231628,"domainLookupStart":159.79999995231628,"fetchStart":159.79999995231628,"redirectEnd":0,"redirectStart":0,"requestStart":159.79999995231628,"responseEnd":296.59999990463257,"responseStart":296.59999990463257,"secureConnectionStart":159.79999995231628},{"duration":140.30000019073486,"initiatorType":"script","name":"https://jira.mariadb.org/s/94c15bff32baef80f4096a08aceae8bc-CDN/lu2bu7/820016/12ta74/c92c0caa9a024ae85b0ebdbed7fb4bd7/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en","startTime":159.89999985694885,"connectEnd":159.89999985694885,"connectStart":159.89999985694885,"domainLookupEnd":159.89999985694885,"domainLookupStart":159.89999985694885,"fetchStart":159.89999985694885,"redirectEnd":0,"redirectStart":0,"requestStart":159.89999985694885,"responseEnd":300.2000000476837,"responseStart":300.2000000476837,"secureConnectionStart":159.89999985694885},{"duration":140.59999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":160,"connectEnd":160,"connectStart":160,"domainLookupEnd":160,"domainLookupStart":160,"fetchStart":160,"redirectEnd":0,"redirectStart":0,"requestStart":160,"responseEnd":300.59999990463257,"responseStart":300.59999990463257,"secureConnectionStart":160},{"duration":140.90000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":160.09999990463257,"connectEnd":160.09999990463257,"connectStart":160.09999990463257,"domainLookupEnd":160.09999990463257,"domainLookupStart":160.09999990463257,"fetchStart":160.09999990463257,"redirectEnd":0,"redirectStart":0,"requestStart":160.09999990463257,"responseEnd":301,"responseStart":301,"secureConnectionStart":160.09999990463257},{"duration":141.19999980926514,"initiatorType":"link","name":"https://jira.mariadb.org/s/b04b06a02d1959df322d9cded3aeecc1-CDN/lu2bu7/820016/12ta74/a2ff6aa845ffc9a1d22fe23d9ee791fc/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":160.20000004768372,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":160.20000004768372,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":301.39999985694885,"responseStart":0,"secureConnectionStart":0},{"duration":141.09999990463257,"initiatorType":"script","name":"https://jira.mariadb.org/rest/api/1.0/shortcuts/820016/47140b6e0a9bc2e4913da06536125810/shortcuts.js?context=issuenavigation&context=issueaction","startTime":160.29999995231628,"connectEnd":160.29999995231628,"connectStart":160.29999995231628,"domainLookupEnd":160.29999995231628,"domainLookupStart":160.29999995231628,"fetchStart":160.29999995231628,"redirectEnd":0,"redirectStart":0,"requestStart":160.29999995231628,"responseEnd":301.39999985694885,"responseStart":301.39999985694885,"secureConnectionStart":160.29999995231628},{"duration":141.40000009536743,"initiatorType":"link","name":"https://jira.mariadb.org/s/3ac36323ba5e4eb0af2aa7ac7211b4bb-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.css?jira.create.linked.issue=true","startTime":160.39999985694885,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":160.39999985694885,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":301.7999999523163,"responseStart":0,"secureConnectionStart":0},{"duration":141.5,"initiatorType":"script","name":"https://jira.mariadb.org/s/3339d87fa2538a859872f2df449bf8d0-CDN/lu2bu7/820016/12ta74/d176f0986478cc64f24226b3d20c140d/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-project.issue.navigator,-jira.view.issue/batch.js?jira.create.linked.issue=true&locale=en","startTime":160.5,"connectEnd":160.5,"connectStart":160.5,"domainLookupEnd":160.5,"domainLookupStart":160.5,"fetchStart":160.5,"redirectEnd":0,"redirectStart":0,"requestStart":160.5,"responseEnd":302,"responseStart":302,"secureConnectionStart":160.5},{"duration":400.10000014305115,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":171.39999985694885,"connectEnd":171.39999985694885,"connectStart":171.39999985694885,"domainLookupEnd":171.39999985694885,"domainLookupStart":171.39999985694885,"fetchStart":171.39999985694885,"redirectEnd":0,"redirectStart":0,"requestStart":171.39999985694885,"responseEnd":571.5,"responseStart":571.5,"secureConnectionStart":171.39999985694885},{"duration":400.39999985694885,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":172,"connectEnd":172,"connectStart":172,"domainLookupEnd":172,"domainLookupStart":172,"fetchStart":172,"redirectEnd":0,"redirectStart":0,"requestStart":172,"responseEnd":572.3999998569489,"responseStart":572.3999998569489,"secureConnectionStart":172},{"duration":135.09999990463257,"initiatorType":"xmlhttprequest","name":"https://jira.mariadb.org/rest/webResources/1.0/resources","startTime":431,"connectEnd":431,"connectStart":431,"domainLookupEnd":431,"domainLookupStart":431,"fetchStart":431,"redirectEnd":0,"redirectStart":0,"requestStart":431,"responseEnd":566.0999999046326,"responseStart":566.0999999046326,"secureConnectionStart":431},{"duration":61.799999952316284,"initiatorType":"script","name":"https://www.google-analytics.com/analytics.js","startTime":649,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":649,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":710.7999999523163,"responseStart":0,"secureConnectionStart":0},{"duration":104.79999995231628,"initiatorType":"link","name":"https://jira.mariadb.org/s/d5715adaadd168a9002b108b2b039b50-CDN/lu2bu7/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/css/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":652.7000000476837,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":652.7000000476837,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":757.5,"responseStart":0,"secureConnectionStart":0},{"duration":104.20000004768372,"initiatorType":"script","name":"https://jira.mariadb.org/s/d41d8cd98f00b204e9800998ecf8427e-CDN/lu2bu7/820016/12ta74/e65b778d185daf5aee24936755b43da6/_/download/contextbatch/js/browser-metrics-plugin.contrib,-_super,-project.issue.navigator,-jira.view.issue,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&slack-enabled=true","startTime":653.5999999046326,"connectEnd":653.5999999046326,"connectStart":653.5999999046326,"domainLookupEnd":653.5999999046326,"domainLookupStart":653.5999999046326,"fetchStart":653.5999999046326,"redirectEnd":0,"redirectStart":0,"requestStart":653.5999999046326,"responseEnd":757.7999999523163,"responseStart":757.7999999523163,"secureConnectionStart":653.5999999046326},{"duration":110.40000009536743,"initiatorType":"script","name":"https://jira.mariadb.org/s/f51ef5507eea4c158f257c66c93b2a3f-CDN/lu2bu7/820016/12ta74/be4b45e9cec53099498fa61c8b7acba4/_/download/contextbatch/js/jira.project.sidebar,-_super,-project.issue.navigator,-jira.general,-jira.browse.project,-jira.view.issue,-jira.global,-atl.general,-com.atlassian.jira.projects.sidebar.init/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en&slack-enabled=true","startTime":653.8999998569489,"connectEnd":653.8999998569489,"connectStart":653.8999998569489,"domainLookupEnd":653.8999998569489,"domainLookupStart":653.8999998569489,"fetchStart":653.8999998569489,"redirectEnd":0,"redirectStart":0,"requestStart":653.8999998569489,"responseEnd":764.2999999523163,"responseStart":764.2999999523163,"secureConnectionStart":653.8999998569489}],"fetchStart":0,"domainLookupStart":0,"domainLookupEnd":0,"connectStart":0,"connectEnd":0,"requestStart":10,"responseStart":151,"responseEnd":172,"domLoading":154,"domInteractive":822,"domContentLoadedEventStart":822,"domContentLoadedEventEnd":863,"domComplete":1142,"loadEventStart":1142,"loadEventEnd":1143,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[{"name":"bigPipe.sidebar-id.start","time":790.5999999046326},{"name":"bigPipe.sidebar-id.end","time":791.2999999523163},{"name":"bigPipe.activity-panel-pipe-id.start","time":791.3999998569489},{"name":"bigPipe.activity-panel-pipe-id.end","time":792.5999999046326},{"name":"activityTabFullyLoaded","time":880.7999999523163}],"measures":[],"correlationId":"9fc6a364f3444","effectiveType":"4g","downlink":10,"rtt":0,"serverDuration":75,"dbReadsTimeInMs":14,"dbConnsTimeInMs":21,"applicationHash":"9d11dbea5f4be3d4cc21f03a88dd11d8c8687422","experiments":[]}}