[MDEV-10603] Mariadb 10.1.13 got killed by SIGNAL 11 Created: 2016-08-20  Updated: 2017-06-14

Status: Open
Project: MariaDB Server
Component/s: None
Affects Version/s: 10.1.13, 10.1.16, 10.1
Fix Version/s: 10.1

Type: Bug Priority: Major
Reporter: Ashish Assignee: Unassigned
Resolution: Unresolved Votes: 0
Labels: None
Environment:

Operating System : Red Hat Enterprise Linux Server
Operating System Version : release 6.8 (Santiago) Kernel 2.6.32-642.1.1.el6.x86_64 (x86_64)

Attachments: File alter.sql     File custom_903.sql     Text File error.log     File my.cnf     File my.cnf     Text File queries.log    
Issue Links:
Relates
relates to MDEV-9690 concurrent queries with virtual colum... Closed

 Description   

Mariadb got killed, here is the logs

160816 16:10:07 [ERROR] mysqld got signal 11 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed,
 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.1.13-MariaDB
 
key_buffer_size=8589934592
 
read_buffer_size=131072
 
max_used_connections=203
 
max_threads=1026
 
thread_count=83
 
It is possible that mysqld could use up to
 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 10642180 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0x7f8f34c95008
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7f8f6dd99d40 thread_stack 0x40000


/usr/sbin/mysqld(my_print_stacktrace+0x2b)[0x7f917e320e0b]
 
/usr/sbin/mysqld(handle_fatal_signal+0x475)[0x7f917de81055]
 
/lib64/libpthread.so.0(+0xf7e0)[0x7f917d2857e0]
 
/usr/sbin/mysqld(_Z18get_datetime_valueP3THDPPP4ItemS3_16enum_field_typesPb+0x41)[0x7f917deb0a01]
 
/usr/sbin/mysqld(_ZN14Arg_comparator16compare_temporalE16enum_field_types+0x60)[0x7f917deb0cb0]
 
/usr/sbin/mysqld(_ZN12Item_func_ge7val_intEv+0x2a)[0x7f917deace4a]
 
/usr/sbin/mysqld(_ZN4Item8val_boolEv+0xac)[0x7f917de918cc]
 
/usr/sbin/mysqld(_ZN14Item_func_case9find_itemEP6String+0x174)[0x7f917deb31c4]
 
/usr/sbin/mysqld(_ZN14Item_func_case6int_opEv+0x75)[0x7f917deb3595]
 
/usr/sbin/mysqld(_ZN27Item_func_hybrid_field_type7val_intEv+0x9c)[0x7f917ded921c]
 
/usr/sbin/mysqld(_ZN4Item13save_in_fieldEP5Fieldb+0x15c)[0x7f917de8fabc]
 
mysys/stacktrace.c:247(my_print_stacktrace)[0x7f917ddb6292]
 
/usr/sbin/mysqld(+0x49c9ee)[0x7f917dd539ee]
 
/usr/sbin/mysqld(+0x3a1d0b)[0x7f917dc58d0b]
 
/usr/sbin/mysqld(+0x3a33f5)[0x7f917dc5a3f5]
 
/usr/sbin/mysqld(_ZN4JOIN14optimize_innerEv+0x5fa)[0x7f917dd5f6ea]
 
/usr/sbin/mysqld(_ZN4JOIN8optimizeEv+0x20)[0x7f917dd62060]
 
/usr/sbin/mysqld(_Z12mysql_selectP3THDPPP4ItemP10TABLE_LISTjR4ListIS1_ES2_jP8st_orderSB_S2_SB_yP13select_resultP18st_select_lex_unitP13st_select_lex+0x9d)[0x7f917dd621bd]
 
/usr/sbin/mysqld(_Z13handle_selectP3THDP3LEXP13select_resultm+0x25d)[0x7f917dd65b5d]
 
/usr/sbin/mysqld(+0x4510c2)[0x7f917dd080c2]
 
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x5e40)[0x7f917dd143d0]
 
/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x28d)[0x7f917dd1790d]
 
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x243b)[0x7f917dd1a56b]


Server version: 10.1.13-MariaDB
 
key_buffer_size=8589934592
 
read_buffer_size=131072
 
max_used_connections=203
 
max_threads=1026
 
thread_count=83
 
It is possible that mysqld could use up to
 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 10642180 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0x7f8f34c95008
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7f8f6dd99d40 thread_stack 0x40000


/usr/sbin/mysqld(my_print_stacktrace+0x2b)[0x7f917e320e0b]
 
/usr/sbin/mysqld(handle_fatal_signal+0x475)[0x7f917de81055]
 
/lib64/libpthread.so.0(+0xf7e0)[0x7f917d2857e0]
 
/usr/sbin/mysqld(_Z18get_datetime_valueP3THDPPP4ItemS3_16enum_field_typesPb+0x41)[0x7f917deb0a01]
 
/usr/sbin/mysqld(_ZN14Arg_comparator16compare_temporalE16enum_field_types+0x60)[0x7f917deb0cb0]
 
/usr/sbin/mysqld(_ZN12Item_func_ge7val_intEv+0x2a)[0x7f917deace4a]
 
/usr/sbin/mysqld(_ZN4Item8val_boolEv+0xac)[0x7f917de918cc]
 
/usr/sbin/mysqld(_ZN14Item_func_case9find_itemEP6String+0x174)[0x7f917deb31c4]
 
/usr/sbin/mysqld(_ZN14Item_func_case6int_opEv+0x75)[0x7f917deb3595]
 
/usr/sbin/mysqld(_ZN27Item_func_hybrid_field_type7val_intEv+0x9c)[0x7f917ded921c]
 
/usr/sbin/mysqld(_ZN4Item13save_in_fieldEP5Fieldb+0x15c)[0x7f917de8fabc]
 
mysys/stacktrace.c:247(my_print_stacktrace)[0x7f917ddb6292]
 
/usr/sbin/mysqld(+0x49c9ee)[0x7f917dd539ee]
 
/usr/sbin/mysqld(+0x3a1d0b)[0x7f917dc58d0b]
 
/usr/sbin/mysqld(+0x3a33f5)[0x7f917dc5a3f5]
 
/usr/sbin/mysqld(_ZN4JOIN14optimize_innerEv+0x5fa)[0x7f917dd5f6ea]
 
/usr/sbin/mysqld(_ZN4JOIN8optimizeEv+0x20)[0x7f917dd62060]
 
/usr/sbin/mysqld(_Z12mysql_selectP3THDPPP4ItemP10TABLE_LISTjR4ListIS1_ES2_jP8st_orderSB_S2_SB_yP13select_resultP18st_select_lex_unitP13st_select_lex+0x9d)[0x7f917dd621bd]
 
/usr/sbin/mysqld(_Z13handle_selectP3THDP3LEXP13select_resultm+0x25d)[0x7f917dd65b5d]
 
/usr/sbin/mysqld(+0x4510c2)[0x7f917dd080c2]
 
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x5e40)[0x7f917dd143d0]
 
/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x28d)[0x7f917dd1790d]
 
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x243b)[0x7f917dd1a56b]
 
/usr/sbin/mysqld(_Z10do_commandP3THD+0x16b)[0x7f917dd1ab1b]
 
/usr/sbin/mysqld(_Z24do_handle_one_connectionP3THD+0x17f)[0x7f917ddd64af]
 
/usr/sbin/mysqld(handle_one_connection+0x47)[0x7f917ddd6607]
 
/lib64/libpthread.so.0(+0x7aa1)[0x7f917d27daa1]
 
/lib64/libc.so.6(clone+0x6d)[0x7f917b762aad]


Trying to get some variables.
 
Some pointers may be invalid and cause the dump to abort.
 
Query (0x7f8eec5ff020): is an invalid pointer
 
Connection ID (thread ID): 102556786
 
Status: NOT_KILLED
 
 
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache:



 Comments   
Comment by Ashish [ 2016-08-23 ]

Hello,

Can anyone look into this, I can provide more details if required.
The last change we did on the database is we added a virtual column and after removing the virtual column we are not seeing any issue further on this. But we have got few more environment with exact same setup, would be nice to fix out.

Comment by Elena Stepanova [ 2016-08-24 ]

Hi,

Are you getting the problem repeatedly? If so, could you maybe enable the general log temporarily, till the next crash? It would show us which exactly query is crashing.

Meanwhile, please attach your cnf file(s).
Thanks.

Comment by Elena Stepanova [ 2016-08-24 ]

It might be a duplicate of MDEV-9690, but it wouldn't hurt to make sure.

Comment by Iliya Taushanov [ 2016-08-24 ]

Attaching my.cnf, create code for the affected table before the changes which crashed MariaDB and the alter code which led to crashes.

Since this is production server we are very limited in making changes on it, especially changes we know they are likely to crash it. Could use virtual development servers with different specs for the purpose with same table stricture and data, but need instructions how to stress test it.

my.cnf custom_903.sql alter.sql

Comment by Iliya Taushanov [ 2016-08-26 ]

Reproduced the crash on a development server with MariaDB 10.1.14 and CentOS 7.
Test was running for more that 12 hours with selects only running as per the gentest. As soon as I updated manually a couple of columns (not the virtual one) while the selects were still running, it crashed right away. Table custom_903 currently has 10000 records.

UPDATE `asterisk`.`custom_903` SET `ContactCompanyID`='jjuyfou' WHERE  `lead_id`=8370139;
 
 
 
UPDATE `asterisk`.`custom_903` SET `ContactCompanyID`='oubuaberrg' WHERE  `lead_id`=8370140;


[root@deviliya randgen]# cat custom903.yy
 
thread1:
 
 
 
    select | select | select | select | select | select | select | select | select |
 
 
 
    flush | optimize ;
 
 
 
 
 
 
 
query:
 
 
 
    select ;
 
 
 
 
 
 
 
flush:
 
 
 
    FLUSH TABLES;
 
 
 
 
 
 
 
optimize:
 
 
 
    OPTIMIZE TABLE my_table ;
 
 
 
 
 
 
 
select:
 
 
 
        SELECT * from my_table;
 
 
 
 
 
my_table:
 
 
 
        custom_903
 
 
 
;


[root@deviliya randgen]# perl ./gentest.pl --dsn="dbi:mysql:user=root:host=localhost:port=3306:database=asterisk" --grammar=custom903.yy --threads=32 --duration=90000 --queries=20M
 
# 2016-08-25T18:15:38 Starting: ./gentest.pl --dsn=dbi:mysql:user=root:host=localhost:port=3306:database=asterisk --grammar=custom903.yy --threads=32 --duration=90000 --queries=20M
 
# 2016-08-25T18:15:38 -------------------------------
 
# 2016-08-25T18:15:38 Configuration
 
# 2016-08-25T18:15:38   debug_server => ['']
 
# 2016-08-25T18:15:38   dsn => ['dbi:mysql:user=root:host=localhost:port=3306:database=asterisk']
 
# 2016-08-25T18:15:38   duration => 90000
 
# 2016-08-25T18:15:38   generator => FromGrammar
 
# 2016-08-25T18:15:38   grammar => custom903.yy
 
# 2016-08-25T18:15:38   queries => 20000000
 
# 2016-08-25T18:15:38   reporters => ['']
 
# 2016-08-25T18:15:38   seed => 1
 
# 2016-08-25T18:15:38   threads => 32
 
# 2016-08-25T18:15:38   transformers => ['']
 
# 2016-08-25T18:15:38   validators => ['']
 
# 2016-08-25T18:15:38   views => ['', '']
 
# 2016-08-25T18:15:38 Reporters: ErrorLog, Backtrace
 
# 2016-08-25T18:15:42 Validators: ErrorMessageCorruption
 
# 2016-08-25T18:15:42 Caching schema metadata for dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-25T18:15:43 Starting 32 processes, 20000000 queries each, duration 90000 seconds.
 
# 2016-08-25T18:15:43 GenTest::ErrorFilter(9326) started
 
# 2016-08-25T18:15:43 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:43 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:43 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:43 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:43 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:43 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:44 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:44 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:44 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:44 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:44 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:44 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:44 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:44 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:45 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:45 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:45 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:45 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:45 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:45 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:45 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:45 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:46 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:46 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:46 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:46 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:46 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:46 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:46 Started periodic reporting process...
 
# 2016-08-25T18:15:46 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:46 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:46 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-25T18:15:47 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:35:37 Query: SELECT * from custom_903 failed: 2013 Lost connection to MySQL server during query
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9335...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9344...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9334...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9351...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9372...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9340...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9349...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9375...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9355...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9338...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9330...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9363...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9332...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9353...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9361...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9333...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9331...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9328...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9365...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9345...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9379...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9369...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9380...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9357...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9342...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9359...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9329...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9336...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9377...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9348...
 
# 2016-08-26T08:35:37 Killing remaining worker process with pid 9367...
 
# 2016-08-26T08:35:38 Killing periodic reporting process with pid 9327...
 
# 2016-08-26T08:35:38 Kill GenTest::ErrorFilter(9326)
 
# 2016-08-26T08:35:38 Server crash reported, initiating post-crash analysis...
 
# 2016-08-26T08:35:38 The last 100 lines from /var/lib/mysql/error.log :
 
160826  8:35:36 [ERROR] mysqld got signal 11 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed,
 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.1.14-MariaDB
 
key_buffer_size=134217728
 
read_buffer_size=131072
 
max_used_connections=40
 
max_threads=1026
 
thread_count=33
 
It is possible that mysqld could use up to
 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 2384644 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0x7fd77c7f4008
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7fd78bbfdd30 thread_stack 0x40000
 
/usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x7fd7a46631be]
 
/usr/sbin/mysqld(handle_fatal_signal+0x38d)[0x7fd7a418ef0d]
 
/lib64/libpthread.so.0(+0xf100)[0x7fd7a37ad100]
 
/usr/sbin/mysqld(_Z18get_datetime_valueP3THDPPP4ItemS3_16enum_field_typesPb+0x36)[0x7fd7a41c1086]
 
/usr/sbin/mysqld(_ZN14Arg_comparator16compare_temporalE16enum_field_types+0x59)[0x7fd7a41c1439]
 
/usr/sbin/mysqld(_ZN12Item_func_ge7val_intEv+0x2a)[0x7fd7a41ba56a]
 
/usr/sbin/mysqld(_ZN4Item8val_boolEv+0x9c)[0x7fd7a419ff8c]
 
/usr/sbin/mysqld(_ZN14Item_func_case9find_itemEP6String+0x182)[0x7fd7a41c3b22]
 
/usr/sbin/mysqld(_ZN14Item_func_case6int_opEv+0x75)[0x7fd7a41c3c35]
 
/usr/sbin/mysqld(_ZN27Item_func_hybrid_field_type7val_intEv+0x154)[0x7fd7a41e9bf4]
 
/usr/sbin/mysqld(_ZN4Item13save_in_fieldEP5Fieldb+0x15c)[0x7fd7a419e6ac]
 
/usr/sbin/mysqld(_Z21update_virtual_fieldsP3THDP5TABLE21enum_vcol_update_mode+0x82)[0x7fd7a40bb652]
 
/usr/sbin/mysqld(_Z13rr_sequentialP11READ_RECORD+0x88)[0x7fd7a4296428]
 
/usr/sbin/mysqld(_Z10sub_selectP4JOINP13st_join_tableb+0x1fb)[0x7fd7a404772b]
 
/usr/sbin/mysqld(+0x4771dd)[0x7fd7a40551dd]
 
/usr/sbin/mysqld(_ZN4JOIN10exec_innerEv+0xb4c)[0x7fd7a406508c]
 
/usr/sbin/mysqld(_ZN4JOIN4execEv+0x54)[0x7fd7a4067084]
 
/usr/sbin/mysqld(_Z12mysql_selectP3THDPPP4ItemP10TABLE_LISTjR4ListIS1_ES2_jP8st_orderSB_S2_SB_yP13select_resultP18st_select_lex_unitP13st_select_lex+0x112)[0x7fd7a4063732]
 
/usr/sbin/mysqld(_Z13handle_selectP3THDP3LEXP13select_resultm+0x245)[0x7fd7a4064205]
 
/usr/sbin/mysqld(+0x428c91)[0x7fd7a4006c91]
 
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x5f8f)[0x7fd7a401289f]
 
/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x28e)[0x7fd7a401617e]
 
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x25db)[0x7fd7a401963b]
 
/usr/sbin/mysqld(_Z10do_commandP3THD+0x169)[0x7fd7a4019eb9]
 
/usr/sbin/mysqld(_Z24do_handle_one_connectionP3THD+0x18a)[0x7fd7a40dd62a]
 
/usr/sbin/mysqld(handle_one_connection+0x40)[0x7fd7a40dd800]
 
/lib64/libpthread.so.0(+0x7dc5)[0x7fd7a37a5dc5]
 
/lib64/libc.so.6(clone+0x6d)[0x7fd7a1bc8ced]
 
 
 
Trying to get some variables.
 
Some pointers may be invalid and cause the dump to abort.
 
Query (0x7fd772388020): SELECT * from custom_903
 
Connection ID (thread ID): 1128
 
Status: NOT_KILLED
 
 
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on
 
 
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
# 2016-08-26T08:35:38 datadir is /var/lib/mysql/
 
# 2016-08-26T08:35:38 binary is /usr/../usr/sbin/mysqld
 
# 2016-08-26T08:35:38 bindir is /usr/../usr/sbin
 
# 2016-08-26T08:35:38 WARNING: Core file not found!
 
"/usr/src/randgen" is not a core dump: Is a directory
 
backtrace.gdb:19: Error in sourced command file:
 
No stack.
 
# 2016-08-26T08:35:40
 
"/usr/src/randgen" is not a core dump: Is a directory
 
# 2016-08-26T08:35:41
 
# 2016-08-26T08:35:41 Test completed with failure status STATUS_SERVER_CRASHED (101)

Comment by Iliya Taushanov [ 2016-08-26 ]

Attached another crash details while running same gentest.

error.log:

pure virtual method called
 
terminate called without an active exception
 
160826  8:55:35 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.1.14-MariaDB
 
key_buffer_size=134217728
 
read_buffer_size=131072
 
max_used_connections=33
 
max_threads=1026
 
thread_count=33
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 2384644 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0x7f6be30e7008
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7f6c0d9a9d30 thread_stack 0x40000
 
/usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x7f6c13d241be]
 
/usr/sbin/mysqld(handle_fatal_signal+0x38d)[0x7f6c1384ff0d]
 
/lib64/libpthread.so.0(+0xf100)[0x7f6c12e6e100]
 
/lib64/libc.so.6(gsignal+0x37)[0x7f6c111c85f7]
 
/lib64/libc.so.6(abort+0x148)[0x7f6c111c9ce8]
 
/lib64/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x165)[0x7f6c118b79b5]
 
/lib64/libstdc++.so.6(+0x5e926)[0x7f6c118b5926]
 
/lib64/libstdc++.so.6(+0x5e953)[0x7f6c118b5953]
 
/lib64/libstdc++.so.6(+0x5f4bf)[0x7f6c118b64bf]
 
/usr/sbin/mysqld(_ZN4Item8val_boolEv+0x12)[0x7f6c13860f02]
 
/usr/sbin/mysqld(_Z18get_datetime_valueP3THDPPP4ItemS3_16enum_field_typesPb+0x3c)[0x7f6c1388208c]
 
/usr/sbin/mysqld(_ZN14Arg_comparator16compare_temporalE16enum_field_types+0x59)[0x7f6c13882439]
 
/usr/sbin/mysqld(_ZN12Item_func_ge7val_intEv+0x2a)[0x7f6c1387b56a]
 
/usr/sbin/mysqld(_ZN4Item8val_boolEv+0x9c)[0x7f6c13860f8c]
 
/usr/sbin/mysqld(_ZN14Item_func_case9find_itemEP6String+0x182)[0x7f6c13884b22]
 
/usr/sbin/mysqld(_ZN14Item_func_case6int_opEv+0x75)[0x7f6c13884c35]
 
/usr/sbin/mysqld(_ZN27Item_func_hybrid_field_type7val_intEv+0x154)[0x7f6c138aabf4]
 
/usr/sbin/mysqld(_ZN4Item13save_in_fieldEP5Fieldb+0x15c)[0x7f6c1385f6ac]
 
/usr/sbin/mysqld(_Z21update_virtual_fieldsP3THDP5TABLE21enum_vcol_update_mode+0x82)[0x7f6c1377c652]
 
/usr/sbin/mysqld(_Z13rr_sequentialP11READ_RECORD+0x88)[0x7f6c13957428]
 
/usr/sbin/mysqld(_Z10sub_selectP4JOINP13st_join_tableb+0x1fb)[0x7f6c1370872b]
 
/usr/sbin/mysqld(+0x4771dd)[0x7f6c137161dd]
 
/usr/sbin/mysqld(_ZN4JOIN10exec_innerEv+0xb4c)[0x7f6c1372608c]
 
/usr/sbin/mysqld(_ZN4JOIN4execEv+0x54)[0x7f6c13728084]
 
/usr/sbin/mysqld(_Z12mysql_selectP3THDPPP4ItemP10TABLE_LISTjR4ListIS1_ES2_jP8st_orderSB_S2_SB_yP13select_resultP18st_select_lex_unitP13st_select_lex+0x112)[0x7f6c13724732]
 
/usr/sbin/mysqld(_Z13handle_selectP3THDP3LEXP13select_resultm+0x245)[0x7f6c13725205]
 
/usr/sbin/mysqld(+0x428c91)[0x7f6c136c7c91]
 
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x5f8f)[0x7f6c136d389f]
 
/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x28e)[0x7f6c136d717e]
 
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x25db)[0x7f6c136da63b]
 
/usr/sbin/mysqld(_Z10do_commandP3THD+0x169)[0x7f6c136daeb9]
 
/usr/sbin/mysqld(_Z24do_handle_one_connectionP3THD+0x18a)[0x7f6c1379e62a]
 
/usr/sbin/mysqld(handle_one_connection+0x40)[0x7f6c1379e800]
 
/lib64/libpthread.so.0(+0x7dc5)[0x7f6c12e66dc5]
 
/lib64/libc.so.6(clone+0x6d)[0x7f6c11289ced]
 
 
 
Trying to get some variables.
 
Some pointers may be invalid and cause the dump to abort.
 
Query (0x7f6c0d58e020): SELECT * from custom_903
 
Connection ID (thread ID): 15
 
Status: NOT_KILLED
 
 
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on
 
 
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.

general_log.log:

160826  8:53:43	    7 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
		    6 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
160826  8:53:44	   20 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
160826  8:53:45	    8 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
160826  8:53:49	    7 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
		    6 Query	OPTIMIZE TABLE custom_903
 
		   23 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
160826  8:53:50	   20 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
160826  8:53:51	   34 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
160826  8:53:52	   10 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
160826  8:53:54	    6 Query	SELECT * from custom_903
 
160826  8:53:55	   14 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
160826  8:53:56	   15 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
160826  8:53:59	   34 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		    6 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
160826  8:54:00	   10 Query	SELECT * from custom_903
 
160826  8:54:01	   35 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
160826  8:54:05	   10 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
		    6 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
160826  8:54:06	   19 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
160826  8:54:07	   11 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
160826  8:54:11	    7 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		    6 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
160826  8:54:12	   24 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
160826  8:54:13	   37 Query	SELECT * from custom_903
 
160826  8:54:15	   38 Connect	cron@10.210.131.178 as anonymous on 
160826  8:54:16	   10 Query	SELECT * from custom_903
 
		    6 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
		   38 Query	SELECT CONNECTION_ID()
 
		   33 Query	SELECT * from custom_903
 
		   38 Query	SET NAMES utf8mb4
 
		   25 Query	SELECT * from custom_903
 
160826  8:54:17	   38 Query	SHOW STATUS
 
		   38 Query	SHOW VARIABLES
 
160826  8:54:18	   24 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		   38 Query	USE `asterisk`
 
160826  8:54:19	   38 Query	UPDATE `asterisk`.`custom_903` SET `ContactCompanyID`='oubuaberrg' WHERE  `lead_id`=8370140
 
160826  8:54:22	   10 Query	SELECT * from custom_903
 
		    6 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
160826  8:54:23	   38 Query	SELECT `lead_id`, `ContactCompanyID`, `ContactCompanyName`, `ContactAdd1`, `ContactAdd2`, `ContactAdd3`, `ContactAdd4`, `ContactTown`, `ContactCounty`, `ContactPostCode`, `ContactPAFBuildingNameNumber`, `ContactPAFStreet1`, `ContactPAFStreet2`, `ContactPAFLocality`, `ContactID`, `ContactTitle`, `ContactFName`, `ContactSName`, `ContactJobTitle`, `ContactJobRole`, `ContactEmail`, `ContactMobile`, `contactcomments`, `ContactLoadDateKey`, `ContactLoadSource`, `ContactSICsect`, `ContactSIC2`, `ContactSIC4`, `ContactThomsons`, `phonenum`, `OriginalloadID`, `DataSource`, `Sale`, `CurrentProvider`, `FutureInterest`, `HANDSET_MAKER`, `ACCOUNT_CONTACT`, `CUSTOMER_NUMBER`, `DECISION_MAKER`, `HOME_PHONE`, `WORK_PHONE`, `bill_day`, `SEGMENT`, `age`, `date_of_birth`, `spend`, `PACKAGE_PLAN`, `Add_ons`, `Payment_Method`, `HANDSET_TYPE`, `VF_TO_VF_MINS`, `MOB_MINS`, `LAND_MINS`, `INT_MINS`, `initial_switch_on_date`, `agreement_date`, `agreement_term`, `FS_CUSTOMER_NUMBER`, `FS_CUSTOMER_PARTY_ID`, `PRODUCT_CATEGORY`, `WINOVER_OPTOUT_STATUS`, `FS_CUSTOMER_NAME`, `FS_TRADING_NAME`, `FS_PRIMARY_ADDRESS_1`, `FS_PRIMARY_ADDRESS_2`, `FS_PRIMARY_ADDRESS_3`, `FS_PRIMARY_CITY`, `FS_PRIMARY_COUNTY_DESC`, `FS_PRIMARY_PHONE_NUMBER`, `FS_PRIMARY_MOBILE_NUMBER`, `MOBILE_CONTACT_IND`, `FS_CALLING_LINE_ID`, `FS_ALLOW_MARKETING_DESC`, `FS_PRODUCT_GROUP_DESC`, `FS_PRODUCT_SEGMENT_DESC`, `START_DATE`, `CONTRACT_END_DATE`, `DAYS_LEFT_IN_CONTRACT`, `PROV_ORDERS_IN_PROG`, `CANCEL_ORDERS_IN_PROG`, `SUM_SVOC_POST`, `SUM_SVOC_PRE`, `SUM_SVOC_MBB`, `SUM_SVOH_POST`, `SUM_SVOH_PRE`, `SUM_SVOH_MBB`, `AVG_OOC_CHARGES`, `AVG_PMC_CHARGES`, `AVG_RMC_CHARGES`, `AVG_UMC_CHARGES`, `AVGERAGE_BILL`, `NATIONAL_CALLS`, `NATIONAL_MINS`, `NATIONAL_SPEND`, `VF_MOBILE_CALLS`, `VF_MOBILE_MINS`, `VF_MOBILE_SPEND`, `OTHER_MOB_CALLS`, `OTHER_MOB_MINS`, `OTHER_MOB_SPEND`, `UK_CALLS`, `UK_MINS`, `UK_SPEND`, `OTHER_INT_CALLS`, `OTHER_INT_MINS`, `OTHER_INT_SPEND`, `OTHER_CALLS`, `OTHER_MINS`, `OTHER_SPEND`, `COUNTY_DESC`, `VestaLead`, `Result`, `SPEED_ORG`, `SPEED_Mb`, `ProjectName`, `SaleType`, `PreRate`, `DaysSinceLoaded`, `IntlAddonAsia`, `IntlAddonAfrica`, `RepeatCallReason`, `NotInterestedReason`, `LandlineNumber`, `SourceURL`, `LineCheckStatus`, `CurrentSupplier`, `ReturnCall`, `FutureInterestDate`, `Batch`, `DNIS`, `Offer_Code`, `tollFreeGiven`, `TMOptOut`, `CustomerContact2`, `ConfirmationReq`, `ConfirmationMethod`, `OptOutType`, `TVProvider`, `uploaded`, `SUBSCRIBER_NUMBER_ID`, `user_name`, `telephone`, `address_1`, `address_2`, `address_3`, `address_4`, `lu_disconnection_reason`, `termination_date`, `campaign_date`, `treatment_code`, `Email_Address`, `Random_ID`, `CustomerOptOut`, `CustomerOptOutDate`, `Data_1`, `Madcalm_Comments`, `NotInMadcalm`, `OptOutAgent`, `VestaContactTitle`, `VestaContactFName`, `VestaContactSName`, `VestaPhoneNum`, `VestaReason`, `TitanCLI`, `TitanNotes`, `Data_5`, `VF_Band`, `IC_Predict_Deciles_Control`, `IC_Predict_Deciles_Actual`, `IC_Predict_Deciles_Dialler`, `IC_Predict_Band_Actual`, `IC_Predict_Band_Dialler`, `DialDate`, `DialDue` FROM `asterisk`.`custom_903` WHERE  `lead_id`=8370140
 
		    9 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
160826  8:54:24	   18 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   38 Query	SHOW TABLE STATUS LIKE 'custom_903'
 
		   38 Query	SHOW CREATE TABLE `asterisk`.`custom_903`
 
160826  8:54:27	   38 Query	SHOW COLLATION
 
		   38 Query	SHOW ENGINES
 
160826  8:54:28	   34 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		   38 Query	UPDATE `asterisk`.`custom_903` SET `ContactCompanyID`='jjuydfgfou' WHERE  `lead_id`=8370139
 
		    6 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
160826  8:54:29	    8 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
160826  8:54:31	   34 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
160826  8:54:34	   11 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
160826  8:54:35	   33 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		    6 Query	OPTIMIZE TABLE custom_903
 
		   20 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
160826  8:54:36	   34 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
160826  8:54:38	   38 Query	UPDATE `asterisk`.`custom_903` SET `ContactCompanyID`='jjuydfgyrfou' WHERE  `lead_id`=8370139
 
		   15 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
160826  8:54:40	   13 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
160826  8:54:41	    6 Query	OPTIMIZE TABLE custom_903
 
160826  8:54:42	   38 Query	UPDATE `asterisk`.`custom_903` SET `ContactCompanyID`='jjuydfgyrfou' WHERE  `lead_id`=8370139
 
160826  8:54:46	   36 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		   38 Query	UPDATE `asterisk`.`custom_903` SET `ContactCompanyID`='jjuydfgyrfou' WHERE  `lead_id`=8370139
 
		   20 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		    6 Query	SELECT * from custom_903
 
160826  8:54:49	   38 Query	UPDATE `asterisk`.`custom_903` SET `ContactCompanyID`='jjuydfgyrfou' WHERE  `lead_id`=8370139
 
160826  8:54:50	   10 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
160826  8:54:52	    8 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
160826  8:54:53	   19 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
		    6 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
160826  8:54:55	   38 Query	UPDATE `asterisk`.`custom_903` SET `ContactCompanyID`='jjuydfgyrfou' WHERE  `lead_id`=8370139
 
160826  8:54:56	   29 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
160826  8:54:57	   37 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
160826  8:54:58	    9 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
160826  8:54:59	   20 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		    6 Query	SELECT * from custom_903
 
		   38 Query	SELECT  `lead_id`,  `ContactCompanyID`,  `ContactCompanyName`,  `ContactAdd1`,  `ContactAdd2`,  `ContactAdd3`,  `ContactAdd4`,  `ContactTown`,  `ContactCounty`,  `ContactPostCode`,  `ContactPAFBuildingNameNumber`,  `ContactPAFStreet1`,  `ContactPAFStreet2`,  `ContactPAFLocality`,  `ContactID`,  `ContactTitle`,  `ContactFName`,  `ContactSName`,  `ContactJobTitle`,  `ContactJobRole`,  `ContactEmail`,  `ContactMobile`,  LEFT(`contactcomments`, 256),  `ContactLoadDateKey`,  `ContactLoadSource`,  `ContactSICsect`,  `ContactSIC2`,  `ContactSIC4`,  `ContactThomsons`,  `phonenum`,  `OriginalloadID`,  `DataSource`,  `Sale`,  `CurrentProvider`,  `FutureInterest`,  `HANDSET_MAKER`,  `ACCOUNT_CONTACT`,  `CUSTOMER_NUMBER`,  `DECISION_MAKER`,  `HOME_PHONE`,  `WORK_PHONE`,  `bill_day`,  `SEGMENT`,  `age`,  `date_of_birth`,  `spend`,  `PACKAGE_PLAN`,  `Add_ons`,  `Payment_Method`,  `HANDSET_TYPE`,  `VF_TO_VF_MINS`,  `MOB_MINS`,  `LAND_MINS`,  `INT_MINS`,  `initial_switch_on_date`,  `agreement_date`,  `agreement_term`,  `FS_CUSTOMER_NUMBER`,  `FS_CUSTOMER_PARTY_ID`,  `PRODUCT_CATEGORY`,  `WINOVER_OPTOUT_STATUS`,  `FS_CUSTOMER_NAME`,  `FS_TRADING_NAME`,  `FS_PRIMARY_ADDRESS_1`,  `FS_PRIMARY_ADDRESS_2`,  `FS_PRIMARY_ADDRESS_3`,  `FS_PRIMARY_CITY`,  `FS_PRIMARY_COUNTY_DESC`,  `FS_PRIMARY_PHONE_NUMBER`,  `FS_PRIMARY_MOBILE_NUMBER`,  `MOBILE_CONTACT_IND`,  `FS_CALLING_LINE_ID`,  `FS_ALLOW_MARKETING_DESC`,  `FS_PRODUCT_GROUP_DESC`,  `FS_PRODUCT_SEGMENT_DESC`,  `START_DATE`,  `CONTRACT_END_DATE`,  `DAYS_LEFT_IN_CONTRACT`,  `PROV_ORDERS_IN_PROG`,  `CANCEL_ORDERS_IN_PROG`,  `SUM_SVOC_POST`,  `SUM_SVOC_PRE`,  `SUM_SVOC_MBB`,  `SUM_SVOH_POST`,  `SUM_SVOH_PRE`,  `SUM_SVOH_MBB`,  `AVG_OOC_CHARGES`,  `AVG_PMC_CHARGES`,  `AVG_RMC_CHARGES`,  `AVG_UMC_CHARGES`,  `AVGERAGE_BILL`,  `NATIONAL_CALLS`,  `NATIONAL_MINS`,  `NATIONAL_SPEND`,  `VF_MOBILE_CALLS`,  `VF_MOBILE_MINS`,  `VF_MOBILE_SPEND`,  `OTHER_MOB_CALLS`,  `OTHER_MOB_MINS`,  `OTHER_MOB_SPEND`,  `UK_CALLS`,  `UK_MINS`,  `UK_SPEND`,  `OTHER_INT_CALLS`,  `OTHER_INT_MINS`,  `OTHER_INT_SPEND`,  `OTHER_CALLS`,  `OTHER_MINS`,  `OTHER_SPEND`,  `COUNTY_DESC`,  `VestaLead`,  `Result`,  `SPEED_ORG`,  `SPEED_Mb`,  `ProjectName`,  `SaleType`,  `PreRate`,  `DaysSinceLoaded`,  `IntlAddonAsia`,  `IntlAddonAfrica`,  `RepeatCallReason`,  `NotInterestedReason`,  `LandlineNumber`,  `SourceURL`,  `LineCheckStatus`,  `CurrentSupplier`,  `ReturnCall`,  `FutureInterestDate`,  `Batch`,  `DNIS`,  `Offer_Code`,  `tollFreeGiven`,  `TMOptOut`,  `CustomerContact2`,  `ConfirmationReq`,  `ConfirmationMethod`,  `OptOutType`,  `TVProvider`,  `uploaded`,  `SUBSCRIBER_NUMBER_ID`,  `user_name`,  `telephone`,  `address_1`,  `address_2`,  `address_3`,  `address_4`,  `lu_disconnection_reason`,  `termination_date`,  `campaign_date`,  `treatment_code`,  `Email_Address`,  `Random_ID`,  `CustomerOptOut`,  `CustomerOptOutDate`,  `Data_1`,  LEFT(`Madcalm_Comments`, 256),  `NotInMadcalm`,  `OptOutAgent`,  `VestaContactTitle`,  `VestaContactFName`,  `VestaContactSName`,  `VestaPhoneNum`,  `VestaReason`,  `TitanCLI`,  LEFT(`TitanNotes`, 256),  `Data_5`,  `VF_Band`,  `IC_Predict_Deciles_Control`,  `IC_Predict_Deciles_Actual`,  `IC_Predict_Deciles_Dialler`,  `IC_Predict_Band_Actual`,  `IC_Predict_Band_Dialler`,  `DialDate`,  `DialDue` FROM `asterisk`.`custom_903` LIMIT 1000
 
		   22 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
160826  8:55:03	   30 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
160826  8:55:04	   38 Query	SHOW CREATE TABLE `asterisk`.`custom_903`
 
		   17 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
160826  8:55:05	    6 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   38 Query	SHOW TABLE STATUS LIKE 'custom_903'
 
160826  8:55:08	   24 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
160826  8:55:09	    8 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
160826  8:55:10	   17 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		    6 Query	FLUSH TABLES
 
		   22 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
		   14 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
160826  8:55:12	   38 Query	UPDATE `asterisk`.`custom_903` SET `ContactCompanyID`='dftgh' WHERE  `lead_id`=8370142
 
160826  8:55:13	   33 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		    6 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
160826  8:55:14	   21 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   38 Query	SELECT `lead_id`, `ContactCompanyID`, `ContactCompanyName`, `ContactAdd1`, `ContactAdd2`, `ContactAdd3`, `ContactAdd4`, `ContactTown`, `ContactCounty`, `ContactPostCode`, `ContactPAFBuildingNameNumber`, `ContactPAFStreet1`, `ContactPAFStreet2`, `ContactPAFLocality`, `ContactID`, `ContactTitle`, `ContactFName`, `ContactSName`, `ContactJobTitle`, `ContactJobRole`, `ContactEmail`, `ContactMobile`, `contactcomments`, `ContactLoadDateKey`, `ContactLoadSource`, `ContactSICsect`, `ContactSIC2`, `ContactSIC4`, `ContactThomsons`, `phonenum`, `OriginalloadID`, `DataSource`, `Sale`, `CurrentProvider`, `FutureInterest`, `HANDSET_MAKER`, `ACCOUNT_CONTACT`, `CUSTOMER_NUMBER`, `DECISION_MAKER`, `HOME_PHONE`, `WORK_PHONE`, `bill_day`, `SEGMENT`, `age`, `date_of_birth`, `spend`, `PACKAGE_PLAN`, `Add_ons`, `Payment_Method`, `HANDSET_TYPE`, `VF_TO_VF_MINS`, `MOB_MINS`, `LAND_MINS`, `INT_MINS`, `initial_switch_on_date`, `agreement_date`, `agreement_term`, `FS_CUSTOMER_NUMBER`, `FS_CUSTOMER_PARTY_ID`, `PRODUCT_CATEGORY`, `WINOVER_OPTOUT_STATUS`, `FS_CUSTOMER_NAME`, `FS_TRADING_NAME`, `FS_PRIMARY_ADDRESS_1`, `FS_PRIMARY_ADDRESS_2`, `FS_PRIMARY_ADDRESS_3`, `FS_PRIMARY_CITY`, `FS_PRIMARY_COUNTY_DESC`, `FS_PRIMARY_PHONE_NUMBER`, `FS_PRIMARY_MOBILE_NUMBER`, `MOBILE_CONTACT_IND`, `FS_CALLING_LINE_ID`, `FS_ALLOW_MARKETING_DESC`, `FS_PRODUCT_GROUP_DESC`, `FS_PRODUCT_SEGMENT_DESC`, `START_DATE`, `CONTRACT_END_DATE`, `DAYS_LEFT_IN_CONTRACT`, `PROV_ORDERS_IN_PROG`, `CANCEL_ORDERS_IN_PROG`, `SUM_SVOC_POST`, `SUM_SVOC_PRE`, `SUM_SVOC_MBB`, `SUM_SVOH_POST`, `SUM_SVOH_PRE`, `SUM_SVOH_MBB`, `AVG_OOC_CHARGES`, `AVG_PMC_CHARGES`, `AVG_RMC_CHARGES`, `AVG_UMC_CHARGES`, `AVGERAGE_BILL`, `NATIONAL_CALLS`, `NATIONAL_MINS`, `NATIONAL_SPEND`, `VF_MOBILE_CALLS`, `VF_MOBILE_MINS`, `VF_MOBILE_SPEND`, `OTHER_MOB_CALLS`, `OTHER_MOB_MINS`, `OTHER_MOB_SPEND`, `UK_CALLS`, `UK_MINS`, `UK_SPEND`, `OTHER_INT_CALLS`, `OTHER_INT_MINS`, `OTHER_INT_SPEND`, `OTHER_CALLS`, `OTHER_MINS`, `OTHER_SPEND`, `COUNTY_DESC`, `VestaLead`, `Result`, `SPEED_ORG`, `SPEED_Mb`, `ProjectName`, `SaleType`, `PreRate`, `DaysSinceLoaded`, `IntlAddonAsia`, `IntlAddonAfrica`, `RepeatCallReason`, `NotInterestedReason`, `LandlineNumber`, `SourceURL`, `LineCheckStatus`, `CurrentSupplier`, `ReturnCall`, `FutureInterestDate`, `Batch`, `DNIS`, `Offer_Code`, `tollFreeGiven`, `TMOptOut`, `CustomerContact2`, `ConfirmationReq`, `ConfirmationMethod`, `OptOutType`, `TVProvider`, `uploaded`, `SUBSCRIBER_NUMBER_ID`, `user_name`, `telephone`, `address_1`, `address_2`, `address_3`, `address_4`, `lu_disconnection_reason`, `termination_date`, `campaign_date`, `treatment_code`, `Email_Address`, `Random_ID`, `CustomerOptOut`, `CustomerOptOutDate`, `Data_1`, `Madcalm_Comments`, `NotInMadcalm`, `OptOutAgent`, `VestaContactTitle`, `VestaContactFName`, `VestaContactSName`, `VestaPhoneNum`, `VestaReason`, `TitanCLI`, `TitanNotes`, `Data_5`, `VF_Band`, `IC_Predict_Deciles_Control`, `IC_Predict_Deciles_Actual`, `IC_Predict_Deciles_Dialler`, `IC_Predict_Band_Actual`, `IC_Predict_Band_Dialler`, `DialDate`, `DialDue` FROM `asterisk`.`custom_903` WHERE  `lead_id`=8370142
 
		   38 Query	SHOW TABLE STATUS LIKE 'custom_903'
 
160826  8:55:16	   14 Query	SELECT * from custom_903
 
160826  8:55:19	   22 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		    6 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
160826  8:55:20	   21 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
160826  8:55:22	   14 Query	SELECT * from custom_903
 
160826  8:55:25	   17 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		    6 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   21 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   18 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   15 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
160826  8:55:27	   14 Query	SELECT * from custom_903
 
		   38 Query	UPDATE `asterisk`.`custom_903` SET `ContactCompanyID`='sgfnsrthwrt' WHERE  `lead_id`=8370144
 
160826  8:55:30	   21 Query	SELECT * from custom_903
 
160826  8:55:31	   18 Query	SELECT * from custom_903
 
		   23 Query	SELECT * from custom_903
 
		   10 Query	SELECT * from custom_903
 
		    9 Query	SELECT * from custom_903
 
		   28 Query	SELECT * from custom_903
 
		   19 Query	SELECT * from custom_903
 
		   13 Query	SELECT * from custom_903
 
		   24 Query	SELECT * from custom_903
 
		   11 Query	SELECT * from custom_903
 
		   12 Query	SELECT * from custom_903
 
		   27 Query	SELECT * from custom_903
 
		    7 Query	SELECT * from custom_903
 
		    6 Query	SELECT * from custom_903
 
		   31 Query	SELECT * from custom_903
 
		    8 Query	SELECT * from custom_903
 
		   17 Query	SELECT * from custom_903
 
		   20 Query	SELECT * from custom_903
 
		   35 Query	SELECT * from custom_903
 
		   32 Query	SELECT * from custom_903
 
		   33 Query	SELECT * from custom_903
 
		   22 Query	SELECT * from custom_903
 
		   36 Query	SELECT * from custom_903
 
		   25 Query	SELECT * from custom_903
 
		   37 Query	SELECT * from custom_903
 
		   30 Query	SELECT * from custom_903
 
		   34 Query	SELECT * from custom_903
 
		   29 Query	SELECT * from custom_903
 
		   38 Query	SELECT `lead_id`, `ContactCompanyID`, `ContactCompanyName`, `ContactAdd1`, `ContactAdd2`, `ContactAdd3`, `ContactAdd4`, `ContactTown`, `ContactCounty`, `ContactPostCode`, `ContactPAFBuildingNameNumber`, `ContactPAFStreet1`, `ContactPAFStreet2`, `ContactPAFLocality`, `ContactID`, `ContactTitle`, `ContactFName`, `ContactSName`, `ContactJobTitle`, `ContactJobRole`, `ContactEmail`, `ContactMobile`, `contactcomments`, `ContactLoadDateKey`, `ContactLoadSource`, `ContactSICsect`, `ContactSIC2`, `ContactSIC4`, `ContactThomsons`, `phonenum`, `OriginalloadID`, `DataSource`, `Sale`, `CurrentProvider`, `FutureInterest`, `HANDSET_MAKER`, `ACCOUNT_CONTACT`, `CUSTOMER_NUMBER`, `DECISION_MAKER`, `HOME_PHONE`, `WORK_PHONE`, `bill_day`, `SEGMENT`, `age`, `date_of_birth`, `spend`, `PACKAGE_PLAN`, `Add_ons`, `Payment_Method`, `HANDSET_TYPE`, `VF_TO_VF_MINS`, `MOB_MINS`, `LAND_MINS`, `INT_MINS`, `initial_switch_on_date`, `agreement_date`, `agreement_term`, `FS_CUSTOMER_NUMBER`, `FS_CUSTOMER_PARTY_ID`, `PRODUCT_CATEGORY`, `WINOVER_OPTOUT_STATUS`, `FS_CUSTOMER_NAME`, `FS_TRADING_NAME`, `FS_PRIMARY_ADDRESS_1`, `FS_PRIMARY_ADDRESS_2`, `FS_PRIMARY_ADDRESS_3`, `FS_PRIMARY_CITY`, `FS_PRIMARY_COUNTY_DESC`, `FS_PRIMARY_PHONE_NUMBER`, `FS_PRIMARY_MOBILE_NUMBER`, `MOBILE_CONTACT_IND`, `FS_CALLING_LINE_ID`, `FS_ALLOW_MARKETING_DESC`, `FS_PRODUCT_GROUP_DESC`, `FS_PRODUCT_SEGMENT_DESC`, `START_DATE`, `CONTRACT_END_DATE`, `DAYS_LEFT_IN_CONTRACT`, `PROV_ORDERS_IN_PROG`, `CANCEL_ORDERS_IN_PROG`, `SUM_SVOC_POST`, `SUM_SVOC_PRE`, `SUM_SVOC_MBB`, `SUM_SVOH_POST`, `SUM_SVOH_PRE`, `SUM_SVOH_MBB`, `AVG_OOC_CHARGES`, `AVG_PMC_CHARGES`, `AVG_RMC_CHARGES`, `AVG_UMC_CHARGES`, `AVGERAGE_BILL`, `NATIONAL_CALLS`, `NATIONAL_MINS`, `NATIONAL_SPEND`, `VF_MOBILE_CALLS`, `VF_MOBILE_MINS`, `VF_MOBILE_SPEND`, `OTHER_MOB_CALLS`, `OTHER_MOB_MINS`, `OTHER_MOB_SPEND`, `UK_CALLS`, `UK_MINS`, `UK_SPEND`, `OTHER_INT_CALLS`, `OTHER_INT_MINS`, `OTHER_INT_SPEND`, `OTHER_CALLS`, `OTHER_MINS`, `OTHER_SPEND`, `COUNTY_DESC`, `VestaLead`, `Result`, `SPEED_ORG`, `SPEED_Mb`, `ProjectName`, `SaleType`, `PreRate`, `DaysSinceLoaded`, `IntlAddonAsia`, `IntlAddonAfrica`, `RepeatCallReason`, `NotInterestedReason`, `LandlineNumber`, `SourceURL`, `LineCheckStatus`, `CurrentSupplier`, `ReturnCall`, `FutureInterestDate`, `Batch`, `DNIS`, `Offer_Code`, `tollFreeGiven`, `TMOptOut`, `CustomerContact2`, `ConfirmationReq`, `ConfirmationMethod`, `OptOutType`, `TVProvider`, `uploaded`, `SUBSCRIBER_NUMBER_ID`, `user_name`, `telephone`, `address_1`, `address_2`, `address_3`, `address_4`, `lu_disconnection_reason`, `termination_date`, `campaign_date`, `treatment_code`, `Email_Address`, `Random_ID`, `CustomerOptOut`, `CustomerOptOutDate`, `Data_1`, `Madcalm_Comments`, `NotInMadcalm`, `OptOutAgent`, `VestaContactTitle`, `VestaContactFName`, `VestaContactSName`, `VestaPhoneNum`, `VestaReason`, `TitanCLI`, `TitanNotes`, `Data_5`, `VF_Band`, `IC_Predict_Deciles_Control`, `IC_Predict_Deciles_Actual`, `IC_Predict_Deciles_Dialler`, `IC_Predict_Band_Actual`, `IC_Predict_Band_Dialler`, `DialDate`, `DialDue` FROM `asterisk`.`custom_903` WHERE  `lead_id`=8370144
 
		   15 Query	SELECT * from custom_903
 
		   26 Query	SELECT * from custom_903
 
		   16 Query	SELECT * from custom_903
 
		   38 Query	SHOW TABLE STATUS LIKE 'custom_903'
 
160826  8:55:32	   14 Query	SELECT * from custom_903
 
160826  8:55:35	   38 Query	UPDATE `asterisk`.`custom_903` SET `ContactCompanyID`='sfwerbqer' WHERE  `lead_id`=8370145


[root@deviliya randgen]# perl ./gentest.pl --dsn="dbi:mysql:user=root:host=localhost:port=3306:database=asterisk" --grammar=custom903.yy --threads=32 --duration=90000 --queries=20M
 
# 2016-08-26T08:52:51 Starting: ./gentest.pl --dsn=dbi:mysql:user=root:host=localhost:port=3306:database=asterisk --grammar=custom903.yy --threads=32 --duration=90000 --queries=20M
 
# 2016-08-26T08:52:51 -------------------------------
 
# 2016-08-26T08:52:51 Configuration
 
# 2016-08-26T08:52:51   debug_server => ['']
 
# 2016-08-26T08:52:51   dsn => ['dbi:mysql:user=root:host=localhost:port=3306:database=asterisk']
 
# 2016-08-26T08:52:51   duration => 90000
 
# 2016-08-26T08:52:51   generator => FromGrammar
 
# 2016-08-26T08:52:51   grammar => custom903.yy
 
# 2016-08-26T08:52:51   queries => 20000000
 
# 2016-08-26T08:52:51   reporters => ['']
 
# 2016-08-26T08:52:51   seed => 1
 
# 2016-08-26T08:52:51   threads => 32
 
# 2016-08-26T08:52:51   transformers => ['']
 
# 2016-08-26T08:52:51   validators => ['']
 
# 2016-08-26T08:52:51   views => ['', '']
 
# 2016-08-26T08:52:51 Reporters: ErrorLog, Backtrace
 
# 2016-08-26T08:52:56 Validators: ErrorMessageCorruption
 
# 2016-08-26T08:52:56 Caching schema metadata for dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:52:56 Starting 32 processes, 20000000 queries each, duration 90000 seconds.
 
# 2016-08-26T08:52:56 GenTest::ErrorFilter(10811) started
 
# 2016-08-26T08:52:56 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:52:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:53:00 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:53:00 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:53:00 Started periodic reporting process...
 
# 2016-08-26T08:53:00 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:53:00 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:53:00 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:53:01 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T08:55:36 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10813...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10873...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10836...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10853...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10865...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10859...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10861...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10842...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10837...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10869...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10849...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10820...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10840...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10824...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10818...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10834...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10845...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10826...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10830...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10828...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10843...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10822...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10863...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10847...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10855...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10866...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10832...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10814...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10857...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10816...
 
# 2016-08-26T08:55:36 Killing remaining worker process with pid 10851...
 
# 2016-08-26T08:55:37 Killing periodic reporting process with pid 10812...
 
# 2016-08-26T08:55:38 Kill GenTest::ErrorFilter(10811)
 
# 2016-08-26T08:55:38 Server crash reported, initiating post-crash analysis...
 
# 2016-08-26T08:55:38 The last 100 lines from /var/lib/mysql/error.log :
 
pure virtual method called
 
terminate called without an active exception
 
160826  8:55:35 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed,
 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.1.14-MariaDB
 
key_buffer_size=134217728
 
read_buffer_size=131072
 
max_used_connections=33
 
max_threads=1026
 
thread_count=33
 
It is possible that mysqld could use up to
 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 2384644 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0x7f6be30e7008
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7f6c0d9a9d30 thread_stack 0x40000
 
/usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x7f6c13d241be]
 
/usr/sbin/mysqld(handle_fatal_signal+0x38d)[0x7f6c1384ff0d]
 
/lib64/libpthread.so.0(+0xf100)[0x7f6c12e6e100]
 
/lib64/libc.so.6(gsignal+0x37)[0x7f6c111c85f7]
 
/lib64/libc.so.6(abort+0x148)[0x7f6c111c9ce8]
 
/lib64/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x165)[0x7f6c118b79b5]
 
/lib64/libstdc++.so.6(+0x5e926)[0x7f6c118b5926]
 
/lib64/libstdc++.so.6(+0x5e953)[0x7f6c118b5953]
 
/lib64/libstdc++.so.6(+0x5f4bf)[0x7f6c118b64bf]
 
/usr/sbin/mysqld(_ZN4Item8val_boolEv+0x12)[0x7f6c13860f02]
 
/usr/sbin/mysqld(_Z18get_datetime_valueP3THDPPP4ItemS3_16enum_field_typesPb+0x3c)[0x7f6c1388208c]
 
/usr/sbin/mysqld(_ZN14Arg_comparator16compare_temporalE16enum_field_types+0x59)[0x7f6c13882439]
 
/usr/sbin/mysqld(_ZN12Item_func_ge7val_intEv+0x2a)[0x7f6c1387b56a]
 
/usr/sbin/mysqld(_ZN4Item8val_boolEv+0x9c)[0x7f6c13860f8c]
 
/usr/sbin/mysqld(_ZN14Item_func_case9find_itemEP6String+0x182)[0x7f6c13884b22]
 
/usr/sbin/mysqld(_ZN14Item_func_case6int_opEv+0x75)[0x7f6c13884c35]
 
/usr/sbin/mysqld(_ZN27Item_func_hybrid_field_type7val_intEv+0x154)[0x7f6c138aabf4]
 
/usr/sbin/mysqld(_ZN4Item13save_in_fieldEP5Fieldb+0x15c)[0x7f6c1385f6ac]
 
/usr/sbin/mysqld(_Z21update_virtual_fieldsP3THDP5TABLE21enum_vcol_update_mode+0x82)[0x7f6c1377c652]
 
/usr/sbin/mysqld(_Z13rr_sequentialP11READ_RECORD+0x88)[0x7f6c13957428]
 
/usr/sbin/mysqld(_Z10sub_selectP4JOINP13st_join_tableb+0x1fb)[0x7f6c1370872b]
 
/usr/sbin/mysqld(+0x4771dd)[0x7f6c137161dd]
 
/usr/sbin/mysqld(_ZN4JOIN10exec_innerEv+0xb4c)[0x7f6c1372608c]
 
/usr/sbin/mysqld(_ZN4JOIN4execEv+0x54)[0x7f6c13728084]
 
/usr/sbin/mysqld(_Z12mysql_selectP3THDPPP4ItemP10TABLE_LISTjR4ListIS1_ES2_jP8st_orderSB_S2_SB_yP13select_resultP18st_select_lex_unitP13st_select_lex+0x112)[0x7f6c13724732]
 
/usr/sbin/mysqld(_Z13handle_selectP3THDP3LEXP13select_resultm+0x245)[0x7f6c13725205]
 
/usr/sbin/mysqld(+0x428c91)[0x7f6c136c7c91]
 
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x5f8f)[0x7f6c136d389f]
 
/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x28e)[0x7f6c136d717e]
 
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x25db)[0x7f6c136da63b]
 
/usr/sbin/mysqld(_Z10do_commandP3THD+0x169)[0x7f6c136daeb9]
 
/usr/sbin/mysqld(_Z24do_handle_one_connectionP3THD+0x18a)[0x7f6c1379e62a]
 
/usr/sbin/mysqld(handle_one_connection+0x40)[0x7f6c1379e800]
 
/lib64/libpthread.so.0(+0x7dc5)[0x7f6c12e66dc5]
 
/lib64/libc.so.6(clone+0x6d)[0x7f6c11289ced]
 
 
 
Trying to get some variables.
 
Some pointers may be invalid and cause the dump to abort.
 
Query (0x7f6c0d58e020): SELECT * from custom_903
 
Connection ID (thread ID): 15
 
Status: NOT_KILLED
 
 
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on
 
 
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
# 2016-08-26T08:55:38 datadir is /var/lib/mysql/
 
# 2016-08-26T08:55:38 binary is /usr/../usr/sbin/mysqld
 
# 2016-08-26T08:55:38 bindir is /usr/../usr/sbin
 
# 2016-08-26T08:55:38 WARNING: Core file not found!
 
"/usr/src/randgen" is not a core dump: Is a directory
 
backtrace.gdb:19: Error in sourced command file:
 
No stack.
 
# 2016-08-26T08:55:39
 
"/usr/src/randgen" is not a core dump: Is a directory
 
# 2016-08-26T08:55:40
 
# 2016-08-26T08:55:40 Test completed with failure status STATUS_SERVER_CRASHED (101)

/var/log/messages:

...
 
Aug 26 08:26:08 deviliya systemd: Starting Session 9239 of user root.
 
Aug 26 08:35:37 deviliya systemd: mariadb.service: main process exited, code=exited, status=1/FAILURE
 
Aug 26 08:35:37 deviliya systemd: Unit mariadb.service entered failed state.
 
Aug 26 08:35:37 deviliya systemd: mariadb.service failed.
 
Aug 26 08:52:13 deviliya systemd: Starting MariaDB database server...
 
Aug 26 08:52:13 deviliya mysqld: 2016-08-26  8:52:13 140102154565760 [Note] /usr/sbin/mysqld (mysqld 10.1.14-MariaDB) starting as process 10776 ...
 
Aug 26 08:52:13 deviliya mysqld: 2016-08-26  8:52:13 140102154565760 [Warning] Could not increase number of max_open_files to more than 16364 (request: 17219)
 
Aug 26 08:52:14 deviliya systemd: Started MariaDB database server.
 
Aug 26 08:55:35 deviliya systemd: mariadb.service: main process exited, code=exited, status=1/FAILURE
 
Aug 26 08:55:35 deviliya systemd: Unit mariadb.service entered failed state.
 
Aug 26 08:55:36 deviliya systemd: mariadb.service failed.

Comment by Iliya Taushanov [ 2016-08-26 ]

Updated the development server to MariaDB 10.1.16, it's crashing too. error.log my.cnf queries.log 

[root@deviliya randgen]# perl ./gentest.pl --dsn="dbi:mysql:user=root:host=localhost:port=3306:database=asterisk" --grammar=custom903.yy --threads=32 --duration=90000 --queries=20M
 
# 2016-08-26T10:12:50 Starting: ./gentest.pl --dsn=dbi:mysql:user=root:host=localhost:port=3306:database=asterisk --grammar=custom903.yy --threads=32 --duration=90000 --queries=20M
 
# 2016-08-26T10:12:50 -------------------------------
 
# 2016-08-26T10:12:50 Configuration
 
# 2016-08-26T10:12:50   debug_server => ['']
 
# 2016-08-26T10:12:50   dsn => ['dbi:mysql:user=root:host=localhost:port=3306:database=asterisk']
 
# 2016-08-26T10:12:50   duration => 90000
 
# 2016-08-26T10:12:50   generator => FromGrammar
 
# 2016-08-26T10:12:50   grammar => custom903.yy
 
# 2016-08-26T10:12:50   queries => 20000000
 
# 2016-08-26T10:12:50   reporters => ['']
 
# 2016-08-26T10:12:50   seed => 1
 
# 2016-08-26T10:12:50   threads => 32
 
# 2016-08-26T10:12:50   transformers => ['']
 
# 2016-08-26T10:12:50   validators => ['']
 
# 2016-08-26T10:12:50   views => ['', '']
 
# 2016-08-26T10:12:50 Reporters: ErrorLog, Backtrace
 
# 2016-08-26T10:12:55 Validators: ErrorMessageCorruption
 
# 2016-08-26T10:12:55 Caching schema metadata for dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:12:56 Starting 32 processes, 20000000 queries each, duration 90000 seconds.
 
# 2016-08-26T10:12:56 GenTest::ErrorFilter(11223) started
 
# 2016-08-26T10:12:56 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:56 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:56 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:56 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:56 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:56 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:57 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:58 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:59 Started periodic reporting process...
 
# 2016-08-26T10:12:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:12:59 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:13:00 Loading Validator GenTest::Validator::ErrorMessageCorruption.
 
# 2016-08-26T10:14:22 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:22 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:22 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:22 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:22 Query: SELECT * from custom_903 failed: 2013 Lost connection to MySQL server during query
 
# 2016-08-26T10:14:22 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:22 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:22 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:22 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:22 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:22 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:22 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:22 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:22 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:22 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:22 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:22 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:22 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:22 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:22 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:22 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:22 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Query: SELECT * from custom_903 failed: 2006 MySQL server has gone away
 
# 2016-08-26T10:14:23 Server crash reported at dsn dbi:mysql:user=root:host=localhost:port=3306:database=asterisk
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11242...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11226...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11230...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11281...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11267...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11228...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11283...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11254...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11256...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11251...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11263...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11261...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11265...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11274...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11240...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11282...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11250...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11277...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11271...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11238...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11225...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11232...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11244...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11234...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11259...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11273...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11247...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11257...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11246...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11236...
 
# 2016-08-26T10:14:23 Killing remaining worker process with pid 11269...
 
# 2016-08-26T10:14:24 Killing periodic reporting process with pid 11224...
 
# 2016-08-26T10:14:24 Kill GenTest::ErrorFilter(11223)
 
# 2016-08-26T10:14:24 Server crash reported, initiating post-crash analysis...
 
# 2016-08-26T10:14:24 The last 100 lines from /var/lib/mysql/error.log :
 
pure virtual method called
 
terminate called without an active exception
 
160826 10:14:21 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed,
 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.1.16-MariaDB
 
key_buffer_size=134217728
 
read_buffer_size=131072
 
max_used_connections=33
 
max_threads=1026
 
thread_count=33
 
It is possible that mysqld could use up to
 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 2384644 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0x7fc12a497008
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7fc14c080d30 thread_stack 0x40000
 
/usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x7fc15b61beee]
 
/usr/sbin/mysqld(handle_fatal_signal+0x2d5)[0x7fc15b143265]
 
/lib64/libpthread.so.0(+0xf100)[0x7fc15a761100]
 
/lib64/libc.so.6(gsignal+0x37)[0x7fc158abb5f7]
 
/lib64/libc.so.6(abort+0x148)[0x7fc158abcce8]
 
/lib64/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x165)[0x7fc1591aa9b5]
 
/lib64/libstdc++.so.6(+0x5e926)[0x7fc1591a8926]
 
/lib64/libstdc++.so.6(+0x5e953)[0x7fc1591a8953]
 
/lib64/libstdc++.so.6(+0x5f4bf)[0x7fc1591a94bf]
 
/usr/sbin/mysqld(_Z18get_datetime_valueP3THDPPP4ItemS3_16enum_field_typesPb+0x3c)[0x7fc15b17587c]
 
/usr/sbin/mysqld(_ZN14Arg_comparator16compare_temporalE16enum_field_types+0x59)[0x7fc15b175c29]
 
/usr/sbin/mysqld(_ZN12Item_func_ge7val_intEv+0x2a)[0x7fc15b16ed5a]
 
/usr/sbin/mysqld(_ZN4Item8val_boolEv+0x9c)[0x7fc15b15476c]
 
/usr/sbin/mysqld(_ZN14Item_func_case9find_itemEP6String+0x182)[0x7fc15b178312]
 
/usr/sbin/mysqld(_ZN14Item_func_case6int_opEv+0x75)[0x7fc15b178425]
 
/usr/sbin/mysqld(_ZN27Item_func_hybrid_field_type7val_intEv+0x154)[0x7fc15b19f074]
 
/usr/sbin/mysqld(_ZN4Item13save_in_fieldEP5Fieldb+0x15c)[0x7fc15b152f0c]
 
/usr/sbin/mysqld(_Z21update_virtual_fieldsP3THDP5TABLE21enum_vcol_update_mode+0x82)[0x7fc15b06fc42]
 
/usr/sbin/mysqld(_Z13rr_sequentialP11READ_RECORD+0x88)[0x7fc15b24b228]
 
/usr/sbin/mysqld(_Z10sub_selectP4JOINP13st_join_tableb+0x1fb)[0x7fc15affa7cb]
 
/usr/sbin/mysqld(+0x47764d)[0x7fc15b00964d]
 
/usr/sbin/mysqld(_ZN4JOIN10exec_innerEv+0xb4c)[0x7fc15b01957c]
 
/usr/sbin/mysqld(_ZN4JOIN4execEv+0x54)[0x7fc15b01b574]
 
/usr/sbin/mysqld(_Z12mysql_selectP3THDPPP4ItemP10TABLE_LISTjR4ListIS1_ES2_jP8st_orderSB_S2_SB_yP13select_resultP18st_select_lex_unitP13st_select_lex+0x112)[0x7fc15b017c22]
 
/usr/sbin/mysqld(_Z13handle_selectP3THDP3LEXP13select_resultm+0x245)[0x7fc15b0186f5]
 
/usr/sbin/mysqld(+0x427b41)[0x7fc15afb9b41]
 
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x5f8f)[0x7fc15afc5fff]
 
/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x28e)[0x7fc15afc98de]
 
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x25db)[0x7fc15afccd9b]
 
/usr/sbin/mysqld(_Z10do_commandP3THD+0x169)[0x7fc15afcd619]
 
/usr/sbin/mysqld(_Z24do_handle_one_connectionP3THD+0x18a)[0x7fc15b091c1a]
 
/usr/sbin/mysqld(handle_one_connection+0x40)[0x7fc15b091df0]
 
/lib64/libpthread.so.0(+0x7dc5)[0x7fc15a759dc5]
 
/lib64/libc.so.6(clone+0x6d)[0x7fc158b7cced]
 
 
 
Trying to get some variables.
 
Some pointers may be invalid and cause the dump to abort.
 
Query (0x7fc12a584020): SELECT * from custom_903
 
Connection ID (thread ID): 42
 
Status: NOT_KILLED
 
 
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=off
 
 
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
# 2016-08-26T10:14:24 datadir is /var/lib/mysql/
 
# 2016-08-26T10:14:24 binary is /usr/../usr/sbin/mysqld
 
# 2016-08-26T10:14:24 bindir is /usr/../usr/sbin
 
# 2016-08-26T10:14:24 WARNING: Core file not found!
 
"/usr/src/randgen" is not a core dump: Is a directory
 
backtrace.gdb:19: Error in sourced command file:
 
No stack.
 
# 2016-08-26T10:14:25
 
"/usr/src/randgen" is not a core dump: Is a directory
 
# 2016-08-26T10:14:27
 
# 2016-08-26T10:14:27 Test completed with failure status STATUS_SERVER_CRASHED (101)

Comment by Elena Stepanova [ 2016-08-26 ]

itaushanov,
Thanks for all the data.

I'm not getting the crash with this particular scenario, but it's not very surprising, it happens with this kind of problems.
It does look similar to MDEV-9690 which hasn't been fixed yet, so naturally it happens on current versions too.
I will assign it to bar to look at them together, to make sure that all flavors are fixed.

Generated at Thu Feb 08 07:43:29 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.