[MCOL-35] 211 Concurrent Transactions Test failed Created: 2016-05-03  Updated: 2016-08-02  Resolved: 2016-08-02

Status: Closed
Project: MariaDB ColumnStore
Component/s: DMLProc
Affects Version/s: None
Fix Version/s: 1.0.2

Type: Task Priority: Major
Reporter: Dipti Joshi (Inactive) Assignee: David Hall (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Relates
relates to MCOL-14 concurDDL test in autopilot failed Closed
relates to MCOL-64 Internal error: CAL0009: Error in d... Closed
relates to MCOL-66 Autopilot systemTest.concurDML test f... Closed
Sprint: 1.0.2-2

 Description   

211 Concurrent Transactions Test: Failed (seconds=1800, thr=15, rowFactor=10000, batches=0, rows=0, bad count=0, errors=75, hung threads=0)



 Comments   
Comment by David Hill (Inactive) [ 2016-05-20 ]

mismatch results with decimals

tested sql/binarysigned.sql.log against sql/binarysigned.sql.log.ref
Failed. Check sql/binarysigned.sql.diff for differences.
tested sql/binaryunsigned.sql.log against sql/binaryunsigned.sql.log.ref
Failed. Check sql/binaryunsigned.sql.diff for differences.

[root@srvss2 srvswdev11]# diff test011/sql/binarysigned.sql.log test011/sql/binarysigned.sql.log.ref
8,9c8,9
< 0 1007 -126 -32766 -2147483646 -9223372036854775806 -9.9 -99.99 -99999.99 -9999999999.99 -3.40282e38 -1.7976931348623157e308
< 0 1008 127 32767 2147483647 9223372036854775807 9.9 99.99 99999.99 9999999999.99 3.40282e38 1.7976931348623157e308

Comment by Dipti Joshi (Inactive) [ 2016-05-20 ]

hill This does not seem to be correct log - this log you have here is for MCOL-29(see your comments on it) - accidentally you seems to be have copied the same comment here too.

This is a concurrency test and does not involve binarysigned or binaryunigned sql test. It runs multiple threads trying to do parallel connections to UM. The reason for this test to fail is that at some point, MySQL process is going away and connections are failing on some the threads
Here is the status result
cat status.txt
(seconds=1800, thr=15, rowFactor=10000, batches=0, rows=0, bad count=0, errors=75, hung threads=0)

Indicating total there are 75 errors across threads.

Here are the error messages across all the threads's log

grep -i error *.log
thread.10.log:ERROR 2013 (HY000) at line 1: Lost connection to MySQL server during query
thread.10.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.10.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.10.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.10.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.11.log:ERROR 1178 (42000) at line 1: The storage engine for the table doesn't support The syntax or the data type(s) is not supported by InfiniDB. Please check the InfiniDB syntax guide for supported syntax or data types.
thread.11.log:Unable to set default JobID; Error getting OID for table dmlc.test211_11: IDB-2006: 'dmlc.test211_11' does not exist in InfiniDB.
thread.11.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.11.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.11.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.12.log:ERROR 2013 (HY000) at line 1: Lost connection to MySQL server during query
thread.12.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.12.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.12.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.12.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.13.log:ERROR 1178 (42000) at line 1: The storage engine for the table doesn't support The syntax or the data type(s) is not supported by InfiniDB. Please check the InfiniDB syntax guide for supported syntax or data types.
thread.13.log:Unable to set default JobID; Error getting OID for table dmlc.test211_13: IDB-2006: 'dmlc.test211_13' does not exist in InfiniDB.
thread.13.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.13.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.13.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.14.log:ERROR 2013 (HY000) at line 1: Lost connection to MySQL server during query
thread.14.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.14.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.14.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.14.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.15.log:ERROR 2013 (HY000) at line 1: Lost connection to MySQL server during query
thread.15.log:Unable to set default JobID; Error getting OID for table dmlc.test211_15: IDB-2006: 'dmlc.test211_15' does not exist in InfiniDB.
thread.15.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.15.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.15.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.1.log:ERROR 1815 (HY000) at line 1: Internal error: CAL0009: Drop table failed due to IDB-2006: 'dmlc.test211_1' does not exist in InfiniDB.
thread.1.log:Unable to set default JobID; Error getting OID for table dmlc.test211_1: IDB-2006: 'dmlc.test211_1' does not exist in InfiniDB.
thread.1.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.1.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.1.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.2.log:ERROR 2013 (HY000) at line 1: Lost connection to MySQL server during query
thread.2.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.2.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.2.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.2.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.3.log:ERROR 2013 (HY000) at line 1: Lost connection to MySQL server during query
thread.3.log:Unable to set default JobID; Error getting OID for table dmlc.test211_3: IDB-2006: 'dmlc.test211_3' does not exist in InfiniDB.
thread.3.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.3.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.3.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.4.log:ERROR 2013 (HY000) at line 1: Lost connection to MySQL server during query
thread.4.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.4.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.4.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.4.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.5.log:ERROR 2013 (HY000) at line 1: Lost connection to MySQL server during query
thread.5.log:Unable to set default JobID; Error getting OID for table dmlc.test211_5: IDB-2006: 'dmlc.test211_5' does not exist in InfiniDB.
thread.5.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.5.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.5.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.6.log:ERROR 2013 (HY000) at line 1: Lost connection to MySQL server during query
thread.6.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.6.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.6.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.6.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.7.log:ERROR 2013 (HY000) at line 1: Lost connection to MySQL server during query
thread.7.log:Unable to set default JobID; Error getting OID for table dmlc.test211_7: IDB-2006: 'dmlc.test211_7' does not exist in InfiniDB.
thread.7.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.7.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.7.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.8.log:ERROR 1815 (HY000) at line 1: Internal error: CAL0009: Drop table failed due to IDB-2006: 'dmlc.test211_8' does not exist in InfiniDB.
thread.8.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.8.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.8.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.8.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.9.log:ERROR 1815 (HY000) at line 1: Internal error: CAL0009: Drop table failed due to IDB-2006: 'dmlc.test211_9' does not exist in InfiniDB.
thread.9.log:Unable to set default JobID; Error getting OID for table dmlc.test211_9: IDB-2006: 'dmlc.test211_9' does not exist in InfiniDB.
thread.9.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.9.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")
thread.9.log:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/usr/local/Calpont/mysql/lib/mysql/mysql.sock' (111 "Connection refused")

Comment by Dipti Joshi (Inactive) [ 2016-05-23 ]

This may be related to MCOL-66, MCOL-64, MCOL-14 and MCOL-20

Comment by David Hill (Inactive) [ 2016-05-26 ]

Looksl ike DDLProc crash in latest runs, possible related to DROP TABLE issue

HALL - DMLPROC when running test211 today... dont know if this is new or previous

[9:58]
May 26 09:50:32 srvregtest joblist[3466]: 32.769031 |0|0|0| C 05 CAL0000: distributedenginecomm.cpp @ 381 DEC: lost connection to 192.168.1.125
May 26 09:50:32 srvregtest joblist[3295]: 32.772833 |0|0|0| C 05 CAL0000: distributedenginecomm.cpp @ 381 DEC: lost connection to 192.168.1.125
May 26 09:50:32 srvregtest joblist[3400]: 32.774381 |0|0|0| C 05 CAL0000: distributedenginecomm.cpp @ 381 DEC: lost connection to 192.168.1.125
May 26 09:51:00 srvregtest ExeMgr[6702]: 00.077963 |2147483676|0|0| C 16 CAL0055: ERROR: ExeMgr has caught an exception. InetStreamSocket::readToMagic(): I/O error2.1: err = -1 e = 104: Connection reset by peer
May 26 09:51:00 srvregtest ExeMgr[6702]: 00.078466 |2147483677|0|0| C 16 CAL0055: ERROR: ExeMgr has caught an exception. InetStreamSocket::readToMagic(): I/O error2.1: err = -1 e = 104: Connection reset by peer
May 26 09:51:00 srvregtest ExeMgr[6702]: 00.078664 |2147483678|0|0| C 16 CAL0055: ERROR: ExeMgr has caught an exception. InetStreamSocket::readToMagic(): I/O error2.1: err = -1 e = 104: Connection reset by peer
May 26 09:51:00 srvregtest ExeMgr[6702]: 00.078949 |2147483679|0|0| C 16 CAL0055: ERROR: ExeMgr has caught an exception. InetStreamSocket::readToMagic(): I/O error2.1: err = -1 e = 104: Connection reset by peer
May 26 09:51:00 srvregtest ExeMgr[6702]: 00.084472 |2147483680|0|0| C 16 CAL0055: ERROR: ExeMgr has caught an exception. InetStreamSocket::readToMagic(): I/O error2.1: err = -1 e = 104: Connection reset by peer
May 26 09:51:03 srvregtest ProcessMonitor[5947]: 03.863565 |0|0|0| C 18 CAL0000: *****Calpont Process Restarting: DDLProc, old PID = 6826

david.hill [10:08 AM]
looksl ike still having issues in drop table

[10:08]
Thu May 26 09:50:57 CDT 2016 - Running drop table if exists test211_15; create table test211_15(batch int, c1 int, c2 int)engine=infinidb;
Error detected, touch stop.txt
Thu May 26 09:50:57 CDT 2016 - Importing rows: batch=1; table=test211_9; rows=90000.
Error detected, touch stop.txt
Error detected, touch stop.txt
Error detected, touch stop.txt
Error detected, touch stop.txt

Comment by Dipti Joshi (Inactive) [ 2016-07-26 ]

As MCOL-66 fix has been developed, the regression test in development environment shows that this test suite is now passing.

Comment by Dipti Joshi (Inactive) [ 2016-08-02 ]

Fixed as part of MCOL-66

Generated at Thu Feb 08 02:18:01 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.