[MDEV-6952] query in relation with replication freeze Created: 2014-10-27  Updated: 2014-11-19  Due: 2014-11-17  Resolved: 2014-11-19

Status: Closed
Project: MariaDB Server
Component/s: Data Definition - Temporary
Affects Version/s: 10.0.14
Fix Version/s: N/A

Type: Bug Priority: Major
Reporter: Aurélien LEQUOY Assignee: Unassigned
Resolution: Cannot Reproduce Votes: 0
Labels: replication
Environment:

unbuntu 12.04


 Description   

Hello,

I made a cleaner to supress data from a database, to test the script I put it at max and I got a freeze on a drop of temporary table (on slave).

 DROP TEMPORARY TABLE IF EXISTS `PRODUCTION`.`DELETE_PROD_PRODUITS_BABEL` /* generated by server */

It's the 3rd time I meet with this problem.

show full processlist;
 
+------+------------------+------------------+------------+---------+--------+----------------------------------+----------------------------------------------------------------------------------------------------+----------+
 
| Id   | User             | Host             | db         | Command | Time   | State                            | Info                                                                                               | Progress |
 
+------+------------------+------------------+------------+---------+--------+----------------------------------+----------------------------------------------------------------------------------------------------+----------+
 
|    2 | event_scheduler  | localhost        | NULL       | Daemon  | 280218 | Waiting on empty queue           | NULL                                                                                               |    0.000 |
 
|  228 | system user      |                  | NULL       | Connect | 274596 | Waiting for master to send event | NULL                                                                                               |    0.000 |
 
|  229 | system user      |                  | PRODUCTION | Connect |  83613 | init                             | DROP TEMPORARY TABLE IF EXISTS `PRODUCTION`.`DELETE_PROD_PRODUITS_BABEL` /* generated by server */ |    0.000 |
 
| 7908 | dba              | 10.10.16.7:32875 | mysql      | Query   |  83610 | init                             | SHOW MASTER STATUS                                                                                 |    0.000 |
 
| 7910 | debian-sys-maint | localhost        | NULL       | Query   |  30808 | init                             | flush logs                                                                                         |    0.000 |
 
| 7913 | dba              | 10.10.16.7:35808 | mysql      | Query   |  13804 | init                             | SHOW MASTER STATUS                                                                                 |    0.000 |
 
| 7914 | dba              | 10.10.16.7:35826 | mysql      | Query   |  13751 | init                             | SHOW MASTER STATUS                                                                                 |    0.000 |
 
| 7915 | dba              | 10.10.16.7:35847 | mysql      | Query   |  13287 | init                             | SHOW MASTER LOGS                                                                                   |    0.000 |
 
| 7917 | dba              | 10.10.16.9:40147 | NULL       | Killed  |  10819 | Killing slave                    | stop slave                                                                                         |    0.000 |
 
| 7922 | dba              | 10.10.16.9:40176 | NULL       | Killed  |     30 | init                             | SHOW MASTER LOGS                                                                                   |    0.000 |
 
| 7925 | dba              | 10.10.16.9:40179 | NULL       | Query   |      0 | init                             | show full processlist                                                                              |    0.000 |
 
+------+------------------+------------------+------------+---------+--------+----------------------------------+----------------------------------------------------------------------------------------------------+----------+
 
11 rows in set (0.00 sec)

and strange things : (empty)

 show engine innodb status;
 
+--------+------+--------+
 
| Type   | Name | Status |
 
+--------+------+--------+
 
| InnoDB |      |        |
 
+--------+------+--------+
 
1 row in set (0.00 sec)

After it all tools / function in relation with replication are totally frozen.

 Comments   
Comment by Elena Stepanova [ 2014-10-27 ]

Hi,

By saying that it's the 3rd time you've seen the problem, do you mean that you have a reliable way to reproduce it, or that it happens sporadically and has happened 3 times so far?

If you have a way to reproduce it, can you share it? The initial data dump, configuration, and the set of statements to execute on the master.
The datadump can be uploaded to our FTP at ftp.askmonty.org/private so that only MariaDB developers have access to it.

If it's sporadic, please attach configuration files from master and slave, and provide some more details:

  • what is your replication configuration/topology?
  • what is SHOW CREATE for this temporary table in question?
  • does it exist on the slave when the DROP is attempted?
  • how much data does it contain?
  • did you check your system logs for disk and other errors?
  • does the slave error log contain any errors/warnings? (please attach it too).

Thanks.

Comment by Aurélien LEQUOY [ 2014-10-27 ]

well it always happen after i can't predict at witch time exactly.

Got the same problem on 2 differents servers.

The 2 first times it seem to happear with flush logs (debian-sys-maint).

I relaunch the process with more log & trace.

Comment by Aurélien LEQUOY [ 2014-10-27 ]

schema on my monitoring tool : https://pbs.twimg.com/media/B09--cBIAAAcoBt.png

M = Binlog
S = Replicate

all servers have binlog + log_slave_update

this script is executed with SET @@skip_replication = ON on dba-test-sa-03
and dba-test-sa-02 have replicate events marked for skip = filter_on_slave

Comment by Elena Stepanova [ 2014-10-27 ]

So, it does not always happen with the same DROP TABLE statement?
If this DROP TABLE is always involved, could you please reply to other questions from my previous comment?
If it happens on totally different queries, then the questions are different, first of all – did you check the disk space where the slave's @@datadir and @@tmpdir are located?
also, what does the error log of this slave say?

Regarding the empty InnoDB status – what kind of GUI do you use? I read about a similar problem with SQLYog, although not a recent one. Did you try to run it via the regular MySQL client? (It will probably hang, but it would be useful to know for sure).

Comment by Aurélien LEQUOY [ 2014-11-19 ]

Can close this bug, I identified the problem and was an hardware issue

Comment by Elena Stepanova [ 2014-11-19 ]

We don't have a proper resolution value for an environmental problem, so I'm closing it as "Cannot Reproduce".
If it turns out that the problem still exist after fixing the hardware, please comment to re-open.

Generated at Thu Feb 08 07:15:50 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.