[MDEV-8097] Extremely slow performance after upgrading to 5.5.43 Created: 2015-05-04 Updated: 2015-05-26 Resolved: 2015-05-26 |
|
| Status: | Closed |
| Project: | MariaDB Server |
| Component/s: | OTHER |
| Affects Version/s: | 5.5.43 |
| Fix Version/s: | N/A |
| Type: | Bug | Priority: | Blocker |
| Reporter: | Vasilis Lourdas | Assignee: | Unassigned |
| Resolution: | Cannot Reproduce | Votes: | 0 |
| Labels: | None | ||
| Environment: |
Debian Linux 7.8 Wheezy, 32-bit system as VMWare ESX 3.5 guest, official MariaDB repository |
||
| Attachments: |
|
| Description |
|
Last weekend, I decided to upgrade to 5.5.43 from 5.5.42. I dumped all databases, upgraded to 5.5.43, created a new database with mysql_install_db, created accounts and imported previously dumped databases. At that time, everything seemed ok. Today, I tried to install dkan (a Drupal based application) and during the installation of the database, the performance was extremely slow. Even when trying to run mysqltuner.pl, the script took more than 1 minute to run (when it usually takes at most 1-1.5 seconds to report results), although it did not report any issues. At one server, I noticed that the slow error log is close to 5GB (though I don't remember when it was created, so take this with a grain of salt. Using HeidiSQL when installing dkan, I noticed that some truncate table operations took many seconds at the server processes tab. I'm sorry I'm not very clear about what I've been experiencing today, but I don't know where to look. The Blade servers do not have any performance issues, I checked this out. I will definitely downgrade to 5.5.42 and see if the same behavior stills applies (that version run for many weeks without issues). I will leave one server with 5.5.43 in order to help with debugging this issue. |
| Comments |
| Comment by Elena Stepanova [ 2015-05-04 ] | |||||||||||||||||||||||
|
Hi, Lets start with the slow log since it's already there. | |||||||||||||||||||||||
| Comment by Vasilis Lourdas [ 2015-05-04 ] | |||||||||||||||||||||||
|
Hi Elena, Unfortunately, I had to delete the huge slow error log file, without taking a backup first. My bad, sorry. At this server, I restarted mysqld and it seems to work ok for now. In another server, the slow log file is small, but it contains huge query times (>2 mins or so) for rather simple operations. I have attached it here for your consideration. As I recall, I did not reload mysqld here (I have to confirm though). Let me know if you need anything else. | |||||||||||||||||||||||
| Comment by Elena Stepanova [ 2015-05-04 ] | |||||||||||||||||||||||
|
So, there is indeed a very slow DROP DATABASE statement (~2.5 min). Assuming it contained a considerable number of InnoDB tables, there is a known problem with performance of DROP DATABASE, it was recently filed as If you are going to downgrade to 5.5.42, could you please run it on both versions (with the same amount of data in the schema) and confirm there is a noticeable difference in performance? Further, there are a few slow queries from INFORMATION_SCHEMA.
| |||||||||||||||||||||||
| Comment by Vasilis Lourdas [ 2015-05-04 ] | |||||||||||||||||||||||
|
Elena, The dkan database had 117 tables (a Drupal installation with more modules). The database size was not big (somewhat 6.5-7MB was the dump file). I've never encountered any MariaDB installation that took minutes to drop a database, so there must be something wrong with this version (and that's what we're trying to figure out here). I will attach my.cnf from this server. I will try to downgrade, but it's not very trivial. I found this link, but it is not very clear how to downgrade, I get apt-get errors. In any case, I will try to downgrade and re-run these queries with the same dataset against both .42 and .43 versions. | |||||||||||||||||||||||
| Comment by Elena Stepanova [ 2015-05-04 ] | |||||||||||||||||||||||
|
Downgrade: Assuming you have the following packages:
and this line in apt sources:
Checked on Wheezy 32 bit. | |||||||||||||||||||||||
| Comment by Jan Lindström (Inactive) [ 2015-05-05 ] | |||||||||||||||||||||||
|
After code review changes between 5.5.42 and 5.5.43, I could not find anything clear that would have caused drop database to be slower. Do we have slow query log from 5.5.42 when doing the same operations ? | |||||||||||||||||||||||
| Comment by Vasilis Lourdas [ 2015-05-26 ] | |||||||||||||||||||||||
|
After some time now, I have yet to encounter the same behaviour as initially reported in this issue. So, I assume it was something of a very rare condition or something else that I cannot reproduce at this point. I haven't tried to downgrade to 5.5.42, because all the servers seem to work fine now. Feel free to close this issue as invalid. Sorry for the noise. | |||||||||||||||||||||||
| Comment by Elena Stepanova [ 2015-05-26 ] | |||||||||||||||||||||||
|
Closing for now as "Cannot reproduce". |