[MCOL-605] Crash when running table_usage Created: 2017-03-04 Updated: 2017-03-22 Resolved: 2017-03-22 |
|
| Status: | Closed |
| Project: | MariaDB ColumnStore |
| Component/s: | None |
| Affects Version/s: | 1.0.7 |
| Fix Version/s: | 1.0.8, 1.1.0 |
| Type: | Bug | Priority: | Major |
| Reporter: | Alexander Rubin | Assignee: | Daniel Lee (Inactive) |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Environment: |
Ubuntu 16.04.1 LTS, single node install |
||
| Sprint: | 2017-5, 2017-6 |
| Description |
|
{{MariaDB [o1543]> call columnstore_info.table_usage('o1543', 'query_class_metrics'); Error log: 2017-03-04 16:13:23 140515920578368 [Note] /usr/local/mariadb/columnstore/mysql//bin/mysqld: ready for connections. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help Server version: 10.1.21-MariaDB Thread pointer: 0x564639e78c88 Trying to get some variables. Optimizer switch: index_merge=off,index_merge_union=off,index_merge_sort_union=off,index_merge_intersection=off,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=off,derived_merge=off,derived_with_keys=off,firstmatch=off,loosescan=off,materialization=off,in_to_exists=on,semijoin=off,partial_match_rowid_merge=off,partial_match_table_scan=off,subquery_cache=off,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=off,semijoin_with_cache=off,join_cache_incremental=off,join_cache_hashed=off,join_cache_bka=off,optimize_join_buffer_size=off,table_elimination=off,extended_keys=off,exists_to_in=on,orderby_uses_equalities=off The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains We think the query pointer is invalid, but we will try to print it anyway. 170304 16:13:45 mysqld_safe Number of processes running now: 0 |
| Comments |
| Comment by Andrew Hutchings (Inactive) [ 2017-03-05 ] | ||||||||||||||||||||||||||||||||||||||||||
|
This is due to port exhaustion due to ports going into a TIME_WAIT state. The code needs modifying to reuse connections rather than binning them and reopening. It also needs to handle this as an error better. As a workaround for now you can increase the available ports and/or decrease the port TIME_WAIT state for your OS:
| ||||||||||||||||||||||||||||||||||||||||||
| Comment by Andrew Hutchings (Inactive) [ 2017-03-05 ] | ||||||||||||||||||||||||||||||||||||||||||
|
The best way I can see to test the new behaviour in this patch is to watch the tcp-tw output of this whilst querying I_S.COLUMNSTORE_FILES:
It should only increase slightly instead of a large jump. | ||||||||||||||||||||||||||||||||||||||||||
| Comment by Alexander Rubin [ 2017-03-05 ] | ||||||||||||||||||||||||||||||||||||||||||
|
Andrew, thank you, workaround worked. | ||||||||||||||||||||||||||||||||||||||||||
| Comment by David Thompson (Inactive) [ 2017-03-07 ] | ||||||||||||||||||||||||||||||||||||||||||
|
Reopening to consider for 1.0.8 backport | ||||||||||||||||||||||||||||||||||||||||||
| Comment by Andrew Hutchings (Inactive) [ 2017-03-07 ] | ||||||||||||||||||||||||||||||||||||||||||
|
New review for 1.0 backport | ||||||||||||||||||||||||||||||||||||||||||
| Comment by Daniel Lee (Inactive) [ 2017-03-21 ] | ||||||||||||||||||||||||||||||||||||||||||
|
Build tested: 1.0.8-1 1um2pm stack MariaDB [(none)]> select * from information_schema.COLUMNSTORE_FILES;
---------------------
--------------------- MariaDB [information_schema]> select * from COLUMNSTORE_FILES; No crit.log and err.log in all three nodes. No errors have been logged yet. | ||||||||||||||||||||||||||||||||||||||||||
| Comment by Andrew Hutchings (Inactive) [ 2017-03-22 ] | ||||||||||||||||||||||||||||||||||||||||||
|
2 new branches (develop-1.0 and develop). Fixes problem found by Daniel | ||||||||||||||||||||||||||||||||||||||||||
| Comment by Daniel Lee (Inactive) [ 2017-03-22 ] | ||||||||||||||||||||||||||||||||||||||||||
|
Build verified: 1.0.8-1 mcsadmin> getsoftware Name : mariadb-columnstore-platform Loaded a 10g DBT3 database and executed the following query: MariaDB [(none)]> select * from information_schema.COLUMNSTORE_FILES;
----------
. Hear is the sar output: 09:50:32 PM totsck tcpsck udpsck rawsck ip-frag tcp-tw Still need to test for 1.1.0 | ||||||||||||||||||||||||||||||||||||||||||
| Comment by Daniel Lee (Inactive) [ 2017-03-22 ] | ||||||||||||||||||||||||||||||||||||||||||
|
Build tested: 1.1.0 GitHub source [root@localhost mariadb-columnstore-server]# git show [root@localhost mariadb-columnstore-engine]# git show Merge pull request #139 from mariadb-corporation/ Execute the same test for 1.0.8-1 MariaDB [(none)]> select * from information_schema.COLUMNSTORE_FILES;
----------
Linux 3.10.0-327.36.1.el7.x86_64 (localhost.localdomain) 03/22/2017 x86_64 (4 CPU) 10:07:16 PM totsck tcpsck udpsck rawsck ip-frag tcp-tw |