[MCOL-749] DMLProc Segfault after killing update and restarting update. Created: 2017-06-06 Updated: 2017-08-09 Resolved: 2017-08-09 |
|
| Status: | Closed |
| Project: | MariaDB ColumnStore |
| Component/s: | DMLProc |
| Affects Version/s: | 1.0.9 |
| Fix Version/s: | Icebox |
| Type: | Bug | Priority: | Major |
| Reporter: | Nivesh | Assignee: | Unassigned |
| Resolution: | Not a Bug | Votes: | 0 |
| Labels: | None | ||
| Environment: |
redhat 7.2 Maipo |
||
| Attachments: |
|
| Description |
|
I have an update running on a 500M Row table on the third update and kill the DMLProc process segfaults with the below and then restarts. DMLProc[18462]: segfault at 30 ip 0000000000424d30 sp 00007f236f7fd410 error 4 in DMLProc[400000+48000] Attached are the logs. MaraidCS config = |
| Comments |
| Comment by David Thompson (Inactive) [ 2017-06-06 ] |
|
Can you check the logs on the pms as well? Alternatively you can run the columnstoreSupport utility which will bundle up everything useful? I'd suspect you are blowing the limit for our dml transaction buffer. If you need to do a very large update like this i'd suggest either increasing the version buffer size (see last section here: https://mariadb.com/kb/en/mariadb/columnstore-batch-insert-mode) or batching your updates by date. If your data is loaded in date order (or approximiately) this will also be efficient due to partition elimination. |
| Comment by Nivesh [ 2017-06-07 ] |
|
Hi David. The actual update is only 85 rows on the multi-million row table. |
| Comment by David Thompson (Inactive) [ 2017-06-07 ] |
|
One thing i see in the logs is using a variety of where clause filters. For partition elimination to work currently you should avoid using functions: would be much faster (assuming data is loaded by event_date) as: Otherwise the system must scan the entire set of rows. YYYY-MM-DD is the default date format for mariadb |
| Comment by Nivesh [ 2017-06-20 ] |
|
thanks for the info. |
| Comment by David Thompson (Inactive) [ 2017-08-09 ] |
|
Please re-open if this reproduces with the proposed changes. |