[MCOL-4444] Investigate potential DDL slowdown in 5.5 vs 1.2 Created: 2020-12-11  Updated: 2021-04-29  Resolved: 2021-04-29

Status: Closed
Project: MariaDB ColumnStore
Component/s: DDLProc
Affects Version/s: 5.5.1
Fix Version/s: N/A

Type: Bug Priority: Minor
Reporter: David Hall (Inactive) Assignee: Unassigned
Resolution: Cannot Reproduce Votes: 0
Labels: None


 Description   

SAS has noticed a slowdown in CREATE and possibly other DDL statements. Project Management has also noticed a slowdown. Other users have not noticed such a slowdown (but this data only covers single node | local storage).

We need to set up tests to show how much slowdown is occurring, and under what topologies.
Once we know that, we may be able to discover where that slowdown s happening.



 Comments   
Comment by David Hall (Inactive) [ 2020-12-11 ]

The suspected configuration is a 3 node system using S3 storage. We need to determine what topologies such a slowdown occurs:
1) multi-node local storage
2) multi-node S3
3) single node local storage
4) single node S3
The scientific method shall be used to determine which of the above manifests a DDL slowdown between 1.2 and 5.5. Since Storage Manager isn't available for 1.2, we sahll collect empirical data from all available configurations for the versions. We may need to throw 5.4 in the mix to get some more data points.

The purpose of this exercise is narrow the scope of the next step, which is to determine in what code the slowdown occurs.

Comment by David Hall (Inactive) [ 2020-12-11 ]

An interesting thing arose during my discussions today. It appears that under 3 node AWS with S3 storage, a CREATE TABLE statement was consistent in taking exactly 6 seconds. This consistency I find suspicious. It's as if a timeout was being waited on. I don't know if this helps, but it wouldn't hurt to keep in the back of your mind as the investigation proceeds.

Comment by Todd Stoffel (Inactive) [ 2021-02-01 ]

This seems to be a symptom of a shared metadata folder like /var/lib/columnstore/storagemanager via EFS.

Generated at Thu Feb 08 02:50:24 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.