[MCOL-3417] Profile / optimize SM Created: 2019-08-08  Updated: 2019-08-15  Resolved: 2019-08-15

Status: Closed
Project: MariaDB ColumnStore
Component/s: ?
Affects Version/s: None
Fix Version/s: 1.4.0

Type: Task Priority: Major
Reporter: Patrick LeBlanc (Inactive) Assignee: Patrick LeBlanc (Inactive)
Resolution: Done Votes: 0
Labels: None

Sub-Tasks:
Key
Summary
Type
Status
Assignee
MCOL-3418 optimize around cpimport's inefficien... Sub-Task Closed Patrick LeBlanc  
Epic Link: ObjectStore support

 Description   

I added some KPIs and started profiling SM behavior to look for low hanging fruit. Subtasks should be specific optimization tasks based on profile info.



 Comments   
Comment by Patrick LeBlanc (Inactive) [ 2019-08-15 ]

Ran a couple more profiles. Looks like we're in pretty good shape. The vast majority of the time is being spent in the kernel doing file IO and messaging stuff, which is appropriate for this process. This process's raison d'etre is to do file IO and messaging stuff.

If this suggests anything, it's that if we spot an opportunity to do file IO smarter we should take it. Maybe a file descriptor cache. Maybe consolidate reads/writes if we see a place where we are artificially splitting them up.

That is a deeper investigation though, will have to do it later. I'm happy with the result for now.

Generated at Thu Feb 08 02:42:35 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.