[MCOL-2244] There is no way to identify execution thread that causes bottleneck Created: 2019-03-15  Updated: 2019-03-29  Resolved: 2019-03-29

Status: Closed
Project: MariaDB ColumnStore
Component/s: ExeMgr, PrimProc
Affects Version/s: 1.2.2
Fix Version/s: 1.2.4

Type: Bug Priority: Minor
Reporter: Roman Assignee: Zdravelina Sokolovska (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Sprint: 2019-03

 Description   

There is no way to identify threads of execution in runtime so here is the patch to explicitly name threads. Any additional changes that helps to identify execution threads are welcome.



 Comments   
Comment by Roman [ 2019-03-15 ]

Please review this patch. ExeMgr and PrimProc set thread name according with thread's operation.

Comment by Patrick LeBlanc (Inactive) [ 2019-03-15 ]

For QA. This patch just assigns names to some of the threads in the system, it should be transparent from your black-box POV. Reading up on this, it looks like you could see thread names using top & ps, and I assume also gdb and perf. Roman can likely give more explicit instructions if you need them.

https://www.google.com/search?q=linux+how+to+see+a+thread%27s+name

Comment by Zdravelina Sokolovska (Inactive) [ 2019-03-29 ]

checked with 1.2 versionEngineID8090d6d

top - 17:32:28 up 4 days, 15:54, 5 users, load average: 0.69, 0.46, 0.37
Threads: 45 total, 0 running, 45 sleeping, 0 stopped, 0 zombie
%Cpu(s): 4.8 us, 1.3 sy, 0.0 ni, 94.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st
KiB Mem : 61848088 total, 58636380 free, 1038172 used, 2173536 buff/cache
KiB Swap: 0 total, 0 free, 0 used. 60216748 avail Mem

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
13945 root 19 -1 36.0g 208332 11824 S 4.0 0.3 0:01.60 TASThrAggr
13952 root 19 -1 36.0g 208332 11824 S 4.0 0.3 0:01.58 TASThrAggr
13358 root 20 0 36.0g 208332 11824 S 3.0 0.3 0:11.91 ExeMgr
13957 root 19 -1 36.0g 208332 11824 S 3.0 0.3 0:02.05 TASThrAggr
15904 root 19 -1 36.0g 208332 11824 S 3.0 0.3 0:01.60 TASThrAggr
13359 root 20 0 36.0g 208332 11824 S 2.0 0.3 0:11.06 ExeMgr
13937 root 19 -1 36.0g 208332 11824 S 2.0 0.3 0:01.34 BPSAggregator
13969 root 19 -1 36.0g 208332 11824 S 2.0 0.3 0:00.58 BPSAggregator
13938 root 19 -1 36.0g 208332 11824 S 1.0 0.3 0:01.13 BPSAggregator
13352 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.04 ExeMgr
13356 root 20 0 36.0g 208332 11824 S 0.0 0.3 0:00.00 ExeMgr
13357 root 20 0 36.0g 208332 11824 S 0.0 0.3 0:00.00 ExeMgr
13360 root 20 0 36.0g 208332 11824 S 0.0 0.3 0:00.05 ExeMgr
13361 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 ExeMgr
13453 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:37.24 ExeMgr
13935 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.14 ExeMgr
13936 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.02 HJSBigSide
13939 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSBigSide
13940 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 TASwoOrd
13941 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 TASwoOrd
13942 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 ExeMgr
13943 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 SQSRunner
13944 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.47 TASwoOrd
13946 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.02 HJSBigSide
13947 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 SQSRunner
13948 root 19 -1 36.0g 208332 11824 S 0.0 0.3 1:14.54 TASAggr
13949 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.47 HJSBigSide
13950 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 TASAggr
13951 root 19 -1 36.0g 208332 11824 S 0.0 0.3 1:17.35 TASThrAggr
13953 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:02.64 TASThrAggr
13954 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.47 TASwoOrd
13955 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide
13956 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide
13958 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.05 BPSPrimitive
13959 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:02.59 TASThrAggr
13960 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 TASwoOrd
13961 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.05 BPSPrimitive
13962 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:01.17 BPSAggregator
13963 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide
13964 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide
13965 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 SQSRunner
13966 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide
13967 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.46 HJSBigSide
13968 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:02.10 TASThrAggr
13970 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.41 SQSRunner

Threads: 36 total, 8 running, 28 sleeping, 0 stopped, 0 zombie
%Cpu(s): 98.5 us, 1.5 sy, 0.0 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st
KiB Mem : 61848088 total, 39622008 free, 10035056 used, 12191024 buff/cache
KiB Swap: 0 total, 0 free, 0 used. 51226620 avail Mem

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
9456 root 19 -1 42.5g 8.9g 12700 R 59.0 15.1 3:43.58 PPBatchPrimProc
9461 root 19 -1 42.5g 8.9g 12700 R 52.0 15.1 3:43.01 PPBatchPrimProc
9459 root 19 -1 42.5g 8.9g 12700 R 51.0 15.1 3:45.67 PPBatchPrimProc
9455 root 19 -1 42.5g 8.9g 12700 R 50.0 15.1 3:41.74 PPBatchPrimProc
9457 root 19 -1 42.5g 8.9g 12700 R 50.0 15.1 3:42.52 PPBatchPrimProc
9454 root 19 -1 42.5g 8.9g 12700 R 46.0 15.1 3:46.87 PPBatchPrimProc
9458 root 19 -1 42.5g 8.9g 12700 R 46.0 15.1 3:44.14 PPBatchPrimProc
9460 root 19 -1 42.5g 8.9g 12700 R 46.0 15.1 3:45.70 PPBatchPrimProc
9464 root 19 -1 42.5g 8.9g 12700 S 1.0 15.1 0:02.34 PPHandDestroy
9465 root 19 -1 42.5g 8.9g 12700 S 1.0 15.1 0:02.74 PPHandDestroy
9413 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.04 PrimProc
9438 root 20 0 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc
9444 root 20 0 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc
9445 root 20 0 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc
9452 root 20 0 42.5g 8.9g 12700 S 0.0 15.1 0:00.08 PrimProc
9453 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc
9462 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:04.94 PPHandDestroy
9463 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.78 PPHandDestroy
9466 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:03.63 PPHandDestroy
9468 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.49 PrimProc
9469 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.31 PrimProc
9470 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.44 PrimProc
9471 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.53 PrimProc
9472 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.53 PrimProc
9473 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.50 PrimProc
9474 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.49 PrimProc
9475 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.55 PrimProc
9476 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc
9477 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPServerThr
9503 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.10 PPReadThread
9504 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.06 PPReadThread
9573 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPReadThread
9679 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPReadThread
13349 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPHandCreate
17373 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPHandCreate
17374 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPHandCreate

Generated at Thu Feb 08 02:34:49 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.