Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-2244

There is no way to identify execution thread that causes bottleneck

Details

    • Bug
    • Status: Closed (View Workflow)
    • Minor
    • Resolution: Fixed
    • 1.2.2
    • 1.2.4
    • ExeMgr, PrimProc
    • None
    • 2019-03

    Description

      There is no way to identify threads of execution in runtime so here is the patch to explicitly name threads. Any additional changes that helps to identify execution threads are welcome.

      Attachments

        Activity

          Ascending order - Click to sort in descending order
          drrtuy Roman added a comment -

          Please review this patch. ExeMgr and PrimProc set thread name according with thread's operation.

          drrtuy Roman added a comment - Please review this patch. ExeMgr and PrimProc set thread name according with thread's operation.
          pleblanc Patrick LeBlanc (Inactive) added a comment -

          For QA. This patch just assigns names to some of the threads in the system, it should be transparent from your black-box POV. Reading up on this, it looks like you could see thread names using top & ps, and I assume also gdb and perf. Roman can likely give more explicit instructions if you need them.

          https://www.google.com/search?q=linux+how+to+see+a+thread%27s+name

          pleblanc Patrick LeBlanc (Inactive) added a comment - For QA. This patch just assigns names to some of the threads in the system, it should be transparent from your black-box POV. Reading up on this, it looks like you could see thread names using top & ps, and I assume also gdb and perf. Roman can likely give more explicit instructions if you need them. https://www.google.com/search?q=linux+how+to+see+a+thread%27s+name
          winstone Zdravelina Sokolovska (Inactive) added a comment -

          checked with 1.2 versionEngineID8090d6d

          top - 17:32:28 up 4 days, 15:54, 5 users, load average: 0.69, 0.46, 0.37
          Threads: 45 total, 0 running, 45 sleeping, 0 stopped, 0 zombie
          %Cpu(s): 4.8 us, 1.3 sy, 0.0 ni, 94.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st
          KiB Mem : 61848088 total, 58636380 free, 1038172 used, 2173536 buff/cache
          KiB Swap: 0 total, 0 free, 0 used. 60216748 avail Mem

          PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
          13945 root 19 -1 36.0g 208332 11824 S 4.0 0.3 0:01.60 TASThrAggr
          13952 root 19 -1 36.0g 208332 11824 S 4.0 0.3 0:01.58 TASThrAggr
          13358 root 20 0 36.0g 208332 11824 S 3.0 0.3 0:11.91 ExeMgr
          13957 root 19 -1 36.0g 208332 11824 S 3.0 0.3 0:02.05 TASThrAggr
          15904 root 19 -1 36.0g 208332 11824 S 3.0 0.3 0:01.60 TASThrAggr
          13359 root 20 0 36.0g 208332 11824 S 2.0 0.3 0:11.06 ExeMgr
          13937 root 19 -1 36.0g 208332 11824 S 2.0 0.3 0:01.34 BPSAggregator
          13969 root 19 -1 36.0g 208332 11824 S 2.0 0.3 0:00.58 BPSAggregator
          13938 root 19 -1 36.0g 208332 11824 S 1.0 0.3 0:01.13 BPSAggregator
          13352 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.04 ExeMgr
          13356 root 20 0 36.0g 208332 11824 S 0.0 0.3 0:00.00 ExeMgr
          13357 root 20 0 36.0g 208332 11824 S 0.0 0.3 0:00.00 ExeMgr
          13360 root 20 0 36.0g 208332 11824 S 0.0 0.3 0:00.05 ExeMgr
          13361 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 ExeMgr
          13453 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:37.24 ExeMgr
          13935 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.14 ExeMgr
          13936 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.02 HJSBigSide
          13939 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSBigSide
          13940 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 TASwoOrd
          13941 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 TASwoOrd
          13942 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 ExeMgr
          13943 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 SQSRunner
          13944 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.47 TASwoOrd
          13946 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.02 HJSBigSide
          13947 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 SQSRunner
          13948 root 19 -1 36.0g 208332 11824 S 0.0 0.3 1:14.54 TASAggr
          13949 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.47 HJSBigSide
          13950 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 TASAggr
          13951 root 19 -1 36.0g 208332 11824 S 0.0 0.3 1:17.35 TASThrAggr
          13953 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:02.64 TASThrAggr
          13954 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.47 TASwoOrd
          13955 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide
          13956 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide
          13958 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.05 BPSPrimitive
          13959 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:02.59 TASThrAggr
          13960 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 TASwoOrd
          13961 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.05 BPSPrimitive
          13962 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:01.17 BPSAggregator
          13963 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide
          13964 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide
          13965 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 SQSRunner
          13966 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide
          13967 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.46 HJSBigSide
          13968 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:02.10 TASThrAggr
          13970 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.41 SQSRunner

          Threads: 36 total, 8 running, 28 sleeping, 0 stopped, 0 zombie
          %Cpu(s): 98.5 us, 1.5 sy, 0.0 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st
          KiB Mem : 61848088 total, 39622008 free, 10035056 used, 12191024 buff/cache
          KiB Swap: 0 total, 0 free, 0 used. 51226620 avail Mem

          PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
          9456 root 19 -1 42.5g 8.9g 12700 R 59.0 15.1 3:43.58 PPBatchPrimProc
          9461 root 19 -1 42.5g 8.9g 12700 R 52.0 15.1 3:43.01 PPBatchPrimProc
          9459 root 19 -1 42.5g 8.9g 12700 R 51.0 15.1 3:45.67 PPBatchPrimProc
          9455 root 19 -1 42.5g 8.9g 12700 R 50.0 15.1 3:41.74 PPBatchPrimProc
          9457 root 19 -1 42.5g 8.9g 12700 R 50.0 15.1 3:42.52 PPBatchPrimProc
          9454 root 19 -1 42.5g 8.9g 12700 R 46.0 15.1 3:46.87 PPBatchPrimProc
          9458 root 19 -1 42.5g 8.9g 12700 R 46.0 15.1 3:44.14 PPBatchPrimProc
          9460 root 19 -1 42.5g 8.9g 12700 R 46.0 15.1 3:45.70 PPBatchPrimProc
          9464 root 19 -1 42.5g 8.9g 12700 S 1.0 15.1 0:02.34 PPHandDestroy
          9465 root 19 -1 42.5g 8.9g 12700 S 1.0 15.1 0:02.74 PPHandDestroy
          9413 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.04 PrimProc
          9438 root 20 0 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc
          9444 root 20 0 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc
          9445 root 20 0 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc
          9452 root 20 0 42.5g 8.9g 12700 S 0.0 15.1 0:00.08 PrimProc
          9453 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc
          9462 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:04.94 PPHandDestroy
          9463 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.78 PPHandDestroy
          9466 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:03.63 PPHandDestroy
          9468 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.49 PrimProc
          9469 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.31 PrimProc
          9470 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.44 PrimProc
          9471 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.53 PrimProc
          9472 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.53 PrimProc
          9473 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.50 PrimProc
          9474 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.49 PrimProc
          9475 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.55 PrimProc
          9476 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc
          9477 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPServerThr
          9503 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.10 PPReadThread
          9504 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.06 PPReadThread
          9573 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPReadThread
          9679 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPReadThread
          13349 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPHandCreate
          17373 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPHandCreate
          17374 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPHandCreate

          winstone Zdravelina Sokolovska (Inactive) added a comment - checked with 1.2 versionEngineID8090d6d top - 17:32:28 up 4 days, 15:54, 5 users, load average: 0.69, 0.46, 0.37 Threads: 45 total, 0 running, 45 sleeping, 0 stopped, 0 zombie %Cpu(s): 4.8 us, 1.3 sy, 0.0 ni, 94.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st KiB Mem : 61848088 total, 58636380 free, 1038172 used, 2173536 buff/cache KiB Swap: 0 total, 0 free, 0 used. 60216748 avail Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 13945 root 19 -1 36.0g 208332 11824 S 4.0 0.3 0:01.60 TASThrAggr 13952 root 19 -1 36.0g 208332 11824 S 4.0 0.3 0:01.58 TASThrAggr 13358 root 20 0 36.0g 208332 11824 S 3.0 0.3 0:11.91 ExeMgr 13957 root 19 -1 36.0g 208332 11824 S 3.0 0.3 0:02.05 TASThrAggr 15904 root 19 -1 36.0g 208332 11824 S 3.0 0.3 0:01.60 TASThrAggr 13359 root 20 0 36.0g 208332 11824 S 2.0 0.3 0:11.06 ExeMgr 13937 root 19 -1 36.0g 208332 11824 S 2.0 0.3 0:01.34 BPSAggregator 13969 root 19 -1 36.0g 208332 11824 S 2.0 0.3 0:00.58 BPSAggregator 13938 root 19 -1 36.0g 208332 11824 S 1.0 0.3 0:01.13 BPSAggregator 13352 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.04 ExeMgr 13356 root 20 0 36.0g 208332 11824 S 0.0 0.3 0:00.00 ExeMgr 13357 root 20 0 36.0g 208332 11824 S 0.0 0.3 0:00.00 ExeMgr 13360 root 20 0 36.0g 208332 11824 S 0.0 0.3 0:00.05 ExeMgr 13361 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 ExeMgr 13453 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:37.24 ExeMgr 13935 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.14 ExeMgr 13936 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.02 HJSBigSide 13939 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSBigSide 13940 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 TASwoOrd 13941 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 TASwoOrd 13942 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 ExeMgr 13943 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 SQSRunner 13944 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.47 TASwoOrd 13946 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.02 HJSBigSide 13947 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 SQSRunner 13948 root 19 -1 36.0g 208332 11824 S 0.0 0.3 1:14.54 TASAggr 13949 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.47 HJSBigSide 13950 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 TASAggr 13951 root 19 -1 36.0g 208332 11824 S 0.0 0.3 1:17.35 TASThrAggr 13953 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:02.64 TASThrAggr 13954 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.47 TASwoOrd 13955 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide 13956 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide 13958 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.05 BPSPrimitive 13959 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:02.59 TASThrAggr 13960 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 TASwoOrd 13961 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.05 BPSPrimitive 13962 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:01.17 BPSAggregator 13963 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide 13964 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide 13965 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 SQSRunner 13966 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.00 HJSSmallSide 13967 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.46 HJSBigSide 13968 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:02.10 TASThrAggr 13970 root 19 -1 36.0g 208332 11824 S 0.0 0.3 0:00.41 SQSRunner Threads: 36 total, 8 running, 28 sleeping, 0 stopped, 0 zombie %Cpu(s): 98.5 us, 1.5 sy, 0.0 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st KiB Mem : 61848088 total, 39622008 free, 10035056 used, 12191024 buff/cache KiB Swap: 0 total, 0 free, 0 used. 51226620 avail Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 9456 root 19 -1 42.5g 8.9g 12700 R 59.0 15.1 3:43.58 PPBatchPrimProc 9461 root 19 -1 42.5g 8.9g 12700 R 52.0 15.1 3:43.01 PPBatchPrimProc 9459 root 19 -1 42.5g 8.9g 12700 R 51.0 15.1 3:45.67 PPBatchPrimProc 9455 root 19 -1 42.5g 8.9g 12700 R 50.0 15.1 3:41.74 PPBatchPrimProc 9457 root 19 -1 42.5g 8.9g 12700 R 50.0 15.1 3:42.52 PPBatchPrimProc 9454 root 19 -1 42.5g 8.9g 12700 R 46.0 15.1 3:46.87 PPBatchPrimProc 9458 root 19 -1 42.5g 8.9g 12700 R 46.0 15.1 3:44.14 PPBatchPrimProc 9460 root 19 -1 42.5g 8.9g 12700 R 46.0 15.1 3:45.70 PPBatchPrimProc 9464 root 19 -1 42.5g 8.9g 12700 S 1.0 15.1 0:02.34 PPHandDestroy 9465 root 19 -1 42.5g 8.9g 12700 S 1.0 15.1 0:02.74 PPHandDestroy 9413 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.04 PrimProc 9438 root 20 0 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc 9444 root 20 0 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc 9445 root 20 0 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc 9452 root 20 0 42.5g 8.9g 12700 S 0.0 15.1 0:00.08 PrimProc 9453 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc 9462 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:04.94 PPHandDestroy 9463 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.78 PPHandDestroy 9466 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:03.63 PPHandDestroy 9468 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.49 PrimProc 9469 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.31 PrimProc 9470 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.44 PrimProc 9471 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.53 PrimProc 9472 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.53 PrimProc 9473 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.50 PrimProc 9474 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.49 PrimProc 9475 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:02.55 PrimProc 9476 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PrimProc 9477 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPServerThr 9503 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.10 PPReadThread 9504 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.06 PPReadThread 9573 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPReadThread 9679 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPReadThread 13349 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPHandCreate 17373 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPHandCreate 17374 root 19 -1 42.5g 8.9g 12700 S 0.0 15.1 0:00.00 PPHandCreate

          People

            winstone Zdravelina Sokolovska (Inactive)
            drrtuy Roman
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.