Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-5044

Improve PP thread pool with a fair scheduler

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 6.3.1
    • Fix Version/s: 22.08.1
    • Component/s: PrimProc
    • Labels:
      None
    • Sprint:
      2021-17

      Description

      PP now uses PriorityThreadPool(PTP) that has 3 priority queues and supports Job re-scheduling(can happen if there is no space to service a primitive job request from EM).
      PTP doesn't equally distribute computation resources b/w primitive jobs that belongs to different queries so that the variance of query timings is linear to number of simultaneous queries.
      The suggestion is to implement a scheduling component that will try to fairly process mentioned primitive jobs.

        Attachments

          Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. MCOL-4593 Multiple concurrent queries with aggregates are bottlenecked, result in lack of user scalability

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MCOL-4691 Major Regression: Selects with aggregates 2x slower in 5.x than in 1.2 (due to collation support)

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. MCOL-5043 Reduce a number of pre-spawned ExeMgr threads

          • Major - Major loss of function.
          • In Progress

          New Feature - A new feature of the product, which has yet to be developed. MCOL-5045 Computational resources and Workload aware primitive job scheduler in EM.

          • Major - Major loss of function.
          • Open

            Activity

              People

              Assignee:
              dleeyh Daniel Lee
              Reporter:
              drrtuy Roman
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.