Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-5044

Improve PP thread pool with a fair scheduler

    XMLWordPrintable

Details

    • New Feature
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • 6.3.1
    • 22.08.1
    • PrimProc
    • None
    • 2021-17

    Description

      PP now uses PriorityThreadPool(PTP) that has 3 priority queues and supports Job re-scheduling(can happen if there is no space to service a primitive job request from EM).
      PTP doesn't equally distribute computation resources b/w primitive jobs that belongs to different queries so that the variance of query timings is linear to number of simultaneous queries.
      The suggestion is to implement a scheduling component that will try to fairly process mentioned primitive jobs.

      Attachments

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. MCOL-4593 Multiple concurrent queries with aggregates are bottlenecked, result in lack of user scalability

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Stalled
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MCOL-4691 Major Regression: Selects with aggregates 2x slower in 5.x than in 1.2 (due to collation support)

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MCOL-5043 Reduce a number of pre-spawned ExeMgr threads

          • Major - Major loss of function.
          • Stalled

          New Feature - A new feature of the product, which has yet to be developed. MCOL-5045 Computational resources and Workload aware primitive job scheduler in EM.

          • Major - Major loss of function.
          • Open

          Activity

            People

              dleeyh Daniel Lee (Inactive)
              drrtuy Roman
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.