[MCOL-5045] Computational resources and Workload aware primitive job scheduler in EM. Created: 2022-04-06  Updated: 2023-12-15

Status: Open
Project: MariaDB ColumnStore
Component/s: ExeMgr, PrimProc
Affects Version/s: 6.2.3
Fix Version/s: Icebox

Type: New Feature Priority: Major
Reporter: Roman Assignee: Max Mether
Resolution: Unresolved Votes: 0
Labels: None

Issue Links:
Relates
relates to MCOL-5044 Improve PP thread pool with a fair sc... Closed
relates to MCOL-5043 Reduce a number of pre-spawned ExeMgr... Stalled

 Description   

EM now issues a number of Primitive Jobs request messages towards PP doing scanning. This takes place in TupleBPS::sendJobs(). The limit of a simultaneous outstanding PJ should become dynamic and its size must depend on a math model that takes the resources currently available into account on the nodes.


Generated at Thu Feb 08 02:54:56 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.