Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-36135

Dynamic CPU Detection & Auto-Adjusting Thread Pool

Details

    • New Feature
    • Status: Open (View Workflow)
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      *Overview:
      *In today's cloud-native deployments, MariaDB Server must adapt to dynamic resource changes without downtime. Currently, the thread pool is configured based on available CPUs only at startup, so if CPUs are added or removed, the server doesn't automatically adjust, potentially limiting performance.

      *Current State:
      *
      Static CPU-Based Settings: Thread pool settings are fixed at startup and do not respond to changes.Dynamic Environments: In Kubernetes-managed deployments, CPU resources can be scaled up or down on the fly.Auto-Scaling Considerations: Adjustments must support both scaling up (adding CPUs) and scaling down (removing CPUs) without affecting active connections.

      *Proposed Feature:
      *Introduce a mechanism that:

      1. Monitors CPU Resources: Uses OS-level notifications or periodic checks to detect changes in available CPUs/vCPUs.
        Auto-Scales Thread Pool Parameters:
      • Scaling Up: When additional CPUs are detected, the thread pool's maximum thread count and related settings are increased to fully utilize the new resources.
      • Scaling Down: When CPUs are removed, the system gracefully reduces the thread pool size, ensuring active threads complete their work before termination.
      1. Ensures Stability: Adjusts parameters dynamically without requiring a server restart, preserving existing connections and workload continuity.

      *Benefits:
      *
      Optimized Performance: Dynamically adjusts to fully leverage available resources, reducing latency and improving throughput.
      Enhanced Flexibility: Adapts in real time to auto-scaling events in cloud environments.
      Seamless Scaling: Supports both upward and downward scaling, ensuring efficient resource utilization without disruption.

      Attachments

        Activity

          People

            Unassigned Unassigned
            adamluciano Adam Luciano
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.