Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-25340

Server startup with large innodb_buffer_pool_size takes a long time

Details

    • Bug
    • Status: Closed (View Workflow)
    • Critical
    • Resolution: Won't Do
    • 10.1(EOL), (13)
      10.2(EOL), 10.3(EOL), 10.4(EOL), 10.5, 10.6, 10.7(EOL), 10.8(EOL), 10.9(EOL), 10.10(EOL), 10.11, 11.0(EOL), 11.1(EOL), 11.2(EOL)
    • N/A

    Description

      The initialization of innodb buffer pool chunks/blocks on allocation has a number of consequences.

      • on very large memory systems this can take significant time
      • the initialization of data in the allocated memory forces this to paged into the process resulting in a real allocation out of the available OS space.

      The second becomes a problem when a large number of processes are on the system, potentially a large number of mariadb instances all competing for memory. A claim on use approach leaves more RAM available for other processes if mariadb doesn't end up using it.

      Sizing innodb buffer pool is a hard task so lets try to make it easier, or just less consequences if its wrong.

      The proposal is buf_pool_t::chunk_t::create removed the initialization (buf_block_init) and this becomes detected when blocks/chunks are used and then initialized there.

      Attachments

        Issue Links

          Activity

            Transition Time In Source Status Execution Times
            Marko Mäkelä made transition -
            Open In Progress
            853d 8h 8m 1
            Marko Mäkelä made transition -
            In Progress In Testing
            4d 6h 41m 1
            Marko Mäkelä made transition -
            In Testing Stalled
            5d 17h 20m 1
            Marko Mäkelä made transition -
            Stalled Needs Feedback
            78d 4h 44m 1
            Sergei Golubchik made transition -
            Needs Feedback Open
            66d 2h 18m 1
            Marko Mäkelä made transition -
            Open Closed
            454d 19h 10m 1

            People

              marko Marko Mäkelä
              danblack Daniel Black
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.