Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-25342

autosize innodb_buffer_pool_chunk_size

Details

    Description

      With MDEV-25340, MDEV-25341 and MDEV-24670 it would be good to ensure that the changes aren't frequently triggered and have a moderately substantial impact.

      The current default innodb_buffer_pool_chunk_size of 128M results in 1024 segments for 128G RAM.

      As the chunk size is designed around buffer pool resizing maybe 128 equating to just under 1% would be more appropriate.

      So I'm thinking MAX(128M, buffer_pool_size / 128), then round down to a multiple of the next smallest large page size if large_pages are enabled, or a multiple of the OS page size otherwise.

      Sound acceptable marko

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. MDEV-27891 Delayed SIGSEGV in buf_pool_t::resize on InnoDB buffer pool resize after or during DROP TABLE

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed
          relates to

          Task - A task that needs to be done. MDEV-24670 avoid OOM by linux kernel co-operative memory management

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25340 Server startup with large innodb_buffer_pool_size takes a long time

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Task - A task that needs to be done. MDEV-25341 innodb buffer pool soft decommit of memory

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-27461 Server hangs when the bufferpool is shrunk to 8M and innodb_page_size=64K

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-28803 ERROR 1206 (HY000): The total number of locks exceeds the lock table size

          • Major - Major loss of function.
          • Confirmed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-28805 SET GLOBAL innodb_buffer_pool_size=12*1024*1024 has different outcomes depending on version

          • Major - Major loss of function.
          • Closed

          Activity

            Ascending order - Click to sort in descending order
            danblack Daniel Black created issue -
            danblack Daniel Black made changes -
            Field Original Value New Value
            Assignee Daniel Black [ danblack ]
            danblack Daniel Black made changes -
            danblack Daniel Black made changes -
            danblack Daniel Black made changes -
            danblack Daniel Black made changes -
            Description With MDEV-25340, MDEV-25341 and MDEV-24670 it would be good to ensure that the changes aren't frequently triggered and have a moderately substantial impact.

            The current default innodb_buffer_pool_chunk_size of 128M results in 1024 segments for 128G RAM.

            As the chunk size is designed around buffer pool resizing maybe 128 equating to just under 1% would be more appropriate.

            So I'm thinking MAX(128M, buffer_pool_size / 128), then round down to a large page size if large_pages are enabled, or the OS page size otherwise.

            Sound acceptable [~marko]             		With MDEV-25340, MDEV-25341 and MDEV-24670 it would be good to ensure that the changes aren't frequently triggered and have a moderately substantial impact.

            The current default innodb_buffer_pool_chunk_size of 128M results in 1024 segments for 128G RAM.

            As the chunk size is designed around buffer pool resizing maybe 128 equating to just under 1% would be more appropriate.

            So I'm thinking MAX(128M, buffer_pool_size / 128), then round down to a multiple of the next smallest large page size if large_pages are enabled, or a multiple of the OS page size otherwise.

            Sound acceptable [~marko]
            serg Sergei Golubchik made changes -
            Fix Version/s 10.7 [ 24805 ]
            Fix Version/s 10.6 [ 24028 ]
            ralf.gebhardt Ralf Gebhardt made changes -
            Fix Version/s 10.8 [ 26121 ]
            Fix Version/s 10.7 [ 24805 ]
            serg Sergei Golubchik made changes -
            Workflow MariaDB v3 [ 120761 ] MariaDB v4 [ 131477 ]
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            marko Marko Mäkelä made changes -
            Fix Version/s 10.8.1 [ 26815 ]
            Fix Version/s 10.8 [ 26121 ]
            Resolution Fixed [ 1 ]
            Status Open [ 1 ] Closed [ 6 ]
            marko Marko Mäkelä made changes -
            danblack Daniel Black made changes -
            Roel Roel Van de Paar made changes -
            rob.schwyzer@mariadb.com Rob Schwyzer (Inactive) made changes -
            rob.schwyzer@mariadb.com Rob Schwyzer (Inactive) made changes -

            People

              danblack Daniel Black
              danblack Daniel Black
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.