Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-24670

avoid OOM by linux kernel co-operative memory management

Details

    Description

      Allocating sufficiently available memory but not too much has been a challenge for MariaDB and MySQL users for a significant time.

      The overallocation results in a risk of OOM killing of the server process.

      Linux kernel this interface:
      https://www.kernel.org/doc/html/latest/accounting/psi.html

      By receiving a memory event of memory pressure options are:

      • madvice(DONT_NEED/FREE) on buf_pool.free
      • Moving innodb buffer LRU pool chunks to free
      • Resizing down innodb buffer pool
      • Kill off thread cache thread(s)?
      • table caches (are these large?)

      So configuration would need a trigger values, "<some|full> <stall amount in us> <time window in us>", from the kernel interface. And a response for "some"/"full".

      Attachments

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. MDEV-31953 madvise(frame, srv_page_size, MADV_FREE) is causing a performance regression

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          causes

          Bug - A problem which impairs or prevents the functions of the product. MDEV-33340 fix for MDEV-24670 causes a performance regression

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-34753 memory pressure - erroneous termination condition

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MDEV-25340 Server startup with large innodb_buffer_pool_size takes a long time

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Task - A task that needs to be done. MDEV-25341 innodb buffer pool soft decommit of memory

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-29431 SQL interface and Storage Engine interface for reclaiming memory

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Task - A task that needs to be done. MDEV-29432 innodb huge pages reclaim

          • Major - Major loss of function.
          • Needs Feedback

          Task - A task that needs to be done. MDEV-19895 Support "autoset" in SET GLOBAL for AUTO_SET system variables

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-25342 autosize innodb_buffer_pool_chunk_size

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-27772 Performance regression with default configuration in 10.6

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. MDEV-30762 Memory Limit reached causes mariadb server restart

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. MDEV-34863 RAM Usage Changed Significantly Between 10.11 Releases

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MDEV-36197 Implement Buffer Pool Auto-Scaling Based on RAM Availability

          • Major - Major loss of function.
          • Open

          Activity

            Transition Time In Source Status Execution Times
            Daniel Black made transition -
            Open In Progress
            		585d 6h 49m 1
            Daniel Black made transition -
            In Progress In Review
            		16m 59s 1
            Daniel Black made transition -
            In Review Stalled
            		416d 22h 53m 1
            Daniel Black made transition -
            Stalled In Progress
            		3d 36m 1
            Daniel Black made transition -
            In Progress Closed
            		22d 26m 1

            People

              danblack Daniel Black
              danblack Daniel Black
              Votes:
              2 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.