Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-34493

memory leak when using galera node with only replication thread

    XMLWordPrintable

Details

    • Bug
    • Status: Open (View Workflow)
    • Major
    • Resolution: Unresolved
    • 10.6.16
    • 10.6
    • Galera, Server
    • None
    • redhat 8 on vmware

    Description

      we are getting memory leak in one DB server.

      situation:

      • our architecture is 3 nodes galera cluster - 2 DB nodes + 1 arbitrator in different locations. Plus running haproxy as the front end
      • haproxy redirects traffic to one DB node in normal stage. Another DB node is configured as backup in haproxy
      • the backup DB node used up its operating system available memory in 1 or 2 days. The DB node is running on 64GB memory VM and 8GB buffer pool
      • after available memory used up in backup DB node, OS killed the DB process and available memory got released
      • the backup DB node got 128 galera replication threads

      Since haproxy does not route traffic to backup DB node in normal situation, only replication and Percona PMM are using backup DB node.

      Screenshot:
      uploaded top command output, keeping decreasing available memory and output of memory_summary_global_by_event_name and memory_summary_by_thread_by_event_name

      Question:
      Any method to continue the troubleshooting? Kindly advise "memory/sql/thd::main_mem_root" is related to the memory leak or not.

      Regards,
      William Wong

      Attachments

        1. available-memory-keeps-decreaing.png
          713 kB
          William Wong
        2. main_mem_root-at-session-level.png
          831 kB
          William Wong
        3. top.png
          360 kB
          William Wong
        4. top-memory_summary_global_by_event_name.png
          557 kB
          William Wong

        Activity

          People

            janlindstrom Jan Lindström
            frelist William Wong
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.