[MDEV-6084] memory usage does not match the OS Created: 2014-04-13  Updated: 2014-05-22  Due: 2014-05-04  Resolved: 2014-05-22

Status: Closed
Project: MariaDB Server
Component/s: None
Affects Version/s: 5.5.36-galera
Fix Version/s: None

Type: Bug Priority: Major
Reporter: Philip orleans Assignee: Unassigned
Resolution: Incomplete Votes: 0
Labels: innodb, memory, usage
Environment:

2.6.32-431.11.2.el6.x86_64, scientific linux


Attachments: PNG File out-of-memory.png     Text File status.txt    

 Description   

I am using INNODB, and have assigned 48GB of large pages to the engine

show variables like '%buffer%';
+-------------------------------------+----------------+
| Variable_name                       | Value          |
+-------------------------------------+----------------+
| aria_pagecache_buffer_size          | 1073741824     |
| aria_sort_buffer_size               | 268434432      |
| bulk_insert_buffer_size             | 94294967295    |
| innodb_buffer_pool_dump_at_shutdown | OFF            |
| innodb_buffer_pool_dump_now         | OFF            |
| innodb_buffer_pool_filename         | ib_buffer_pool |
| innodb_buffer_pool_instances        | 32             |
| innodb_buffer_pool_load_abort       | OFF            |
| innodb_buffer_pool_load_at_startup  | OFF            |
| innodb_buffer_pool_load_now         | OFF            |
| innodb_buffer_pool_size             | 48318382080    |
| innodb_change_buffer_max_size       | 25             |
| innodb_change_buffering             | all            |
| innodb_log_buffer_size              | 4294967296     |
| innodb_sort_buffer_size             | 1048576        |
| join_buffer_size                    | 4294967296     |
| join_buffer_space_limit             | 2097152        |
| key_buffer_size                     | 1585446912     |
| mrr_buffer_size                     | 262144         |
| myisam_sort_buffer_size             | 8388608        |
| net_buffer_length                   | 8192           |
| preload_buffer_size                 | 32768          |
| read_buffer_size                    | 4194304        |
| read_rnd_buffer_size                | 4194304        |
| sort_buffer_size                    | 8388608        |
| sql_buffer_result                   | OFF            |
+-------------------------------------+----------------+

But my OS is telling me that mariadb is using 70 GB

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
 5918 mysql     20   0 70.3g  11g 5852 S  4.0 12.6   9:00.18 mysqld

The question is, where are the other 20 Gb being used?
I only need to use INNODB, don´t understand exactly what aria is.



 Comments   
Comment by Sergei Golubchik [ 2014-04-14 ]

There are many reasons why a memory could be allocated. And show variables is not the only way to examine that. See, for example,

Comment by Philip orleans [ 2014-04-14 ]

Show status output

Comment by Philip orleans [ 2014-04-14 ]

machine out-of-memory error

Comment by Philip orleans [ 2014-04-14 ]

I uploaded the output of "show status". Also, the machine threw an out-of-memory error.

Comment by Sergei Golubchik [ 2014-04-21 ]

this doesn't help, unfortunately. Perhaps it's still InnoDB that allocates all this memory, but I cannot tell that based on the information you've provided. Try this article — innodb memory usage, you should be able to see how much memory innodb is really using in your setup.

Generated at Thu Feb 08 07:09:14 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.