[MDEV-22186] Please add innodb_buffer_pool_in_core_file option (Facebook/MySQL 8 cherry pick patch) Created: 2020-04-08  Updated: 2022-01-05  Resolved: 2020-04-08

Status: Closed
Project: MariaDB Server
Component/s: Configuration
Fix Version/s: N/A

Type: Task Priority: Major
Reporter: Roel Van de Paar Assignee: Roel Van de Paar
Resolution: Won't Do Votes: 0
Labels: None

Issue Links:
Relates
relates to MDEV-10814 Feature request: Optionally exclude ... Closed

 Description   

It would be great to have the innodb_buffer_pool_in_core_file option in all MariaDB versions (10.1-10.5).

Please ref;



 Comments   
Comment by Daniel Black [ 2020-04-08 ]

This implemented differently in MDEV-10814 (10.3.7+) as an always on function.

Could look at attempting a core_pattern (man 5 core) script that filters out aspects though I don't know how to do that. A gdb script maybe.

coredump_filter doesn't seem usable, unless with huge pages which is horrible and getting fixed in 10.5 (MDEV-18851).

Comment by Roel Van de Paar [ 2020-04-08 ]

Thank you Daniel! Some thoughts

  • Ack on MDEV-10814!
  • Some further research shows that cores generated are 1.2GB in size on 128GB server, so seems reasonable as-is.
  • Looking at man 5 core, coredump_filter may work also to reduce further (and gdb script would not work as that is post-core-generation)

In summary, I will close this request for the moment. Thank you.

Comment by Daniel Black [ 2020-04-08 ]

I had a 10.1/10.2 thought for you. In your test environment after the server is started, execute a gdb script with `call madvise(

{approprate buffer pointer}

,size, MADV_DONTDUMP);`

It has to be done with every chunk of the innodb buffer pool, so reducing the number of pools and increasing the chunk size will result in less calls.

buf_pool_ptr[i] and then to chunk:

how allocated: https://github.com/MariaDB/server/blob/mariadb-10.2.22/storage/innobase/buf/buf0buf.cc#L1533

or take addresses/sizes out of /proc/$(pidof mysqld)/smaps

ref: call https://sourceware.org/gdb/onlinedocs/gdb/Calling.html

Comment by Daniel Black [ 2020-04-08 ]

ps. glad MDEV-10814 is working so well you didn't even notice

Comment by Roel Van de Paar [ 2020-04-08 ]

Yes And thank you for the 10.1/10.2 tip!

Generated at Thu Feb 08 09:12:50 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.