[MDEV-21863] InnoDB: Assertion failure rem0rec.cc 1878 Created: 2020-03-03  Updated: 2020-04-27  Resolved: 2020-04-27

Status: Closed
Project: MariaDB Server
Component/s: Storage Engine - InnoDB
Affects Version/s: 10.3.11
Fix Version/s: N/A

Type: Bug Priority: Major
Reporter: Aurélien LEQUOY Assignee: Marko Mäkelä
Resolution: Cannot Reproduce Votes: 0
Labels: None

Issue Links:
Blocks
is blocked by MDEV-21890 cannot connect to phpAdmin Closed
Relates
relates to MDEV-13542 Crashing on a corrupted page is unhel... Closed

 Description    

2020-03-03 17:11:31 0x7f03bcb92700  InnoDB: Assertion failure in file /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/rem/rem0rec.cc line 1878
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to https://jira.mariadb.org/
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mysqld startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: https://mariadb.com/kb/en/library/xtradbinnodb-recovery-modes/
 
InnoDB: about forcing recovery.
 
200303 17:11:31 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed,
 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.3.11-MariaDB-log
 
key_buffer_size=134217728
 
read_buffer_size=2097152
 
max_used_connections=13
 
max_threads=2002
 
thread_count=23
 
It is possible that mysqld could use up to
 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 8375880 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x7f03480009a8
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7f03bcb91d00 thread_stack 0x49000
 
/usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x55b0b491061e]
 
mysys/stacktrace.c:270(my_print_stacktrace)[0x55b0b43b13a7]
 
sigaction.c:0(__restore_rt)[0x7f38ad7a75d0]
 
:0(__GI_raise)[0x7f38aba7b207]
 
:0(__GI_abort)[0x7f38aba7c8f8]
 
/usr/sbin/mysqld(+0x4c62b6)[0x55b0b40fb2b6]
 
ut/ut0rbt.cc:221(rbt_tree_add_child(ib_rbt_t const*, ib_rbt_bound_t*, ib_rbt_node_t*) [clone .isra.4] [clone .part.5])[0x55b0b46222c3]
 
rem/rem0rec.cc:1878(rec_copy_prefix_to_buf(unsigned char const*, dict_index_t const*, unsigned long, unsigned char**, unsigned long*))[0x55b0b46fc4d8]
 
btr/btr0pcur.cc:174(btr_pcur_store_position(btr_pcur_t*, mtr_t*))[0x55b0b4668828]
 
row/row0sel.cc:5597(row_search_mvcc(unsigned char*, page_cur_mode_t, row_prebuilt_t*, unsigned long, unsigned long))[0x55b0b4590a99]
 
handler/ha_innodb.cc:9530(ha_innobase::general_fetch(unsigned char*, unsigned int, unsigned int))[0x55b0b43b6d29]
 
sql/handler.cc:2894(handler::ha_index_prev(unsigned char*))[0x55b0b421e33c]
 
sql/sql_select.cc:20444(join_read_prev(READ_RECORD*))[0x55b0b421360f]
 
sql/sql_select.cc:19417(sub_select(JOIN*, st_join_table*, bool))[0x55b0b4234cfb]
 
sql/sql_select.cc:18937(do_select)[0x55b0b4234f13]
 
sql/sql_select.cc:3835(JOIN::exec())[0x55b0b423506a]
 
sql/sql_select.cc:4241(mysql_select(THD*, TABLE_LIST*, unsigned int, List<Item>&, Item*, unsigned int, st_order*, st_order*, Item*, st_order*, unsigned long long, select_result*, st_select_lex_unit*, st_select_lex*))[0x55b0b4235b7c]
 
sql/sql_select.cc:385(handle_select(THD*, LEX*, select_result*, unsigned long))[0x55b0b40eb6b7]
 
sql/sql_parse.cc:6547(execute_sqlcom_select(THD*, TABLE_LIST*))[0x55b0b41e1af3]
 
sql/sql_parse.cc:3767(mysql_execute_command(THD*))[0x55b0b41e42db]
 
sql/sql_parse.cc:8091(mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x55b0b41e6e35]
 
sql/sql_parse.cc:1850(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool))[0x55b0b41e7c9e]
 
sql/sql_parse.cc:1397(do_command(THD*))[0x55b0b42b79da]
 
sql/sql_connect.cc:1402(do_handle_one_connection(CONNECT*))[0x55b0b42b7afd]
 
sql/sql_connect.cc:1310(handle_one_connection)[0x55b0b455bd3d]
 
pthread_create.c:0(start_thread)[0x7f38ad79fdd5]
 
/lib64/libc.so.6(clone+0x6d)[0x7f38abb42ead]
 
 
 
Trying to get some variables.
 
Some pointers may be invalid and cause the dump to abort.
 
Query (0x7f0348011de0): SELECT `ssladmin_certificatemodel`.`id`, `ssladmin_certificatemodel`.`provider`, `ssladmin_certificatemodel`.`orderid`, `ssladmin_certificatemodel`.`common_name`, `ssladmin_certificatemodel`.`key_alg`, `ssladmin_certificatemodel`.`private_key_pem`, `ssladmin_certificatemodel`.`private_key_fernet`, `ssladmin_certificatemodel`.`certificate_request_pem`, `ssladmin_certificatemodel`.`certificate_pem`, `ssladmin_certificatemodel`.`status`, `ssladmin_certificatemodel`.`created`, `ssladmin_certificatemodel`.`modified` FROM `ssladmin_certificatemodel` WHERE (`ssladmin_certificatemodel`.`id` LIKE '%aazfby%' OR `ssladmin_certificatemodel`.`common_name` LIKE '%aazfby%') ORDER BY `ssladmin_certificatemodel`.`id` DESC
 
Connection ID (thread ID): 75887
 
Status: NOT_KILLED
 
 
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on
 
 
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.

The query who caused this crash :

 
 
CREATE TABLE `ssladmin_certificatemodel` (
 
  `id` int(11) NOT NULL AUTO_INCREMENT,
 
  `provider` varchar(30) NOT NULL,
 
  `orderid` varchar(30) NOT NULL,
 
  `common_name` varchar(100) NOT NULL,
 
  `key_alg` varchar(10) NOT NULL,
 
  `private_key_pem` longtext NOT NULL,
 
  `certificate_request_pem` longtext NOT NULL,
 
  `certificate_pem` longtext NOT NULL,
 
  `status` longtext NOT NULL,
 
  `created` datetime(6) NOT NULL,
 
  `modified` datetime(6) NOT NULL,
 
  `private_key_fernet` longtext NOT NULL,
 
  PRIMARY KEY (`id`),
 
  UNIQUE KEY `ssladmin_certificatemode_provider_orderid_common__bc90565b_uniq` (`provider`,`orderid`,`common_name`,`key_alg`)
 
) ENGINE=InnoDB AUTO_INCREMENT=24264 DEFAULT CHARSET=utf8;
 
 
 
 
 
SELECT 
  `ssladmin_certificatemodel`.`id`, 
  `ssladmin_certificatemodel`.`provider`, 
  `ssladmin_certificatemodel`.`orderid`, 
  `ssladmin_certificatemodel`.`common_name`, 
  `ssladmin_certificatemodel`.`key_alg`, 
  `ssladmin_certificatemodel`.`private_key_pem`, 
  `ssladmin_certificatemodel`.`private_key_fernet`, 
  `ssladmin_certificatemodel`.`certificate_request_pem`, 
  `ssladmin_certificatemodel`.`certificate_pem`, 
  `ssladmin_certificatemodel`.`status`, 
  `ssladmin_certificatemodel`.`created`, 
  `ssladmin_certificatemodel`.`modified` 
FROM 
  `ssladmin_certificatemodel` 
WHERE 
  (
 
    `ssladmin_certificatemodel`.`id` LIKE '%aazfby%' 
    OR `ssladmin_certificatemodel`.`common_name` LIKE '%aazfby%'
 
  ) 
ORDER BY 
  `ssladmin_certificatemodel`.`id` DESC

Unfortunatly I cannot provide data (private keys)

Workaround to fix :

 
 
mysql_upgrade --force
 
--nothing special
 
 
 
MariaDB [netportal_db]> SELECT    `ssladmin_certificatemodel`.`id`,    `ssladmin_certificatemodel`.`provider`,    `ssladmin_certificatemodel`.`orderid`,    `ssladmin_certificatemodel`.`common_name`,    `ssladmin_certificatemodel`.`key_alg`,    `ssladmin_certificatemodel`.`private_key_pem`,    `ssladmin_certificatemodel`.`private_key_fernet`,    `ssladmin_certificatemodel`.`certificate_request_pem`,    `ssladmin_certificatemodel`.`certificate_pem`,    `ssladmin_certificatemodel`.`status`,    `ssladmin_certificatemodel`.`created`,    `ssladmin_certificatemodel`.`modified`  FROM    `ssladmin_certificatemodel`  WHERE    (     `ssladmin_certificatemodel`.`id` LIKE '%aazfby%'      OR `ssladmin_certificatemodel`.`common_name` LIKE '%aazfby%'   )  ORDER BY    `ssladmin_certificatemodel`.`id` DESC;
 
 
 
--crash mariadb got signal 6
 
 
 
MariaDB [netportal_db]> ALTER TABLE ssladmin_certificatemodel ENGINE=INNODB; 
Query OK, 0 rows affected (21.818 sec)     -- <<= 26 000 lignes and not big at all !         
Records: 0  Duplicates: 0  Warnings: 0
 
 
 
MariaDB [netportal_db]> SELECT    `ssladmin_certificatemodel`.`id`,    `ssladmin_certificatemodel`.`provider`,    `ssladmin_certificatemodel`.`orderid`,    `ssladmin_certificatemodel`.`common_name`,    `ssladmin_certificatemodel`.`key_alg`,    `ssladmin_certificatemodel`.`private_key_pem`,    `ssladmin_certificatemodel`.`private_key_fernet`,    `ssladmin_certificatemodel`.`certificate_request_pem`,    `ssladmin_certificatemodel`.`certificate_pem`,    `ssladmin_certificatemodel`.`status`,    `ssladmin_certificatemodel`.`created`,    `ssladmin_certificatemodel`.`modified`  FROM    `ssladmin_certificatemodel`  WHERE    (     `ssladmin_certificatemodel`.`id` LIKE '%aazfby%'      OR `ssladmin_certificatemodel`.`common_name` LIKE '%aazfby%'   )  ORDER BY    `ssladmin_certificatemodel`.`id` DESC;
 
 
 
-- secret results
 
2 rows in set (0.061 sec)



 Comments   
Comment by Aurélien LEQUOY [ 2020-03-05 ]

after EXPORT & IMPORT of table space :

in 10.4.12 => OK (but i think PK rebuild on import ? )
in 10.3.11 => crash

some tests :

MariaDB [test]> select id from ssladmin_certificatemodel *order by id* DESC;
 
ERROR 2013 (HY000): Lost connection to MySQL server during query
 
MariaDB [test]>

ORDER BY "pk" is the point who make it crash

ALTER TABLE ssladmin_certificatemodel DROP PRIMARY KEY;
 
ERROR 2006 (HY000): MySQL server has gone away
 
No connection. Trying to reconnect...
 
Connection id:    21
 
Current database: test
 
 
 
ERROR 1075 (42000): Incorrect table definition; there can be only one auto column and it must be defined as a key
 
 
 
 
 
 
 
MariaDB [test]> ALTER TABLE ssladmin_certificatemodel MODIFY id INT NOT NULL;
 
Query OK, 23585 rows affected (2.262 sec)              
Records: 23585  Duplicates: 0  Warnings: 0
 
 
 
 
 
and finnaly :
 
 
 
MariaDB [test]> select id from ssladmin_certificatemodel order by id limit 10;
 
+----+
 
| id |
 
+----+
 
|  2 |
 
|  3 |
 
|  4 |
 
|  5 |
 
|  6 |
 
|  7 |
 
|  8 |
 
|  9 |
 
| 10 |
 
| 11 |
 
+----+
 
10 rows in set (0.003 sec)
 
 
 
 

Comment by Marko Mäkelä [ 2020-03-09 ]

Aurelien_LEQUOY, the top of the stack trace is slightly wrong, but the rest of it is plausible. It looks like corruption is being detected in rec_copy_prefix_to_buf():

        switch (rec_get_status(rec)) {
 
        default:
 
                /* infimum or supremum record: no sense to copy anything */
 
                ut_error;
 
                return(NULL);

The function btr_cur_store_position() should never invoke this function on the predefined infimum or supremum record. It looks like the record header of a user record is corrupted on that page. If you could attach the debugger to the server before the crash, then we should be able to confirm this.

gdb -p $(pgrep -x mysqld)
 
continue

Then, trigger the crash and in gdb, execute the following:

thread apply all backtrace
 
quit

Even better would be a dump of the data page.

If this crash is caused by corruption, like I suspect, then this report essentially duplicates MDEV-13542.

Comment by Aurélien LEQUOY [ 2020-03-09 ]

this backtrace worked good :

log_error :

2020-03-09 16:04:16 0x7efdb4884700  InnoDB: Assertion failure in file /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/rem/rem0rec.cc line 1878
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to https://jira.mariadb.org/
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mysqld startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: https://mariadb.com/kb/en/library/xtradbinnodb-recovery-modes/
 
InnoDB: about forcing recovery.
 
200309 16:04:36 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.3.11-MariaDB-log
 
key_buffer_size=134217728
 
read_buffer_size=2097152
 
max_used_connections=5
 
max_threads=2002
 
thread_count=13
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 8375880 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x7efd740009a8
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7efdb4883d00 thread_stack 0x49000
 
/usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x55f07986e61e]
 
mysys/stacktrace.c:270(my_print_stacktrace)[0x55f07930f3a7]
 
sigaction.c:0(__restore_rt)[0x7f32a05d85d0]
 
:0(__GI_raise)[0x7f329e8ac207]
 
:0(__GI_abort)[0x7f329e8ad8f8]
 
/usr/sbin/mysqld(+0x4c62b6)[0x55f0790592b6]
 
ut/ut0rbt.cc:221(rbt_tree_add_child(ib_rbt_t const*, ib_rbt_bound_t*, ib_rbt_node_t*) [clone .isra.4] [clone .part.5])[0x55f0795802c3]
 
rem/rem0rec.cc:1878(rec_copy_prefix_to_buf(unsigned char const*, dict_index_t const*, unsigned long, unsigned char**, unsigned long*))[0x55f07965a4d8]
 
btr/btr0pcur.cc:174(btr_pcur_store_position(btr_pcur_t*, mtr_t*))[0x55f0795c6828]
 
row/row0sel.cc:5597(row_search_mvcc(unsigned char*, page_cur_mode_t, row_prebuilt_t*, unsigned long, unsigned long))[0x55f0794eea99]
 
handler/ha_innodb.cc:9530(ha_innobase::general_fetch(unsigned char*, unsigned int, unsigned int))[0x55f079314d29]
 
sql/handler.cc:2894(handler::ha_index_prev(unsigned char*))[0x55f07917c33c]
 
sql/sql_select.cc:20444(join_read_prev(READ_RECORD*))[0x55f07917160f]
 
sql/sql_select.cc:19417(sub_select(JOIN*, st_join_table*, bool))[0x55f079192cfb]
 
sql/sql_select.cc:18937(do_select)[0x55f079192f13]
 
sql/sql_select.cc:3835(JOIN::exec())[0x55f07919306a]
 
sql/sql_select.cc:4241(mysql_select(THD*, TABLE_LIST*, unsigned int, List<Item>&, Item*, unsigned int, st_order*, st_order*, Item*, st_order*, unsigned long long, select_result*, st_select_lex_unit*, st_select_lex*))[0x55f079193b7c]
 
sql/sql_select.cc:385(handle_select(THD*, LEX*, select_result*, unsigned long))[0x55f0790496b7]
 
sql/sql_parse.cc:6547(execute_sqlcom_select(THD*, TABLE_LIST*))[0x55f07913faf3]
 
sql/sql_parse.cc:3767(mysql_execute_command(THD*))[0x55f0791422db]
 
sql/sql_parse.cc:8091(mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x55f079144e35]
 
sql/sql_parse.cc:1850(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool))[0x55f079145c9e]
 
sql/sql_parse.cc:1397(do_command(THD*))[0x55f0792159da]
 
sql/sql_connect.cc:1402(do_handle_one_connection(CONNECT*))[0x55f079215afd]
 
sql/sql_connect.cc:1310(handle_one_connection)[0x55f0794b9d3d]
 
pthread_create.c:0(start_thread)[0x7f32a05d0dd5]
 
/lib64/libc.so.6(clone+0x6d)[0x7f329e973ead]
 
 
 
Trying to get some variables.
 
Some pointers may be invalid and cause the dump to abort.
 
Query (0x7efd74011b10): SELECT `ssladmin_certificatemodel`.`id`, `ssladmin_certificatemodel`.`provider`, `ssladmin_certificatemodel`.`orderid`, `ssladmin_certificatemodel`.`common_name`, `ssladmin_certificatemodel`.`key_alg`, `ssladmin_certificatemodel`.`private_key_pem`, `ssladmin_certificatemodel`.`private_key_fernet`, `ssladmin_certificatemodel`.`certificate_request_pem`, `ssladmin_certificatemodel`.`certificate_pem`, `ssladmin_certificatemodel`.`status`, `ssladmin_certificatemodel`.`created`, `ssladmin_certificatemodel`.`modified` FROM `ssladmin_certificatemodel` WHERE (`ssladmin_certificatemodel`.`id` LIKE '%aazfby%' OR `ssladmin_certificatemodel`.`common_name` LIKE '%aazfby%') ORDER BY `ssladmin_certificatemodel`.`id` DESC
 
Connection ID (thread ID): 82
 
Status: NOT_KILLED
 
 
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on
 
 
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
2020-03-09 16:04:43 0 [Note] Using unique option prefix 'myisam_recover' is error-prone and can break in the future. Please use the full name 'myisam-recover-options' instead.
 
2020-03-09 16:04:43 0 [Note] InnoDB: Using Linux native AIO
 
2020-03-09 16:04:43 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
 
2020-03-09 16:04:43 0 [Note] InnoDB: Uses event mutexes
 
2020-03-09 16:04:43 0 [Note] InnoDB: Compressed tables use zlib 1.2.7
 
2020-03-09 16:04:43 0 [Note] InnoDB: Number of pools: 1
 
2020-03-09 16:04:43 0 [Note] InnoDB: Using SSE2 crc32 instructions
 
2020-03-09 16:04:43 0 [Note] InnoDB: Initializing buffer pool, total size = 202G, instances = 8, chunk size = 128M
 
2020-03-09 16:04:51 0 [Note] InnoDB: Completed initialization of buffer pool
 
2020-03-09 16:04:52 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
 
2020-03-09 16:04:53 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=57815019421
 
2020-03-09 16:04:56 0 [Note] InnoDB: Last binlog file '/var/opt/mysqllog/db59-bin-log.000001', position 28406502
 
2020-03-09 16:04:57 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
 
2020-03-09 16:04:57 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
 
2020-03-09 16:04:57 0 [Note] InnoDB: Creating shared tablespace for temporary tables
 
2020-03-09 16:04:57 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
 
2020-03-09 16:04:57 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
 
2020-03-09 16:04:57 0 [Note] InnoDB: Waiting for purge to start
 
2020-03-09 16:04:57 0 [Note] InnoDB: 10.3.11 started; log sequence number 57815019430; transaction id 61422540
 
2020-03-09 16:04:57 0 [Note] InnoDB: Loading buffer pool(s) from /var/opt/mysql/ib_buffer_pool
 
2020-03-09 16:04:57 0 [Note] Plugin 'FEEDBACK' is disabled.
 
2020-03-09 16:04:57 0 [Note] mysqld: GSSAPI plugin : using principal name 'mariadb/pmaria23-par.storage.criteo.preprod@UADPREPROD.PREPROD.CRTO.IN'
 
200309 16:04:57 server_audit: MariaDB Audit Plugin version 1.4.4 STARTED.
 
2020-03-09 16:04:57 0 [Note] Recovering after a crash using /var/opt/mysqllog/db59-bin-log
 
2020-03-09 16:04:57 0 [Note] Starting crash recovery...
 
2020-03-09 16:04:57 0 [Note] Crash recovery finished.
 
2020-03-09 16:04:57 0 [Note] Server socket created on IP: '0.0.0.0'.
 
2020-03-09 16:04:57 7 [Note] Event Scheduler: scheduler thread started with id 7
 
2020-03-09 16:04:57 0 [Note] Reading of all Master_info entries succeded
 
2020-03-09 16:04:57 0 [Note] Added new Master_info '' to hash table
 
2020-03-09 16:04:57 0 [Note] /usr/sbin/mysqld: ready for connections.
 
Version: '10.3.11-MariaDB-log'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  MariaDB Server
 
2020-03-09 16:05:01 10 [Warning] IP address '172.29.1.70' could not be resolved: Name or service not known
 
2020-03-09 16:05:05 0 [Note] InnoDB: Buffer pool(s) load completed at 200309 16:05:05

gdb -p $(pgrep -x mysqld)

[root@pmaria23-par /var/lib/mysql/test]# gdb -p $(pgrep -x mysqld)
 
GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-114.el7
 
Copyright (C) 2013 Free Software Foundation, Inc.
 
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
 
This is free software: you are free to change and redistribute it.
 
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
 
and "show warranty" for details.
 
This GDB was configured as "x86_64-redhat-linux-gnu".
 
For bug reporting instructions, please see:
 
<http://www.gnu.org/software/gdb/bugs/>.
 
Attaching to process 160534
 
Reading symbols from /usr/sbin/mysqld...done.
 
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
 
[New LWP 161761]
 
[New LWP 161058]
 
[New LWP 160831]
 
[New LWP 160828]
 
[New LWP 160827]
 
[New LWP 160826]
 
[New LWP 160825]
 
[New LWP 160824]
 
[New LWP 160823]
 
[New LWP 160822]
 
[New LWP 160821]
 
[New LWP 160820]
 
[New LWP 160819]
 
[New LWP 160818]
 
[New LWP 160817]
 
[New LWP 160816]
 
[New LWP 160815]
 
[New LWP 160814]
 
[New LWP 160813]
 
[New LWP 160812]
 
[New LWP 160811]
 
[New LWP 160580]
 
[New LWP 160579]
 
[New LWP 160578]
 
[New LWP 160577]
 
[New LWP 160576]
 
[New LWP 160575]
 
[New LWP 160574]
 
[New LWP 160573]
 
[New LWP 160572]
 
[New LWP 160571]
 
[New LWP 160570]
 
[New LWP 160569]
 
[New LWP 160568]
 
[New LWP 160567]
 
[New LWP 160537]
 
[New LWP 160536]
 
[Thread debugging using libthread_db enabled]
 
Using host libthread_db library "/lib64/libthread_db.so.1".
 
Loaded symbols for /lib64/libpthread.so.0
 
Reading symbols from /lib64/liblzma.so.5...Reading symbols from /lib64/liblzma.so.5...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/liblzma.so.5
 
Reading symbols from /lib64/libaio.so.1...Reading symbols from /lib64/libaio.so.1...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libaio.so.1
 
Reading symbols from /lib64/libz.so.1...Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libz.so.1
 
Reading symbols from /lib64/libcrypt.so.1...(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libcrypt.so.1
 
Reading symbols from /lib64/libsystemd.so.0...Reading symbols from /lib64/libsystemd.so.0...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libsystemd.so.0
 
Reading symbols from /lib64/libssl.so.10...Reading symbols from /lib64/libssl.so.10...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libssl.so.10
 
Reading symbols from /lib64/libcrypto.so.10...Reading symbols from /lib64/libcrypto.so.10...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libcrypto.so.10
 
Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libdl.so.2
 
Reading symbols from /lib64/libstdc++.so.6...(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libstdc++.so.6
 
Reading symbols from /lib64/libm.so.6...(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libm.so.6
 
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libc.so.6
 
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
 
Loaded symbols for /lib64/ld-linux-x86-64.so.2
 
Reading symbols from /lib64/libfreebl3.so...Reading symbols from /lib64/libfreebl3.so...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libfreebl3.so
 
Reading symbols from /lib64/libcap.so.2...Reading symbols from /lib64/libcap.so.2...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libcap.so.2
 
Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done.
 
Loaded symbols for /lib64/librt.so.1
 
Reading symbols from /lib64/libselinux.so.1...Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libselinux.so.1
 
Reading symbols from /lib64/liblz4.so.1...Reading symbols from /lib64/liblz4.so.1...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/liblz4.so.1
 
Reading symbols from /lib64/libgcrypt.so.11...Reading symbols from /lib64/libgcrypt.so.11...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libgcrypt.so.11
 
Reading symbols from /lib64/libgpg-error.so.0...Reading symbols from /lib64/libgpg-error.so.0...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libgpg-error.so.0
 
Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libresolv.so.2
 
Reading symbols from /lib64/libdw.so.1...Reading symbols from /lib64/libdw.so.1...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libdw.so.1
 
Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libgcc_s.so.1
 
Reading symbols from /lib64/libgssapi_krb5.so.2...Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libgssapi_krb5.so.2
 
Reading symbols from /lib64/libkrb5.so.3...Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libkrb5.so.3
 
Reading symbols from /lib64/libcom_err.so.2...Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libcom_err.so.2
 
Reading symbols from /lib64/libk5crypto.so.3...Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libk5crypto.so.3
 
Reading symbols from /lib64/libattr.so.1...Reading symbols from /lib64/libattr.so.1...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libattr.so.1
 
Reading symbols from /lib64/libpcre.so.1...Reading symbols from /lib64/libpcre.so.1...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libpcre.so.1
 
Reading symbols from /lib64/libelf.so.1...Reading symbols from /lib64/libelf.so.1...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libelf.so.1
 
Reading symbols from /lib64/libbz2.so.1...Reading symbols from /lib64/libbz2.so.1...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libbz2.so.1
 
Reading symbols from /lib64/libkrb5support.so.0...Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libkrb5support.so.0
 
Reading symbols from /lib64/libkeyutils.so.1...Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libkeyutils.so.1
 
Reading symbols from /lib64/libnss_files.so.2...(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libnss_files.so.2
 
Reading symbols from /usr/lib64/mysql/plugin/auth_gssapi.so...Reading symbols from /usr/lib64/mysql/plugin/auth_gssapi.so...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /usr/lib64/mysql/plugin/auth_gssapi.so
 
Reading symbols from /usr/lib64/mysql/plugin/auth_pam.so...done.
 
Loaded symbols for /usr/lib64/mysql/plugin/auth_pam.so
 
Reading symbols from /lib64/libpam.so.0...Reading symbols from /lib64/libpam.so.0...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libpam.so.0
 
Reading symbols from /lib64/libaudit.so.1...Reading symbols from /lib64/libaudit.so.1...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libaudit.so.1
 
Reading symbols from /lib64/libcap-ng.so.0...Reading symbols from /lib64/libcap-ng.so.0...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libcap-ng.so.0
 
Reading symbols from /usr/lib64/mysql/plugin/metadata_lock_info.so...done.
 
Loaded symbols for /usr/lib64/mysql/plugin/metadata_lock_info.so
 
Reading symbols from /usr/lib64/mysql/plugin/server_audit.so...done.
 
Loaded symbols for /usr/lib64/mysql/plugin/server_audit.so
 
Reading symbols from /lib64/libnss_dns.so.2...(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libnss_dns.so.2
 
Reading symbols from /lib64/libnss_myhostname.so.2...Reading symbols from /lib64/libnss_myhostname.so.2...(no debugging symbols found)...done.
 
(no debugging symbols found)...done.
 
Loaded symbols for /lib64/libnss_myhostname.so.2
 
0x00007f329e96920d in poll () from /lib64/libc.so.6
 
Missing separate debuginfos, use: debuginfo-install MariaDB-server-10.3.11-1.el7.centos.x86_64
 
(gdb) continue
 
Continuing.
 
[New Thread 0x7f324c060700 (LWP 165026)]
 
[New Thread 0x7efdb4884700 (LWP 165027)]
 
 
 
Program received signal SIGABRT, Aborted.
 
[Switching to Thread 0x7efdb4884700 (LWP 165027)]
 
0x00007f329e8ac207 in raise () from /lib64/libc.so.6
 
(gdb) thread apply all backtrace
 
 
 
Thread 40 (Thread 0x7efdb4884700 (LWP 165027)):
 
#0  0x00007f329e8ac207 in raise () from /lib64/libc.so.6
 
#1  0x00007f329e8ad8f8 in abort () from /lib64/libc.so.6
 
#2  0x000055f0790592b6 in ut_dbg_assertion_failed (expr=expr@entry=0x0, 
    file=file@entry=0x55f079a23c48 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/rem/rem0rec.cc", line=line@entry=1878)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/ut/ut0dbg.cc:61
 
#3  0x000055f0795802c3 in rec_copy_prefix_to_buf (rec=0x7f1860390070 "supremum", index=0x7efd78844a00, n_fields=1, buf=0x7efd78841c10, 
    buf_size=0x7efd78841c18)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/rem/rem0rec.cc:1878
 
#4  0x000055f07965a4d8 in btr_pcur_store_position (cursor=cursor@entry=0x7efd78841b28, mtr=mtr@entry=0x7efdb48810b0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/btr/btr0pcur.cc:172
 
#5  0x000055f0795c6828 in row_search_mvcc (buf=buf@entry=0x7efd78836860 "\002", mode=PAGE_CUR_L, mode@entry=PAGE_CUR_UNSUPP, 
    prebuilt=<optimized out>, match_mode=match_mode@entry=0, direction=direction@entry=2)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/row/row0sel.cc:5597
 
#6  0x000055f0794eea99 in general_fetch (match_mode=0, direction=2, buf=<optimized out>, this=0x7efd78839c70)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/handler/ha_innodb.cc:9528
 
#7  ha_innobase::index_prev (this=0x7efd78839c70, buf=0x7efd78836860 "\002")
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/handler/ha_innodb.cc:9621
 
#8  0x000055f079314d29 in handler::ha_index_prev (this=0x7efd78839c70, buf=0x7efd78836860 "\002")
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/handler.cc:2894
 
#9  0x000055f07917c33c in join_read_prev (info=0x7efd74016ad0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:20444
 
#10 0x000055f07917160f in read_record (this=0x7efd74016ad0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/records.h:73
 
#11 sub_select (join=0x7efd74014560, join_tab=0x7efd74016a08, end_of_records=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:19415
 
#12 0x000055f079192cfb in do_select (procedure=0x0, join=0x7efd74014560)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:18936
 
#13 JOIN::exec_inner (this=this@entry=0x7efd74014560)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:4040
 
#14 0x000055f079192f13 in JOIN::exec (this=this@entry=0x7efd74014560)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:3834
 
#15 0x000055f07919306a in mysql_select (thd=thd@entry=0x7efd740009a8, tables=0x7efd74013378, wild_num=0, fields=..., conds=0x7efd740141b8, 
    og_num=1, order=0x7efd74014420, group=0x0, having=0x0, proc_param=0x0, select_options=2147748608, result=result@entry=0x7efd74014538, 
    unit=unit@entry=0x7efd74004698, select_lex=select_lex@entry=0x7efd74004e08)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:4239
 
#16 0x000055f079193b7c in handle_select (thd=thd@entry=0x7efd740009a8, lex=lex@entry=0x7efd740045d0, result=result@entry=0x7efd74014538, 
    setup_tables_done_option=setup_tables_done_option@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:385
 
#17 0x000055f0790496b7 in execute_sqlcom_select (thd=thd@entry=0x7efd740009a8, all_tables=0x7efd74013378)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_parse.cc:6546
 
#18 0x000055f07913faf3 in mysql_execute_command (thd=thd@entry=0x7efd740009a8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_parse.cc:3767
 
#19 0x000055f0791422db in mysql_parse (thd=0x7efd740009a8, rawbuf=<optimized out>, length=714, parser_state=0x7efdb48834c0, 
    is_com_multi=<optimized out>, is_next_command=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_parse.cc:8090
 
#20 0x000055f079144e35 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x7efd740009a8, 
    packet=packet@entry=0x7efd740093a9 "", packet_length=packet_length@entry=714, is_com_multi=is_com_multi@entry=false, 
    is_next_command=is_next_command@entry=false)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_parse.cc:1850
 
#21 0x000055f079145c9e in do_command (thd=0x7efd740009a8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_parse.cc:1395
 
#22 0x000055f0792159da in do_handle_one_connection (connect=connect@entry=0x55f1abe3a138)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1402
 
#23 0x000055f079215afd in handle_one_connection (arg=arg@entry=0x55f1abe3a138)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1308
 
#24 0x000055f0794b9d3d in pfs_spawn_thread (arg=0x55f1abeb6c88)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#25 0x00007f32a05d0dd5 in start_thread () from /lib64/libpthread.so.0
 
#26 0x00007f329e973ead in clone () from /lib64/libc.so.6
 
 
 
Thread 39 (Thread 0x7f324c060700 (LWP 165026)):
 
#0  0x00007f32a05d4d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x000055f07907e20e in inline_mysql_cond_timedwait (
 
    src_file=0x55f0798e51a8 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc", 
    src_line=3006, abstime=0x7f324c05fc70, mutex=0x55f07a1fb220 <LOCK_thread_cache>, that=0x55f07a1fdc00 <COND_thread_cache>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/include/mysql/psi/mysql_thread.h:1215
 
#2  cache_thread (thd=0x7efd700009a8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:3005
 
#3  one_thread_per_connection_end (thd=0x7efd700009a8, put_in_cache=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:3092
 
#4  0x000055f079215966 in do_handle_one_connection (connect=connect@entry=0x55f1abe3a198)
 
---Type <return> to continue, or q <return> to quit---
 
 at /home/buildbot/buildbot/padding_for_CPACK_RPM_BQuit
 
(gdb) q
 
A debugging session is active.
 
 
 
	Inferior 1 [process 160534] will be detached.
 
 
 
Quit anyway? (y or n) y
 
Detaching from program: /usr/sbin/mysqld, process 160534

Comment by Aurélien LEQUOY [ 2020-03-09 ] 

#3  0x000055f0795802c3 in rec_copy_prefix_to_buf (rec=0x7f1860390070 "supremum", index=0x7efd78844a00, n_fields=1, buf=0x7efd78841c10, 
 
 
    buf_size=0x7efd78841c18)

you was good =)

Comment by Aurélien LEQUOY [ 2020-03-09 ]

should remove function "*_old" no ?

Comment by Marko Mäkelä [ 2020-03-09 ]

Aurelien_LEQUOY, it seems to me that there could be a bug in the function btr_pcur_store_position(). It is also possible that the page is corrupted in some way, because we have not observed such a failure in our internal testing.

The function is trying to check whether the page is empty, and it should never invoke dict_index_copy_rec_order_prefix() on the page infimum or supremum records. Yet, in your stack trace, it is invoking that on the page supremum (byte offset 0x70 from the start of the page).

Can you please post output of the following gdb commands:

frame 4
 
print cursor->btr_cur.index
 
print cursor->btr_cur.page_cur.block->page.id
 
dump binary memory page.bin cursor->btr_cur.page_cur.block->frame cursor->btr_cur.page_cur.block->frame+srv_page_size

and if possible, attach the page.bin that was generated by the last command. I am mostly interested in the first 0x70 bytes. The user data should start at byte offset 0x78, immediately after the string "supremum".

Comment by Aurélien LEQUOY [ 2020-03-09 ]

email sent

Comment by Aurélien LEQUOY [ 2020-03-09 ] 

Program received signal SIGABRT, Aborted.
 
[Switching to Thread 0x7f6340b47700 (LWP 242980)]
 
0x00007f6391e6d207 in raise () from /lib64/libc.so.6
 
(gdb) frame 4
 
#4  0x00005576e472e4d8 in btr_pcur_store_position (cursor=cursor@entry=0x7f2e64028da8, mtr=mtr@entry=0x7f6340b440b0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/btr/btr0pcur.cc:172
 
172	/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/btr/btr0pcur.cc: No such file or directory.
 
(gdb) print cursor->btr_cur.index
 
$1 = (dict_index_t *) 0x7f2e64031490
 
(gdb) print cursor->btr_cur.page_cur.block->page.id
 
$2 = {m_space = 511, m_page_no = 7490}

Comment by Aurélien LEQUOY [ 2020-03-09 ] 

(gdb) thread apply all backtrace
 
 
 
Thread 43 (Thread 0x7f2e8ed52700 (LWP 244060)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e415220e in inline_mysql_cond_timedwait (
 
    src_file=0x5576e49b91a8 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc", 
    src_line=3006, abstime=0x7f2e8ed51c70, mutex=0x5576e52cf220 <LOCK_thread_cache>, that=0x5576e52d1c00 <COND_thread_cache>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/include/mysql/psi/mysql_thread.h:1215
 
#2  cache_thread (thd=0x7f2e4c0009a8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:3005
 
#3  one_thread_per_connection_end (thd=0x7f2e4c0009a8, put_in_cache=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:3092
 
#4  0x00005576e42e9966 in do_handle_one_connection (connect=connect@entry=0x55781649a438)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1421
 
#5  0x00005576e42e9afd in handle_one_connection (arg=arg@entry=0x55781649a438)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1308
 
#6  0x00005576e458dd3d in pfs_spawn_thread (arg=0x557816538948)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 42 (Thread 0x7f2e8ed9d700 (LWP 244059)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e415220e in inline_mysql_cond_timedwait (
 
    src_file=0x5576e49b91a8 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc", 
    src_line=3006, abstime=0x7f2e8ed9cc70, mutex=0x5576e52cf220 <LOCK_thread_cache>, that=0x5576e52d1c00 <COND_thread_cache>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/include/mysql/psi/mysql_thread.h:1215
 
#2  cache_thread (thd=0x7f2e580009a8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:3005
 
#3  one_thread_per_connection_end (thd=0x7f2e580009a8, put_in_cache=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:3092
 
#4  0x00005576e42e9966 in do_handle_one_connection (connect=connect@entry=0x5578164ec7d8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1421
 
#5  0x00005576e42e9afd in handle_one_connection (arg=arg@entry=0x5578164ec7d8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1308
 
#6  0x00005576e458dd3d in pfs_spawn_thread (arg=0x557816538498)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 41 (Thread 0x7f2e8ede8700 (LWP 244058)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e415220e in inline_mysql_cond_timedwait (
 
    src_file=0x5576e49b91a8 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc", 
    src_line=3006, abstime=0x7f2e8ede7c70, mutex=0x5576e52cf220 <LOCK_thread_cache>, that=0x5576e52d1c00 <COND_thread_cache>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/include/mysql/psi/mysql_thread.h:1215
 
#2  cache_thread (thd=0x7f2e540009a8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:3005
 
#3  one_thread_per_connection_end (thd=0x7f2e540009a8, put_in_cache=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:3092
 
#4  0x00005576e42e9966 in do_handle_one_connection (connect=connect@entry=0x55781649a3d8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1421
 
#5  0x00005576e42e9afd in handle_one_connection (arg=arg@entry=0x55781649a3d8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1308
 
#6  0x00005576e458dd3d in pfs_spawn_thread (arg=0x5578164bb1a8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 40 (Thread 0x7f2ea8093700 (LWP 244057)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e44c6936 in inline_mysql_cond_timedwait (
 
    src_file=0x5576e4ad0bf8 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/log.cc", 
    src_line=8375, abstime=0x7f2ea808f180, mutex=0x5576e52fb840 <mysql_bin_log+1136>, that=0x5576e52fb910 <mysql_bin_log+1344>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/include/mysql/psi/mysql_thread.h:1215
 
#2  MYSQL_BIN_LOG::wait_for_update_binlog_end_pos (this=this@entry=0x5576e52fb3d0 <mysql_bin_log>, thd=0x7f2e600009a8, 
    timeout=timeout@entry=0x7f2ea808f180)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/log.cc:8375
 
#3  0x00005576e422df85 in wait_new_events (end_pos_ptr=<synthetic pointer>, 
    binlog_end_pos_filename=0x7f2ea80904e0 "/var/opt/mysqllog/db59-bin-log.000121", linfo=0x7f2ea80908f0, info=0x7f2ea8090b40)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_repl.cc:2430
 
#4  get_binlog_end_pos (linfo=0x7f2ea80908f0, log=0x7f2ea808f610, info=0x7f2ea8090b40)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_repl.cc:2550
 
#5  send_one_binlog_file (start_pos=<optimized out>, linfo=0x7f2ea80908f0, log=0x7f2ea808f610, info=0x7f2ea8090b40)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_repl.cc:2710
 
---Type <return> to continue, or q <return> to quit---
 
#6  mysql_binlog_send (thd=thd@entry=0x7f2e600009a8, log_ident=<optimized out>, pos=<optimized out>, pos@entry=361, flags=flags@entry=2)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_repl.cc:2844
 
#7  0x00005576e4218dad in dispatch_command (command=command@entry=COM_BINLOG_DUMP, thd=thd@entry=0x7f2e600009a8, 
    packet=packet@entry=0x7f2e600093a9 "", packet_length=packet_length@entry=29, is_com_multi=is_com_multi@entry=false, 
    is_next_command=is_next_command@entry=false)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_parse.cc:2102
 
#8  0x00005576e4219c9e in do_command (thd=0x7f2e600009a8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_parse.cc:1395
 
#9  0x00005576e42e99da in do_handle_one_connection (connect=connect@entry=0x557816520a08)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1402
 
#10 0x00005576e42e9afd in handle_one_connection (arg=arg@entry=0x557816520a08)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1308
 
#11 0x00005576e458dd3d in pfs_spawn_thread (arg=0x557816537d38)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#12 0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#13 0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 39 (Thread 0x7f6340ab1700 (LWP 244056)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e415220e in inline_mysql_cond_timedwait (
 
    src_file=0x5576e49b91a8 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc", 
    src_line=3006, abstime=0x7f6340ab0c70, mutex=0x5576e52cf220 <LOCK_thread_cache>, that=0x5576e52d1c00 <COND_thread_cache>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/include/mysql/psi/mysql_thread.h:1215
 
#2  cache_thread (thd=0x7f2e5c0009a8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:3005
 
#3  one_thread_per_connection_end (thd=0x7f2e5c0009a8, put_in_cache=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:3092
 
#4  0x00005576e42e9966 in do_handle_one_connection (connect=connect@entry=0x5578164ec7d8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1421
 
#5  0x00005576e42e9afd in handle_one_connection (arg=arg@entry=0x5578164ec7d8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1308
 
#6  0x00005576e458dd3d in pfs_spawn_thread (arg=0x557816537688)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 38 (Thread 0x7f6358b9e700 (LWP 242703)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e4946c27 in inline_mysql_cond_timedwait (that=0x5576e5b60fe0 <COND_timer>, mutex=0x5576e5b61020 <LOCK_timer>, 
    src_file=0x5576e4b2ecb8 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/mysys/thr_timer.c", 
    src_line=292, abstime=0x7f6358b9dce0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/include/mysql/psi/mysql_thread.h:1215
 
#2  timer_handler (arg=arg@entry=0x0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/mysys/thr_timer.c:292
 
#3  0x00005576e458dd3d in pfs_spawn_thread (arg=0x5576e6e07b88)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#4  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#5  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 37 (Thread 0x7f63431c0700 (LWP 242704)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e485f156 in inline_mysql_cond_timedwait (
 
    src_file=0x5576e4b248a0 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/maria/ma_servicethread.c", src_line=116, abstime=0x7f63431bfc60, mutex=0x5576e5b57a40 <LOCK_checkpoint>, that=0x5576e5b57a00 <COND_checkpoint>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/include/mysql/psi/mysql_thread.h:1215
 
#2  my_service_thread_sleep (control=control@entry=0x5576e52522a0 <checkpoint_control>, sleep_time=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/maria/ma_servicethread.c:115
 
#3  0x00005576e4856c5e in ma_checkpoint_background (arg=arg@entry=0x1e)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/maria/ma_checkpoint.c:707
 
#4  0x00005576e458dd3d in pfs_spawn_thread (arg=0x5576e6e2c9e8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#5  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#6  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 36 (Thread 0x7f6340a28700 (LWP 242717)):
 
#0  0x00007f6393762644 in __io_getevents_0_4 () from /lib64/libaio.so.1
 
#1  0x00005576e462496b in LinuxAIOHandler::collect (this=this@entry=0x7f6340a27b00)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:1926
 
#2  0x00005576e4624f32 in LinuxAIOHandler::poll (this=this@entry=0x7f6340a27b00, m1=m1@entry=0x7f6340a27ba0, m2=m2@entry=0x7f6340a27bb0, 
    request=request@entry=0x7f6340a27bc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2071
 
#3  0x00005576e462c1e1 in os_aio_linux_handler (request=0x7f6340a27bc0, m2=0x7f6340a27bb0, m1=0x7f6340a27ba0, global_segment=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2125
 
#4  os_aio_handler (segment=segment@entry=0, m1=m1@entry=0x7f6340a27ba0, m2=m2@entry=0x7f6340a27bb0, request=request@entry=0x7f6340a27bc0)
 
---Type <return> to continue, or q <return> to quit---
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:5678
 
#5  0x00005576e47b2916 in fil_aio_wait (segment=segment@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/fil/fil0fil.cc:4535
 
#6  0x00005576e46bd4a8 in io_handler_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0start.cc:331
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 35 (Thread 0x7f2d76354700 (LWP 242718)):
 
#0  0x00007f6393762644 in __io_getevents_0_4 () from /lib64/libaio.so.1
 
#1  0x00005576e462496b in LinuxAIOHandler::collect (this=this@entry=0x7f2d76353b00)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:1926
 
#2  0x00005576e4624f32 in LinuxAIOHandler::poll (this=this@entry=0x7f2d76353b00, m1=m1@entry=0x7f2d76353ba0, m2=m2@entry=0x7f2d76353bb0, 
    request=request@entry=0x7f2d76353bc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2071
 
#3  0x00005576e462c1e1 in os_aio_linux_handler (request=0x7f2d76353bc0, m2=0x7f2d76353bb0, m1=0x7f2d76353ba0, global_segment=1)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2125
 
#4  os_aio_handler (segment=segment@entry=1, m1=m1@entry=0x7f2d76353ba0, m2=m2@entry=0x7f2d76353bb0, request=request@entry=0x7f2d76353bc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:5678
 
#5  0x00005576e47b2916 in fil_aio_wait (segment=segment@entry=1)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/fil/fil0fil.cc:4535
 
#6  0x00005576e46bd4a8 in io_handler_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0start.cc:331
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 34 (Thread 0x7f2d75b53700 (LWP 242719)):
 
#0  0x00007f6393762644 in __io_getevents_0_4 () from /lib64/libaio.so.1
 
#1  0x00005576e462496b in LinuxAIOHandler::collect (this=this@entry=0x7f2d75b52b00)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:1926
 
#2  0x00005576e4624f32 in LinuxAIOHandler::poll (this=this@entry=0x7f2d75b52b00, m1=m1@entry=0x7f2d75b52ba0, m2=m2@entry=0x7f2d75b52bb0, 
    request=request@entry=0x7f2d75b52bc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2071
 
#3  0x00005576e462c1e1 in os_aio_linux_handler (request=0x7f2d75b52bc0, m2=0x7f2d75b52bb0, m1=0x7f2d75b52ba0, global_segment=2)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2125
 
#4  os_aio_handler (segment=segment@entry=2, m1=m1@entry=0x7f2d75b52ba0, m2=m2@entry=0x7f2d75b52bb0, request=request@entry=0x7f2d75b52bc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:5678
 
#5  0x00005576e47b2916 in fil_aio_wait (segment=segment@entry=2)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/fil/fil0fil.cc:4535
 
#6  0x00005576e46bd4a8 in io_handler_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0start.cc:331
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 33 (Thread 0x7f2d75352700 (LWP 242720)):
 
#0  0x00007f6393762644 in __io_getevents_0_4 () from /lib64/libaio.so.1
 
#1  0x00005576e462496b in LinuxAIOHandler::collect (this=this@entry=0x7f2d75351b00)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:1926
 
#2  0x00005576e4624f32 in LinuxAIOHandler::poll (this=this@entry=0x7f2d75351b00, m1=m1@entry=0x7f2d75351ba0, m2=m2@entry=0x7f2d75351bb0, 
    request=request@entry=0x7f2d75351bc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2071
 
#3  0x00005576e462c1e1 in os_aio_linux_handler (request=0x7f2d75351bc0, m2=0x7f2d75351bb0, m1=0x7f2d75351ba0, global_segment=3)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2125
 
#4  os_aio_handler (segment=segment@entry=3, m1=m1@entry=0x7f2d75351ba0, m2=m2@entry=0x7f2d75351bb0, request=request@entry=0x7f2d75351bc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:5678
 
#5  0x00005576e47b2916 in fil_aio_wait (segment=segment@entry=3)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/fil/fil0fil.cc:4535
 
#6  0x00005576e46bd4a8 in io_handler_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0start.cc:331
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 32 (Thread 0x7f2d74b51700 (LWP 242721)):
 
#0  0x00007f6393762644 in __io_getevents_0_4 () from /lib64/libaio.so.1
 
#1  0x00005576e462496b in LinuxAIOHandler::collect (this=this@entry=0x7f2d74b50b00)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:1926
 
#2  0x00005576e4624f32 in LinuxAIOHandler::poll (this=this@entry=0x7f2d74b50b00, m1=m1@entry=0x7f2d74b50ba0, m2=m2@entry=0x7f2d74b50bb0, 
    request=request@entry=0x7f2d74b50bc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2071
 
#3  0x00005576e462c1e1 in os_aio_linux_handler (request=0x7f2d74b50bc0, m2=0x7f2d74b50bb0, m1=0x7f2d74b50ba0, global_segment=4)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2125
 
#4  os_aio_handler (segment=segment@entry=4, m1=m1@entry=0x7f2d74b50ba0, m2=m2@entry=0x7f2d74b50bb0, request=request@entry=0x7f2d74b50bc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:5678
 
#5  0x00005576e47b2916 in fil_aio_wait (segment=segment@entry=4)
 
---Type <return> to continue, or q <return> to quit---
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/fil/fil0fil.cc:4535
 
#6  0x00005576e46bd4a8 in io_handler_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0start.cc:331
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 31 (Thread 0x7f2d74350700 (LWP 242722)):
 
#0  0x00007f6393762644 in __io_getevents_0_4 () from /lib64/libaio.so.1
 
#1  0x00005576e462496b in LinuxAIOHandler::collect (this=this@entry=0x7f2d7434fb00)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:1926
 
#2  0x00005576e4624f32 in LinuxAIOHandler::poll (this=this@entry=0x7f2d7434fb00, m1=m1@entry=0x7f2d7434fba0, m2=m2@entry=0x7f2d7434fbb0, 
    request=request@entry=0x7f2d7434fbc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2071
 
#3  0x00005576e462c1e1 in os_aio_linux_handler (request=0x7f2d7434fbc0, m2=0x7f2d7434fbb0, m1=0x7f2d7434fba0, global_segment=5)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2125
 
#4  os_aio_handler (segment=segment@entry=5, m1=m1@entry=0x7f2d7434fba0, m2=m2@entry=0x7f2d7434fbb0, request=request@entry=0x7f2d7434fbc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:5678
 
#5  0x00005576e47b2916 in fil_aio_wait (segment=segment@entry=5)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/fil/fil0fil.cc:4535
 
#6  0x00005576e46bd4a8 in io_handler_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0start.cc:331
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 30 (Thread 0x7f2d73b4f700 (LWP 242723)):
 
#0  0x00007f6393762644 in __io_getevents_0_4 () from /lib64/libaio.so.1
 
#1  0x00005576e462496b in LinuxAIOHandler::collect (this=this@entry=0x7f2d73b4eb00)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:1926
 
#2  0x00005576e4624f32 in LinuxAIOHandler::poll (this=this@entry=0x7f2d73b4eb00, m1=m1@entry=0x7f2d73b4eba0, m2=m2@entry=0x7f2d73b4ebb0, 
    request=request@entry=0x7f2d73b4ebc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2071
 
#3  0x00005576e462c1e1 in os_aio_linux_handler (request=0x7f2d73b4ebc0, m2=0x7f2d73b4ebb0, m1=0x7f2d73b4eba0, global_segment=6)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2125
 
#4  os_aio_handler (segment=segment@entry=6, m1=m1@entry=0x7f2d73b4eba0, m2=m2@entry=0x7f2d73b4ebb0, request=request@entry=0x7f2d73b4ebc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:5678
 
#5  0x00005576e47b2916 in fil_aio_wait (segment=segment@entry=6)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/fil/fil0fil.cc:4535
 
#6  0x00005576e46bd4a8 in io_handler_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0start.cc:331
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 29 (Thread 0x7f2d7334e700 (LWP 242724)):
 
#0  0x00007f6393762644 in __io_getevents_0_4 () from /lib64/libaio.so.1
 
#1  0x00005576e462496b in LinuxAIOHandler::collect (this=this@entry=0x7f2d7334db00)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:1926
 
#2  0x00005576e4624f32 in LinuxAIOHandler::poll (this=this@entry=0x7f2d7334db00, m1=m1@entry=0x7f2d7334dba0, m2=m2@entry=0x7f2d7334dbb0, 
    request=request@entry=0x7f2d7334dbc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2071
 
#3  0x00005576e462c1e1 in os_aio_linux_handler (request=0x7f2d7334dbc0, m2=0x7f2d7334dbb0, m1=0x7f2d7334dba0, global_segment=7)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2125
 
#4  os_aio_handler (segment=segment@entry=7, m1=m1@entry=0x7f2d7334dba0, m2=m2@entry=0x7f2d7334dbb0, request=request@entry=0x7f2d7334dbc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:5678
 
#5  0x00005576e47b2916 in fil_aio_wait (segment=segment@entry=7)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/fil/fil0fil.cc:4535
 
#6  0x00005576e46bd4a8 in io_handler_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0start.cc:331
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 28 (Thread 0x7f2d72b4d700 (LWP 242725)):
 
#0  0x00007f6393762644 in __io_getevents_0_4 () from /lib64/libaio.so.1
 
#1  0x00005576e462496b in LinuxAIOHandler::collect (this=this@entry=0x7f2d72b4cb00)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:1926
 
#2  0x00005576e4624f32 in LinuxAIOHandler::poll (this=this@entry=0x7f2d72b4cb00, m1=m1@entry=0x7f2d72b4cba0, m2=m2@entry=0x7f2d72b4cbb0, 
    request=request@entry=0x7f2d72b4cbc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2071
 
#3  0x00005576e462c1e1 in os_aio_linux_handler (request=0x7f2d72b4cbc0, m2=0x7f2d72b4cbb0, m1=0x7f2d72b4cba0, global_segment=8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2125
 
#4  os_aio_handler (segment=segment@entry=8, m1=m1@entry=0x7f2d72b4cba0, m2=m2@entry=0x7f2d72b4cbb0, request=request@entry=0x7f2d72b4cbc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:5678
 
#5  0x00005576e47b2916 in fil_aio_wait (segment=segment@entry=8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/fil/fil0fil.cc:4535
 
#6  0x00005576e46bd4a8 in io_handler_thread (arg=<optimized out>)
 
---Type <return> to continue, or q <return> to quit---
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0start.cc:331
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 27 (Thread 0x7f2d7234c700 (LWP 242726)):
 
#0  0x00007f6393762644 in __io_getevents_0_4 () from /lib64/libaio.so.1
 
#1  0x00005576e462496b in LinuxAIOHandler::collect (this=this@entry=0x7f2d7234bb00)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:1926
 
#2  0x00005576e4624f32 in LinuxAIOHandler::poll (this=this@entry=0x7f2d7234bb00, m1=m1@entry=0x7f2d7234bba0, m2=m2@entry=0x7f2d7234bbb0, 
    request=request@entry=0x7f2d7234bbc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2071
 
#3  0x00005576e462c1e1 in os_aio_linux_handler (request=0x7f2d7234bbc0, m2=0x7f2d7234bbb0, m1=0x7f2d7234bba0, global_segment=9)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:2125
 
#4  os_aio_handler (segment=segment@entry=9, m1=m1@entry=0x7f2d7234bba0, m2=m2@entry=0x7f2d7234bbb0, request=request@entry=0x7f2d7234bbc0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0file.cc:5678
 
#5  0x00005576e47b2916 in fil_aio_wait (segment=segment@entry=9)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/fil/fil0fil.cc:4535
 
#6  0x00005576e46bd4a8 in io_handler_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0start.cc:331
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 26 (Thread 0x7f2d71b4b700 (LWP 242727)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462d5a3 in os_event::timed_wait (this=this@entry=0x5576e709e830, abstime=abstime@entry=0x7f2d71b4aad0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:283
 
 
 
#2  0x00005576e462d7d1 in os_event::wait_time_low (this=0x5576e709e830, time_in_usec=time_in_usec@entry=1000000, 
 
 
    reset_sig_count=<optimized out>, reset_sig_count@entry=2)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:405
 
#3  0x00005576e462da8a in os_event_wait_time_low (event=<optimized out>, time_in_usec=time_in_usec@entry=1000000, 
    reset_sig_count=reset_sig_count@entry=2)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:505
 
#4  0x00005576e475bd1d in pc_sleep_if_needed (cur_time=1583772925089, sig_count=2, next_loop_time=1583772926089)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/buf/buf0flu.cc:2687
 
#5  buf_flush_page_cleaner_coordinator ()
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/buf/buf0flu.cc:3146
 
#6  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#7  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 25 (Thread 0x7f2d7134a700 (LWP 242728)):
 
#0  0x00007f6393b95965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462dad1 in wait (this=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:163
 
#2  wait_low (reset_sig_count=<optimized out>, this=0x5578163ec760)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:333
 
#3  os_event_wait_low (event=0x5578163ec760, reset_sig_count=reset_sig_count@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:522
 
#4  0x00005576e475aec3 in buf_flush_page_cleaner_worker (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/buf/buf0flu.cc:3497
 
#5  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#6  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 24 (Thread 0x7f2d70b49700 (LWP 242729)):
 
#0  0x00007f6393b95965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462dad1 in wait (this=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:163
 
#2  wait_low (reset_sig_count=<optimized out>, this=0x5578163ec760)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:333
 
#3  os_event_wait_low (event=0x5578163ec760, reset_sig_count=reset_sig_count@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:522
 
#4  0x00005576e475aec3 in buf_flush_page_cleaner_worker (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/buf/buf0flu.cc:3497
 
#5  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#6  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 23 (Thread 0x7f2d6bfff700 (LWP 242730)):
 
#0  0x00007f6393b95965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462dad1 in wait (this=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:163
 
#2  wait_low (reset_sig_count=<optimized out>, this=0x5578163ec760)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:333
 
#3  os_event_wait_low (event=0x5578163ec760, reset_sig_count=reset_sig_count@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:522
 
#4  0x00005576e475aec3 in buf_flush_page_cleaner_worker (arg=<optimized out>)
 
---Type <return> to continue, or q <return> to quit---
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/buf/buf0flu.cc:3497
 
#5  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#6  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 22 (Thread 0x7f2d6b7fe700 (LWP 242731)):
 
#0  0x00007f6393b95965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462dad1 in wait (this=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:163
 
#2  wait_low (reset_sig_count=<optimized out>, this=0x5578163ec760)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:333
 
#3  os_event_wait_low (event=0x5578163ec760, reset_sig_count=reset_sig_count@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:522
 
#4  0x00005576e475aec3 in buf_flush_page_cleaner_worker (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/buf/buf0flu.cc:3497
 
#5  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
 
 
#6  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 21 (Thread 0x7f2ead2a4700 (LWP 242736)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462d5a3 in os_event::timed_wait (this=this@entry=0x5578163ea7f0, abstime=abstime@entry=0x7f2ead2a3bd0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:283
 
#2  0x00005576e462d7d1 in os_event::wait_time_low (this=this@entry=0x5578163ea7f0, time_in_usec=time_in_usec@entry=1000000, 
    reset_sig_count=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:405
 
#3  0x00005576e462da8a in os_event_wait_time_low (event=event@entry=0x5578163ea7f0, time_in_usec=time_in_usec@entry=1000000, 
    reset_sig_count=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:505
 
#4  0x00005576e4600f7f in lock_wait_timeout_thread ()
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/lock/lock0wait.cc:543
 
 
 
#5  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#6  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 20 (Thread 0x7f2eacaa3700 (LWP 242737)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462d5a3 in os_event::timed_wait (this=this@entry=0x5576e709e6b0, abstime=abstime@entry=0x7f2eacaa2b70)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:283
 
 
 
#2  0x00005576e462d7d1 in os_event::wait_time_low (this=0x5576e709e6b0, time_in_usec=time_in_usec@entry=1000000, 
    reset_sig_count=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:405
 
#3  0x00005576e462da8a in os_event_wait_time_low (event=<optimized out>, time_in_usec=time_in_usec@entry=1000000, 
    reset_sig_count=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:505
 
#4  0x00005576e46b9fec in srv_error_monitor_thread ()
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0srv.cc:1853
 
#5  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#6  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 19 (Thread 0x7f2eac2a2700 (LWP 242738)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462d5a3 in os_event::timed_wait (this=this@entry=0x5576e709e730, abstime=abstime@entry=0x7f2eac2a1c70)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:283
 
#2  0x00005576e462d7d1 in os_event::wait_time_low (this=0x5576e709e730, time_in_usec=time_in_usec@entry=5000000, 
    reset_sig_count=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:405
 
#3  0x00005576e462da8a in os_event_wait_time_low (event=<optimized out>, time_in_usec=time_in_usec@entry=5000000, 
    reset_sig_count=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:505
 
#4  0x00005576e46b98d8 in srv_monitor_thread ()
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0srv.cc:1689
 
#5  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#6  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 18 (Thread 0x7f2eabaa1700 (LWP 242739)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462d5a3 in os_event::timed_wait (this=this@entry=0x55781640f270, abstime=abstime@entry=0x7f2eabaa0bf0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:283
 
 
 
#2  0x00005576e462d7d1 in os_event::wait_time_low (this=0x55781640f270, time_in_usec=time_in_usec@entry=10000000, 
    reset_sig_count=<optimized out>, reset_sig_count@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:405
 
#3  0x00005576e462da8a in os_event_wait_time_low (event=<optimized out>, time_in_usec=time_in_usec@entry=10000000, 
    reset_sig_count=reset_sig_count@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:505
 
#4  0x00005576e47a5282 in dict_stats_thread ()
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/dict/dict0stats_bg.cc:461
 
---Type <return> to continue, or q <return> to quit---
 
#5  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#6  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 17 (Thread 0x7f2eab2a0700 (LWP 242740)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462d5a3 in os_event::timed_wait (this=this@entry=0x557816479330, abstime=abstime@entry=0x7f2eab29fac0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:283
 
 
 
#2  0x00005576e462d7d1 in os_event::wait_time_low (this=0x557816479330, time_in_usec=time_in_usec@entry=5000000, 
    reset_sig_count=<optimized out>, reset_sig_count@entry=1)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:405
 
#3  0x00005576e462da8a in os_event_wait_time_low (event=<optimized out>, time_in_usec=time_in_usec@entry=5000000, 
    reset_sig_count=reset_sig_count@entry=1)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:505
 
 
 
#4  0x00005576e470720e in ib_wqueue_timedwait (wq=wq@entry=0x55781645ed30, wait_in_usecs=wait_in_usecs@entry=5000000)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/ut/ut0wqueue.cc:163
 
#5  0x00005576e47ef2bc in fts_optimize_thread (arg=0x55781645ed30)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/fts/fts0opt.cc:2899
 
#6  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#7  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 16 (Thread 0x7f2eadaa5700 (LWP 242741)):
 
#0  0x00007f6393b98e3d in nanosleep () from /lib64/libpthread.so.0
 
#1  0x00005576e462dce0 in os_thread_sleep (tm=tm@entry=1000000)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0thread.cc:230
 
#2  0x00005576e46bad89 in srv_master_sleep ()
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0srv.cc:2325
 
#3  srv_master_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0srv.cc:2366
 
#4  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#5  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 15 (Thread 0x7f2eaaa9f700 (LWP 242742)):
 
#0  0x00007f6393b95965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462dad1 in wait (this=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:163
 
#2  wait_low (reset_sig_count=<optimized out>, this=0x5576e709e4b0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:333
 
#3  os_event_wait_low (event=0x5576e709e4b0, reset_sig_count=reset_sig_count@entry=1)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:522
 
#4  0x00005576e46bc32f in srv_resume_thread (timeout_usec=0, wait=true, sig_count=1, slot=0x5576e524f600 <srv_sys+192>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0srv.cc:915
 
#5  srv_purge_coordinator_suspend (rseg_history_len=<optimized out>, slot=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0srv.cc:2637
 
#6  srv_purge_coordinator_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0srv.cc:2712
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 14 (Thread 0x7f2eaa29e700 (LWP 242743)):
 
#0  0x00007f6393b95965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462dad1 in wait (this=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:163
 
#2  wait_low (reset_sig_count=<optimized out>, this=0x5576e709e5b0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:333
 
#3  os_event_wait_low (event=0x5576e709e5b0, reset_sig_count=reset_sig_count@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:522
 
#4  0x00005576e46b5e1b in srv_resume_thread (slot=slot@entry=0x5576e524f670 <srv_sys+304>, wait=wait@entry=true, timeout_usec=0, 
    sig_count=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0srv.cc:915
 
 
 
#5  0x00005576e46bb695 in srv_worker_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0srv.cc:2500
 
#6  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#7  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 13 (Thread 0x7f2ea9a9d700 (LWP 242744)):
 
#0  0x00007f6393b95965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462dad1 in wait (this=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:163
 
#2  wait_low (reset_sig_count=<optimized out>, this=0x5576e709e530)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:333
 
#3  os_event_wait_low (event=0x5576e709e530, reset_sig_count=reset_sig_count@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:522
 
#4  0x00005576e46b5e1b in srv_resume_thread (slot=slot@entry=0x5576e524f638 <srv_sys+248>, wait=wait@entry=true, timeout_usec=0, 
    sig_count=0)
 
---Type <return> to continue, or q <return> to quit---
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0srv.cc:915
 
#5  0x00005576e46bb695 in srv_worker_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0srv.cc:2500
 
#6  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#7  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 12 (Thread 0x7f2ea929c700 (LWP 242745)):
 
#0  0x00007f6393b95965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462dad1 in wait (this=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:163
 
#2  wait_low (reset_sig_count=<optimized out>, this=0x5576e709e630)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:333
 
#3  os_event_wait_low (event=0x5576e709e630, reset_sig_count=reset_sig_count@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:522
 
#4  0x00005576e46b5e1b in srv_resume_thread (slot=slot@entry=0x5576e524f6a8 <srv_sys+360>, wait=wait@entry=true, timeout_usec=0, 
    sig_count=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0srv.cc:915
 
#5  0x00005576e46bb695 in srv_worker_thread (arg=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/srv/srv0srv.cc:2500
 
#6  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#7  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 11 (Thread 0x7f2ea8a9b700 (LWP 242746)):
 
#0  0x00007f6393b95965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462dad1 in wait (this=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:163
 
#2  wait_low (reset_sig_count=<optimized out>, this=0x5576e709e7b0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:333
 
#3  os_event_wait_low (event=0x5576e709e7b0, reset_sig_count=reset_sig_count@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:522
 
#4  0x00005576e4755917 in buf_dump_thread ()
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/buf/buf0dump.cc:837
 
#5  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#6  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 10 (Thread 0x7f2e87fff700 (LWP 242747)):
 
#0  0x00007f6393b98e3d in nanosleep () from /lib64/libpthread.so.0
 
#1  0x00005576e462dce0 in os_thread_sleep (tm=tm@entry=1000000)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0thread.cc:230
 
#2  0x00005576e473f1da in btr_defragment_thread ()
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/btr/btr0defragment.cc:717
 
#3  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 9 (Thread 0x7f2e8ffff700 (LWP 242748)):
 
#0  0x00007f6393b95965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e462dad1 in wait (this=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:163
 
#2  wait_low (reset_sig_count=<optimized out>, this=0x5576e709e8b0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:333
 
#3  os_event_wait_low (event=0x5576e709e8b0, reset_sig_count=reset_sig_count@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/os/os0event.cc:522
 
#4  0x00005576e474e042 in buf_resize_thread ()
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/buf/buf0buf.cc:3260
 
#5  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#6  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 8 (Thread 0x7f2e8f7fe700 (LWP 242749)):
 
#0  0x00007f6393b95965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e45a9dab in inline_mysql_cond_wait (
 
    src_file=0x5576e4ae3568 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/handler/ha_innodb.cc", src_line=309, mutex=0x7f2e8f7fdcc0, that=0x7f2e8f7fdcf0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/include/mysql/psi/mysql_thread.h:1178
 
#2  thd_destructor_proxy ()
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/handler/ha_innodb.cc:309
 
#3  0x00005576e458dd3d in pfs_spawn_thread (arg=0x557816490708)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#4  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#5  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 7 (Thread 0x7f635806e700 (LWP 242750)):
 
#0  0x00007f6393b95965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e44ca30f in inline_mysql_cond_wait (that=0x5576e52fc058 <mysql_bin_log+3208>, mutex=0x5576e52fc028 <mysql_bin_log+3160>, 
    src_file=0x5576e4ad0bf8 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/log.cc", 
---Type <return> to continue, or q <return> to quit---
 
    src_line=9903)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/include/mysql/psi/mysql_thread.h:1178
 
#2  binlog_background_thread (arg=arg@entry=0x0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/log.cc:9903
 
#3  0x00005576e458dd3d in pfs_spawn_thread (arg=0x55781649ba78)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#4  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#5  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 6 (Thread 0x7f6340c28700 (LWP 242751)):
 
#0  0x00007f6393b99361 in sigwait () from /lib64/libpthread.so.0
 
#1  0x00005576e415083b in signal_hand (arg=arg@entry=0x0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:3556
 
#2  0x00005576e458dd3d in pfs_spawn_thread (arg=0x55781649a3d8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#3  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 5 (Thread 0x7f6340bdd700 (LWP 242752)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e453fd80 in inline_mysql_cond_timedwait (
 
    src_file=0x5576e4ad6de0 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/event_queue.cc", 
    src_line=782, abstime=0x7f6340bdcca0, mutex=0x557816507b60, that=0x557816507b90)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/include/mysql/psi/mysql_thread.h:1215
 
#2  Event_queue::cond_wait (this=this@entry=0x557816507b60, thd=thd@entry=0x55781652aa98, abstime=abstime@entry=0x7f6340bdcca0, 
    stage=<optimized out>, 
    src_func=src_func@entry=0x5576e4ad6ef0 <Event_queue::get_top_for_execution_if_time(THD*, Event_queue_element_for_exec**)::__FUNCTION__> "get_top_for_execution_if_time", 
    src_file=src_file@entry=0x5576e4ad6de0 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/event_queue.cc", src_line=src_line@entry=634)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/event_queue.cc:782
 
#3  0x00005576e453ffb8 in Event_queue::get_top_for_execution_if_time (this=0x557816507b60, thd=thd@entry=0x55781652aa98, 
    event_name=event_name@entry=0x7f6340bdccf0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/event_queue.cc:634
 
#4  0x00005576e453ecbe in Event_scheduler::run (this=this@entry=0x557816507c40, thd=0x55781652aa98)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/event_scheduler.cc:477
 
#5  0x00005576e453ede5 in event_scheduler_thread (arg=arg@entry=0x557816496458)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/event_scheduler.cc:234
 
#6  0x00005576e458dd3d in pfs_spawn_thread (arg=0x5578164ec478)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 4 (Thread 0x7f6340b92700 (LWP 242753)):
 
#0  0x00007f6393b95965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e416e6e3 in inline_mysql_cond_wait (that=<optimized out>, mutex=<optimized out>, 
    src_file=0x5576e49c3750 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/slave.cc", 
    src_line=513)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/include/mysql/psi/mysql_thread.h:1178
 
#2  handle_slave_background (arg=arg@entry=0x0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/slave.cc:513
 
#3  0x00005576e458dd3d in pfs_spawn_thread (arg=0x5576e6e4e458)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#4  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#5  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 3 (Thread 0x7f6340b47700 (LWP 242980)):
 
#0  0x00007f6391e6d207 in raise () from /lib64/libc.so.6
 
#1  0x00007f6391e6e8f8 in abort () from /lib64/libc.so.6
 
#2  0x00005576e412d2b6 in ut_dbg_assertion_failed (expr=expr@entry=0x0, 
    file=file@entry=0x5576e4af7c48 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/rem/rem0rec.cc", line=line@entry=1878)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/ut/ut0dbg.cc:61
 
#3  0x00005576e46542c3 in rec_copy_prefix_to_buf (rec=0x7f494e01c070 "supremum", index=0x7f2e64031490, n_fields=1, buf=0x7f2e64028e90, 
    buf_size=0x7f2e64028e98)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/rem/rem0rec.cc:1878
 
#4  0x00005576e472e4d8 in btr_pcur_store_position (cursor=cursor@entry=0x7f2e64028da8, mtr=mtr@entry=0x7f6340b440b0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/btr/btr0pcur.cc:172
 
#5  0x00005576e469a828 in row_search_mvcc (buf=buf@entry=0x7f2e64027ed0 "\002", mode=PAGE_CUR_L, mode@entry=PAGE_CUR_UNSUPP, 
    prebuilt=<optimized out>, match_mode=match_mode@entry=0, direction=direction@entry=2)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/row/row0sel.cc:5597
 
#6  0x00005576e45c2a99 in general_fetch (match_mode=0, direction=2, buf=<optimized out>, this=0x7f2e64024a80)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/handler/ha_innodb.cc:9528
 
#7  ha_innobase::index_prev (this=0x7f2e64024a80, buf=0x7f2e64027ed0 "\002")
 
---Type <return> to continue, or q <return> to quit---
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/innobase/handler/ha_innodb.cc:9621
 
#8  0x00005576e43e8d29 in handler::ha_index_prev (this=0x7f2e64024a80, buf=0x7f2e64027ed0 "\002")
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/handler.cc:2894
 
#9  0x00005576e425033c in join_read_prev (info=0x7f2e640175e0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:20444
 
#10 0x00005576e424560f in read_record (this=0x7f2e640175e0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/records.h:73
 
#11 sub_select (join=0x7f2e64015070, join_tab=0x7f2e64017518, end_of_records=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:19415
 
#12 0x00005576e4266cfb in do_select (procedure=0x0, join=0x7f2e64015070)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:18936
 
#13 JOIN::exec_inner (this=this@entry=0x7f2e64015070)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:4040
 
#14 0x00005576e4266f13 in JOIN::exec (this=this@entry=0x7f2e64015070)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:3834
 
#15 0x00005576e426706a in mysql_select (thd=thd@entry=0x7f2e640009a8, tables=0x7f2e64013e88, wild_num=0, fields=..., conds=0x7f2e64014cc8, 
    og_num=1, order=0x7f2e64014f30, group=0x0, having=0x0, proc_param=0x0, select_options=2147748608, result=result@entry=0x7f2e64015048, 
    unit=unit@entry=0x7f2e64004698, select_lex=select_lex@entry=0x7f2e64004e08)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:4239
 
#16 0x00005576e4267b7c in handle_select (thd=thd@entry=0x7f2e640009a8, lex=lex@entry=0x7f2e640045d0, result=result@entry=0x7f2e64015048, 
    setup_tables_done_option=setup_tables_done_option@entry=0)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_select.cc:385
 
#17 0x00005576e411d6b7 in execute_sqlcom_select (thd=thd@entry=0x7f2e640009a8, all_tables=0x7f2e64013e88)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_parse.cc:6546
 
#18 0x00005576e4213af3 in mysql_execute_command (thd=thd@entry=0x7f2e640009a8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_parse.cc:3767
 
#19 0x00005576e42162db in mysql_parse (thd=0x7f2e640009a8, rawbuf=<optimized out>, length=714, parser_state=0x7f6340b464c0, 
    is_com_multi=<optimized out>, is_next_command=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_parse.cc:8090
 
#20 0x00005576e4218e35 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x7f2e640009a8, 
    packet=packet@entry=0x7f2e640093a9 "", packet_length=packet_length@entry=714, is_com_multi=is_com_multi@entry=false, 
    is_next_command=is_next_command@entry=false)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_parse.cc:1850
 
#21 0x00005576e4219c9e in do_command (thd=0x7f2e640009a8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_parse.cc:1395
 
#22 0x00005576e42e99da in do_handle_one_connection (connect=connect@entry=0x557816520a08)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1402
 
#23 0x00005576e42e9afd in handle_one_connection (arg=arg@entry=0x557816520a08)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1308
 
#24 0x00005576e458dd3d in pfs_spawn_thread (arg=0x5578164bb1a8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#25 0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#26 0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 2 (Thread 0x7f6340afc700 (LWP 242981)):
 
#0  0x00007f6393b95d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00005576e415220e in inline_mysql_cond_timedwait (
 
    src_file=0x5576e49b91a8 "/home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc", 
    src_line=3006, abstime=0x7f6340afbc70, mutex=0x5576e52cf220 <LOCK_thread_cache>, that=0x5576e52d1c00 <COND_thread_cache>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/include/mysql/psi/mysql_thread.h:1215
 
#2  cache_thread (thd=0x7f2e680009d8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:3005
 
#3  one_thread_per_connection_end (thd=0x7f2e680009d8, put_in_cache=<optimized out>)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:3092
 
#4  0x00005576e42e9966 in do_handle_one_connection (connect=connect@entry=0x557816520a08)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1421
 
#5  0x00005576e42e9afd in handle_one_connection (arg=arg@entry=0x557816520a08)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/sql_connect.cc:1308
 
#6  0x00005576e458dd3d in pfs_spawn_thread (arg=0x5578165371d8)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/storage/perfschema/pfs.cc:1862
 
#7  0x00007f6393b91dd5 in start_thread () from /lib64/libpthread.so.0
 
#8  0x00007f6391f34ead in clone () from /lib64/libc.so.6
 
 
 
Thread 1 (Thread 0x7f6393faf8c0 (LWP 242701)):
 
#0  0x00007f6391f2a20d in poll () from /lib64/libc.so.6
 
#1  0x00005576e41596cf in poll (__timeout=-1, __nfds=2, __fds=0x7ffd3fd5ec30) at /usr/include/bits/poll2.h:41
 
#2  handle_connections_sockets ()
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:6725
 
#3  0x00005576e415ad8c in mysqld_main (argc=82, argv=0x5576e6d20e78)
 
    at /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.3.11/sql/mysqld.cc:6194
 
#4  0x00007f6391e593d5 in __libc_start_main () from /lib64/libc.so.6
 
#5  0x00005576e414d7dd in _start ()

Comment by Aurélien LEQUOY [ 2020-03-09 ]

about page.bin :

xxd page.bin
 
0000000: 7bbd d2d4 0000 1d42 ffff ffff 0000 0005  {......B........
 
0000010: 0000 000d 760b 15a8 45bf 0000 0000 0000  ....v...E.......
 
0000020: 0000 0000 01ff 0002 00a8 8003 0000 0000  ................
 
0000030: 0087 0005 0000 0001 0000 0000 0000 0000  ................
 
0000040: 0000 0000 0000 0000 04d0 0000 0000 0000  ................
 
0000050: 0000 0000 0000 0000 0000 0000 0000 0100  ................
 
0000060: 0200 2469 6e66 696d 756d 0002 000b 0000  ..$infimum......
 
0000070: 7375 7072 656d 756d 0000 0000 0000 0000  supremum........
 
0000080: 0000 1000 14ff e980 0000 0000 0000 0000  ................
 
0000090: 0080 0000 0000 0000 8000 0000 0000 0000  ................
 
00000a0: 8000 0000 0000 0000 0000 0000 0000 0000  ................
 
00000b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00000c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00000d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00000e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00000f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000100: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000110: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000120: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000130: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000140: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000150: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000160: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000170: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000180: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000190: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00001a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00001b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00001c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00001d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00001e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00001f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000200: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000210: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000220: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000230: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000240: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000250: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000260: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000270: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000280: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000290: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00002a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00002b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00002c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00002d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00002e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00002f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000300: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000310: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000320: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000330: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000340: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000350: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000360: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000370: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000380: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000390: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00003a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00003b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00003c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00003d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00003e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00003f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000400: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000410: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000420: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000430: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000440: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000450: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000460: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000470: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000480: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000490: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00004a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00004b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00004c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00004d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00004e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00004f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000500: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000510: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000520: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000530: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000540: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000550: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000560: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000570: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000580: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000590: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00005a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00005b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00005c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00005d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00005e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00005f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000600: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000610: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000620: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000630: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000640: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000650: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000660: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000670: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000680: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000690: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00006a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00006b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00006c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00006d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00006e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00006f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000700: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000710: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000720: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000730: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000740: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000750: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000760: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000770: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000780: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000790: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00007a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00007b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00007c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00007d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00007e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00007f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000800: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000810: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000820: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000830: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000840: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000850: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000860: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000870: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000880: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000890: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00008a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00008b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00008c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00008d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00008e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00008f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000900: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000910: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000920: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000930: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000940: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000950: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000960: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000970: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000980: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000990: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00009a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00009b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00009c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00009d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00009e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00009f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000a00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000a10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000a20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000a30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000a40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000a50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000a60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000a70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000a80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000a90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000aa0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000ab0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000ac0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000ad0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000ae0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000af0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000b00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000b10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000b20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000b30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000b40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000b50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000b60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000b70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000b80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000b90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000ba0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000bb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000bc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000bd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000be0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000bf0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000c00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000c10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000c20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000c30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000c40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000c50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000c60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000c70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000c80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000c90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000ca0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000cb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000cc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000cd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000ce0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000cf0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000d00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000d10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000d20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000d30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000d40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000d50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000d60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000d70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000d80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000d90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000da0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000db0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000dc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000dd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000de0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000df0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000e00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000e10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000e20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000e30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000e40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000e50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000e60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000e70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000e80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000e90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000ea0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000eb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000ec0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000ed0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000ee0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000ef0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000f00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000f10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000f20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000f30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000f40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000f50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000f60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000f70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000f80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000f90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000fa0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000fb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000fc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000fd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000fe0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0000ff0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001000: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001010: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001020: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001030: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001040: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001050: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001060: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001070: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001080: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001090: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00010a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00010b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00010c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00010d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00010e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00010f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001100: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001110: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001120: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001130: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001140: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001150: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001160: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001170: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001180: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001190: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00011a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00011b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00011c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00011d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00011e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00011f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001200: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001210: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001220: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001230: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001240: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001250: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001260: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001270: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001280: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001290: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00012a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00012b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00012c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00012d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00012e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00012f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001300: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001310: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001320: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001330: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001340: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001350: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001360: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001370: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001380: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001390: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00013a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00013b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00013c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00013d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00013e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00013f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001400: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001410: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001420: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001430: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001440: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001450: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001460: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001470: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001480: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001490: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00014a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00014b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00014c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00014d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00014e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00014f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001500: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001510: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001520: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001530: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001540: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001550: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001560: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001570: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001580: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001590: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00015a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00015b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00015c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00015d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00015e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00015f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001600: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001610: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001620: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001630: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001640: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001650: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001660: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001670: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001680: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001690: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00016a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00016b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00016c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00016d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00016e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00016f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001700: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001710: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001720: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001730: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001740: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001750: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001760: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001770: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001780: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001790: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00017a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00017b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00017c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00017d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00017e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00017f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001800: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001810: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001820: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001830: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001840: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001850: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001860: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001870: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001880: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001890: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00018a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00018b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00018c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00018d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00018e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00018f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001900: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001910: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001920: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001930: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001940: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001950: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001960: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001970: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001980: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001990: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00019a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00019b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00019c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00019d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00019e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00019f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001a00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001a10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001a20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001a30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001a40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001a50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001a60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001a70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001a80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001a90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001aa0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001ab0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001ac0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001ad0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001ae0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001af0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001b00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001b10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001b20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001b30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001b40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001b50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001b60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001b70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001b80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001b90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001ba0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001bb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001bc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001bd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001be0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001bf0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001c00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001c10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001c20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001c30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001c40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001c50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001c60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001c70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001c80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001c90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001ca0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001cb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001cc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001cd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001ce0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001cf0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001d00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001d10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001d20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001d30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001d40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001d50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001d60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001d70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001d80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001d90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001da0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001db0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001dc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001dd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001de0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001df0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001e00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001e10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001e20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001e30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001e40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001e50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001e60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001e70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001e80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001e90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001ea0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001eb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001ec0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001ed0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001ee0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001ef0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001f00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001f10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001f20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001f30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001f40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001f50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001f60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001f70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001f80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001f90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001fa0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001fb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001fc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001fd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001fe0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0001ff0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002000: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002010: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002020: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002030: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002040: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002050: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002060: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002070: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002080: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002090: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00020a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00020b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00020c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00020d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00020e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00020f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002100: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002110: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002120: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002130: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002140: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002150: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002160: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002170: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002180: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002190: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00021a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00021b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00021c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00021d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00021e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00021f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002200: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002210: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002220: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002230: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002240: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002250: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002260: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002270: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002280: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002290: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00022a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00022b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00022c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00022d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00022e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00022f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002300: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002310: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002320: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002330: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002340: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002350: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002360: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002370: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002380: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002390: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00023a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00023b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00023c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00023d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00023e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00023f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002400: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002410: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002420: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002430: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002440: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002450: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002460: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002470: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002480: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002490: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00024a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00024b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00024c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00024d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00024e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00024f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002500: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002510: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002520: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002530: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002540: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002550: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002560: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002570: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002580: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002590: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00025a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00025b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00025c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00025d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00025e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00025f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002600: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002610: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002620: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002630: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002640: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002650: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002660: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002670: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002680: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002690: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00026a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00026b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00026c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00026d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00026e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00026f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002700: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002710: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002720: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002730: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002740: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002750: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002760: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002770: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002780: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002790: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00027a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00027b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00027c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00027d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00027e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00027f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002800: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002810: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002820: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002830: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002840: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002850: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002860: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002870: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002880: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002890: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00028a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00028b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00028c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00028d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00028e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00028f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002900: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002910: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002920: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002930: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002940: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002950: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002960: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002970: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002980: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002990: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00029a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00029b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00029c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00029d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00029e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00029f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002a00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002a10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002a20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002a30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002a40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002a50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002a60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002a70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002a80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002a90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002aa0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002ab0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002ac0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002ad0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002ae0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002af0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002b00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002b10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002b20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002b30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002b40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002b50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002b60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002b70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002b80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002b90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002ba0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002bb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002bc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002bd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002be0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002bf0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002c00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002c10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002c20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002c30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002c40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002c50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002c60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002c70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002c80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002c90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002ca0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002cb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002cc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002cd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002ce0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002cf0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002d00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002d10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002d20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002d30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002d40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002d50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002d60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002d70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002d80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002d90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002da0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002db0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002dc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002dd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002de0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002df0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002e00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002e10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002e20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002e30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002e40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002e50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002e60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002e70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002e80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002e90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002ea0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002eb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002ec0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002ed0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002ee0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002ef0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002f00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002f10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002f20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002f30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002f40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002f50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002f60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002f70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002f80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002f90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002fa0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002fb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002fc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002fd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002fe0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0002ff0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003000: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003010: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003020: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003030: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003040: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003050: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003060: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003070: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003080: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003090: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00030a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00030b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00030c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00030d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00030e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00030f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003100: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003110: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003120: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003130: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003140: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003150: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003160: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003170: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003180: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003190: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00031a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00031b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00031c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00031d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00031e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00031f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003200: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003210: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003220: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003230: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003240: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003250: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003260: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003270: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003280: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003290: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00032a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00032b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00032c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00032d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00032e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00032f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003300: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003310: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003320: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003330: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003340: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003350: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003360: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003370: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003380: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003390: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00033a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00033b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00033c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00033d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00033e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00033f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003400: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003410: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003420: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003430: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003440: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003450: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003460: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003470: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003480: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003490: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00034a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00034b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00034c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00034d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00034e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00034f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003500: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003510: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003520: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003530: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003540: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003550: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003560: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003570: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003580: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003590: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00035a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00035b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00035c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00035d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00035e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00035f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003600: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003610: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003620: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003630: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003640: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003650: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003660: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003670: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003680: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003690: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00036a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00036b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00036c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00036d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00036e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00036f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003700: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003710: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003720: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003730: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003740: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003750: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003760: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003770: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003780: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003790: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00037a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00037b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00037c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00037d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00037e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00037f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003800: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003810: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003820: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003830: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003840: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003850: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003860: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003870: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003880: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003890: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00038a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00038b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00038c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00038d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00038e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00038f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003900: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003910: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003920: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003930: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003940: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003950: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003960: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003970: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003980: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003990: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00039a0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00039b0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00039c0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00039d0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00039e0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
00039f0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003a00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003a10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003a20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003a30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003a40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003a50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003a60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003a70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003a80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003a90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003aa0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003ab0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003ac0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003ad0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003ae0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003af0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003b00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003b10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003b20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003b30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003b40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003b50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003b60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003b70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003b80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003b90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003ba0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003bb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003bc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003bd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003be0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003bf0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003c00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003c10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003c20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003c30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003c40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003c50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003c60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003c70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003c80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003c90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003ca0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003cb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003cc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003cd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003ce0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003cf0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003d00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003d10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003d20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003d30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003d40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003d50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003d60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003d70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003d80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003d90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003da0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003db0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003dc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003dd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003de0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003df0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003e00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003e10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003e20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003e30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003e40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003e50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003e60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003e70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003e80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003e90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003ea0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003eb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003ec0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003ed0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003ee0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003ef0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003f00: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003f10: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003f20: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003f30: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003f40: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003f50: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003f60: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003f70: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003f80: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003f90: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003fa0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003fb0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003fc0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003fd0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003fe0: 0000 0000 0000 0000 0000 0000 0000 0000  ................
 
0003ff0: 0000 0000 0070 0063 7bbd d2d4 760b 15a8  .....p.c{...v...

Comment by Aurélien LEQUOY [ 2020-03-09 ]

Other point after many test I can make : 

select id from ssladmin_certificatemodel order by id;

and

select id from ssladmin_certificatemodel order by id limit 10;

without crash

look there is an other issue (or fix) with import table and restart of MariaDB

original query sill crash MariaDB :

SELECT `ssladmin_certificatemodel`.`id`, `ssladmin_certificatemodel`.`provider`, `ssladmin_certificatemodel`.`orderid`, `ssladmin_certificatemodel`.`common_name`, `ssladmin_certificatemodel`.`key_alg`, `ssladmin_certificatemodel`.`private_key_pem`, `ssladmin_certificatemodel`.`private_key_fernet`, `ssladmin_certificatemodel`.`certificate_request_pem`, `ssladmin_certificatemodel`.`certificate_pem`, `ssladmin_certificatemodel`.`status`, `ssladmin_certificatemodel`.`created`, `ssladmin_certificatemodel`.`modified` FROM `ssladmin_certificatemodel` WHERE (`ssladmin_certificatemodel`.`id` LIKE '%aazfby%' OR `ssladmin_certificatemodel`.`common_name` LIKE '%aazfby%') ORDER BY `ssladmin_certificatemodel`.`id` DESC;
 
ERROR 2013 (HY000): Lost connection to MySQL server during query

Comment by Marko Mäkelä [ 2020-03-09 ]

Aurelien_LEQUOY, the page looks like the root (and leaf) page in a secondary index, with the PAGE_INDEX_ID=0x04d0, containing only the record that was inserted at 0x87. You should be able to look up the index name from INFORMATION_SCHEMA.INNODB_SYS_INDEXES and then compare to SHOW CREATE TABLE. You could try to ‘heal’ the table by:

ALTER TABLE ssladmin_certificatemodel DROP INDEX corrupted_index_name;
 
ALTER TABLE ssladmin_certificatemodel ADD INDEX corrupted_index_name(…);

It really looks like a corrupted page to me. The info_bits in the record header byte 0x87-5 are 0x10 (REC_INFO_MIN_REC_FLAG). Before MDEV-11369, that flag could only be set in the first record of leftmost non-leaf pages (pointing to the leftmost child page). After MDEV-11369, the flag can also be set in the leftmost leaf page of a clustered index (primary key index). But never on a secondary index leaf page! The consistency check was introduced in 10.3 only; earlier versions would happily do ‘garbage in, garbage out’ in this case.

The page contents does not look like a clustered index to me. Most notably, outside the system tablespace (tablespace ID 0), the clustered index root page number must be 3. Here we have an apparent index root page with a different page number (0x1d42 in tablespace 0x1ff).

If you did ALTER TABLE…IMPORT TABLESPACE without a .cfg file at some point, then it is possible that we would guess a wrong index root page number. I have not checked what that code actually does. We really should store the index root page numbers in the .ibd file (as outlined in MDEV-4259) and avoid such guessing. And perhaps the guessing code should be revised so that it would perform stricter sanity checks.

I am afraid that even a full copy of the data file would not be helpful in resolving this. I would need the complete set of commands from the beginning, to create, export, and import the file, with a reasonably high probability of failure.

Comment by Marko Mäkelä [ 2020-03-10 ]

I am lowering the priority, because the bug (if it could be reproduced) seems to be related to ALTER TABLE…IMPORT TABLESPACE. I am also tentatively setting a fixVersion based on the fact that the consistency check was introduced in MariaDB Server 10.3 related to MDEV-11369. This bug is already marked related to MDEV-13542 where we should eventually replace such crashes with proper error handling.

Comment by Aurélien LEQUOY [ 2020-03-10 ]

About IMPORT table space i do this to not impact production, I still have one server with this issue.
Marko Mäkelä : export / import was the solution to work quietly, i am sure the problem not come from there. (maybe we not the good things with this server)

It's happen on master and I got exactly the same trouble and both slaves behind. I can isolate this slave and make a debug too.

Comment by Aurélien LEQUOY [ 2020-03-10 ]

I think it's more complicated than that, I clearly identified the problem with PRIMARY INDEX.

MariaDB [test]> show create table ssladmin_certificatemodel\G
 
*************************** 1. row ***************************
 
       Table: ssladmin_certificatemodel
 
Create Table: CREATE TABLE `ssladmin_certificatemodel` (
 
  `id` int(11) NOT NULL,
 
  `provider` varchar(30) NOT NULL,
 
  `orderid` varchar(30) NOT NULL,
 
  `common_name` varchar(100) NOT NULL,
 
  `key_alg` varchar(10) NOT NULL,
 
  `private_key_pem` longtext NOT NULL,
 
  `certificate_request_pem` longtext NOT NULL,
 
  `certificate_pem` longtext NOT NULL,
 
  `status` longtext NOT NULL,
 
  `created` datetime(6) NOT NULL,
 
  `modified` datetime(6) NOT NULL,
 
  `private_key_fernet` longtext NOT NULL,
 
  PRIMARY KEY (`id`),
 
  UNIQUE KEY `ssladmin_certificatemode_provider_orderid_common__bc90565b_uniq` (`provider`,`orderid`,`common_name`,`key_alg`)
 
) ENGINE=InnoDB DEFAULT CHARSET=utf8
 
1 row in set (0.000 sec)
 
 
 
MariaDB [test]> ALTER TABLE ssladmin_certificatemodel DROP INDEX ssladmin_certificatemode_provider_orderid_common__bc90565b_uniq;
 
Query OK, 0 rows affected (0.019 sec)
 
Records: 0  Duplicates: 0  Warnings: 0
 
 
 
MariaDB [test]> SELECT 
  `ssladmin_certificatemodel`.`id`, 
  `ssladmin_certificatemodel`.`provider`, 
  `ssladmin_certificatemodel`.`orderid`, 
  `ssladmin_certificatemodel`.`common_name`, 
  `ssladmin_certificatemodel`.`key_alg`, 
  `ssladmin_certificatemodel`.`private_key_pem`, 
  `ssladmin_certificatemodel`.`private_key_fernet`, 
  `ssladmin_certificatemodel`.`certificate_request_pem`, 
  `ssladmin_certificatemodel`.`certificate_pem`, 
  `ssladmin_certificatemodel`.`status`, 
  `ssladmin_certificatemodel`.`created`, 
  `ssladmin_certificatemodel`.`modified` 
FROM 
  `ssladmin_certificatemodel` 
WHERE 
  (
 
    `ssladmin_certificatemodel`.`id` LIKE '%aazfby%' 
    OR `ssladmin_certificatemodel`.`common_name` LIKE '%aazfby%'
 
  ) 
ORDER BY 
  `ssladmin_certificatemodel`.`id` DESC
 
ERROR 2013 (HY000): Lost connection to MySQL server during query

On original server I couldn't DROP PK, on copy i can : 

MariaDB [test]> ALTER TABLE ssladmin_certificatemodel DROP PRIMARY KEY;
 
Query OK, 23585 rows affected (2.523 sec)              
Records: 23585  Duplicates: 0  Warnings: 0
 
 
 
 
 
-- and now this query works good :
 
 
 
MariaDB [test]> SELECT 
  `ssladmin_certificatemodel`.`id`, 
  `ssladmin_certificatemodel`.`provider`, 
  `ssladmin_certificatemodel`.`orderid`, 
  `ssladmin_certificatemodel`.`common_name`, 
  `ssladmin_certificatemodel`.`key_alg`, 
  `ssladmin_certificatemodel`.`private_key_pem`, 
  `ssladmin_certificatemodel`.`private_key_fernet`, 
  `ssladmin_certificatemodel`.`certificate_request_pem`, 
  `ssladmin_certificatemodel`.`certificate_pem`, 
  `ssladmin_certificatemodel`.`status`, 
  `ssladmin_certificatemodel`.`created`, 
  `ssladmin_certificatemodel`.`modified` 
FROM 
  `ssladmin_certificatemodel` 
WHERE 
  (
 
    `ssladmin_certificatemodel`.`id` LIKE '%aazfby%' 
    OR `ssladmin_certificatemodel`.`common_name` LIKE '%aazfby%'
 
  ) 
ORDER BY 
  `ssladmin_certificatemodel`.`id` DESC
 
 
 
...
 
2 rows in set (0.027 sec)

Comment by Aurélien LEQUOY [ 2020-03-10 ]

I already faced to some kind of corruption with InnoDB. My problem there it's the corruption happen on all the servers included in cluster Master/Slave !

Comment by Marko Mäkelä [ 2020-03-10 ]

If some columns had been added to the table in MariaDB 10.3 before version 10.3.17, then the corruption of the primary key could be explained by MDEV-19916.

If you cannot provide exact steps for repeating the bug, then I do not think that we can do much more unless you are a paying customer of MariaDB Corporation.

Comment by Aurélien LEQUOY [ 2020-03-26 ]

I upgraded to lastest of 10.3 with "corrupted" file and it's working fine !

You can close ticket

Generated at Thu Feb 08 09:10:23 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.