Details
-
Task
-
Status: Confirmed (View Workflow)
-
Major
-
Resolution: Unresolved
-
None
Description
I load backup to mariadb and break it. In processlist still present one killed thread:
{code}
show processlist;
---------------------------------------------------------------------------------------------------------
Id | User | Host | db | Command | Time | State | Info | Progress |
---------------------------------------------------------------------------------------------------------
85 | loader | 10.10.16.216:43971 | phonebook_storage | Killed | 1845 | Unlocking tables | NULL | 0.000 |
184 | root | localhost | NULL | Query | 0 | init | show processlist | 0.000 |
---------------------------------------------------------------------------------------------------------
{code}
In same time I run strace for mysqld and see many calls to madvise:
{code}
- strace -ff -p 33080
...
[pid 60412] madvise(0x7f36cb638000, 331776, MADV_DONTNEED) = 0
[pid 60412] madvise(0x7f36cb441000, 135168, MADV_DONTNEED) = 0
[pid 60412] madvise(0x7f36cb638000, 335872, MADV_DONTNEED) = 0
[pid 60412] madvise(0x7f36cb441000, 135168, MADV_DONTNEED) = 0
[pid 60412] madvise(0x7f36cb638000, 335872, MADV_DONTNEED) = 0
[pid 60412] madvise(0x7f36cb441000, 135168, MADV_DONTNEED) = 0
[pid 60412] madvise(0x7f36cb638000, 335872, MADV_DONTNEED) = 0
{code}
Table which been loading:
{code}
/*!40101 SET @saved_cs_client = @@character_set_client */;
/*!40101 SET character_set_client = utf8 */;
CREATE TABLE `contact` (
`id` int(10) unsigned NOT NULL AUTO_INCREMENT,
`id_phonebook` int(10) unsigned NOT NULL DEFAULT '0',
`id_user` int(10) unsigned NOT NULL DEFAULT '0',
`firstname` varchar(255) NOT NULL DEFAULT '',
`lastname` varchar(255) NOT NULL DEFAULT '',
`local_key` varchar(255) NOT NULL DEFAULT '',
PRIMARY KEY (`id`),
KEY `id_phonebook` (`id_phonebook`) USING BTREE,
KEY `id_user` (`id_user`) USING BTREE
) ENGINE=InnoDB AUTO_INCREMENT=133028725 DEFAULT CHARSET=utf8 ROW_FORMAT=COMPRESSED KEY_BLOCK_SIZE=2;
/*!40101 SET character_set_client = @saved_cs_client */;
{code}
Attachments
Issue Links
- relates to
-
MDEV-515 innodb bulk insert
-
- Closed
-
-
MDEV-21225 Remove ut_align() and use aligned_malloc()
-
- Closed
-
-
MDEV-32050 UNDO logs still growing for write-intensive workloads
-
- Closed
-
-
MDEV-18746 Reduce the amount of mem_heap_create() or malloc()
-
- Open
-
-
MDEV-30889 Memory leak issues with MariaDB 10.6.12 and OOM Crashes
-
- Confirmed
-
Activity
Link | This issue relates to MDEV-18746 [ MDEV-18746 ] |
Link |
This issue relates to |
Link | This issue relates to MDEV-30889 [ MDEV-30889 ] |
Description |
I load backup to mariadb and break it. In processlist still present one killed thread:
{code} show processlist; +-----+--------+--------------------+-------------------+---------+------+------------------+------------------+----------+ | Id | User | Host | db | Command | Time | State | Info | Progress | +-----+--------+--------------------+-------------------+---------+------+------------------+------------------+----------+ | 85 | loader | 10.10.16.216:43971 | phonebook_storage | Killed | 1845 | Unlocking tables | NULL | 0.000 | | 184 | root | localhost | NULL | Query | 0 | init | show processlist | 0.000 | +-----+--------+--------------------+-------------------+---------+------+------------------+------------------+----------+ {code} In same time I run strace for mysqld and see many calls to madvise: {code} # strace -ff -p 33080 ... [pid 60412] madvise(0x7f36cb638000, 331776, MADV_DONTNEED) = 0 [pid 60412] madvise(0x7f36cb441000, 135168, MADV_DONTNEED) = 0 [pid 60412] madvise(0x7f36cb638000, 335872, MADV_DONTNEED) = 0 [pid 60412] madvise(0x7f36cb441000, 135168, MADV_DONTNEED) = 0 [pid 60412] madvise(0x7f36cb638000, 335872, MADV_DONTNEED) = 0 [pid 60412] madvise(0x7f36cb441000, 135168, MADV_DONTNEED) = 0 [pid 60412] madvise(0x7f36cb638000, 335872, MADV_DONTNEED) = 0 {code} Table which been loading: {code} /*!40101 SET @saved_cs_client = @@character_set_client */; /*!40101 SET character_set_client = utf8 */; CREATE TABLE `contact` ( `id` int(10) unsigned NOT NULL AUTO_INCREMENT, `id_phonebook` int(10) unsigned NOT NULL DEFAULT '0', `id_user` int(10) unsigned NOT NULL DEFAULT '0', `firstname` varchar(255) NOT NULL DEFAULT '', `lastname` varchar(255) NOT NULL DEFAULT '', `local_key` varchar(255) NOT NULL DEFAULT '', PRIMARY KEY (`id`), KEY `id_phonebook` (`id_phonebook`) USING BTREE, KEY `id_user` (`id_user`) USING BTREE ) ENGINE=InnoDB AUTO_INCREMENT=133028725 DEFAULT CHARSET=utf8 ROW_FORMAT=COMPRESSED KEY_BLOCK_SIZE=2; /*!40101 SET character_set_client = @saved_cs_client */; {code} |
I load backup to mariadb and break it. In processlist still present one killed thread: \{code\} show processlist; +\-\-\-\--+\-\-\-\-\-\-\-\-+-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\--+\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-+-\-\-\-\-\-\-\--+\-\-\-\-\-\-+-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\--+\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-+-\-\-\-\-\-\-\-\-\-+ | Id | User | Host | db | Command | Time | State | Info | Progress | +\-\-\-\--+\-\-\-\-\-\-\-\-+-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\--+\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-+-\-\-\-\-\-\-\--+\-\-\-\-\-\-+-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\--+\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-+-\-\-\-\-\-\-\-\-\-+ | 85 | loader | 10.10.16.216:43971 | phonebook_storage | Killed | 1845 | Unlocking tables | NULL | 0.000 | | 184 | root | localhost | NULL | Query | 0 | init | show processlist | 0.000 | +\-\-\-\--+\-\-\-\-\-\-\-\-+-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\--+\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-+-\-\-\-\-\-\-\--+\-\-\-\-\-\-+-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\--+\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-+-\-\-\-\-\-\-\-\-\-+ \{code\} In same time I run strace for mysqld and see many calls to madvise: \{code\} # strace -ff -p 33080 ... \[pid 60412\] madvise(0x7f36cb638000, 331776, MADV\_DONTNEED) = 0 \[pid 60412\] madvise(0x7f36cb441000, 135168, MADV\_DONTNEED) = 0 \[pid 60412\] madvise(0x7f36cb638000, 335872, MADV\_DONTNEED) = 0 \[pid 60412\] madvise(0x7f36cb441000, 135168, MADV\_DONTNEED) = 0 \[pid 60412\] madvise(0x7f36cb638000, 335872, MADV\_DONTNEED) = 0 \[pid 60412\] madvise(0x7f36cb441000, 135168, MADV\_DONTNEED) = 0 \[pid 60412\] madvise(0x7f36cb638000, 335872, MADV\_DONTNEED) = 0 \{code\} Table which been loading: \{code\} /*!40101 SET @saved_cs_client = @@character_set_client */; /*!40101 SET character_set_client = utf8 */; CREATE TABLE `contact` ( `id` int(10) unsigned NOT NULL AUTO\_INCREMENT, `id\_phonebook` int(10) unsigned NOT NULL DEFAULT '0', `id\_user` int(10) unsigned NOT NULL DEFAULT '0', `firstname` varchar(255) NOT NULL DEFAULT '', `lastname` varchar(255) NOT NULL DEFAULT '', `local\_key` varchar(255) NOT NULL DEFAULT '', PRIMARY KEY (`id`), KEY `id_phonebook` (`id_phonebook`) USING BTREE, KEY `id_user` (`id_user`) USING BTREE ) ENGINE=InnoDB AUTO_INCREMENT=133028725 DEFAULT CHARSET=utf8 ROW_FORMAT=COMPRESSED KEY_BLOCK_SIZE=2; /*!40101 SET character_set_client = @saved_cs_client */; \{code\} |
Workflow | MariaDB v3 [ 84341 ] | MariaDB v4 [ 131800 ] |
Link |
This issue relates to |
Affects Version/s | 10.2 [ 14601 ] | |
Affects Version/s | 5.5 [ 15800 ] | |
Affects Version/s | 10.0 [ 16000 ] | |
Affects Version/s | 10.1 [ 16100 ] | |
Affects Version/s | 10.3 [ 22126 ] | |
Affects Version/s | 10.4 [ 22408 ] | |
Affects Version/s | 10.1.29 [ 22636 ] | |
Environment | centos7 3.10.0-693.5.2.el7.x86_64 | |
Issue Type | Bug [ 1 ] | Task [ 3 ] |
Fix Version/s | 10.4 [ 22408 ] | |
NRE Projects | RM_long_term | |
Affects Version/s | 10.4 [ 22408 ] | |
Labels | memory performance | |
Summary | ROLLBACK of an INSERT into ROW_FORMAT=COMPRESSED table is very slow | Reduce malloc()/free() usage in InnoDB |
Fix Version/s | 10.4 [ 22408 ] | |
Fix Version/s | 10.1 [ 16100 ] |
Affects Version/s | 5.5 [ 15800 ] | |
Affects Version/s | 10.0 [ 16000 ] | |
Affects Version/s | 10.1 [ 16100 ] | |
Affects Version/s | 10.2 [ 14601 ] | |
Affects Version/s | 10.3 [ 22126 ] |
Status | Open [ 1 ] | Confirmed [ 10101 ] |
Summary | endless loop when rollback insert into compressed table | ROLLBACK of an INSERT into ROW_FORMAT=COMPRESSED table is very slow |
Assignee | Jan Lindström [ jplindst ] | Marko Mäkelä [ marko ] |
Fix Version/s | 10.1 [ 16100 ] | |
Assignee | Jan Lindström [ jplindst ] |
Attachment | vars.txt [ 44751 ] | |
Attachment | status.txt [ 44752 ] |
Field | Original Value | New Value |
---|---|---|
Attachment | gdb.txt [ 44750 ] |