[MDEV-19002] Partition performance optimization - Jira

Details

Type: Task
Status: Stalled (View Workflow)
Priority: Major
Resolution: Unresolved
Fix Version/s: None
Component/s: Partitioning, Server
Labels:
None

Description

Add the partition options of the following function for batch call instead of each partition

store_lock
external_lock
start_stmt
extra
cond_push
info_push
top_table

original description:
Partition performance optimization: improve the select/insert/delete/update/replace performance of the partition table under multiple partitions by executing prune_partition before the lock table

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending
- Thumbnails
- List
- Download All

gmon_del_with_1024_partitions.zip
485 kB
2019-05-07 17:33
gmon_del_without_partition.zip
471 kB
2019-05-07 17:33
gmon_ins_with_1024_partitions.zip
485 kB
2019-05-07 17:33
gmon_ins_without_partition.zip
460 kB
2019-05-07 17:33
gmon_sel_with_1024_partitions.zip
502 kB
2019-05-07 17:33
gmon_sel_without_partition.zip
474 kB
2019-05-07 17:33
gmon_spider_del_with_1024_partitions_after.zip
433 kB
2019-05-20 08:27
gmon_spider_del_with_1024_partitions_before.zip
436 kB
2019-05-20 08:25
gmon_spider_del_without_partition.zip
393 kB
2019-05-20 08:25
gmon_spider_ins_with_1024_partitions_after.zip
407 kB
2019-05-20 08:27
gmon_spider_ins_with_1024_partitions_before.zip
409 kB
2019-05-20 08:25
gmon_spider_ins_without_partition.zip
375 kB
2019-05-20 08:25
gmon_spider_sel_with_1024_partitions_after.zip
446 kB
2019-05-20 08:27
gmon_spider_sel_with_1024_partitions_before.zip
452 kB
2019-05-20 08:25
gmon_spider_sel_without_partition.zip
407 kB
2019-05-20 08:25
gmon_spider_upd_with_1024_partitions_after.zip
448 kB
2019-05-20 08:27
gmon_spider_upd_with_1024_partitions_before.zip
452 kB
2019-05-20 08:25
gmon_spider_upd_without_partition.zip
399 kB
2019-05-20 08:25
gmon_upd_with_1024_partitions.zip
490 kB
2019-05-07 17:33
gmon_upd_without_partition.zip
470 kB
2019-05-07 17:33
Test_procedures_delete.txt
1 kB
2019-05-07 17:33
Test_procedures_insert.txt
1 kB
2019-05-07 17:33
Test_procedures_select.txt
1 kB
2019-05-07 17:33
Test_procedures_update.txt
1 kB
2019-05-07 17:33
test_results_of_spider.txt
7 kB
2019-05-20 08:38

Issue Links

causes

MDEV-26158 SIGSEGV in spider_free_mem from ha_spider::open on INSERT

Closed

MDEV-26539 SIGSEGV in spider_check_and_set_trx_isolation and I_P_List_iterator from THD::drop_temporary_table (10.5.3 opt only) on ALTER

Closed

MDEV-26582 SIGSEGV in spider_db_bulk_insert and spider_db_connect and spider_db_before_query, and hang in "End of update loop" / "Reset for next command" query states

Closed

MDEV-27171 Spider: SIGSEGV in spider_set_direct_limit_offset on INSERT

Closed

MDEV-27239 Spider: Assertion `thd->transaction->stmt.ha_list == __null || trans == &thd->transaction->stmt' failed in ha_commit_trans on BEGIN WORK after FTWRL

Closed

MDEV-27240 SIGSEGV in ha_spider::store_lock on LOCK TABLE

Closed

MDEV-30191 SIGSEGV & heap-use-after-free in spider_db_print_item_type, SIGABRT in __cxa_pure_virtual/spider_db_print_item_type, Got error 128 "Out of memory in engine", 56/112 memory not freed, and Assertion `fixed()' failed in Item_sp_variable::val_str on SP call

Closed

MDEV-31996 Segfault when setting spider_delete_all_rows to 0 and delete all rows of a spider table, ASAN heap-use-after-free in spider_db_delete_all_rows

Closed

relates to

MDEV-20250 Implement early partition pruning before statement start

In Progress

(3 causes, 1 relates to)

Activity

Ascending order - Click to sort in descending order

willhan created issue - 2019-03-21 04:05

Kentoku Shiba (Inactive) made changes - 2019-05-03 14:18

Field	Original Value	New Value
Assignee		Kentoku [ kentoku ]

Kentoku Shiba (Inactive) made changes - 2019-05-03 14:18

Status

Open [ 1 ]

In Progress [ 3 ]

Kentoku Shiba (Inactive) made changes - 2019-05-06 01:14

Attachment		gmon_with_1024_partition.zip [ 48018 ]
Attachment		gmon_without_partition.zip [ 48019 ]
Attachment		Test_procedures.txt [ 48020 ]

Kentoku Shiba (Inactive) made changes - 2019-05-07 17:26

Attachment		gmonnpdel.txt [ 48026 ]
Attachment		gmonnpins.txt [ 48027 ]
Attachment		gmonnpupd.txt [ 48028 ]
Attachment		gmonptdel.txt [ 48029 ]
Attachment		gmonptins.txt [ 48030 ]
Attachment		gmoptpupd.txt [ 48031 ]

Kentoku Shiba (Inactive) made changes - 2019-05-07 17:26

Attachment

gmoptpupd.txt [ 48031 ]

Kentoku Shiba (Inactive) made changes - 2019-05-07 17:27

Attachment

gmon_without_partition.zip [ 48019 ]

Kentoku Shiba (Inactive) made changes - 2019-05-07 17:27

Attachment

gmonnpdel.txt [ 48026 ]

Kentoku Shiba (Inactive) made changes - 2019-05-07 17:27

Attachment

gmonnpupd.txt [ 48028 ]

Kentoku Shiba (Inactive) made changes - 2019-05-07 17:27

Attachment

gmonptdel.txt [ 48029 ]

Kentoku Shiba (Inactive) made changes - 2019-05-07 17:27

Attachment

gmonptins.txt [ 48030 ]

Kentoku Shiba (Inactive) made changes - 2019-05-07 17:27

Attachment

gmonnpins.txt [ 48027 ]

Kentoku Shiba (Inactive) made changes - 2019-05-07 17:27

Attachment

gmon_with_1024_partition.zip [ 48018 ]

Kentoku Shiba (Inactive) made changes - 2019-05-07 17:33

Attachment

Test_procedures.txt [ 48020 ]

Kentoku Shiba (Inactive) made changes - 2019-05-07 17:33

Attachment		gmon_del_with_1024_partitions.zip [ 48032 ]
Attachment		gmon_del_without_partition.zip [ 48033 ]
Attachment		gmon_ins_with_1024_partitions.zip [ 48034 ]
Attachment		gmon_ins_without_partition.zip [ 48035 ]
Attachment		gmon_sel_with_1024_partitions.zip [ 48036 ]
Attachment		gmon_sel_without_partition.zip [ 48037 ]
Attachment		gmon_upd_with_1024_partitions.zip [ 48038 ]
Attachment		gmon_upd_without_partition.zip [ 48039 ]
Attachment		Test_procedures_delete.txt [ 48040 ]
Attachment		Test_procedures_insert.txt [ 48041 ]
Attachment		Test_procedures_select.txt [ 48042 ]
Attachment		Test_procedures_update.txt [ 48043 ]

Kentoku Shiba (Inactive) made changes - 2019-05-20 08:25

Attachment		gmon_spider_upd_without_partition.zip [ 48081 ]
Attachment		gmon_spider_upd_with_1024_partitions_before.zip [ 48082 ]
Attachment		gmon_spider_sel_without_partition.zip [ 48083 ]
Attachment		gmon_spider_sel_with_1024_partitions_before.zip [ 48084 ]
Attachment		gmon_spider_ins_without_partition.zip [ 48085 ]
Attachment		gmon_spider_ins_with_1024_partitions_before.zip [ 48086 ]
Attachment		gmon_spider_del_without_partition.zip [ 48087 ]
Attachment		gmon_spider_del_with_1024_partitions_before.zip [ 48088 ]

Kentoku Shiba (Inactive) made changes - 2019-05-20 08:27

Attachment		gmon_spider_del_with_1024_partitions_after.zip [ 48089 ]
Attachment		gmon_spider_ins_with_1024_partitions_after.zip [ 48090 ]
Attachment		gmon_spider_sel_with_1024_partitions_after.zip [ 48091 ]
Attachment		gmon_spider_upd_with_1024_partitions_after.zip [ 48092 ]

Kentoku Shiba (Inactive) made changes - 2019-05-20 08:38

Attachment

test_results_of_spider.txt [ 48093 ]

Kentoku Shiba (Inactive) made changes - 2019-05-20 09:14

Assignee	Kentoku [ kentoku ]	Michael Widenius [ monty ]
Status	In Progress [ 3 ]	In Review [ 10002 ]

Kentoku Shiba (Inactive) made changes - 2019-11-20 07:17

Priority

Major [ 3 ]

Critical [ 2 ]

Sergei Golubchik made changes - 2019-11-22 16:13

Description

Partition performance optimization: improve the select/insert/delete/update/replace performance of the partition table under multiple partitions by executing prune_partition before the lock table

Add the partition options of the following function for batch call instead of each partition
- store_lock
- external_lock
- start_stmt
- extra
- cond_push
- info_push
- top_table

*original description:*
Partition performance optimization: improve the select/insert/delete/update/replace performance of the partition table under multiple partitions by executing prune_partition before the lock table

Julien Fritsch made changes - 2020-04-09 06:41

Fix Version/s

N/A [ 14700 ]

Julien Fritsch made changes - 2021-03-03 08:08

Fix Version/s		10.2 [ 14601 ]
Fix Version/s		10.3 [ 22126 ]
Fix Version/s		10.4 [ 22408 ]
Fix Version/s		10.5 [ 23123 ]
Fix Version/s		10.6 [ 24028 ]
Fix Version/s	N/A [ 14700 ]

Ralf Gebhardt made changes - 2021-03-04 08:42

Component/s

Partitioning [ 10802 ]

Ralf Gebhardt made changes - 2021-03-04 08:43

Fix Version/s		10.7 [ 24805 ]
Fix Version/s	10.2 [ 14601 ]
Fix Version/s	10.3 [ 22126 ]
Fix Version/s	10.4 [ 22408 ]
Fix Version/s	10.5 [ 23123 ]
Fix Version/s	10.6 [ 24028 ]

Sergei Golubchik made changes - 2021-09-04 12:24

Link

This issue relates to MDEV-20250 [ MDEV-20250 ]

Sergei Golubchik made changes - 2021-09-04 12:24

Priority

Critical [ 2 ]

Major [ 3 ]

Sergei Golubchik made changes - 2021-09-04 12:24

Assignee

Michael Widenius [ monty ]

Alexey Botchkov [ holyfoot ]

Nayuta Yanagisawa (Inactive) made changes - 2021-09-16 05:43

Link

This issue causes ~~MDEV-26582~~ [ ~~MDEV-26582~~ ]

Roel Van de Paar made changes - 2021-09-17 18:04

Assignee

Alexey Botchkov [ holyfoot ]

Kentoku Shiba [ kentoku ]

Roel Van de Paar made changes - 2021-09-17 18:06

Fix Version/s		N/A [ 14700 ]
Fix Version/s	10.7 [ 24805 ]
Resolution		Fixed [ 1 ]
Status	In Review [ 10002 ]	Closed [ 6 ]

Roel Van de Paar made changes - 2021-09-17 18:06

Resolution	Fixed [ 1 ]
Status	Closed [ 6 ]	Stalled [ 10000 ]

Roel Van de Paar made changes - 2021-09-17 18:07

Fix Version/s		10.7 [ 24805 ]
Fix Version/s	N/A [ 14700 ]

Nayuta Yanagisawa (Inactive) made changes - 2021-09-21 04:34

Assignee

Kentoku Shiba [ kentoku ]

Nayuta Yanagisawa [ JIRAUSER47117 ]

Nayuta Yanagisawa (Inactive) made changes - 2021-09-21 09:26

Link

This issue causes ~~MDEV-26539~~ [ ~~MDEV-26539~~ ]

Nayuta Yanagisawa (Inactive) made changes - 2021-09-21 11:22

Link

This issue causes ~~MDEV-26158~~ [ ~~MDEV-26158~~ ]

Ralf Gebhardt made changes - 2021-11-11 10:04

Fix Version/s		10.8 [ 26121 ]
Fix Version/s	10.7 [ 24805 ]

Nayuta Yanagisawa (Inactive) made changes - 2021-11-29 08:29

Fix Version/s

10.8 [ 26121 ]

Sergei Golubchik made changes - 2021-12-06 21:22

Workflow

MariaDB v3 [ 93418 ]

MariaDB v4 [ 131719 ]

Nayuta Yanagisawa (Inactive) made changes - 2021-12-16 09:27

Link

This issue causes ~~MDEV-27171~~ [ ~~MDEV-27171~~ ]

Nayuta Yanagisawa (Inactive) made changes - 2021-12-16 16:00

Link

This issue causes ~~MDEV-27240~~ [ ~~MDEV-27240~~ ]

Nayuta Yanagisawa (Inactive) made changes - 2021-12-20 09:02

Assignee

Nayuta Yanagisawa [ JIRAUSER47117 ]

Alexey Botchkov [ holyfoot ]

Nayuta Yanagisawa (Inactive) made changes - 2022-01-20 06:02

Link

This issue causes ~~MDEV-27239~~ [ ~~MDEV-27239~~ ]

Nayuta Yanagisawa (Inactive) made changes - 2022-06-17 05:40

Assignee

Alexey Botchkov [ holyfoot ]

Nayuta Yanagisawa [ JIRAUSER47117 ]

AirFocus made changes - 2022-08-09 16:10

Description

Add the partition options of the following function for batch call instead of each partition

* store\_lock
* external\_lock
* start\_stmt
* extra
* cond\_push
* info\_push
* top\_table

*original description:*
Partition performance optimization: improve the select/insert/delete/update/replace performance of the partition table under multiple partitions by executing prune\_partition before the lock table

Nayuta Yanagisawa (Inactive) made changes - 2022-12-15 11:59

Link

This issue causes ~~MDEV-30191~~ [ ~~MDEV-30191~~ ]

Yuchen Pei made changes - 2023-04-12 23:45

Assignee

Nayuta Yanagisawa [ JIRAUSER47117 ]

Alexey Botchkov [ holyfoot ]

Yuchen Pei made changes - 2023-10-06 00:12

Link

This issue causes ~~MDEV-31996~~ [ ~~MDEV-31996~~ ]

People

Assignee:: Alexey Botchkov

Reporter:: willhan

Votes:: 0 Vote for this issue

Watchers:: 10 Start watching this issue

Dates

Created:: 2019-03-21 04:05

Updated:: 2024-07-16 08:33

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.

MariaDB Server

Details

Description

Attachments

Attachments

Issue Links

Activity

People

Dates

Git Integration