[MDEV-6593] domain_id based replication filters - Jira

Nirbhay Choubey (Inactive) created issue - 2014-08-16 06:23

Nirbhay Choubey (Inactive) made changes - 2014-08-16 06:30

Field	Original Value	New Value
Link		This issue blocks ~~MDEV-6594~~ [ ~~MDEV-6594~~ ]

Kristian Nielsen added a comment - 2014-08-16 14:33

It might be better to do it like ignored server ids. Eg.

CHANGE MASTER TO IGNORE_DOMAIN_IDS= (1,2)
CHANGE MASTER TO ONLY_DOMAIN_IDS= (0)

This way, it is possible to configure it per master connection, which would seem to be useful.

Kristian Nielsen added a comment - 2014-08-16 14:33 It might be better to do it like ignored server ids. Eg. CHANGE MASTER TO IGNORE_DOMAIN_IDS= (1,2) CHANGE MASTER TO ONLY_DOMAIN_IDS= (0) This way, it is possible to configure it per master connection, which would seem to be useful.

Nirbhay Choubey (Inactive) made changes - 2014-08-23 00:00

Assignee

Nirbhay Choubey [ nirbhay_c ]

Nirbhay Choubey (Inactive) made changes - 2014-08-23 00:00

Status

Open [ 1 ]

In Progress [ 3 ]

Nirbhay Choubey (Inactive) made changes - 2014-09-05 02:49

Description

Provide a mechanism to filter replication events on the slave replication
server based on domain_id.

Someting like:
--replicate-do-domain-id=N
--replicate-ignore-domain-id=N

Provide a mechanism to filter replication events on the slave replication
server based on domain_id.

New master definitions:

(1) DO_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be kept.
  * This list would take precedence over IGNORE_DOMAIN_IDS list.
  * If a CHANGE MASTER command is executed without DO_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * DO_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.

(2) IGNORE_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be filtered out.
  * If a CHANGE MASTER command is executed without IGNORE_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * IGNORE_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.

Additional notes:
  * The list preservation rule is consistent with IGNORE_SERVER_IDS.

Examples:

CHANGE MASTER TO .. IGNORE_DOMAIN_IDS= (1,2,3) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= (99) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= () .. ;

$ tail -2 master.info
ignore_domain_ids=3 1 2 3
do_domain_ids=1 99

Nirbhay Choubey (Inactive) added a comment - 2014-09-05 02:50

Hi Kristian,
Thanks for the suggestion. I have updated the description accordingly.

Nirbhay Choubey (Inactive) added a comment - 2014-09-05 02:50 Hi Kristian, Thanks for the suggestion. I have updated the description accordingly.

Nirbhay Choubey (Inactive) made changes - 2014-09-05 02:51

Description

Provide a mechanism to filter replication events on the slave replication
server based on domain_id.

New master definitions:

(1) DO_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be kept.
  * This list would take precedence over IGNORE_DOMAIN_IDS list.
  * If a CHANGE MASTER command is executed without DO_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * DO_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.

(2) IGNORE_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be filtered out.
  * If a CHANGE MASTER command is executed without IGNORE_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * IGNORE_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.

Additional notes:
  * The list preservation rule is consistent with IGNORE_SERVER_IDS.

Examples:

CHANGE MASTER TO .. IGNORE_DOMAIN_IDS= (1,2,3) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= (99) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= () .. ;

$ tail -2 master.info
ignore_domain_ids=3 1 2 3
do_domain_ids=1 99

Provide a mechanism to filter replication events on the slave replication
server based on domain_id.

New master definitions:

(1) DO_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be kept.
  * This list would take precedence over IGNORE_DOMAIN_IDS list.
  * If a CHANGE MASTER command is executed without DO_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * DO_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.

(2) IGNORE_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be filtered out.
  * If a CHANGE MASTER command is executed without IGNORE_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * IGNORE_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.

Additional notes:
  * The list preservation rule is consistent with IGNORE_SERVER_IDS.

Examples:

CHANGE MASTER TO .. IGNORE_DOMAIN_IDS= (1,2,3) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= (99) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= () .. ;

$ tail -2 master.info
ignore_domain_ids=3 1 2 3
do_domain_ids=0

Nirbhay Choubey (Inactive) made changes - 2014-09-05 06:10

Description

Provide a mechanism to filter replication events on the slave replication
server based on domain_id.

New master definitions:

(1) DO_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be kept.
  * This list would take precedence over IGNORE_DOMAIN_IDS list.
  * If a CHANGE MASTER command is executed without DO_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * DO_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.

(2) IGNORE_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be filtered out.
  * If a CHANGE MASTER command is executed without IGNORE_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * IGNORE_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.

Additional notes:
  * The list preservation rule is consistent with IGNORE_SERVER_IDS.

Examples:

CHANGE MASTER TO .. IGNORE_DOMAIN_IDS= (1,2,3) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= (99) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= () .. ;

$ tail -2 master.info
ignore_domain_ids=3 1 2 3
do_domain_ids=0

Provide a mechanism to filter replication events on the slave replication
server based on domain_id.

New master definitions:

(1) DO_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be kept.
  * This list would take precedence over IGNORE_DOMAIN_IDS list.
  * If a CHANGE MASTER command is executed without DO_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * DO_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.

(2) IGNORE_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be filtered out.
  * If a CHANGE MASTER command is executed without IGNORE_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * IGNORE_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.

Additional notes:
  * The list preservation rule is consistent with IGNORE_SERVER_IDS.

Examples:

CHANGE MASTER TO .. IGNORE_DOMAIN_IDS= (1,2,3) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= (99) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= () .. ;

$ tail -2 master.info
do_domain_ids=0
ignore_domain_ids=3 1 2 3

Nirbhay Choubey (Inactive) made changes - 2014-09-12 21:13

Description

Provide a mechanism to filter replication events on the slave replication
server based on domain_id.

New master definitions:

(1) DO_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be kept.
  * This list would take precedence over IGNORE_DOMAIN_IDS list.
  * If a CHANGE MASTER command is executed without DO_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * DO_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.

(2) IGNORE_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be filtered out.
  * If a CHANGE MASTER command is executed without IGNORE_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * IGNORE_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.

Additional notes:
  * The list preservation rule is consistent with IGNORE_SERVER_IDS.

Examples:

CHANGE MASTER TO .. IGNORE_DOMAIN_IDS= (1,2,3) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= (99) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= () .. ;

$ tail -2 master.info
do_domain_ids=0
ignore_domain_ids=3 1 2 3

Provide a mechanism to filter replication events on the slave replication
server based on domain_id.

New master definitions:

(1) DO_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be kept.
  * This list would take precedence over IGNORE_DOMAIN_IDS list.
  * If a CHANGE MASTER command is executed without DO_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * DO_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.
  * On restart, the list should automatically get populated from master_info.

(2) IGNORE_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be filtered out.
  * If a CHANGE MASTER command is executed without IGNORE_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * IGNORE_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.
  * On restart, the list should automatically get populated from master_info.

Additional notes:
  * The list preservation rule is consistent with IGNORE_SERVER_IDS.

Examples:

CHANGE MASTER TO .. IGNORE_DOMAIN_IDS= (1,2,3) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= (99) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= () .. ;

$ tail -2 master.info
do_domain_ids=0
ignore_domain_ids=3 1 2 3

Nirbhay Choubey (Inactive) added a comment - 2014-09-12 21:18

http://lists.askmonty.org/pipermail/commits/2014-September/006553.html

Nirbhay Choubey (Inactive) added a comment - 2014-09-12 21:18 http://lists.askmonty.org/pipermail/commits/2014-September/006553.html

Nirbhay Choubey (Inactive) made changes - 2014-09-12 21:18

Assignee	Nirbhay Choubey [ nirbhay_c ]	Kristian Nielsen [ knielsen ]
Status	In Progress [ 3 ]	In Review [ 10002 ]

Kristian Nielsen added a comment - 2014-09-16 11:11

https://lists.launchpad.net/maria-developers/msg07703.html
https://lists.launchpad.net/maria-developers/msg07704.html

Kristian Nielsen added a comment - 2014-09-16 11:11 https://lists.launchpad.net/maria-developers/msg07703.html https://lists.launchpad.net/maria-developers/msg07704.html

Kristian Nielsen made changes - 2014-09-16 11:11

Assignee	Kristian Nielsen [ knielsen ]	Nirbhay Choubey [ nirbhay_c ]
Status	In Review [ 10002 ]	Stalled [ 10000 ]

Nirbhay Choubey (Inactive) made changes - 2014-09-16 22:19

Status

Stalled [ 10000 ]

In Progress [ 3 ]

Nirbhay Choubey (Inactive) added a comment - 2014-11-07 04:51

http://lists.askmonty.org/pipermail/commits/2014-November/006904.html

Nirbhay Choubey (Inactive) added a comment - 2014-11-07 04:51 http://lists.askmonty.org/pipermail/commits/2014-November/006904.html

Nirbhay Choubey (Inactive) made changes - 2014-11-07 04:51

Assignee	Nirbhay Choubey [ nirbhay_c ]	Kristian Nielsen [ knielsen ]
Status	In Progress [ 3 ]	In Review [ 10002 ]

Kristian Nielsen added a comment - 2014-11-14 11:00 - edited

Review sent on maria-developers@:

https://lists.launchpad.net/maria-developers/msg07895.html

Kristian Nielsen added a comment - 2014-11-14 11:00 - edited Review sent on maria-developers@: https://lists.launchpad.net/maria-developers/msg07895.html

Kristian Nielsen made changes - 2014-11-14 11:00

Assignee

Kristian Nielsen [ knielsen ]

Nirbhay Choubey [ nirbhay_c ]

Nirbhay Choubey (Inactive) added a comment - 2014-11-18 05:37

http://lists.askmonty.org/pipermail/commits/2014-November/007040.html

Nirbhay Choubey (Inactive) added a comment - 2014-11-18 05:37 http://lists.askmonty.org/pipermail/commits/2014-November/007040.html

Sergei Golubchik made changes - 2014-12-03 19:01

Fix Version/s

10.1 [ 16100 ]

Nirbhay Choubey (Inactive) made changes - 2014-12-04 02:48

Description

Provide a mechanism to filter replication events on the slave replication
server based on domain_id.

New master definitions:

(1) DO_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be kept.
  * This list would take precedence over IGNORE_DOMAIN_IDS list.
  * If a CHANGE MASTER command is executed without DO_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * DO_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.
  * On restart, the list should automatically get populated from master_info.

(2) IGNORE_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be filtered out.
  * If a CHANGE MASTER command is executed without IGNORE_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * IGNORE_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.
  * On restart, the list should automatically get populated from master_info.

Additional notes:
  * The list preservation rule is consistent with IGNORE_SERVER_IDS.

Examples:

CHANGE MASTER TO .. IGNORE_DOMAIN_IDS= (1,2,3) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= (99) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= () .. ;

$ tail -2 master.info
do_domain_ids=0
ignore_domain_ids=3 1 2 3

Provide a mechanism to filter replication events on the slave replication
server based on domain_id.

New master definitions:

(1) DO_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be kept.
  * If a CHANGE MASTER command is executed without DO_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * DO_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.
  * On restart, the list should automatically get populated from master_info.

(2) IGNORE_DOMAIN_IDS = (N[,N])
  * Accepts a comma-separated list of domain_ids, the replication events of
    which will be filtered out.
  * If a CHANGE MASTER command is executed without IGNORE_DOMAIN_IDS, the
    existing list of domain ids (if any) would be preserved.
  * IGNORE_DOMAIN_IDS=() can be used to clear the list.
  * The list should show in SHOW MASTER STATUS output and master_info file.
  * On restart, the list should automatically get populated from master_info.

Additional notes:
  * The list preservation rule is consistent with IGNORE_SERVER_IDS.
  * Both the lists (DO_ & IGNORE_) cannot be non-empty at the same time.
  * CHANGE MASTER TO command would fail with ER_MASTER_INFO if it tries
     to set both the lists.

Examples:

CHANGE MASTER TO .. IGNORE_DOMAIN_IDS= (1,2,3) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= (99) .. ;
CHANGE MASTER TO .. DO_DOMAIN_IDS= () .. ;

$ tail -2 master.info
do_domain_ids=0
ignore_domain_ids=3 1 2 3

Nirbhay Choubey (Inactive) added a comment - 2014-12-04 05:39

https://github.com/MariaDB/server/commit/a50ddebb5cfa7b79540d155e8e41c7a07c4c3fbf

Nirbhay Choubey (Inactive) added a comment - 2014-12-04 05:39 https://github.com/MariaDB/server/commit/a50ddebb5cfa7b79540d155e8e41c7a07c4c3fbf

Nirbhay Choubey (Inactive) made changes - 2014-12-04 05:39

Component/s		Replication [ 10100 ]
Fix Version/s		10.1.2 [ 15801 ]
Fix Version/s	10.1 [ 16100 ]
Resolution		Fixed [ 1 ]
Status	In Review [ 10002 ]	Closed [ 6 ]

Rasmus Johansson (Inactive) made changes - 2015-05-18 17:51

Workflow

MariaDB v2 [ 52803 ]

MariaDB v3 [ 64681 ]

VAROQUI Stephane made changes - 2015-12-30 14:32

Link

This issue is part of MDEV-9345 [ MDEV-9345 ]

Sergei Golubchik made changes - 2021-12-06 21:22

Workflow

MariaDB v3 [ 64681 ]

MariaDB v4 [ 132393 ]

MariaDB Server

domain_id based replication filters

Details

Description

Attachments

Issue Links

Activity

People

Dates

Git Integration