[MXS-3904] Confirmation whether the event/data change is pushed to KafkaBroker or Not from the KafkaCDC router Created: 2021-12-08  Updated: 2023-10-04  Resolved: 2023-10-04

Status: Closed
Project: MariaDB MaxScale
Component/s: cdc
Affects Version/s: None
Fix Version/s: N/A

Type: New Feature Priority: Major
Reporter: Naresh Chandra Assignee: Todd Stoffel (Inactive)
Resolution: Won't Do Votes: 0
Labels: None


 Description   

As a user, we need a confirmation whether any data/event is pushed to KafkaBroker or not. For example any disaster or crash happens we need to know the event is pushed or paused in the KafkaCDC router.
1. If we enable KafkaCDC router cooperative monitoring between two maxscale servers then we don't know which maxscale is pushing the CDC changes or where the event is paused. We need some GUI monitoring on this if any event is missed from one maxscale kafkacdc router then other maxscale kafkacdc router should send the event to kafka broker.

 Comments   
Comment by markus makela [ 2022-12-14 ]

if you turn on cooperative_replication and enable_idempotence, all events should eventually get delivered. The Maxscale instances read the GTID coordinates from Kafka and use them to detect which events haven't been read. The monitor which "owns" the cluster is the one who is delivering the events.

Comment by Johan Wikman [ 2023-10-04 ]

Not possible.

Generated at Thu Feb 08 04:24:47 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.