[MXS-1687] Kafka integration failover Created: 2018-02-26  Updated: 2020-11-03  Resolved: 2020-10-26

Status: Closed
Project: MariaDB MaxScale
Component/s: avrorouter, failover
Affects Version/s: 2.1.13
Fix Version/s: 6.0.0

Type: New Feature Priority: Major
Reporter: Drew Schatt Assignee: markus makela
Resolution: Fixed Votes: 0
Labels: Kafka

Issue Links:
Relates
relates to MXS-1686 Direct Kafka Integration Closed
Epic Link: Stream To Kafka (Milestone 1)
Sprint: MXS-SPRINT-117

 Description   

We have a need for highly reliable CDC events to be sent from maxscale to kafka (for billing reasons).

Currently, to protect against maxscale crashes (either the process or the whole machine), we would have to run multiple instances of maxscale, each of which would process the binlogs and send them to kafka, leading to duplicate events.

I believe that Marcus mentioned the possibility to have maxscale's cluster (which is aware of active/passive maxscale instances) be able to failover the processing. This would ideally tie in with the direct kafka integration.


Generated at Thu Feb 08 04:08:40 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.