Uploaded image for project: 'MariaDB MaxScale'
  1. MariaDB MaxScale
  2. MXS-1686

Direct Kafka Integration

    XMLWordPrintable

Details

    • New Feature
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • None
    • N/A
    • avrorouter, failover
    • None

    Description

      Currently, the CDC events are presented to the user via a particular channel, and a custom script has to pull those events, and then send them on to kafka (if using the kafka integration).

      It would be ideal if maxscale could directly send these events directly to kafka. Necessary information would be the kafka cluster address, the zookeeper address(es), and what tables (via regex, ideally both white and black lists) that should be sent.

      In theory, this could happen on the fly, and completely skip writing these events to disk.

      It would be nice if maxscale could use zookeeper to keep the current position of the last event sent, in order to not send duplicates after a crash.

      Attachments

        Issue Links

          Activity

            People

              markus makela markus makela
              schatt Drew Schatt
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.