Uploaded image for project: 'MariaDB MaxScale'
  1. MariaDB MaxScale
  2. MXS-1271

cdc.py consuming 100% of CPU and never sending to kafka

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.0.5
    • Fix Version/s: 2.0.6, 2.1.4
    • Component/s: avrorouter
    • Labels:
      None
    • Environment:
      Ubuntu 14.04

      Description

      When using the cdc.py tool to pipe data to kafka it unfortunately fails for a table with a lot of changes.

      If I use the MariaDB table which has much fewer changes (lets say, our users):
      /usr/bin/cdc.py -u cdc_user --p123456 -h 127.0.0.1 -P 4001 production.users | /usr/bin/cdc_kafka_producer.py --kafka-broker=172.30.0.190:9092 --kafka-topic=users

      It works properly (and still pegs the CPU at 100%).

      But when I switch to another table (items) with more data/changes, it pegs the CPU at 100%, and nothing is ever sent to the kafka topic.

      The server running the script is on AWS (m4.large).

        Attachments

          Activity

            People

            Assignee:
            markus makela markus makela
            Reporter:
            geesu Josh Becker
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: