[MXS-2588] Kafka to MariaDB router Created: 2019-07-04 Updated: 2021-04-22 Resolved: 2021-04-15 |
|
| Status: | Closed |
| Project: | MariaDB MaxScale |
| Component/s: | None |
| Affects Version/s: | 2.3.8, 2.4.0 |
| Fix Version/s: | 6.0.0 |
| Type: | New Feature | Priority: | Major |
| Reporter: | Sylvain ARBAUDIE | Assignee: | markus makela |
| Resolution: | Fixed | Votes: | 1 |
| Labels: | Kafka | ||
| Issue Links: |
|
||||||||||||||||
| Epic Link: | Stream To Kafka (Milestone 1) | ||||||||||||||||
| Sprint: | MXS-SPRINT-129 | ||||||||||||||||
| Description |
|
Clients are requesting a way to fetch datas from kafka topics into the mariadb server but not into column store, so in a storage engine agnostic way. It feels like it could be a great idea to convert AVRO events (avro format would be requested on the kafka side) into binlogs, then have the instances be slaves of the avro/binlog router. Most of the functionalities seem to be already existing, even tho syncing them together might be tricky. |
| Comments |
| Comment by markus makela [ 2020-02-14 ] |
|
This isn't really something that needs to be done inside MaxScale. Whatever inserts the data into Kafka could also insert it into MariaDB. |