[MXS-3851] Show more KafkaCDC router statistics on GUI Created: 2021-11-04  Updated: 2023-12-04  Resolved: 2023-12-04

Status: Closed
Project: MariaDB MaxScale
Component/s: cdc, maxgui
Affects Version/s: None
Fix Version/s: 24.02.0

Type: New Feature Priority: Major
Reporter: Naresh Chandra Assignee: Duong Thien Ly
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Relates
relates to MXS-4846 Show service statistics in the GUI Closed
Sprint: MXS-SPRINT-193

 Description   

Add a new feature like show KafkaCDC router status by showing with below details. It will be helpful what is happening on the KafkaCDC router from the Primary node or Galera Node.
1. Kafka CDC router status(Running/Paused/Waiting/Stopped).
2. Current GTID position, Last GTID position Status in the GUI.
3. Replicating From Which Primary Node or Galera Node.
4. If possible show the GUI which tables and schema are currently being replicating from Primary/Galera cluster.
5. Show all the tables with schema wise and their sizes, created and updated date.
6. KafkaCDC router path disk space and available space.

If possible, we can add more related to KafkaCDC then it would be better experience to the user.

 Comments   
Comment by Duong Thien Ly [ 2023-10-23 ]

naresh.chandra@copart.com
1. I believe this one is already visible in the router state. It's shown in the service dashboard and service detail page
Can you elaborate more on 6? I believe this one is outside the scope of the kafkacdc router.

Comment by markus makela [ 2023-10-23 ]

4. If possible show the GUI which tables and schema are currently being replicating from Primary/Galera cluster.
5. Show all the tables with schema wise and their sizes, created and updated date.

Please clarify what is meant by tables and schema are currently being replicating from Primary/Galera cluster. The KafkaCDC converts a stream of events so there's only one table being processed at a time and the table may be different for every event. Additionally, the table creation and update dates are better retrieved from the database as that's where the information related to their creation is.

6. KafkaCDC router path disk space and available space.

What exactly does this mean? The KafkaCDC service does not store any data on disk and the only thing it stores is a few kilobytes of metadata per table.

Comment by Naresh Chandra [ 2023-11-14 ]

Duong/Markus,

Sorry for the delay in response. I have missed this to update due to some priority works.

If there is a feasibility implement this feature otherwise show only information whichever is possible.

Generated at Thu Feb 08 04:24:25 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.