# core-db-1 (candidate replica) error log, lab run s3b1-M-node-loss-1, the primary's node (and one other node in its zone) was stopped at 18:21:00.8 UTC. Redacted: pod IPs replaced by <pod-ip-a>/<pod-ip-b>.
2026-10-30T18:21:01.152902569Z 2026-10-30 18:21:01 1561 [Warning] Aborted connection 1561 to db: 'unconnected' user: 'lab_probe' host: '<pod-ip-a>' (Got an error reading communication packets)
2026-10-30T18:21:01.154923115Z 2026-10-30 18:21:01 1557 [Warning] Aborted connection 1557 to db: 'unconnected' user: 'lab_probe' host: '<pod-ip-a>' (Got an error reading communication packets)
2026-10-30T18:21:01.157433939Z 2026-10-30 18:21:01 1555 [Warning] Aborted connection 1555 to db: 'unconnected' user: 'lab_probe' host: '<pod-ip-a>' (Got an error reading communication packets)
2026-10-30T18:21:01.158895002Z 2026-10-30 18:21:01 41 [Warning] Aborted connection 41 to db: 'unconnected' user: 'core-db-maxscale-monitor' host: '<pod-ip-a>' (Got an error reading communication packets)
2026-10-30T18:21:01.245736702Z 2026-10-30 18:21:01 15 [ERROR] Error reading packet from server: Lost connection to server during query (server_errno=2013)
2026-10-30T18:21:01.245903595Z 2026-10-30 18:21:01 15 [Note] Slave I/O thread: Failed reading log event, reconnecting to retry, log 'core-db-bin.000001' at position 805582; GTID position '0-10-2473'
2026-10-30T18:21:01.249343998Z 2026-10-30 18:21:01 15 [ERROR] Slave I/O: error reconnecting to master 'repl@core-db-0.core-db-internal.noop.svc.cluster.local:3306' - retry-time: 5  maximum-retries: 100000  message: Can't connect to server on 'core-db-0.core-db-internal.noop.svc.cluster.local' (111 "Connection refused"), Internal MariaDB error code: 2003
2026-10-30T18:21:38.647482873Z 2026-10-30 18:21:38 16 [Note] Error reading relay log event: slave SQL thread was killed
2026-10-30T18:21:38.647606025Z 2026-10-30 18:21:38 16 [Note] Slave SQL thread exiting, replication stopped in log 'core-db-bin.000001' at position 805582; GTID position '0-10-2473', master: core-db-0.core-db-internal.noop.svc.cluster.local:3306
2026-10-30T18:21:46.280620192Z 2026-10-30 18:21:46 15 [Note] Slave I/O thread killed during or after a reconnect done to recover from failed read
2026-10-30T18:21:46.280650152Z 2026-10-30 18:21:46 15 [Note] Slave I/O thread exiting, read up to log 'core-db-bin.000001', position 805582; GTID position 0-10-2473, master core-db-0.core-db-internal.noop.svc.cluster.local:3306
2026-10-30T18:21:47.282059486Z 2026-10-30 18:21:47 15 [Note] cannot connect to master to kill slave io_thread's connection
2026-10-30T18:21:47.284976499Z 2026-10-30 18:21:47 28 [Warning] Aborted connection 28 to db: 'unconnected' user: 'core-db-maxscale-monitor' host: '<pod-ip-b>' (Got an error reading communication packets)
# [omitted: mariadbd was restarted by the orchestrator at 18:21:59 (shutdown and startup lines, 18:21:59 to 18:22:10)]
2026-10-30T18:22:10.637072960Z 2026-10-30 18:22:10 6 [ERROR] Slave I/O: error connecting to master 'repl@core-db-0.core-db-internal.noop.svc.cluster.local:3306' - retry-time: 5  maximum-retries: 100000  message: Can't connect to server on 'core-db-0.core-db-internal.noop.svc.cluster.local' (110 "Connection timed out"), Internal MariaDB error code: 2003
2026-10-30T18:22:49.815369363Z 2026-10-30 18:22:49 7 [Note] Error reading relay log event: slave SQL thread was killed
2026-10-30T18:22:49.815398001Z 2026-10-30 18:22:49 7 [Note] Slave SQL thread exiting, replication stopped in log 'core-db-bin.000001' at position 805582; GTID position '0-10-2473', master: core-db-0.core-db-internal.noop.svc.cluster.local:3306
2026-10-30T18:22:55.664590474Z 2026-10-30 18:22:55 6 [Note] Slave I/O thread killed while connecting to master
2026-10-30T18:22:55.664618730Z 2026-10-30 18:22:55 6 [Note] Slave I/O thread exiting, read up to log 'core-db-bin.000001', position 805582; GTID position 0-10-2473, master core-db-0.core-db-internal.noop.svc.cluster.local:3306
2026-10-30T18:22:55.664791655Z 2026-10-30 18:22:55 6 [Note] cannot connect to master to kill slave io_thread's connection
2026-10-30T18:22:55.667946234Z 2026-10-30 18:22:55 24 [Note] Deleted Master_info file '/var/lib/mysql/master.info'.
2026-10-30T18:22:55.667956815Z 2026-10-30 18:22:55 24 [Note] Deleted Master_info file '/var/lib/mysql/relay-log.info'.