Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-19689

Replication I/O thread stops daily: "bogus data in log event"

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Not a Bug
    • Affects Version/s: 10.3.15, 10.4.5
    • Fix Version/s: N/A
    • Component/s: Replication
    • Labels:
      None
    • Environment:
      Ubuntu 18.04.2 LTS, Linux 4.15.0 (x86_64)

      Description

      We run a master-master replication setup with two servers (`N` and `T`).

      Every night at 02:20 am, replication from T to N stops, with the following message on the replication slave:

      [ERROR] Error reading packet from server: bogus data in log event; the first event 'mysql-bin.000280' at 4, the last event read from 'mysql-bin.000281' at 397, the last byte read from 'mysql-bin.000281' at 416. (server_errno=1236)
      [ERROR] Slave I/O: Got fatal error 1236 from master when reading data from binary log: 'bogus data in log event; the first event 'mysql-bin.000280' at 4, the last event read from 'mysql-bin.000281' at 397, the last byte read from 'mysql-bin.000281' at 416.', Internal MariaDB error code: 1236
      [Note] Slave I/O thread exiting, read up to log 'mysql-bin.000281', position 374
      

      Replication continues after issuing a START SLAVE command.

      The issue seems similar to MDEV-14014, but in our case, replication seems to consistently stop at the moment the master rotates to a new binary log file (hence the position 4). The slave knows a new master log file was created, but is apparently unable to read from it in the first attempt. Subsequent attempts (after START SLAVE) works fine.

      +---------------------------------------+-----------------------------------------------+
      | Variable_name                         | Value                                         |
      +---------------------------------------+-----------------------------------------------+
      | gtid_slave_pos                        | 0-1-11,2-2-3953073486,3-3-72675512            |
      | init_slave                            |                                               |
      | log_slave_updates                     | OFF                                           |
      | log_slow_slave_statements             | ON                                            |
      | pseudo_slave_mode                     | OFF                                           |
      | rpl_semi_sync_master_wait_no_slave    | ON                                            |
      | rpl_semi_sync_slave_delay_master      | OFF                                           |
      | rpl_semi_sync_slave_enabled           | OFF                                           |
      | rpl_semi_sync_slave_kill_conn_timeout | 5                                             |
      | rpl_semi_sync_slave_trace_level       | 32                                            |
      | slave_compressed_protocol             | ON                                            |
      | slave_ddl_exec_mode                   | IDEMPOTENT                                    |
      | slave_domain_parallel_threads         | 0                                             |
      | slave_exec_mode                       | STRICT                                        |
      | slave_load_tmpdir                     | /tmp                                          |
      | slave_max_allowed_packet              | 1073741824                                    |
      | slave_net_timeout                     | 60                                            |
      | slave_parallel_max_queued             | 131072                                        |
      | slave_parallel_mode                   | conservative                                  |
      | slave_parallel_threads                | 1                                             |
      | slave_parallel_workers                | 1                                             |
      | slave_run_triggers_for_rbr            | NO                                            |
      | slave_skip_errors                     | OFF                                           |
      | slave_sql_verify_checksum             | ON                                            |
      | slave_transaction_retries             | 10                                            |
      | slave_transaction_retry_errors        | 1158,1159,1160,1161,1205,1213,1429,2013,12701 |
      | slave_transaction_retry_interval      | 0                                             |
      | slave_type_conversions                |                                               |
      | sql_slave_skip_counter                | 0                                             |
      | wsrep_restart_slave                   | OFF                                           |
      | wsrep_slave_fk_checks                 | ON                                            |
      | wsrep_slave_uk_checks                 | OFF                                           |
      | wsrep_slave_threads                   | 1                                             |
      +---------------------------------------+-----------------------------------------------+
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Elkin Andrei Elkin
                Reporter:
                crishoj Christian Rishøj
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: