Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-19689

Replication I/O thread stops daily: "bogus data in log event"

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Not a Bug
    • 10.3.15, 10.4.5
    • N/A
    • Replication
    • None
    • Ubuntu 18.04.2 LTS, Linux 4.15.0 (x86_64)

    Description

      We run a master-master replication setup with two servers (`N` and `T`).

      Every night at 02:20 am, replication from T to N stops, with the following message on the replication slave:

      [ERROR] Error reading packet from server: bogus data in log event; the first event 'mysql-bin.000280' at 4, the last event read from 'mysql-bin.000281' at 397, the last byte read from 'mysql-bin.000281' at 416. (server_errno=1236)
      [ERROR] Slave I/O: Got fatal error 1236 from master when reading data from binary log: 'bogus data in log event; the first event 'mysql-bin.000280' at 4, the last event read from 'mysql-bin.000281' at 397, the last byte read from 'mysql-bin.000281' at 416.', Internal MariaDB error code: 1236
      [Note] Slave I/O thread exiting, read up to log 'mysql-bin.000281', position 374
      

      Replication continues after issuing a START SLAVE command.

      The issue seems similar to MDEV-14014, but in our case, replication seems to consistently stop at the moment the master rotates to a new binary log file (hence the position 4). The slave knows a new master log file was created, but is apparently unable to read from it in the first attempt. Subsequent attempts (after START SLAVE) works fine.

      +---------------------------------------+-----------------------------------------------+
      | Variable_name                         | Value                                         |
      +---------------------------------------+-----------------------------------------------+
      | gtid_slave_pos                        | 0-1-11,2-2-3953073486,3-3-72675512            |
      | init_slave                            |                                               |
      | log_slave_updates                     | OFF                                           |
      | log_slow_slave_statements             | ON                                            |
      | pseudo_slave_mode                     | OFF                                           |
      | rpl_semi_sync_master_wait_no_slave    | ON                                            |
      | rpl_semi_sync_slave_delay_master      | OFF                                           |
      | rpl_semi_sync_slave_enabled           | OFF                                           |
      | rpl_semi_sync_slave_kill_conn_timeout | 5                                             |
      | rpl_semi_sync_slave_trace_level       | 32                                            |
      | slave_compressed_protocol             | ON                                            |
      | slave_ddl_exec_mode                   | IDEMPOTENT                                    |
      | slave_domain_parallel_threads         | 0                                             |
      | slave_exec_mode                       | STRICT                                        |
      | slave_load_tmpdir                     | /tmp                                          |
      | slave_max_allowed_packet              | 1073741824                                    |
      | slave_net_timeout                     | 60                                            |
      | slave_parallel_max_queued             | 131072                                        |
      | slave_parallel_mode                   | conservative                                  |
      | slave_parallel_threads                | 1                                             |
      | slave_parallel_workers                | 1                                             |
      | slave_run_triggers_for_rbr            | NO                                            |
      | slave_skip_errors                     | OFF                                           |
      | slave_sql_verify_checksum             | ON                                            |
      | slave_transaction_retries             | 10                                            |
      | slave_transaction_retry_errors        | 1158,1159,1160,1161,1205,1213,1429,2013,12701 |
      | slave_transaction_retry_interval      | 0                                             |
      | slave_type_conversions                |                                               |
      | sql_slave_skip_counter                | 0                                             |
      | wsrep_restart_slave                   | OFF                                           |
      | wsrep_slave_fk_checks                 | ON                                            |
      | wsrep_slave_uk_checks                 | OFF                                           |
      | wsrep_slave_threads                   | 1                                             |
      +---------------------------------------+-----------------------------------------------+
      

      Attachments

        Issue Links

          Activity

            People

              Elkin Andrei Elkin
              crishoj Christian Rishøj
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.