Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-9501

rpl.rpl_binlog_index, rpl.rpl_gtid_crash, rpl.rpl_stm_multi_query fail sporadically in buildbot with Master command COM_REGISTER_SLAVE failed

Details

    • 5.5.59

    Description

      http://buildbot.askmonty.org/buildbot/builders/p8-rhel7-bintar/builds/1060/steps/test/logs/stdio

      rpl.rpl_binlog_index 'row'               w4 [ fail ]  Found warnings/errors in server log file!
              Test ended at 2016-01-26 20:02:26
      line
      160126 20:02:17 [Warning] Slave I/O: Master command COM_REGISTER_SLAVE failed: failed registering on master, reconnecting to try again, log 'master-bin.000002' at position 549, Internal MariaDB error code: 1597
      ^ Found warnings in /home/buildbot/maria-slave/power8-vlp03-bintar/build/mysql-test/var/4/log/mysqld.2.err
      ok
      

      Attachments

        Issue Links

          Activity

            alice Alice Sherepa added a comment -

            rpl.rpl_gtid_crash on 10.3 http://buildbot.askmonty.org/buildbot/builders/kvm-fulltest2/builds/9508/steps/test_3/logs/stdio

            rpl.rpl_gtid_crash 'innodb,row'          w1 [ fail ]  Found warnings/errors in server log file!
                    Test ended at 2017-09-08 03:53:39
            line
            2017-09-08  3:53:28 10 [ERROR] Slave I/O: Master command COM_REGISTER_SLAVE failed: Lost connection to MySQL server during query (Errno: 2013), Internal MariaDB error code: 1597
            2017-09-08  3:53:28 10 [ERROR] Slave I/O thread couldn't register on master
            2017-09-08  3:53:29 10 [Warning] Slave I/O: Master command COM_REGISTER_SLAVE failed: failed registering on master, reconnecting to try again, log 'master-bin.000006' at position 785; GTID position '1-1-2,0-1-9,2-1-1', Internal MariaDB error code: 1597
            ^ Found warnings in /mnt/buildbot/build/mariadb-10.3.2/mysql-test/var/1/log/mysqld.2.err
            

            alice Alice Sherepa added a comment - rpl.rpl_gtid_crash on 10.3 http://buildbot.askmonty.org/buildbot/builders/kvm-fulltest2/builds/9508/steps/test_3/logs/stdio rpl.rpl_gtid_crash 'innodb,row' w1 [ fail ] Found warnings/errors in server log file! Test ended at 2017-09-08 03:53:39 line 2017-09-08 3:53:28 10 [ERROR] Slave I/O: Master command COM_REGISTER_SLAVE failed: Lost connection to MySQL server during query (Errno: 2013), Internal MariaDB error code: 1597 2017-09-08 3:53:28 10 [ERROR] Slave I/O thread couldn't register on master 2017-09-08 3:53:29 10 [Warning] Slave I/O: Master command COM_REGISTER_SLAVE failed: failed registering on master, reconnecting to try again, log 'master-bin.000006' at position 785; GTID position '1-1-2,0-1-9,2-1-1', Internal MariaDB error code: 1597 ^ Found warnings in /mnt/buildbot/build/mariadb-10.3.2/mysql-test/var/1/log/mysqld.2.err
            alice Alice Sherepa added a comment -

            on 5.5 http://buildbot.askmonty.org/buildbot/builders/kvm-rpm-centos74-amd64/builds/591/steps/mtr/logs/stdio

            rpl.rpl_binlog_index 'row'               w2 [ fail ]  Found warnings/errors in server log file!
                    Test ended at 2017-11-16 13:48:23
            line
            171116 13:48:08 [Warning] Slave I/O: Master command COM_REGISTER_SLAVE failed: failed registering on master, reconnecting to try again, log 'master-bin.000002' at position 457, Error_code: 1597
            ^ Found warnings in /dev/shm/var/2/log/mysqld.2.err
            

            alice Alice Sherepa added a comment - on 5.5 http://buildbot.askmonty.org/buildbot/builders/kvm-rpm-centos74-amd64/builds/591/steps/mtr/logs/stdio rpl.rpl_binlog_index 'row' w2 [ fail ] Found warnings/errors in server log file! Test ended at 2017-11-16 13:48:23 line 171116 13:48:08 [Warning] Slave I/O: Master command COM_REGISTER_SLAVE failed: failed registering on master, reconnecting to try again, log 'master-bin.000002' at position 457, Error_code: 1597 ^ Found warnings in /dev/shm/var/2/log/mysqld.2.err

            This affects 10.5 as well:

            10.5 17a7bafec068d6436f3f6c5ca67b9d6c98b31ef5

            rpl.rpl_binlog_index 'row'               w1 [ fail ]  Found warnings/errors in server log file!
                    Test ended at 2020-06-10 08:46:08
            line
            2020-06-10  8:45:58 7 [Warning] Slave I/O: SET @master_heartbeat_period to master failed with error: Lost connection to server during query, Internal MariaDB error code: 2013
            2020-06-10  8:45:59 7 [Warning] Slave I/O: Master command COM_REGISTER_SLAVE failed: failed registering on master, reconnecting to try again, log 'master-bin.000002' at position 633, Internal MariaDB error code: 1597
            

            I did not see a sign of a crash in the server logs, but the log of the replica server contains some error messages about failing to connect to the master.

            marko Marko Mäkelä added a comment - This affects 10.5 as well : 10.5 17a7bafec068d6436f3f6c5ca67b9d6c98b31ef5 rpl.rpl_binlog_index 'row' w1 [ fail ] Found warnings/errors in server log file! Test ended at 2020-06-10 08:46:08 line 2020-06-10 8:45:58 7 [Warning] Slave I/O: SET @master_heartbeat_period to master failed with error: Lost connection to server during query, Internal MariaDB error code: 2013 2020-06-10 8:45:59 7 [Warning] Slave I/O: Master command COM_REGISTER_SLAVE failed: failed registering on master, reconnecting to try again, log 'master-bin.000002' at position 633, Internal MariaDB error code: 1597 I did not see a sign of a crash in the server logs, but the log of the replica server contains some error messages about failing to connect to the master.
            sujatha.sivakumar Sujatha Sivakumar (Inactive) added a comment - Hello Andrei, Can you please review the fix for MDEV-9501 . Patch: https://github.com/MariaDB/server/commit/965663f090c4af83e8c4aca913568f6065509ff4 BuildBot Testing: http://buildbot.askmonty.org/buildbot/grid?category=main&branch=bb-10.1-sujatha Thank you.

            Merged patch to higher versions and tested the changes.

            Minor merge conflicts were observed from 10.1 to 10.2.
            The result files need to be re-recorded.

            10.2: https://github.com/MariaDB/server/commit/37273575004598b459d7bbdd453ed3a28df66037

            The patch remains the same for 10.3+ versions.
            10.3: https://github.com/MariaDB/server/commit/5b2540397ca45a124027f0b276a6f7b00d0b80b8

            sujatha.sivakumar Sujatha Sivakumar (Inactive) added a comment - Merged patch to higher versions and tested the changes. Minor merge conflicts were observed from 10.1 to 10.2. The result files need to be re-recorded. 10.2: https://github.com/MariaDB/server/commit/37273575004598b459d7bbdd453ed3a28df66037 The patch remains the same for 10.3+ versions. 10.3: https://github.com/MariaDB/server/commit/5b2540397ca45a124027f0b276a6f7b00d0b80b8

            People

              sujatha.sivakumar Sujatha Sivakumar (Inactive)
              elenst Elena Stepanova
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.