Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-25818

RSYNC SST failed due to busy port

    XMLWordPrintable

Details

    Description

      After the code for detecting busy ports was improved in the SST script code, the SST script for rsync sometimes began to diagnose an error associated with a busy port, which especially often happens when running some tests in parallel or when restarting quickly after failures:

      2021-05-25  7:26:53 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '127.0.0.1:16020' --datadir '/dev/shm/bb-10.4-merge/mysql-test/var/1/mysqld.5/data/' --defaults-file '/dev/shm/bb-10.4-merge/mysql-test/var/1/my.cnf' --defaults-group-suffix '.5' --parent '107939' --binlog 'mysqld-bin' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.5 --defaults-file=/dev/shm/bb-10.4-merge/mysql-test/var/1/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --core-file --loose-debug-sync-timeout=300'
      WSREP_SST: [ERROR] rsync or stunnel daemon port '16020'  has been taken by another program (20210525 07:26:53.410)
      WSREP_SST: [INFO] Joiner cleanup. rsync PID: 109214 (20210525 07:26:53.412)
      /dev/shm/bb-10.4-merge/scripts/wsrep_sst_rsync: line 41: kill: (109214) - No such process
      WSREP_SST: [INFO] Joiner cleanup done. (20210525 07:26:53.415)
      2021-05-25  7:26:53 0 [ERROR] WSREP: Failed to read 'ready <addr>' from: wsrep_sst_rsync --role 'joiner' --address '127.0.0.1:16020' --datadir '/dev/shm/bb-10.4-merge/mysql-test/var/1/mysqld.5/data/' --defaults-file '/dev/shm/bb-10.4-merge/mysql-test/var/1/my.cnf' --defaults-group-suffix '.5' --parent '107939' --binlog 'mysqld-bin' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.5 --defaults-file=/dev/shm/bb-10.4-merge/mysql-test/var/1/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --core-file --loose-debug-sync-timeout=300
      	Read: '(null)'
      2021-05-25  7:26:53 0 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'joiner' --address '127.0.0.1:16020' --datadir '/dev/shm/bb-10.4-merge/mysql-test/var/1/mysqld.5/data/' --defaults-file '/dev/shm/bb-10.4-merge/mysql-test/var/1/my.cnf' --defaults-group-suffix '.5' --parent '107939' --binlog 'mysqld-bin' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.5 --defaults-file=/dev/shm/bb-10.4-merge/mysql-test/var/1/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --core-file --loose-debug-sync-timeout=300: 16 (Device or resource busy)
      2021-05-25  7:26:53 2 [ERROR] WSREP: Failed to prepare for 'rsync' SST. Unrecoverable.
      

      Attachments

        Activity

          People

            sysprg Julius Goryavsky
            sysprg Julius Goryavsky
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.