Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-25818

RSYNC SST failed due to busy port

    XMLWordPrintable

    Details

      Description

      After the code for detecting busy ports was improved in the SST script code, the SST script for rsync sometimes began to diagnose an error associated with a busy port, which especially often happens when running some tests in parallel or when restarting quickly after failures:

      2021-05-25  7:26:53 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '127.0.0.1:16020' --datadir '/dev/shm/bb-10.4-merge/mysql-test/var/1/mysqld.5/data/' --defaults-file '/dev/shm/bb-10.4-merge/mysql-test/var/1/my.cnf' --defaults-group-suffix '.5' --parent '107939' --binlog 'mysqld-bin' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.5 --defaults-file=/dev/shm/bb-10.4-merge/mysql-test/var/1/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --core-file --loose-debug-sync-timeout=300'
      WSREP_SST: [ERROR] rsync or stunnel daemon port '16020'  has been taken by another program (20210525 07:26:53.410)
      WSREP_SST: [INFO] Joiner cleanup. rsync PID: 109214 (20210525 07:26:53.412)
      /dev/shm/bb-10.4-merge/scripts/wsrep_sst_rsync: line 41: kill: (109214) - No such process
      WSREP_SST: [INFO] Joiner cleanup done. (20210525 07:26:53.415)
      2021-05-25  7:26:53 0 [ERROR] WSREP: Failed to read 'ready <addr>' from: wsrep_sst_rsync --role 'joiner' --address '127.0.0.1:16020' --datadir '/dev/shm/bb-10.4-merge/mysql-test/var/1/mysqld.5/data/' --defaults-file '/dev/shm/bb-10.4-merge/mysql-test/var/1/my.cnf' --defaults-group-suffix '.5' --parent '107939' --binlog 'mysqld-bin' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.5 --defaults-file=/dev/shm/bb-10.4-merge/mysql-test/var/1/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --core-file --loose-debug-sync-timeout=300
      	Read: '(null)'
      2021-05-25  7:26:53 0 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --role 'joiner' --address '127.0.0.1:16020' --datadir '/dev/shm/bb-10.4-merge/mysql-test/var/1/mysqld.5/data/' --defaults-file '/dev/shm/bb-10.4-merge/mysql-test/var/1/my.cnf' --defaults-group-suffix '.5' --parent '107939' --binlog 'mysqld-bin' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.5 --defaults-file=/dev/shm/bb-10.4-merge/mysql-test/var/1/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --core-file --loose-debug-sync-timeout=300: 16 (Device or resource busy)
      2021-05-25  7:26:53 2 [ERROR] WSREP: Failed to prepare for 'rsync' SST. Unrecoverable.
      

        Attachments

          Activity

            People

            Assignee:
            sysprg Julius Goryavsky
            Reporter:
            sysprg Julius Goryavsky
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Git Integration