Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-19874

Unable to join galera node. SST ERROR with mariabackup


    • Type: Bug
    • Status: Open (View Workflow)
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 10.3.16
    • Fix Version/s: 10.3
    • Component/s: Backup, Galera SST
    • Labels:
    • Environment:
      CentOS 7.6


      JOINER node shows next error at startup:

      _2019-06-26 12:38:30 2 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 7b7e89ca-973f-11e9-a0d6-2e5b7bc7be09:66
      WSREP_SST: [INFO] Proceeding with SST (20190626 12:38:31.100)
      WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:4444,reuseaddr stdio | mbstream -x; RC=( ${PIPESTATUS[@]} ) (20190626 12:38:31.103)
      WSREP_SST: [INFO] Cleaning the existing datadir and innodb-data/log directories (20190626 12:38:31.114)
      find: ‘NULL’: No such file or directory
      removed ‘/data/mariadb/data/aria_log_control’
      removed ‘/data/mariadb/data/aria_log.00000001’
      removed ‘/data/mariadb/data/ibdata1’
      removed ‘/data/mariadb/data/ib_logfile1’
      WSREP_SST: [ERROR] Cleanup after exit with status:1 (20190626 12:38:31.125)
      2019-06-26 12:38:43 0 [ERROR] WSREP: Process completed with error: wsrep_sst_mariabackup --role 'joiner' --address '' --datadir '/data/mariadb/data/' --parent '2379' --binlog '/data/mariadb/binlog/webregqbd-bin' '': 1 (Operation not permitted)
      2019-06-26 12:38:43 0 [ERROR] WSREP: Failed to read uuid:seqno and wsrep_gtid_domain_id from joiner script.
      2019-06-26 12:38:43 0 [ERROR] WSREP: SST failed: 1 (Operation not permitted)
      2019-06-26 12:38:43 0 [ERROR] Aborting
      Error in my_thread_global_end(): 1 threads didn't exit_

      Backup works fine in DONOR node and DATADIR was recovered properly in JOINER node but mariabackup did not execute the steps of PREPARE and MOVE.

      With wsrep_sst_method=rsync or running a mariabackup manually works fine.


      Problem is because I do not have the innodb-undo-directory parameter defined in my.cnf.
      I have modified the wsrep_sst_mariabackup script and now works well.

      [root@vmxas1]$ diff /bin/wsrep_sst_mariabackup.orig /bin/wsrep_sst_mariabackup
      < find $ib_home_dir $ib_log_dir $ib_undo_dir $DATA -mindepth 1 -prune -regex $cpat -o -exec rm -rfv {} 1>&2 +

      > find $ib_home_dir $ib_log_dir $DATA -mindepth 1 -prune -regex $cpat -o -exec rm -rfv {} 1>&2 +

      I do not know if it's a possible bug or just a mismatch...

      Thanks in advance,
      Jon K.




            • Assignee:
              jplindst Jan Lindström
              peoples21 Jon Barca
            • Votes:
              0 Vote for this issue
              1 Start watching this issue


              • Created: