Uploaded image for project: 'MariaDB MaxScale'
  1. MariaDB MaxScale
  2. MXS-6927

compression and multithreads for async-rebuild-server

    XMLWordPrintable

Details

    • New Feature
    • Status: Open (View Workflow)
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Monitor
    • None

    Description

      Let s start for the basic command:

      maxctrl call command mariadbmon async-rebuild-server MariaDB-Monitor server-2
      

      maxscale will:
      rm -rf /var/lib/mysql/* #on server-2

      #from the donor to server-2
      mariabackup --backup --stream=xbstream --user=maxscale --password=*** | ssh root@server-2 "mbstream -x -C /var/lib/mysql"

      #on server-2 prepare:
      mariabackup --prepare --target-dir=/var/lib/mysql

      chown -R mysql:mysql /var/lib/mysql

      systemctl start mariadb

      now the command that should better use to should be:

      mariabackup --user=root --password=XXXX --backup --tmpdir=/tmp --stream=xbstream --parallel=6 --datadir=/var/lib/mysql/ | pigz -p 4 | ssh root@server-2 " pigz -dc -p 4 | mbstream --directory=/var/lib/mysql -x --parallel=4"
      

      what is missing as parameter are:

      • parallel threads for xbstream
      • parallel compression thread for pigz
      • parallel threads for mbstream
      • memory to be used on -prepare command (-use-memory=xGB)

      could we get this implemented ? the data size now a day is quite big , we should be able to run instead things like this:

        
      socat -u TCP-LISTEN:4444,reuseaddr stdio | pigz -dc -p 4 | mbstream --directory=/var/lib/mysql -x --parallel=4
       
      mariabackup --user=root --password=XXXX --backup --tmpdir=/tmp --stream=xbstream --parallel=6 --datadir=/var/lib/mysql/ | pigz -p 4 | socat -u stdio TCP:1server-2:4444
       
      mariadb-backup --prepare  --use-memory=4gb --target-dir=/var/lib/mysql/
      
      

      Attachments

        Activity

          People

            allen.herrera Allen Herrera
            massimo.disaro Massimo
            Votes:
            2 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.