Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-5993

MySQL WL#4783 Extend mysqlbinlog to support remote backup of binary logs

Details

    Description

      main.mysqlbinlog_raw_mode and main.mysqlbinlog_raw_mode_win covering this worklog: https://dev.mysql.com/worklog/task/?id=4783

      MySQL needs a way of creating real-time backups.  The current method of doing
      		 
      this is to create a slave with using the blackhole engine as can be seen at the
      		 
      following URL:
      		 
      http://dev.mysql.com/doc/refman/5.1/en/blackhole-storage-engine.html
      		 
       
      		 
      This method works rather well but has the disadvantage of requiring a whole
      		 
      MySQL instance to run to make the real-time backups, this can be a burden on
      		 
      resources and difficult to setup if you are trying to backup many MySQL servers.
      		 
       
      		 
      We already have mysqlbinlog to talk to remote MySQL servers to retrieve binlog
      		 
      data and translate it into SQL statements so in theory it should be easy enough
      		 
      to create a raw mode for the output.
      		 
       
      		 
      Solution
      		 
      mysqlbinlog has been modified to have several new parameters, key to this is the
      		 
      new --raw flag which writes the data out in raw binlog format rather than
      		 
      translating it.  The other parameter changes are designed to add more
      		 
      functionality to the --raw flag so that it can easily be used in various backup
      		 
      scenarios.

      Attachments

        Issue Links

          is duplicated by

          Task - A task that needs to be done. MDEV-8713 Add continuous binary log backup to mysqlbinlog

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is part of

          Task - A task that needs to be done. MDEV-4784 merge test cases from 5.6

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Stalled

          Activity

            Ascending order - Click to sort in descending order
            svoj Sergey Vojtovich created issue -
            svoj Sergey Vojtovich made changes -
            Field Original Value New Value
            colin Colin Charles added a comment -

            This is now documented here:
            http://dev.mysql.com/doc/refman/5.6/en/mysqlbinlog-backup.html

            This is in use by tools like MHA now as well: https://code.google.com/p/mysql-master-ha/wiki/Configuration#Binlog_server

            colin Colin Charles added a comment - This is now documented here: http://dev.mysql.com/doc/refman/5.6/en/mysqlbinlog-backup.html This is in use by tools like MHA now as well: https://code.google.com/p/mysql-master-ha/wiki/Configuration#Binlog_server
            colin Colin Charles made changes -
            Labels mysqlbinlog
            serg Sergei Golubchik made changes -
            Fix Version/s 10.0.12 [ 15201 ]
            Fix Version/s 10.0.11 [ 15200 ]
            dbart Daniel Bartholomew made changes -
            Priority Minor [ 4 ] Major [ 3 ]
            dbart Daniel Bartholomew made changes -
            Assignee Rasmus Johansson [ ratzpo ]
            dbart Daniel Bartholomew made changes -
            Fix Version/s 10.1.0 [ 12200 ]
            Fix Version/s 10.0.12 [ 15201 ]
            serg Sergei Golubchik made changes -
            Workflow defaullt [ 37910 ] MariaDB v2 [ 43691 ]
            serg Sergei Golubchik made changes -
            Fix Version/s 10.1 [ 16100 ]
            Fix Version/s 10.1.0 [ 12200 ]
            serg Sergei Golubchik made changes -
            Labels mysqlbinlog gsoc15 mysqlbinlog
            ratzpo Rasmus Johansson (Inactive) made changes -
            Workflow MariaDB v2 [ 43691 ] MariaDB v3 [ 65755 ]
            ratzpo Rasmus Johansson (Inactive) made changes -
            Status Open [ 1 ] Confirmed [ 10101 ]
            colin Colin Charles made changes -
            Labels gsoc15 mysqlbinlog gsoc16 mysqlbinlog
            serg Sergei Golubchik made changes -
            Labels gsoc16 mysqlbinlog gsoc15 gsoc16 mysqlbinlog
            serg Sergei Golubchik made changes -
            Affects Version/s 10.0.10 [ 14500 ]
            Issue Type Bug [ 1 ] Task [ 3 ]
            serg Sergei Golubchik made changes -
            Status Confirmed [ 10101 ] Open [ 1 ]
            serg Sergei Golubchik made changes -
            serg Sergei Golubchik made changes -
            Labels gsoc15 gsoc16 mysqlbinlog gsoc15 mysqlbinlog
            serg Sergei Golubchik made changes -
            Assignee Rasmus Johansson [ ratzpo ] Alexey Botchkov [ holyfoot ]
            serg Sergei Golubchik made changes -
            Fix Version/s 10.2.0 [ 20700 ]
            Fix Version/s 10.1 [ 16100 ]
            serg Sergei Golubchik added a comment -

            Implemented as MDEV-8713

            serg Sergei Golubchik added a comment - Implemented as MDEV-8713
            serg Sergei Golubchik made changes -
            Component/s Replication [ 10100 ]
            Component/s Scripts & Clients [ 11002 ]
            Resolution Fixed [ 1 ]
            Status Open [ 1 ] Closed [ 6 ]
            serg Sergei Golubchik made changes -
            Workflow MariaDB v3 [ 65755 ] MariaDB v4 [ 132300 ]

            People

              holyfoot Alexey Botchkov
              svoj Sergey Vojtovich
              Votes:
              2 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.