[MDEV-14936] Test MariaDB Backup 10.1 against newest versions of 5.5 and 10.0 - Jira

Details

Type: Task
Status: Closed (View Workflow)
Priority: Major
Resolution: Done
Fix Version/s: None
Component/s: None
Labels:
None

Description

The first version of MariaDB Backup was added to 10.1.23. As we now support also Windows we can expect to get questions from users/customers about supporting 10.0 and 5.5.

It would be good to test MariaDB Backup against the newest versions of MariaDB Server 5.5 and 10.0. and to add the information to the table https://mariadb.com/kb/en/mariadb/mariadb-backup/ in a "Compatibility" column

Attachments

Issue Links

relates to

MDEV-14172 mariabackup doesn't store innodb_fast_checksum (removed variable) in backup-my.cnf when taking backup of 5.5

Closed

MDEV-14174 crash on start with innodb-track-changed-pages

Closed

MDEV-14175 backup shows corruption for 5.5 Server with innodb-fast-checksum

Closed

MDEV-14176 XtraDB files with innodb_page_size in MariaDB 5.5 are incompatible with later versions

Closed

MDEV-14177 Document comand FLUSH CHANGED_PAGE_BITMAPS

Closed

MDEV-14937 Test final version of MariaDB Backup 10.1 against newest versions of 5.5 and 10.0

Closed

(1 relates to)

Activity

Ascending order - Click to sort in descending order

Andrii Nikitin (Inactive) added a comment - 2017-05-04 09:00 - edited

With environs framework I did following actions to deploy tar packages and run xtrabackup tests with then:

./replant.sh m2-10.0.30

m2-10.0.30/download.sh

./replant.sh m3-5.5.55

m3-5.5.55/download.sh

./replant.sh m6-10.1.23

m6-10.1.23/download.sh

# first test 10.1.23 alone just in case

./runsuite.sh m6 _plugin/xtrabackup/t

...

Duration=345

Passes=136

Failures=0

# now test 10.0.30 with mariabackup from 10.1.23

./runsuite.sh m6 m2 _plugin/xtrabackup/t

…

Duration=281

Passes=132

Failures=4

# now test 5.5.55 with mariabackup from 10.1.23

./runsuite.sh m6 m3 _plugin/xtrabackup/t

...

Duration=162

Passes=112

Failures=17

Failures in 10.0 are in tests xb_incremental_compressed_bitmap* and rather internal problems of the framework, which needs to be adjusted to 10.0

Almost all failures in 5.5 are related to crashes of mariabackup during incremental backup.

Conclusion:
mariabackup 10.1.23 works “well enough” with 10.0.30 MariaDB Server
mariabackup 10.1.23 works “well enough” with 5.5.55 MariaDB Server, excluding incremental backup.
“Well enough” = considering Alpha status of the release

Andrii Nikitin (Inactive) added a comment - 2017-05-04 09:00 - edited With environs framework I did following actions to deploy tar packages and run xtrabackup tests with then: . /replant .sh m2-10.0.30 m2-10.0.30 /download .sh . /replant .sh m3-5.5.55 m3-5.5.55 /download .sh . /replant .sh m6-10.1.23 m6-10.1.23 /download .sh # first test 10.1.23 alone just in case . /runsuite .sh m6 _plugin /xtrabackup/t ... Duration=345 Passes=136 Failures=0 # now test 10.0.30 with mariabackup from 10.1.23 . /runsuite .sh m6 m2 _plugin /xtrabackup/t … Duration=281 Passes=132 Failures=4 # now test 5.5.55 with mariabackup from 10.1.23 . /runsuite .sh m6 m3 _plugin /xtrabackup/t ... Duration=162 Passes=112 Failures=17 Failures in 10.0 are in tests xb_incremental_compressed_bitmap* and rather internal problems of the framework, which needs to be adjusted to 10.0 Almost all failures in 5.5 are related to crashes of mariabackup during incremental backup. Conclusion: mariabackup 10.1.23 works “well enough” with 10.0.30 MariaDB Server mariabackup 10.1.23 works “well enough” with 5.5.55 MariaDB Server, excluding incremental backup. “Well enough” = considering Alpha status of the release

Andrii Nikitin (Inactive) added a comment - 2017-05-04 09:36 - edited

Percona-XtraBackup 2.3.8 handles these tests better for 5.5.55 , maybe work for another todo:

./replant.sh x9-system

sudo x9-system/install.sh 2.3.8

./runsuite.sh m3 x9 _plugin/xtrabackup/t

...

Duration=155

Passes=122

Failures=8

Andrii Nikitin (Inactive) added a comment - 2017-05-04 09:36 - edited Percona-XtraBackup 2.3.8 handles these tests better for 5.5.55 , maybe work for another todo: . /replant .sh x9-system sudo x9-system /install .sh 2.3.8 . /runsuite .sh m3 x9 _plugin /xtrabackup/t ... Duration=155 Passes=122 Failures=8

Andrii Nikitin (Inactive) added a comment - 2017-05-04 10:41

The same tests with InnoDB plugin:

mkdir m2-10.0.30/config_load

cp m2-10.0.30/configure_innodb_plugin.sh m2-10.0.30/config_load/

./runsuite.sh m6 m2 _plugin/xtrabackup/t

...

FAILED tests :

_plugin/xtrabackup/t/remote_tablespaces.sh

Duration=215

Passes=127

Failures=1

mkdir m3-5.5.55/config_load

cp m3-5.5.55/configure_innodb_plugin.sh m3-5.5.55/config_load/

./runsuite.sh m6 m3 _plugin/xtrabackup/t

...

Duration=151

Passes=108

Failures=8

./runsuite.sh m3 x9 _plugin/xtrabackup/t

...

Duration=143

Passes=117

Failures=0

With InnoDB plugin, 10.0.30 and 5.5.55 have less failures because some tests don't run . Crashes for incremental backup for mariabackup in 5.5.55 are still observed even with innodb plugin.

Andrii Nikitin (Inactive) added a comment - 2017-05-04 10:41 The same tests with InnoDB plugin: mkdir m2-10.0.30 /config_load cp m2-10.0.30 /configure_innodb_plugin .sh m2-10.0.30 /config_load/ . /runsuite .sh m6 m2 _plugin /xtrabackup/t ... FAILED tests : _plugin /xtrabackup/t/remote_tablespaces .sh Duration=215 Passes=127 Failures=1 mkdir m3-5.5.55 /config_load cp m3-5.5.55 /configure_innodb_plugin .sh m3-5.5.55 /config_load/ . /runsuite .sh m6 m3 _plugin /xtrabackup/t ... Duration=151 Passes=108 Failures=8 . /runsuite .sh m3 x9 _plugin /xtrabackup/t ... Duration=143 Passes=117 Failures=0 With InnoDB plugin, 10.0.30 and 5.5.55 have less failures because some tests don't run . Crashes for incremental backup for mariabackup in 5.5.55 are still observed even with innodb plugin.

Elena Stepanova added a comment - 2017-05-04 17:15

anikitin,

Please make sure all real failures (those that aren't caused by the tool/environment) are filed as separate bugs in JIRA/MDEV. It was desirable before the release, but after it's gone public it's mandatory.

Elena Stepanova added a comment - 2017-05-04 17:15 anikitin , Please make sure all real failures (those that aren't caused by the tool/environment) are filed as separate bugs in JIRA/MDEV. It was desirable before the release, but after it's gone public it's mandatory.

Andrii Nikitin (Inactive) added a comment - 2017-10-27 12:07

Testing current 10.1 tree:
5.5 failures:
FAILED tests :
_plugin/xtrabackup/t/bug1112224.sh
_plugin/xtrabackup/t/bug733651.sh
_plugin/xtrabackup/t/ib_incremental_bitmap_lsn.sh
_plugin/xtrabackup/t/ib_incremental_bitmap.sh
_plugin/xtrabackup/t/ib_incremental_force_full_scan.sh
_plugin/xtrabackup/t/ib_lru_dump_stream.sh
_plugin/xtrabackup/t/innodb_fast_checksum.sh
_plugin/xtrabackup/t/innodb_page_size.sh
_plugin/xtrabackup/t/xb_incremental_bitmap_misc.sh
_plugin/xtrabackup/t/xb_incremental_compressed_bitmap_16kb.sh
_plugin/xtrabackup/t/xb_incremental_compressed_bitmap_2kb.sh
_plugin/xtrabackup/t/xb_incremental_compressed_bitmap_4kb.sh
_plugin/xtrabackup/t/xb_incremental_compressed_bitmap_8kb.sh
Host=UBINTI
Extra=
Concurrency=10
Timeout=1
Duration=121
Passes=98
Failures=13

bug1112224.sh - happened once, couldn't reproduce
bug733651.sh - (minor problem) - ~~MDEV-14172~~
ib_incremental_bitmap*.sh , ib_incremental_force_full_scan, xb_bitmap (8 failures) - (not a backup problem) - ~~MDEV-14174~~
innodb_fast_checksum.sh - (probably minor problem) ~~MDEV-14175~~
innodb_page_size.sh - ~~MDEV-14176~~

Andrii Nikitin (Inactive) added a comment - 2017-10-27 12:07 Testing current 10.1 tree: 5.5 failures: FAILED tests : _plugin/xtrabackup/t/bug1112224.sh _plugin/xtrabackup/t/bug733651.sh _plugin/xtrabackup/t/ib_incremental_bitmap_lsn.sh _plugin/xtrabackup/t/ib_incremental_bitmap.sh _plugin/xtrabackup/t/ib_incremental_force_full_scan.sh _plugin/xtrabackup/t/ib_lru_dump_stream.sh _plugin/xtrabackup/t/innodb_fast_checksum.sh _plugin/xtrabackup/t/innodb_page_size.sh _plugin/xtrabackup/t/xb_incremental_bitmap_misc.sh _plugin/xtrabackup/t/xb_incremental_compressed_bitmap_16kb.sh _plugin/xtrabackup/t/xb_incremental_compressed_bitmap_2kb.sh _plugin/xtrabackup/t/xb_incremental_compressed_bitmap_4kb.sh _plugin/xtrabackup/t/xb_incremental_compressed_bitmap_8kb.sh Host=UBINTI Extra= Concurrency=10 Timeout=1 Duration=121 Passes=98 Failures=13 bug1112224.sh - happened once, couldn't reproduce bug733651.sh - (minor problem) - MDEV-14172 ib_incremental_bitmap*.sh , ib_incremental_force_full_scan, xb_ bitmap (8 failures) - (not a backup problem) - MDEV-14174 innodb_fast_checksum.sh - (probably minor problem) MDEV-14175 innodb_page_size.sh - MDEV-14176

Andrii Nikitin (Inactive) added a comment - 2017-10-27 12:58

10.0 tests all passed except xb_incremental_compressed_bitmap* , which is probably cannot run in 10.0
Related documentation request as been opened ~~MDEV-14177~~
FAILED tests :
_plugin/xtrabackup/t/xb_incremental_compressed_bitmap_16kb.sh
_plugin/xtrabackup/t/xb_incremental_compressed_bitmap_2kb.sh
_plugin/xtrabackup/t/xb_incremental_compressed_bitmap_4kb.sh
_plugin/xtrabackup/t/xb_incremental_compressed_bitmap_8kb.sh
Host=UBINTI
Extra=
Concurrency=10
Timeout=300
Duration=197
Passes=111
Failures=4

Andrii Nikitin (Inactive) added a comment - 2017-10-27 12:58 10.0 tests all passed except xb_incremental_compressed_bitmap* , which is probably cannot run in 10.0 Related documentation request as been opened MDEV-14177 FAILED tests : _plugin/xtrabackup/t/xb_incremental_compressed_bitmap_16kb.sh _plugin/xtrabackup/t/xb_incremental_compressed_bitmap_2kb.sh _plugin/xtrabackup/t/xb_incremental_compressed_bitmap_4kb.sh _plugin/xtrabackup/t/xb_incremental_compressed_bitmap_8kb.sh Host=UBINTI Extra= Concurrency=10 Timeout=300 Duration=197 Passes=111 Failures=4

Andrii Nikitin (Inactive) added a comment - 2017-10-27 13:07

For reference: steps to perform tests:
1. setup framework

git clone http://github.com/AndriiNikitin/mariadb-environs

cd mariadb-environs

./get_plugin.sh xtrabackup

2. Build 5.5, 10.0 and 10.1 environs. Code below will build 10.1 from source (m1) and download and configure 5.5 (m2) and 10.0 (m3) tar packages:

./replant.sh m1-10.1

./replant.sh m2-5.5.58

./replant.sh m3-10.0.36

./build_or_download.sh m1

./build_or_download.sh m2

./build_or_download.sh m3

3. Optionally test 10.1 and see if any failure

./runsuite.sh m1 _plugin/xtrabackup/t

4. Test 5.5 and 10.0 with commands below:

./runsuite.sh m1 m2 _plugin/xtrabackup/t

./runsuite.sh m1 m3 _plugin/xtrabackup/t

Andrii Nikitin (Inactive) added a comment - 2017-10-27 13:07 For reference: steps to perform tests: 1. setup framework git clone http: //github .com /AndriiNikitin/mariadb-environs cd mariadb-environs . /get_plugin .sh xtrabackup 2. Build 5.5, 10.0 and 10.1 environs. Code below will build 10.1 from source (m1) and download and configure 5.5 (m2) and 10.0 (m3) tar packages: ./replant.sh m1- 10.1 ./replant.sh m2- 5.5 . 58 ./replant.sh m3- 10.0 . 36 ./build_or_download.sh m1 ./build_or_download.sh m2 ./build_or_download.sh m3 3. Optionally test 10.1 and see if any failure ./runsuite.sh m1 _plugin/xtrabackup/t 4. Test 5.5 and 10.0 with commands below: ./runsuite.sh m1 m2 _plugin/xtrabackup/t ./runsuite.sh m1 m3 _plugin/xtrabackup/t

People

Assignee:: Andrii Nikitin (Inactive)

Reporter:: Ralf Gebhardt

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 2017-05-04 07:37

Updated:: 2018-01-12 17:58

Resolved:: 2017-10-27 13:08

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.