Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-21200

About 10x less insert performance with Galera cluster

Details

    • Bug
    • Status: Closed (View Workflow)
    • Minor
    • Resolution: Cannot Reproduce
    • 10.3.18
    • 10.3.21
    • Galera
    • None

    Description

      I am running an application which inserts a lot of rows and we were experiencing some low performance. So i started benchmarking the Galera Cluster with sysbench and oltp_insert.lua. The performance of the cluster is really bad.
      With the same test:
      As a standalone DB i can perform about18000 tps
      With Galera the performance is: 1000 tps
      I try to decrease cluster size to 1, but the result is still bad.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MDEV-20646 10.3.18 is slower than 10.3.17

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            Ascending order - Click to sort in descending order
            yz s added a comment - - edited

            When i set up pxc on docker, find the performance is good,. Tps about 6500!!! What puzzled me was that the performance of MariaDB cluster using Galera was so bad

            yz s added a comment - - edited When i set up pxc on docker, find the performance is good,. Tps about 6500!!! What puzzled me was that the performance of MariaDB cluster using Galera was so bad
            yz s added a comment -

            When I use 10.4.10 MariaDB with same cnf to sysbench, I get a good result, about 8000tps

            yz s added a comment - When I use 10.4.10 MariaDB with same cnf to sysbench, I get a good result, about 8000tps
            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited

            Please, see below my performance test results in TPS on the latest 10.4 (ae72205e31e7665238c1757ede352d9ca53d5327) and 10.3 (d759f764f6b115ca7ad7644ae3ee2e19c71c6138):

            Ver. Standalone 3 nodes 1 Galera node
            10.3.21 133 57 76
            10.4.11 131 89 90

            I can confirm the difference for 10.3 between using Galera and without it in 2 times, but not in 10!
            Maybe, there was anything else special in original tests. I run oltp_insert.lua for 10 mins on the table with already 1M rows. But do not think that it matters here.

            But I run it on HyperV VM, not on the real one.

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - - edited Please, see below my performance test results in TPS on the latest 10.4 (ae72205e31e7665238c1757ede352d9ca53d5327) and 10.3 (d759f764f6b115ca7ad7644ae3ee2e19c71c6138): Ver. Standalone 3 nodes 1 Galera node 10.3.21 133 57 76 10.4.11 131 89 90 I can confirm the difference for 10.3 between using Galera and without it in 2 times, but not in 10! Maybe, there was anything else special in original tests. I run oltp_insert.lua for 10 mins on the table with already 1M rows. But do not think that it matters here. But I run it on HyperV VM, not on the real one.
            yz s added a comment -

            I solve the problem by upgrading mariadb from 10.3.18 to 10.4.10.

            yz s added a comment - I solve the problem by upgrading mariadb from 10.3.18 to 10.4.10.
            yz s added a comment -

            I think that the problem may be solved in 10.3.19 or later.

            yz s added a comment - I think that the problem may be solved in 10.3.19 or later.
            stepan.patryshev Stepan Patryshev (Inactive) added a comment -

            I've tested it on 10.3.18 (604f80e77c054758aa449064cdc29dfa13a71922) also. See below my results:

            Ver. Standalone 3 nodes 1 Galera node
            10.3.18 133 58 76
            10.3.21 133 57 76
            10.4.11 131 89 90

            Practically, do not see any difference between 10.3.18 and the latest 10.3 (10.3.21).

            Btw, found also performance related issue MDEV-20646 (10.3.18 is slower than 10.3.17). But there is nothing about Galera.

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - I've tested it on 10.3.18 (604f80e77c054758aa449064cdc29dfa13a71922) also. See below my results: Ver. Standalone 3 nodes 1 Galera node 10.3.18 133 58 76 10.3.21 133 57 76 10.4.11 131 89 90 Practically, do not see any difference between 10.3.18 and the latest 10.3 (10.3.21). Btw, found also performance related issue MDEV-20646 (10.3.18 is slower than 10.3.17). But there is nothing about Galera.
            yz s added a comment -

            Maybe it's not the reason for Galera. Anyway, thanks for your help, I've decided to use the latest version of MariaDB Galera cluster

            yz s added a comment - Maybe it's not the reason for Galera. Anyway, thanks for your help, I've decided to use the latest version of MariaDB Galera cluster
            stepan.patryshev Stepan Patryshev (Inactive) added a comment -

            Closing it as not reproduced.

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - Closing it as not reproduced.

            People

              stepan.patryshev Stepan Patryshev (Inactive)
              yz s
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.