Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-29296

Undo Size Problems with MariaDB 10.6

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Incomplete
    • 10.6
    • N/A
    • None
    • None

    Description

      We are doing tests with MariaDB 10.6 testing to deploy it on our production enviroment.

      But, in our testing we have some wrong expirence with the undo purge process.

      We did the test with sysbench tool:

      sysbench \
      --db-driver=mysql \
      --mysql-user=sbtest_user \
      --mysql_password=user_test \
      --mysql-db=sbtest \
      --mysql-host=mariadb-dba-test-01 \
      --mysql-port=33033 \
      --tables=32 \
      --table-size=1000000 \
      /usr/share/sysbench/oltp_read_write.lua prepare
       
      sysbench \
      --db-driver=mysql \
      --mysql-user=sbtest_user \
      --mysql_password=user_test \
      --mysql-db=sbtest \
      --mysql-host=mariadb-dba-test-00 \
      --mysql-port=33033 \
      --tables=32 \
      --table-size=1000000 \
      --threads=8 \
      --time=0 \
      --events=0 \
      --report-interval=1 \
      /usr/share/sysbench/oltp_read_write.lua run

      After many tests an reads we found this pool of variables to set:

      innodb_purge_threads = 32
      innodb_purge_batch_size = 50
      innodb_max_undo_log_size = 1G
      innodb_purge_rseg_truncate_frequency = 64
      innodb_undo_log_truncate = on

      But, the problem was the same.

      We didn't see the same behaivor wth MariaDB 10.5 version.

      Executing this query:

      select count from information_schema.innodb_metrics where name = 'trx_rseg_history_len';

      The values never stop to increase.

      Attachments

        Issue Links

          Activity

            See also MDEV-29401 for a sysbench test comparing 10.6.9 to 10.5.x and showing increased history list length for the same load.

            valerii Valerii Kravchuk added a comment - See also MDEV-29401 for a sysbench test comparing 10.6.9 to 10.5.x and showing increased history list length for the same load.

            Would the purge throttling work-around that was implemented in MDEV-29401 help here? Or would MDEV-29593 help prevent the growth of undo tablespaces? How does MariaDB Server 10.6.14 work for you?

            Before MDEV-31382, innodb_undo_log_truncate=ON would actually be ignored much of the time unless you are running with innodb_purge_rseg_truncate_frequency=1. That parameter is somewhat misleading; the value is more like a reciprocal of probability of truncating undo logs. With the default value, the probability would be 1/128. Maybe not a problem if you have a constant write workload, but likely one if the workload includes bursts of writes followed by long periods of no write activity.

            marko Marko Mäkelä added a comment - Would the purge throttling work-around that was implemented in MDEV-29401 help here? Or would MDEV-29593 help prevent the growth of undo tablespaces? How does MariaDB Server 10.6.14 work for you? Before MDEV-31382 , innodb_undo_log_truncate=ON would actually be ignored much of the time unless you are running with innodb_purge_rseg_truncate_frequency=1 . That parameter is somewhat misleading; the value is more like a reciprocal of probability of truncating undo logs. With the default value, the probability would be 1/128. Maybe not a problem if you have a constant write workload, but likely one if the workload includes bursts of writes followed by long periods of no write activity.

            People

              marko Marko Mäkelä
              maximiliano.dumon Maximiliano Dumon
              Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.