Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-22205

WSREP even if galera not used require almost 2 times more opened files

Details

    • Bug
    • Status: Closed (View Workflow)
    • Blocker
    • Resolution: Cannot Reproduce
    • 10.1(EOL), 10.2(EOL), 10.3(EOL), 10.4(EOL), 10.5
    • N/A
    • N/A
    • None

    Description

      Take dSTAR16_MariaDB.sql from MDEV-21447 and try to find with ulimit -n number of file required by server. With WSREP compiled in it is between 2368-2304 without WSREP it is almost 2 times less.

      Attachments

        Activity

          sanja Oleksandr Byelkin added a comment - - edited

          Do not use mysql-test-run if play with ulimit, because it set its own.

          sanja Oleksandr Byelkin added a comment - - edited Do not use mysql-test-run if play with ulimit, because it set its own.

          If problem does not repeat WITH_WSREP=OFF it is just matter of grepping WITH_WSREP and finding the offending code by e.g. changing WITH_WSREP with WITH_WSREP_DISABLED until the problem part if found.

          jplindst Jan Lindström (Inactive) added a comment - If problem does not repeat WITH_WSREP=OFF it is just matter of grepping WITH_WSREP and finding the offending code by e.g. changing WITH_WSREP with WITH_WSREP_DISABLED until the problem part if found.

          e.g. 10.1 startup:

          /home/x/maria/git/10.1/sql/mysqld --no-defaults  --basedir=/home/x/maria/git/10.1 --datadir=/home/x/maria/git/10.1/mysql-test/var/install.db --plugin-dir=/home/x/maria/git/10.1/mysql-test/var/plugins --default-storage-engine=myisam --loose-skip-plugin-innodb --loose-skip-plugin-innodb-buffer-page --loose-skip-plugin-innodb-buffer-page-lru --loose-skip-plugin-innodb-buffer-pool-stats --loose-skip-plugin-innodb-changed-pages --loose-skip-plugin-innodb-cmp --loose-skip-plugin-innodb-cmp-per-index --loose-skip-plugin-innodb-cmp-per-index-reset --loose-skip-plugin-innodb-cmp-reset --loose-skip-plugin-innodb-cmpmem --loose-skip-plugin-innodb-cmpmem-reset --loose-skip-plugin-innodb-ft-being-deleted --loose-skip-plugin-innodb-ft-config --loose-skip-plugin-innodb-ft-default-stopword --loose-skip-plugin-innodb-ft-deleted --loose-skip-plugin-innodb-ft-index-cache --loose-skip-plugin-innodb-ft-index-table --loose-skip-plugin-innodb-lock-waits --loose-skip-plugin-innodb-locks --loose-skip-plugin-innodb-metrics --loose-skip-plugin-innodb-mutexes --loose-skip-plugin-innodb-sys-columns --loose-skip-plugin-innodb-sys-datafiles --loose-skip-plugin-innodb-sys-fields --loose-skip-plugin-innodb-sys-foreign --loose-skip-plugin-innodb-sys-foreign-cols --loose-skip-plugin-innodb-sys-indexes --loose-skip-plugin-innodb-sys-semaphore-waits --loose-skip-plugin-innodb-sys-tables --loose-skip-plugin-innodb-sys-tablespaces --loose-skip-plugin-innodb-sys-tablestats --loose-skip-plugin-innodb-tablespaces-encryption --loose-skip-plugin-innodb-tablespaces-scrubbing --loose-skip-plugin-innodb-trx --loose-skip-plugin-partition --loose-skip-plugin-sequence --loose-skip-plugin-xtradb-internal-hash-tables --loose-skip-plugin-xtradb-read-view --loose-skip-plugin-xtradb-rseg --loose-innodb --loose-innodb-log-file-size=5M --disable-sync-frm --tmpdir=/home/x/maria/git/10.1/mysql-test/var/tmp/ --core-file --console --lc-messages-dir=/home/x/maria/git/10.1/sql/share/ --character-sets-dir=/home/x/maria/git/10.1/sql/share/charsets
          

          jplindst Jan Lindström (Inactive) added a comment - e.g. 10.1 startup: /home/x/maria/git/10.1/sql/mysqld --no-defaults --basedir=/home/x/maria/git/10.1 --datadir=/home/x/maria/git/10.1/mysql-test/var/install.db --plugin-dir=/home/x/maria/git/10.1/mysql-test/var/plugins --default-storage-engine=myisam --loose-skip-plugin-innodb --loose-skip-plugin-innodb-buffer-page --loose-skip-plugin-innodb-buffer-page-lru --loose-skip-plugin-innodb-buffer-pool-stats --loose-skip-plugin-innodb-changed-pages --loose-skip-plugin-innodb-cmp --loose-skip-plugin-innodb-cmp-per-index --loose-skip-plugin-innodb-cmp-per-index-reset --loose-skip-plugin-innodb-cmp-reset --loose-skip-plugin-innodb-cmpmem --loose-skip-plugin-innodb-cmpmem-reset --loose-skip-plugin-innodb-ft-being-deleted --loose-skip-plugin-innodb-ft-config --loose-skip-plugin-innodb-ft-default-stopword --loose-skip-plugin-innodb-ft-deleted --loose-skip-plugin-innodb-ft-index-cache --loose-skip-plugin-innodb-ft-index-table --loose-skip-plugin-innodb-lock-waits --loose-skip-plugin-innodb-locks --loose-skip-plugin-innodb-metrics --loose-skip-plugin-innodb-mutexes --loose-skip-plugin-innodb-sys-columns --loose-skip-plugin-innodb-sys-datafiles --loose-skip-plugin-innodb-sys-fields --loose-skip-plugin-innodb-sys-foreign --loose-skip-plugin-innodb-sys-foreign-cols --loose-skip-plugin-innodb-sys-indexes --loose-skip-plugin-innodb-sys-semaphore-waits --loose-skip-plugin-innodb-sys-tables --loose-skip-plugin-innodb-sys-tablespaces --loose-skip-plugin-innodb-sys-tablestats --loose-skip-plugin-innodb-tablespaces-encryption --loose-skip-plugin-innodb-tablespaces-scrubbing --loose-skip-plugin-innodb-trx --loose-skip-plugin-partition --loose-skip-plugin-sequence --loose-skip-plugin-xtradb-internal-hash-tables --loose-skip-plugin-xtradb-read-view --loose-skip-plugin-xtradb-rseg --loose-innodb --loose-innodb-log-file-size=5M --disable-sync-frm --tmpdir=/home/x/maria/git/10.1/mysql-test/var/tmp/ --core-file --console --lc-messages-dir=/home/x/maria/git/10.1/sql/share/ --character-sets-dir=/home/x/maria/git/10.1/sql/share/charsets

          A thorough check was performed both manually and with a modified version of mtr (which does not change "ulimit -n" in safe_processs.cc) - the problem is not confirmed at the moment, the number of open files is the same both when building with wsrep or without. There are very insignificant differences in the operations of writing to files, which are explained by the innodb code in connection with some additions specific to wsrep, but the number of open files remains the same.

          sysprg Julius Goryavsky added a comment - A thorough check was performed both manually and with a modified version of mtr (which does not change "ulimit -n" in safe_processs.cc) - the problem is not confirmed at the moment, the number of open files is the same both when building with wsrep or without. There are very insignificant differences in the operations of writing to files, which are explained by the innodb code in connection with some additions specific to wsrep, but the number of open files remains the same.

          OK, I will recheck

          sanja Oleksandr Byelkin added a comment - OK, I will recheck

          Yes it looks like it gone

          sanja Oleksandr Byelkin added a comment - Yes it looks like it gone

          If problem is not repeatable as some comments indicate, this should be closed.

          jplindst Jan Lindström (Inactive) added a comment - If problem is not repeatable as some comments indicate, this should be closed.

          People

            sanja Oleksandr Byelkin
            sanja Oleksandr Byelkin
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.