Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-36437

mariabackup - confusing error message when running out of file handles with partitioned MyISAM

Details

    Description

      When having a MyISAM table with many partitions the backup process seems to want to open all the related MYD and MYI partition files and keep them open simultaneously until the full table has been copied.

      Unlike with InnoDB and Aria tables, where a proper "Too many open files" message (or similar) is logged, with MyISAM things fail with just:

      Error on file ./test/t1#P#p513.MYD open during `test`.`t1` table copy

      How to reproduce: create a partitioned MyISAM table as:

      CREATE TABLE `t1` (
        `id` bigint(20) NOT NULL AUTO_INCREMENT,
        PRIMARY KEY (`id`)
      ) ENGINE=MyISAM
       PARTITION BY HASH (`id`)
       PARTITIONS 600;
      

      then try to run mariabackup with an open files limit too small for this:

      mariabackup --backup --user=root --open-files-limit=500
      

      Attachments

        Activity

          serg Sergei Golubchik created issue -
          serg Sergei Golubchik made changes -
          Field Original Value New Value
          Component/s Backup [ 13902 ]
          Component/s Backup [ 14923 ]
          Fix Version/s 10.11 [ 27614 ]
          Fix Version/s 11.4 [ 29301 ]
          Fix Version/s 11.8 [ 29921 ]
          Fix Version/s 10.5 [ 23608 ]
          Fix Version/s 10.6 [ 24027 ]
          Key MENT-2256 MDEV-36437
          Affects Version/s 10.11 [ 27614 ]
          Affects Version/s 11.4 [ 29301 ]
          Affects Version/s 11.8 [ 29921 ]
          Affects Version/s 10.2.43-15 [ 27107 ]
          Affects Version/s 10.3.39-20 [ 28709 ]
          Affects Version/s 23.08.0 [ 29107 ]
          Affects Version/s 10.5.24-18 [ 29614 ]
          Affects Version/s 10.4.33-23 [ 29615 ]
          Affects Version/s 10.6.17-13 [ 29827 ]
          Affects Version/s 11.4.4-2 [ 29963 ]
          Project MariaDB Enterprise [ 11500 ] MariaDB Server [ 10000 ]
          serg Sergei Golubchik made changes -
          serg Sergei Golubchik made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          serg Sergei Golubchik made changes -
          Priority Major [ 3 ] Blocker [ 1 ]
          serg Sergei Golubchik made changes -
          Status In Progress [ 3 ] In Testing [ 10301 ]

          hholzgra,

          [00] 2025-03-30 13:49:31 Error 24 on file ./test/t1#P#p196.MYI open during `test`.`t1` table copy: Too many open files
          

          Looks good?

          serg Sergei Golubchik added a comment - hholzgra , [00] 2025-03-30 13:49:31 Error 24 on file ./test/t1#P#p196.MYI open during `test`.`t1` table copy: Too many open files Looks good?
          serg Sergei Golubchik made changes -
          Fix Version/s 10.11.12 [ 29998 ]
          Fix Version/s 11.4.6 [ 29999 ]
          Fix Version/s 11.8.2 [ 30001 ]
          Fix Version/s 10.11 [ 27614 ]
          Fix Version/s 11.4 [ 29301 ]
          Fix Version/s 11.8 [ 29921 ]
          Resolution Fixed [ 1 ]
          Status In Testing [ 10301 ] Closed [ 6 ]

          People

            serg Sergei Golubchik
            hholzgra Hartmut Holzgraefe
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.