Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-12587

MariaDB CONNECT DIR Type - Subfolder Option: SELECT Query Never Ends

Details

    Description

      If I execute the following code:

      create table Table_Name
      (
        PATH varchar(256) NOT NULL flag=1,
        FNAME varchar(256) NOT NULL,
        FTYPE char(4) NOT NULL,
        SIZE double(12,0) NOT NULL flag=5
      )
           ENGINE=CONNECT 
           TABLE_TYPE=DIR 
           FILE_NAME='C:\Folder\Subfolder\*.zip'
           OPTION_LIST='subdir=1';
      

      With a folder that contains 31 subfolders, and a total of 30.000 .zip files:

      • The SELECT query never ends, as I left it running for more than half an hour without obtaining any results.
      • Without the subfolder option (that is, all files in the main folder) works perfectly, obtaining all results in few seconds.

      Also I obtain error which does not allow me to start my development server after using this CONNECT ENGINE option:
      2017-04-25 16:04:23 9124 [ERROR] mysqld.exe: Got an error writing communication packets

      However, it is trivial bug, so it does not have to be considered prioritary.

      Thank you a lot for your excellent work!
      Juan

      Attachments

        Activity

          Juan Juan Telleria created issue -
          Juan Juan Telleria made changes -
          Field Original Value New Value
          Description If I execute the following code:


          {code:java}
          create table Table_Name
          (
            PATH varchar(256) NOT NULL flag=1,
            FNAME varchar(256) NOT NULL,
            FTYPE char(4) NOT NULL,
            SIZE double(12,0) NOT NULL flag=5
          )
               ENGINE=CONNECT
               TABLE_TYPE=DIR
               FILE_NAME='*.zip'
               OPTION_LIST='subdir=1';
          {code}

          With a folder that contains 31 subfolders, and a total of 30.000 .zip files.

          The SELECT query never ends, as I left it running for more than half an hour without obtaining results.

          However, it is trivial bug, so it does not haqve to be considered prioritary.

          Thank you a lot for your excellent work!
          Juan
          If I execute the following code:


          {code:java}
          create table Table_Name
          (
            PATH varchar(256) NOT NULL flag=1,
            FNAME varchar(256) NOT NULL,
            FTYPE char(4) NOT NULL,
            SIZE double(12,0) NOT NULL flag=5
          )
               ENGINE=CONNECT
               TABLE_TYPE=DIR
               FILE_NAME='C:\Folder\Subfolder\*.zip'
               OPTION_LIST='subdir=1';
          {code}

          With a folder that contains 31 subfolders, and a total of 30.000 .zip files:

          * The SELECT query never ends, as I left it running for more than half an hour without obtaining results.
          * Without the subfolder option works perfectly.

          However, it is trivial bug, so it does not have to be considered prioritary.

          Thank you a lot for your excellent work!
          Juan
          Juan Juan Telleria made changes -
          Description If I execute the following code:


          {code:java}
          create table Table_Name
          (
            PATH varchar(256) NOT NULL flag=1,
            FNAME varchar(256) NOT NULL,
            FTYPE char(4) NOT NULL,
            SIZE double(12,0) NOT NULL flag=5
          )
               ENGINE=CONNECT
               TABLE_TYPE=DIR
               FILE_NAME='C:\Folder\Subfolder\*.zip'
               OPTION_LIST='subdir=1';
          {code}

          With a folder that contains 31 subfolders, and a total of 30.000 .zip files:

          * The SELECT query never ends, as I left it running for more than half an hour without obtaining results.
          * Without the subfolder option works perfectly.

          However, it is trivial bug, so it does not have to be considered prioritary.

          Thank you a lot for your excellent work!
          Juan
          If I execute the following code:


          {code:java}
          create table Table_Name
          (
            PATH varchar(256) NOT NULL flag=1,
            FNAME varchar(256) NOT NULL,
            FTYPE char(4) NOT NULL,
            SIZE double(12,0) NOT NULL flag=5
          )
               ENGINE=CONNECT
               TABLE_TYPE=DIR
               FILE_NAME='C:\Folder\Subfolder\*.zip'
               OPTION_LIST='subdir=1';
          {code}

          With a folder that contains 31 subfolders, and a total of 30.000 .zip files:

          * The SELECT query never ends, as I left it running for more than half an hour without obtaining results.
          * Without the subfolder option (that is, all files in the main folder) works perfectly, obtaining all results in few seconds.

          However, it is trivial bug, so it does not have to be considered prioritary.

          Thank you a lot for your excellent work!
          Juan
          Juan Juan Telleria made changes -
          Description If I execute the following code:


          {code:java}
          create table Table_Name
          (
            PATH varchar(256) NOT NULL flag=1,
            FNAME varchar(256) NOT NULL,
            FTYPE char(4) NOT NULL,
            SIZE double(12,0) NOT NULL flag=5
          )
               ENGINE=CONNECT
               TABLE_TYPE=DIR
               FILE_NAME='C:\Folder\Subfolder\*.zip'
               OPTION_LIST='subdir=1';
          {code}

          With a folder that contains 31 subfolders, and a total of 30.000 .zip files:

          * The SELECT query never ends, as I left it running for more than half an hour without obtaining results.
          * Without the subfolder option (that is, all files in the main folder) works perfectly, obtaining all results in few seconds.

          However, it is trivial bug, so it does not have to be considered prioritary.

          Thank you a lot for your excellent work!
          Juan
          If I execute the following code:


          {code:java}
          create table Table_Name
          (
            PATH varchar(256) NOT NULL flag=1,
            FNAME varchar(256) NOT NULL,
            FTYPE char(4) NOT NULL,
            SIZE double(12,0) NOT NULL flag=5
          )
               ENGINE=CONNECT
               TABLE_TYPE=DIR
               FILE_NAME='C:\Folder\Subfolder\*.zip'
               OPTION_LIST='subdir=1';
          {code}

          With a folder that contains 31 subfolders, and a total of 30.000 .zip files:

          * The SELECT query never ends, as I left it running for more than half an hour without obtaining any results.
          * Without the subfolder option (that is, all files in the main folder) works perfectly, obtaining all results in few seconds.

          However, it is +_*trivial*_+ bug, so it does not have to be considered prioritary.

          Thank you a lot for your excellent work!
          Juan
          Juan Juan Telleria made changes -
          Description If I execute the following code:


          {code:java}
          create table Table_Name
          (
            PATH varchar(256) NOT NULL flag=1,
            FNAME varchar(256) NOT NULL,
            FTYPE char(4) NOT NULL,
            SIZE double(12,0) NOT NULL flag=5
          )
               ENGINE=CONNECT
               TABLE_TYPE=DIR
               FILE_NAME='C:\Folder\Subfolder\*.zip'
               OPTION_LIST='subdir=1';
          {code}

          With a folder that contains 31 subfolders, and a total of 30.000 .zip files:

          * The SELECT query never ends, as I left it running for more than half an hour without obtaining any results.
          * Without the subfolder option (that is, all files in the main folder) works perfectly, obtaining all results in few seconds.

          However, it is +_*trivial*_+ bug, so it does not have to be considered prioritary.

          Thank you a lot for your excellent work!
          Juan
          If I execute the following code:


          {code:java}
          create table Table_Name
          (
            PATH varchar(256) NOT NULL flag=1,
            FNAME varchar(256) NOT NULL,
            FTYPE char(4) NOT NULL,
            SIZE double(12,0) NOT NULL flag=5
          )
               ENGINE=CONNECT
               TABLE_TYPE=DIR
               FILE_NAME='C:\Folder\Subfolder\*.zip'
               OPTION_LIST='subdir=1';
          {code}

          With a folder that contains 31 subfolders, and a total of 30.000 .zip files:

          * The SELECT query never ends, as I left it running for more than half an hour without obtaining any results.
          * Without the subfolder option (that is, all files in the main folder) works perfectly, obtaining all results in few seconds.

          Also I obtain error which does not allow me to start my development server after using this CONNECT ENGINE option:
          2017-04-25 16:04:23 9124 [ERROR] mysqld.exe: Got an error writing communication packets

          However, it is +_*trivial*_+ bug, so it does not have to be considered prioritary.

          Thank you a lot for your excellent work!
          Juan
          elenst Elena Stepanova made changes -
          Assignee Olivier Bertrand [ bertrandop ]
          bertrandop Olivier Bertrand made changes -
          issue.field.resolutiondate 2017-05-02 22:43:06.0 2017-05-02 22:43:06.794
          bertrandop Olivier Bertrand made changes -
          Fix Version/s 10.0.31 [ 22501 ]
          Fix Version/s 10.1.23 [ 22503 ]
          Resolution Fixed [ 1 ]
          Status Open [ 1 ] Closed [ 6 ]
          serg Sergei Golubchik made changes -
          Workflow MariaDB v3 [ 80466 ] MariaDB v4 [ 152012 ]

          People

            bertrandop Olivier Bertrand
            Juan Juan Telleria
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.