Details

    Description

      I would like to suggest the possibility of developing a ZIP Type CONNECT Storage Engine, which could work directly with ZIP files (which contain CSV or XML into them) without the need of previously decompressing such files and importing them into the database.

      Thank you. Hope my suggestion is useful.

      Kind regards,
      Juan Telleria

      Attachments

        1. connect.zip
          805 kB
        2. CONNECT CSV Table Type.pdf
          920 kB
        3. Data Structure.png
          Data Structure.png
          60 kB
        4. error log.log
          8 kB
        5. Folder Example.png
          Folder Example.png
          31 kB
        6. P700-error.log
          14 kB
        7. Subfolder Option.PNG
          Subfolder Option.PNG
          62 kB
        8. Test Data.zip
          9.36 MB

        Issue Links

          Activity

            Juan Juan Telleria created issue -
            elenst Elena Stepanova made changes -
            Field Original Value New Value
            Assignee Olivier Bertrand [ bertrandop ]
            bertrandop Olivier Bertrand made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            Juan Juan Telleria made changes -
            Attachment Data Structure.png [ 43001 ]
            bertrandop Olivier Bertrand made changes -
            issue.field.resolutiondate 2016-12-26 11:41:18.0 2016-12-26 11:41:18.899
            bertrandop Olivier Bertrand made changes -
            Fix Version/s 10.0.29 [ 22312 ]
            Fix Version/s 10.1.21 [ 22113 ]
            Fix Version/s 10.2.4 [ 22116 ]
            Resolution Fixed [ 1 ]
            Status In Progress [ 3 ] Closed [ 6 ]
            Juan Juan Telleria made changes -
            Attachment Folder Example.png [ 43316 ]
            Juan Juan Telleria made changes -
            Attachment Subfolder Option.PNG [ 43394 ]
            Juan Juan Telleria made changes -
            Comment [ Hi!

            Could the "subfolder" option be developed please (in case it only takes little work, otherwise no) before MariaDB 10.2.4 RC turns out to be GA.

            They have changed the data structure in my work from monthly folders to daily folders, and is somehow a chaos :P:

             !Subfolder Option.PNG|thumbnail!

            Thank you :-) ]
            Juan Juan Telleria made changes -
            Comment [ Some ideas for subfolder option (From Stack Overflow):

            [Move all files in subfolders to a parent folder|http://superuser.com/questions/999922/move-all-files-from-multiple-subfolders-into-the-parent-folder]

            But actually, I would not move the files (nor copy them), because that is time consuming; and I would simply perform in C# the following command:

            [For /R (CMD)|https://ss64.com/nt/for_r.html]

            ]
            Juan Juan Telleria made changes -
            Comment [ * New sub-folder option (_multiple=3_) Information could be added to Knowledge Base documentation.
            * ¿Will it be distributed from MariaDB 10.2.4 RC?.
            ]
            Juan Juan Telleria made changes -
            Comment [ *ERRORS:*
            * Got error 174 'Open() error 13 on C:/Users/ANALISISOTS/Desktop/GA155AL15012017.csv: Permission denied' from CONNECT.
            * Got error 174 'Zipfile open error on C:/Users/ANALISISOTS/Desktop/GA155AL15012017.zip' from CONNECT.

            Are due to Directory permission issues on Windows:

            Same CREATE TABLE for CONNECT CSV (Zipped = 1 | 0) works perfectly on MariaDB 10.1 directory, but it does not work on other Windows paths.

            This is due to the fact that mysqld can only read MariaDB 10.1 folder.

            ¿Which would be the easiest way to solve this?

            Thank you.
            ]
            Juan Juan Telleria made changes -
            Attachment error log.log [ 43490 ]
            Juan Juan Telleria made changes -
            Juan Juan Telleria made changes -
            Attachment P700-error.log [ 43493 ]
            bertrandop Olivier Bertrand made changes -
            Resolution Fixed [ 1 ]
            Status Closed [ 6 ] Stalled [ 10000 ]
            Juan Juan Telleria made changes -
            Attachment Test Data.zip [ 43494 ]
            bertrandop Olivier Bertrand made changes -
            Attachment connect.zip [ 43504 ]
            Juan Juan Telleria made changes -
            Attachment CONNECT CSV Table Type.pdf [ 43508 ]
            serg Sergei Golubchik made changes -
            Resolution Fixed [ 1 ]
            Status Stalled [ 10000 ] Closed [ 6 ]
            serg Sergei Golubchik made changes -
            Summary SUGGESTION: CONNECT Storage Engine - ZIP Engine CONNECT Storage Engine - ZIP Engine
            serg Sergei Golubchik made changes -
            Workflow MariaDB v3 [ 78319 ] MariaDB v4 [ 133001 ]

            People

              bertrandop Olivier Bertrand
              Juan Juan Telleria
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.