Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-3928

Add Option To Read From a Lakehouse (Including Apache Parquet/Arrow Support)

    XMLWordPrintable

Details

    Description

      Add the ability to connect to and read from a lakehouse (Hadoop, Databricks, Snowflake, etc) for import into ColumnStore.

      Cpimport should be able to take a parquet (and later arrow) file and
      1. read the schema
      2. create a table
      3. import the data

      Attachments

        Issue Links

          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. MCOL-5505 Add support for Parquet file format in cpimport

          • Major - Major loss of function.
          • Stalled
          relates to

          New Feature - A new feature of the product, which has yet to be developed. MCOL-2209 mcsimport - parquet file format support

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. MCOL-5013 Support Load data from AWS S3 : UDF : columnstore_info.load_from_s3

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              toddstoffel Todd Stoffel (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.