[MCOL-267] TEXT and BLOB data types are not supported Created: 2016-08-18  Updated: 2017-12-01  Resolved: 2017-05-05

Status: Closed
Project: MariaDB ColumnStore
Component/s: None
Affects Version/s: None
Fix Version/s: 1.1.0

Type: New Feature Priority: Minor
Reporter: Andrew Hutchings (Inactive) Assignee: Daniel Lee (Inactive)
Resolution: Fixed Votes: 7
Labels: relnote

Issue Links:
Duplicate
is duplicated by MCOL-356 BLOB data type not supported Closed
Relates
relates to MCOL-635 Add DML cpimport configurable row limit Closed
relates to MCOL-642 Add BLOB/TEXT detection Closed
relates to MCOL-643 support longer then 8m rows in order by Closed
relates to MCOL-654 cpimport binary mode needs to support... Closed
relates to MCOL-665 DictStep _execute and _project need B... Closed
relates to MCOL-669 INSERT_SELECT with TEXT column crashes Closed
relates to MCOL-670 BLOB/TEXT updates truncated Closed
relates to MCOL-671 WHERE condition on TEXT column fails ... Closed
relates to MCOL-673 BLOB INSERT...SELECT / LDI fail on lo... Closed
relates to MCOL-697 hex() on TEXT/BLOB truncated at 64KB Closed
relates to MCOL-698 Joining two text/longtext/blob/longbl... Closed
relates to MCOL-701 Need better error reporting -- follow... Closed
relates to MCOL-664 TEXT columns need to support the same... Closed
Sprint: 2017-2, 2017-3, 2017-4, 2017-5, 2017-6, 2017-7, 2017-8, 2017-9

 Description   

Columnstore throws an error for the TEXT data type.

 Comments   
Comment by Jose Cavieres Soto [ 2017-01-20 ]

I wouldn't consider this a minor issue.
Not being able to use text data type leads to a reduction in the number of columns of the table to a few hundreds from the theoretical 4096 . In OLAP that's not a small problem

Comment by Andrew Hutchings (Inactive) [ 2017-01-20 ]

At the time of issue creation the priority was minor as we were prioritising critical problems for the 1.0 GA release. Now that we have started work on further GA releases we should re-evaluate this.

Comment by Andrew Hutchings (Inactive) [ 2017-03-23 ]

Pull request open for feature and tests

BLOB/TEXT is implemented using a multi-block dictionary, eliminating the need for the 8KB limit. Also allows BLOB/TEXT columns to be used in cross engine joins.

Release notes:

  • LONGBLOB/LONGTEXT is capped at 2,100,000,000 bytes
  • LDI and INSERT...SELECT limited to 1MB row length so max 512KB blob (halved due to hex conversion) - we should open a new ticket for this to be configurable as a sysvar after this and 10.2 is merged.
  • cpimport needs BLOB/TEXT to be in hex form (like VARBINARY)
  • you will likely need to use '-c' to increase the buffer size with cpimport
Comment by Andrew Hutchings (Inactive) [ 2017-04-04 ]

Additional:

  • We don't support joins on BLOB/TEXT columns
Comment by Daniel Lee (Inactive) [ 2017-05-05 ]

Build verified: Github source
[root@localhost mariadb-columnstore-server]# git show
commit 349cae544b6bc71910267a3b3b0fa3fb57b0a587
Merge: bd13090 2ecb85c
Author: benthompson15 <ben.thompson@mariadb.com>
Date: Thu May 4 16:06:16 2017 -0500
Merge pull request #50 from mariadb-corporation/10.2-fixes
10.2 fixes
[root@localhost mariadb-columnstore-server]# cd mariadb-columnstore-engine/
[root@localhost mariadb-columnstore-engine]# git show
commit 9ef603c14aa3cb8e9fe7f21c9965f6cf3f0a11d8
Merge: 19342ef 82c983e
Author: dhall-InfiniDB <david.hall@mariadb.com>
Date: Fri May 5 13:09:34 2017 -0500
Merge pull request #169 from mariadb-corporation/MCOL-701
MCOL-701 stop join on BLOB columns

I have been testing this feature for a while now. Since the feature have been implemented and issues found are being tracked by separate tickets, I am closing this ticket.

Generated at Thu Feb 08 02:19:45 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.