[MCOL-1831] multibyte space (zenkaku) breaks strings comparisation Created: 2018-10-24  Updated: 2020-08-25  Resolved: 2019-04-18

Status: Closed
Project: MariaDB ColumnStore
Component/s: ExeMgr
Affects Version/s: 1.1.6
Fix Version/s: Icebox

Type: Bug Priority: Critical
Reporter: Richard Stracke Assignee: Andrew Hutchings (Inactive)
Resolution: Fixed Votes: 1
Labels: None

Issue Links:
Duplicate
duplicates MCOL-1559 Regression on working_tpch1/misc/bug3... Closed

 Description   

This is variant of MCOL-1245 and MCOL-1403

Strings comparisation don't work,if mulktibyte space are ivolved

create table ws2 (a int, b char(100), c varchar(100)) engine=columnstore   DEFAULT  CHARSET = UTF8 ;
 
 
 
insert into ws2 (b,c) values ('01:朝食を毎日食べていますか  ','01:朝食を毎日食べていますか  ');
 
 
 
select * from ws2 where b = '01:朝食を毎日食べていますか  ';
 
-
 
select * from ws2 where c = '01:朝食を毎日食べていますか  ';

Both selects give no resultsets back.

 Comments   
Comment by David Hall (Inactive) [ 2019-04-18 ]

Using 1.2.4:

MariaDB [dhall]> create table ws2 (a int, b char(100), c varchar(100)) engine=columnstore DEFAULT CHARSET = UTF8 ;
Query OK, 0 rows affected (1.688 sec)

MariaDB [dhall]>
MariaDB [dhall]> insert into ws2 (b,c) values ('01:朝食を毎日食べていますか ','01:朝食を毎日食べてい ますか ');
Query OK, 1 row affected (0.758 sec)

MariaDB [dhall]>
MariaDB [dhall]> select * from ws2 where b = '01:朝食を毎日食べていますか ';
--------------------------------------------------------------------------------------

a b c

--------------------------------------------------------------------------------------

NULL 01:朝食を毎日食べていますか 01:朝食を毎日食べていますか

--------------------------------------------------------------------------------------
1 row in set (0.236 sec)

MariaDB [dhall]>
MariaDB [dhall]> select * from ws2 where c = '01:朝食を毎日食べていますか ';
--------------------------------------------------------------------------------------

a b c

--------------------------------------------------------------------------------------

NULL 01:朝食を毎日食べていますか 01:朝食を毎日食べていますか

--------------------------------------------------------------------------------------
1 row in set (0.051 sec)

So it appears to be fixed in 1.2.4

Comment by Andrew Hutchings (Inactive) [ 2019-04-18 ]

The various string whitespace handling fixes in 1.2 up to and including 1.2.4 appear to have fixed this.

Generated at Thu Feb 08 02:31:42 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.