Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-4417

Non-equality comparison operators do not work well with NOPAD collations

    XMLWordPrintable

Details

    Description

      Long VARCHAR:

      DROP TABLE IF EXISTS t1;
      		 
      CREATE TABLE t1 (a VARCHAR(32) CHARACTER SET utf8 COLLATE utf8_general_nopad_ci) ENGINE=ColumnStore;
      		 
      INSERT INTO t1 VALUES ('a');
      		 
      INSERT INTO t1 VALUES ('ã');
      		 
      INSERT INTO t1 VALUES ('a ');
      		 
      INSERT INTO t1 VALUES ('ã ');
      		 
      INSERT INTO t1 VALUES ('a  ');
      		 
      INSERT INTO t1 VALUES ('ã  ');
      		 
      SELECT quote(a) FROM t1 WHERE a<='a  ';


      +----------+
      		 
      | quote(a) |
      		 
      +----------+
      		 
      | 'a'      |
      		 
      +----------+

      Looks wrong. The condition should match all records.

      Short VARCHAR:

      DROP TABLE IF EXISTS t1;
      		 
      CREATE TABLE t1 (a VARCHAR(4) CHARACTER SET utf8 COLLATE utf8_general_nopad_ci) ENGINE=ColumnStore;
      		 
      INSERT INTO t1 VALUES ('a');
      		 
      INSERT INTO t1 VALUES ('ã');
      		 
      INSERT INTO t1 VALUES ('a ');
      		 
      INSERT INTO t1 VALUES ('ã ');
      		 
      INSERT INTO t1 VALUES ('a  ');
      		 
      INSERT INTO t1 VALUES ('ã  ');
      		 
      SELECT quote(a) FROM t1 WHERE a<='a  ';


      +----------+
      		 
      | quote(a) |
      		 
      +----------+
      		 
      | 'a'      |
      		 
      | 'a '     |
      		 
      | 'a  '    |
      		 
      +----------+

      It returns a different result set, but it is still wrong.

      With other engines it works as expected:

      DROP TABLE IF EXISTS t1;
      		 
      CREATE TABLE t1 (a VARCHAR(32) CHARACTER SET utf8 COLLATE utf8_general_nopad_ci) ENGINE=MyISAM;
      		 
      INSERT INTO t1 VALUES ('a');
      		 
      INSERT INTO t1 VALUES ('ã');
      		 
      INSERT INTO t1 VALUES ('a ');
      		 
      INSERT INTO t1 VALUES ('ã ');
      		 
      INSERT INTO t1 VALUES ('a  ');
      		 
      INSERT INTO t1 VALUES ('ã  ');
      		 
      SELECT quote(a) FROM t1 WHERE a<='a  ';


      +----------+
      		 
      | quote(a) |
      		 
      +----------+
      		 
      | 'a'      |
      		 
      | 'ã'      |
      		 
      | 'a '     |
      		 
      | 'ã '     |
      		 
      | 'a  '    |
      		 
      | 'ã  '    |
      		 
      +----------+


      DROP TABLE IF EXISTS t1;
      		 
      CREATE TABLE t1 (a VARCHAR(4) CHARACTER SET utf8 COLLATE utf8_general_nopad_ci) ENGINE=MyISAM;
      		 
      INSERT INTO t1 VALUES ('a');
      		 
      INSERT INTO t1 VALUES ('ã');
      		 
      INSERT INTO t1 VALUES ('a ');
      		 
      INSERT INTO t1 VALUES ('ã ');
      		 
      INSERT INTO t1 VALUES ('a  ');
      		 
      INSERT INTO t1 VALUES ('ã  ');
      		 
      SELECT quote(a) FROM t1 WHERE a<='a  ';


      +----------+
      		 
      | quote(a) |
      		 
      +----------+
      		 
      | 'a'      |
      		 
      | 'ã'      |
      		 
      | 'a '     |
      		 
      | 'ã '     |
      		 
      | 'a  '    |
      		 
      | 'ã  '    |
      		 
      +----------+

      Attachments

        Issue Links

          is blocked by

          Task - A task that needs to be done. MCOL-4422 Remove mariadb.h and my_sys.h dependency from collation.h

          • Major - Major loss of function.
          • Closed
          relates to

          Task - A task that needs to be done. MCOL-495 Make string comparison not case sensitive

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MCOL-4064 Make JOIN collation aware

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MCOL-4498 LIKE is not collation aware

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MCOL-4065 DISTINCT is case sensitive

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MCOL-4388 Equality does not respect the NOPAD collation attribute

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MCOL-4428 WHERE char6col <='STR' OR char6col IS NULL -- returns a wrong result after MCOL-495

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MCOL-4539 WHERE short_char_column='literal' ignores the collation on a huge table

          • Major - Major loss of function.
          • Closed

          Activity

            People

              dleeyh Daniel Lee (Inactive)
              bar Alexander Barkov
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.