Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-707

GROUP_CONCAT function on TEXT/TEXT got ColumnStore stuck in "Join or subselect exceeds memory limit" error

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • 1.1.0
    • 1.1.0
    • ExeMgr
    • None
    • 2017-10

    Description

      Build tested: Github source

      [root@localhost mariadb-columnstore-server]# git show
      commit 349cae544b6bc71910267a3b3b0fa3fb57b0a587
      Merge: bd13090 2ecb85c
      Author: benthompson15 <ben.thompson@mariadb.com>
      Date: Thu May 4 16:06:16 2017 -0500

      Merge pull request #50 from mariadb-corporation/10.2-fixes

      10.2 fixes

      [root@localhost mariadb-columnstore-server]# cd mariadb-columnstore-engine/
      [root@localhost mariadb-columnstore-engine]# git show
      commit 9ef603c14aa3cb8e9fe7f21c9965f6cf3f0a11d8
      Merge: 19342ef 82c983e
      Author: dhall-InfiniDB <david.hall@mariadb.com>
      Date: Fri May 5 13:09:34 2017 -0500

      Merge pull request #169 from mariadb-corporation/MCOL-701

      MCOL-701 stop join on BLOB columns

      Test queries are at the end of this comment.

      The following query would cause this the "Sorting length Exceeded" error: (query #22)

      MariaDB [mytest]> select cidx, CTEXT, GROUP_CONCAT(CTEXT) from datatypetestm group by cidx, CTEXT order by cidx;
      ERROR 1815 (HY000): Internal error: IDB-2015: Sorting length exceeded. Session variable max_length_for_sort_data needs to be set higher.

      The following query would cause this the "Aggregation/Distinct memory limit Exceeded" error: (query #23)
      MariaDB [mytest]> select GROUP_CONCAT(CLONGTEXT) from datatypetestm;
      ERROR 1815 (HY000): Internal error: IDB-2003: Aggregation/Distinct memory limit is exceeded.

      If I execute the script that include the following 45 queries, ColumnStore would get into a condition that it will return a "IDB-2001: Join or subselect exceeds memory limit." even if I just execute a select count.

      MariaDB [mytest]> select count from datatypetestm;
      ERROR 1815 (HY000): Internal error: IDB-2001: Join or subselect exceeds memory limit.

      MariaDB [mytest]> create table t2 (c1 int) engine=columnstore;
      Query OK, 0 rows affected (0.07 sec)
      MariaDB [mytest]> select count from t2;
      ERROR 1815 (HY000): Internal error: IDB-2001: Join or subselect exceeds memory limit.

      I need to restart the system to get out of this condition.

      select GROUP_CONCAT(CCHAR2) from datatypetestm;
      select GROUP_CONCAT(CCHAR3) from datatypetestm;
      select GROUP_CONCAT(CCHAR4) from datatypetestm;
      select GROUP_CONCAT(CCHAR5) from datatypetestm;
      select GROUP_CONCAT(CCHAR6) from datatypetestm;
      select GROUP_CONCAT(CCHAR7) from datatypetestm;
      select GROUP_CONCAT(CCHAR8) from datatypetestm;
      select GROUP_CONCAT(CCHAR9) from datatypetestm;
      select GROUP_CONCAT(CCHAR255) from datatypetestm;
      select GROUP_CONCAT(CVCHAR1) from datatypetestm;
      select GROUP_CONCAT(CVCHAR2) from datatypetestm;
      select GROUP_CONCAT(CVCHAR3) from datatypetestm;
      select GROUP_CONCAT(CVCHAR4) from datatypetestm;
      select GROUP_CONCAT(CVCHAR5) from datatypetestm;
      select GROUP_CONCAT(CVCHAR6) from datatypetestm;
      select GROUP_CONCAT(CVCHAR7) from datatypetestm;
      select GROUP_CONCAT(CVCHAR8) from datatypetestm;
      select GROUP_CONCAT(CVCHAR255) from datatypetestm;
      select GROUP_CONCAT(CTEXT) from datatypetestm;
      select GROUP_CONCAT(CLONGTEXT) from datatypetestm;
      select GROUP_CONCAT('Hello') from datatypetestm;
      select GROUP_CONCAT('Hello, World') from datatypetestm;
      select cidx, CCHAR1, GROUP_CONCAT(CCHAR1) from datatypetestm group by cidx, CCHAR1 order by cidx;
      select cidx, CCHAR2, GROUP_CONCAT(CCHAR2) from datatypetestm group by cidx, CCHAR2 order by cidx;
      select cidx, CCHAR3, GROUP_CONCAT(CCHAR3) from datatypetestm group by cidx, CCHAR3 order by cidx;
      select cidx, CCHAR4, GROUP_CONCAT(CCHAR4) from datatypetestm group by cidx, CCHAR4 order by cidx;
      select cidx, CCHAR5, GROUP_CONCAT(CCHAR5) from datatypetestm group by cidx, CCHAR5 order by cidx;
      select cidx, CCHAR6, GROUP_CONCAT(CCHAR6) from datatypetestm group by cidx, CCHAR6 order by cidx;
      select cidx, CCHAR7, GROUP_CONCAT(CCHAR7) from datatypetestm group by cidx, CCHAR7 order by cidx;
      select cidx, CCHAR8, GROUP_CONCAT(CCHAR8) from datatypetestm group by cidx, CCHAR8 order by cidx;
      select cidx, CCHAR9, GROUP_CONCAT(CCHAR9) from datatypetestm group by cidx, CCHAR9 order by cidx;
      select cidx, CCHAR255, GROUP_CONCAT(CCHAR255) from datatypetestm group by cidx, CCHAR255 order by cidx;
      select cidx, CVCHAR1, GROUP_CONCAT(CVCHAR1) from datatypetestm group by cidx, CVCHAR1 order by cidx;
      select cidx, CVCHAR2, GROUP_CONCAT(CVCHAR2) from datatypetestm group by cidx, CVCHAR2 order by cidx;
      select cidx, CVCHAR3, GROUP_CONCAT(CVCHAR3) from datatypetestm group by cidx, CVCHAR3 order by cidx;
      select cidx, CVCHAR4, GROUP_CONCAT(CVCHAR4) from datatypetestm group by cidx, CVCHAR4 order by cidx;
      select cidx, CVCHAR5, GROUP_CONCAT(CVCHAR5) from datatypetestm group by cidx, CVCHAR5 order by cidx;
      select cidx, CVCHAR6, GROUP_CONCAT(CVCHAR6) from datatypetestm group by cidx, CVCHAR6 order by cidx;
      select cidx, CVCHAR7, GROUP_CONCAT(CVCHAR7) from datatypetestm group by cidx, CVCHAR7 order by cidx;
      select cidx, CVCHAR8, GROUP_CONCAT(CVCHAR8) from datatypetestm group by cidx, CVCHAR8 order by cidx;
      select cidx, CVCHAR255, GROUP_CONCAT(CVCHAR255) from datatypetestm group by cidx, CVCHAR255 order by cidx;
      select cidx, CTEXT, GROUP_CONCAT(CTEXT) from datatypetestm group by cidx, CTEXT order by cidx;
      select cidx, CLONGTEXT, GROUP_CONCAT(CLONGTEXT) from datatypetestm group by cidx, CLONGTEXT order by cidx;

      Attachments

        1. dttCreateTable_c.sql
          0.9 kB
          Daniel Lee
        2. dttInsertRowsMidValues.sql
          4 kB
          Daniel Lee

        Issue Links

          Activity

            People

              dleeyh Daniel Lee (Inactive)
              dleeyh Daniel Lee (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.