Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-16520

Out-Of-Memory running big aggregate query on Spider Engine

    XMLWordPrintable

Details

    Description

      When running 6 concurrent queries (2 queries per 3 tables) the mysqld process gets killed by the OOM killer.

      The queries was:

      select min(id), max(id), avg(id), sum(id), min(id2), max(id2), avg(id2), sum(id2), count(*) FROM t2; -- Finished
      		 
      select min(id), max(id), avg(id), sum(id), min(id2), max(id2), avg(id2), sum(id2), count(*) FROM t3;
      		 
      select min(id), max(id), avg(id), sum(id), count(*) FROM t1;
      		 
      select min(id), max(id), avg(id), bit_xor(id), min(id2), max(id2), avg(id2), bit_xor(id2), count(*) FROM t2; -- Finished
      		 
      select min(id), max(id), avg(id), bit_xor(id), min(id2), max(id2), avg(id2), bit_xor(id2), count(*) FROM t3;
      		 
      select min(id), max(id), avg(id), bit_xor(id), count(*) FROM t1;


      Where the tables has more than 100M rows.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MDEV-16249 CHECKSUM TABLE for a spider table is not parallel and saves all data in memory in the spider head by default

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-16279 Spider crashes on CHECKSUM TABLE with spider_quick_mode=3

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-16880 Provide checksum aggregate functions, and partition-level checksums

          • Major - Major loss of function.
          • Open

          Activity

            People

              Kentoku Kentoku Shiba (Inactive)
              mattiasjonsson Mattias Jonsson
              Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.