Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-20609

Full table scan in INFORMATION_SCHEMA.PARAMETERS/ROUTINES

Details

    Description

      It seems there is an issue when querying on I_S.PARAMETERS table (used in java metadata) :
      when doing this kind of query (one result) :
      SELECT * FROM INFORMATION_SCHEMA.PARAMETERS WHERE SPECIFIC_SCHEMA = 'testj' AND SPECIFIC_NAME = 'p2_512'
      It takes 15ms if 400 parameters in I_S.PARAMETERS table
      It takes 65ms if 4K parameters
      It takes 350ms if 20K parameters

      It seems to execute a full table scan in INFORMATION_SCHEMA.PARAMETERS

      The same query takes 6ms on mysql 8 with 20K same parameters

      Attachments

        1. mdev20609.diff
          8 kB
        2. screenshot-1.png
          screenshot-1.png
          5 kB
        3. screenshot-2.png
          screenshot-2.png
          18 kB

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. CONJ-684 Performance of con.getMetaData().getProcedureColumns(null, null, name, "%") is much lower than mysql jdbc

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-29550 Valgrind/MSAN uninitialised value errors upon SHOW PROCEDURE STATUS with condition on Db

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MDEV-29858 Missing DBUG_RETURN or DBUG_VOID_RETURN macro in function "fill_schema_proc"

          • Major - Major loss of function.
          • Closed
          is part of

          Task - A task that needs to be done. MDEV-29547 prepare 10.11.0 preview releases

          • Blocker - Blocks development and/or testing work, production could not run.
          • Closed
          relates to

          Task - A task that needs to be done. MDEV-28979 Feature Request: Allow for indexes to be created on the information_schema tables

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. MDEV-29104 Performance Issues Reading information_schema.PARAMETERS

          • Major - Major loss of function.
          • Closed

          Activity

            Ascending order - Click to sort in descending order
            diego dupin Diego Dupin created issue -
            diego dupin Diego Dupin made changes -
            Field Original Value New Value
            Description It seems there is an issue when querying on I_S.PARAMETERS table (used in java metadata) :
            when doing this kind of query (one result) :
            SELECT * FROM INFORMATION_SCHEMA.PARAMETERS WHERE SPECIFIC_SCHEMA = 'testj' AND SPECIFIC_NAME = 'p2_512'
            It takes 15ms if 400 parameters in I_S.PARAMETERS table
            It takes 65ms if 4K parameters
            It takes 350ms if 20K parameters

            The same query takes 6ms on mysql 8 with 20K same parameters
            		It seems there is an issue when querying on I_S.PARAMETERS table (used in java metadata) :
            when doing this kind of query (one result) :
            SELECT * FROM INFORMATION_SCHEMA.PARAMETERS WHERE SPECIFIC_SCHEMA = 'testj' AND SPECIFIC_NAME = 'p2_512'
            It takes 15ms if 400 parameters in I_S.PARAMETERS table
            It takes 65ms if 4K parameters
            It takes 350ms if 20K parameters

            It seems to execute a full table scan in INFORMATION_SCHEMA.PARAMETERS

            The same query takes 6ms on mysql 8 with 20K same parameters
            diego dupin Diego Dupin made changes -
            elenst Elena Stepanova made changes -
            Component/s Server [ 13907 ]
            Fix Version/s 10.1 [ 16100 ]
            Fix Version/s 10.2 [ 14601 ]
            Fix Version/s 10.3 [ 22126 ]
            Fix Version/s 10.4 [ 22408 ]
            Assignee Oleksandr Byelkin [ sanja ]
            diego dupin Diego Dupin made changes -
            Attachment screenshot-1.png [ 53698 ]
            diego dupin Diego Dupin made changes -
            Attachment screenshot-2.png [ 53699 ]
            diego dupin Diego Dupin made changes -
            Fix Version/s 10.5 [ 23123 ]
            julien.fritsch Julien Fritsch made changes -
            Fix Version/s 10.1 [ 16100 ]
            diego dupin Diego Dupin made changes -
            Labels CONNECTOR_RELATED
            psergei Sergei Petrunia made changes -
            Comment [ On first glance, it seems {{calc_lookup_values_from_cond}} can be used to infer the lookup value. ]
            psergei Sergei Petrunia made changes -
            Comment [ On first glance, it seems {{calc_lookup_values_from_cond}} can be used to infer the lookup value. ]
            psergei Sergei Petrunia made changes -
            Comment [ On first glance, it seems {{calc_lookup_values_from_cond}} can be used to infer the lookup value. ]
            serg Sergei Golubchik made changes -
            Workflow MariaDB v3 [ 99707 ] MariaDB v4 [ 141542 ]
            serg Sergei Golubchik made changes -
            Priority Major [ 3 ] Critical [ 2 ]
            serg Sergei Golubchik made changes -
            Priority Critical [ 2 ] Major [ 3 ]
            julien.fritsch Julien Fritsch made changes -
            Status Open [ 1 ] Confirmed [ 10101 ]
            ralf.gebhardt Ralf Gebhardt made changes -
            ccalender Chris Calender (Inactive) made changes -
            Priority Major [ 3 ] Critical [ 2 ]
            sanja Oleksandr Byelkin made changes -
            Status Confirmed [ 10101 ] In Progress [ 3 ]
            sanja Oleksandr Byelkin made changes -
            Status In Progress [ 3 ] Stalled [ 10000 ]
            sanja Oleksandr Byelkin made changes -
            Fix Version/s 10.11 [ 27614 ]
            Fix Version/s 10.2 [ 14601 ]
            Fix Version/s 10.3 [ 22126 ]
            Fix Version/s 10.4 [ 22408 ]
            Fix Version/s 10.5 [ 23123 ]
            sanja Oleksandr Byelkin made changes -
            Affects Version/s 10.2 [ 14601 ]
            Affects Version/s 10.3 [ 22126 ]
            Affects Version/s 10.4 [ 22408 ]
            Issue Type Bug [ 1 ] Task [ 3 ]
            sanja Oleksandr Byelkin made changes -
            Assignee Oleksandr Byelkin [ sanja ] Sergei Petrunia [ psergey ]
            psergei Sergei Petrunia made changes -
            serg Sergei Golubchik made changes -
            Attachment mdev20609.diff [ 64903 ]
            psergei Sergei Petrunia made changes -
            Assignee Sergei Petrunia [ psergey ] Oleg Smirnov [ JIRAUSER50405 ]
            oleg.smirnov Oleg Smirnov made changes -
            Status Stalled [ 10000 ] In Progress [ 3 ]
            julien.fritsch Julien Fritsch made changes -
            Summary Full table scan in INFORMATION_SCHEMA.PARAMETERS Full table scan in INFORMATION_SCHEMA.PARAMETERS
            oleg.smirnov Oleg Smirnov made changes -
            Summary Full table scan in INFORMATION_SCHEMA.PARAMETERS Full table scan in INFORMATION_SCHEMA.PARAMETERS/ROUTINES
            oleg.smirnov Oleg Smirnov made changes -
            Assignee Oleg Smirnov [ JIRAUSER50405 ] Sergei Petrunia [ psergey ]
            Status In Progress [ 3 ] In Review [ 10002 ]
            psergei Sergei Petrunia made changes -
            Status In Review [ 10002 ] Stalled [ 10000 ]
            psergei Sergei Petrunia made changes -
            Status Stalled [ 10000 ] In Testing [ 10301 ]
            psergei Sergei Petrunia made changes -
            Assignee Sergei Petrunia [ psergey ] Elena Stepanova [ elenst ]
            elenst Elena Stepanova made changes -
            elenst Elena Stepanova made changes -
            Assignee Elena Stepanova [ elenst ] Oleg Smirnov [ JIRAUSER50405 ]
            Status In Testing [ 10301 ] Stalled [ 10000 ]
            oleg.smirnov Oleg Smirnov made changes -
            Status Stalled [ 10000 ] In Progress [ 3 ]
            oleg.smirnov Oleg Smirnov made changes -
            Status In Progress [ 3 ] In Testing [ 10301 ]
            oleg.smirnov Oleg Smirnov made changes -
            Assignee Oleg Smirnov [ JIRAUSER50405 ] Elena Stepanova [ elenst ]
            serg Sergei Golubchik made changes -
            elenst Elena Stepanova made changes -
            Assignee Elena Stepanova [ elenst ] Ramesh Sivaraman [ JIRAUSER48189 ]
            ramesh Ramesh Sivaraman made changes -
            Assignee Ramesh Sivaraman [ JIRAUSER48189 ] Oleg Smirnov [ JIRAUSER50405 ]
            Status In Testing [ 10301 ] Stalled [ 10000 ]
            oleg.smirnov Oleg Smirnov made changes -
            Fix Version/s 10.11.0 [ 28411 ]
            Fix Version/s 10.11 [ 27614 ]
            Resolution Fixed [ 1 ]
            Status Stalled [ 10000 ] Closed [ 6 ]
            elenst Elena Stepanova made changes -
            ralf.gebhardt Ralf Gebhardt made changes -
            Labels CONNECTOR_RELATED CONNECTOR_RELATED Preview_10.11
            mariadb-jira-automation Jira Automation (IT) made changes -
            Zendesk Related Tickets 164352 150968 150559

            People

              oleg.smirnov Oleg Smirnov
              diego dupin Diego Dupin
              Votes:
              2 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.