Details

    Description

      This task is a proposal to introduce new variables
      log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
      log_slow_queries_not_using_indexes_filter: filter based on task MDEV-7566
      log_slow_query_time: alias of long_query_time
      log_slow_throttle_queries_not_using_indexes; alias of log_throttle_queries_not_using_indexes introduced in 5.6
      log_slow_min_examined_row_limit: alias of min_examined_row_limit

      Attachments

        Issue Links

          Activity

            stephane@skysql.com VAROQUI Stephane created issue -
            stephane@skysql.com VAROQUI Stephane made changes -
            Field Original Value New Value
            stephane@skysql.com VAROQUI Stephane made changes -
            Description This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_verbosity=1 : filter based on task MDEV 7566
            log_slow_queries_not_using_indexes_verbosity=2 : log all plan as today
            log_slow_queries_timean alias of long_query_time
            This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_verbosity=1: filter based on task MDEV 7566
            log_slow_queries_not_using_indexes_verbosity=2: log all plan as today
            log_slow_queries_time: alias of long_query_time
            stephane@skysql.com VAROQUI Stephane made changes -
            Description This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_verbosity=1: filter based on task MDEV 7566
            log_slow_queries_not_using_indexes_verbosity=2: log all plan as today
            log_slow_queries_time: alias of long_query_time
            This task is a proposal to introduce new variables
            log_slow_query_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_query_not_using_indexes_verbosity=1: filter based on task MDEV 7566
            log_slow_query_not_using_indexes_verbosity=2: log all plan as today
            log_slow_query_time: alias of long_query_time
            log_slow_query_launch_time : alias of slow_launch_time
             
            stephane@skysql.com VAROQUI Stephane made changes -
            Description This task is a proposal to introduce new variables
            log_slow_query_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_query_not_using_indexes_verbosity=1: filter based on task MDEV 7566
            log_slow_query_not_using_indexes_verbosity=2: log all plan as today
            log_slow_query_time: alias of long_query_time
            log_slow_query_launch_time : alias of slow_launch_time
             
            This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_verbosity=1: filter based on task MDEV 7566
            log_slow_queries_not_using_indexes_verbosity=2: log all plan as today
            log_slow_query_time: alias of long_query_time
            stephane@skysql.com VAROQUI Stephane made changes -
            Summary rename slow queires variables rename slow queries variables
            stephane@skysql.com VAROQUI Stephane made changes -
            Description This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_verbosity=1: filter based on task MDEV 7566
            log_slow_queries_not_using_indexes_verbosity=2: log all plan as today
            log_slow_query_time: alias of long_query_time
            This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_verbosity=1: filter based on task MDEV 7566
            log_slow_queries_not_using_indexes_verbosity=2: log all plan as today
            log_slow_query_time: alias of long_query_time
            log_slow_throttle_queries_not_using_indexes; alias of log_throttle_queries_not_using_indexes introduced in 5.6
            stephane@skysql.com VAROQUI Stephane made changes -
            Description This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_verbosity=1: filter based on task MDEV 7566
            log_slow_queries_not_using_indexes_verbosity=2: log all plan as today
            log_slow_query_time: alias of long_query_time
            log_slow_throttle_queries_not_using_indexes; alias of log_throttle_queries_not_using_indexes introduced in 5.6
            This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_verbosity=1: filter based on task MDEV 7566
            log_slow_queries_not_using_indexes_verbosity=2: log all plan as today
            log_slow_query_time: alias of long_query_time
            log_slow_throttle_queries_not_using_indexes; alias of log_throttle_queries_not_using_indexes introduced in 5.6
            log_slow_min_examined_row_limit: alias of min_examined_row_limit
            stephane@skysql.com VAROQUI Stephane made changes -
            Description This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_verbosity=1: filter based on task MDEV 7566
            log_slow_queries_not_using_indexes_verbosity=2: log all plan as today
            log_slow_query_time: alias of long_query_time
            log_slow_throttle_queries_not_using_indexes; alias of log_throttle_queries_not_using_indexes introduced in 5.6
            log_slow_min_examined_row_limit: alias of min_examined_row_limit
            This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_verbosity: filter based on task MDEV 7566
            log_slow_query_time: alias of long_query_time
            log_slow_throttle_queries_not_using_indexes; alias of log_throttle_queries_not_using_indexes introduced in 5.6
            log_slow_min_examined_row_limit: alias of min_examined_row_limit
            stephane@skysql.com VAROQUI Stephane made changes -
            Description This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_verbosity: filter based on task MDEV 7566
            log_slow_query_time: alias of long_query_time
            log_slow_throttle_queries_not_using_indexes; alias of log_throttle_queries_not_using_indexes introduced in 5.6
            log_slow_min_examined_row_limit: alias of min_examined_row_limit
            This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_filter: filter based on task MDEV 7566
            log_slow_query_time: alias of long_query_time
            log_slow_throttle_queries_not_using_indexes; alias of log_throttle_queries_not_using_indexes introduced in 5.6
            log_slow_min_examined_row_limit: alias of min_examined_row_limit
            ratzpo Rasmus Johansson (Inactive) made changes -
            Workflow MariaDB v2 [ 59606 ] MariaDB v3 [ 61710 ]
            serg Sergei Golubchik made changes -
            Priority Major [ 3 ] Minor [ 4 ]
            greenman Ian Gilfillan made changes -
            Labels beginner-friendly
            serg Sergei Golubchik made changes -
            Description This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_filter: filter based on task MDEV 7566
            log_slow_query_time: alias of long_query_time
            log_slow_throttle_queries_not_using_indexes; alias of log_throttle_queries_not_using_indexes introduced in 5.6
            log_slow_min_examined_row_limit: alias of min_examined_row_limit
            This task is a proposal to introduce new variables
            log_slow_queries_not_using_indexes: alias of log_queries_not_using_indexes
            log_slow_queries_not_using_indexes_filter: filter based on task MDEV-7566
            log_slow_query_time: alias of long_query_time
            log_slow_throttle_queries_not_using_indexes; alias of log_throttle_queries_not_using_indexes introduced in 5.6
            log_slow_min_examined_row_limit: alias of min_examined_row_limit
            serg Sergei Golubchik made changes -
            Workflow MariaDB v3 [ 61710 ] MariaDB v4 [ 130312 ]

            The idea here seems to be to rename all variables relating to the slow query log such that they have the prefix "log_slow".

            The following is a list of variables I found to be related to the slow query log. The original variable names are on the left and the new aliases, if any, are on the right.

            log_queries_not_using_indexes - log_slow_queries_not_using_indexes
            log_slow_admin_statements
            log_slow_disabled_statements
            log_slow_filter
            log_slow_rate_limit
            log_slow_verbosity
            long_query_time - log_slow_query_time
            min_examined_row_limit - log_slow_min_examined_row_limit
            slow_query_log - log_slow_query_enable
            slow_query_log_file - log_slow_query_name

            qinmic Michael Qin (Inactive) added a comment - The idea here seems to be to rename all variables relating to the slow query log such that they have the prefix "log_slow". The following is a list of variables I found to be related to the slow query log. The original variable names are on the left and the new aliases, if any, are on the right. log_queries_not_using_indexes - log_slow_queries_not_using_indexes log_slow_admin_statements log_slow_disabled_statements log_slow_filter log_slow_rate_limit log_slow_verbosity long_query_time - log_slow_query_time min_examined_row_limit - log_slow_min_examined_row_limit slow_query_log - log_slow_query_enable slow_query_log_file - log_slow_query_name

            PR https://github.com/MariaDB/server/pull/2137 that implements this has been open since May 31st, 2022.

            otto Otto Kekäläinen added a comment - PR https://github.com/MariaDB/server/pull/2137 that implements this has been open since May 31st, 2022.

            This is generally a good idea.

            I'm a bit worried that we have no approach to dealing with aliases. I mean, new aliases are added, duplicates are left, "we'll solve it later, somehow".

            May be, something like

            • when a variable is renamed, an alias with the old name is created
            • aliases are not shown in I_S or on SHOW commands unless --old is used. Direct access via @@var works but produces a "deprecated" warning
            • when the last release where the old name was not an alias reaches EOL, the alias is removed.

            How does that sound?

            Note, this is not something that should be done in this MDEV, this is just a discussion

            serg Sergei Golubchik added a comment - This is generally a good idea. I'm a bit worried that we have no approach to dealing with aliases. I mean, new aliases are added, duplicates are left, "we'll solve it later, somehow". May be, something like when a variable is renamed, an alias with the old name is created aliases are not shown in I_S or on SHOW commands unless --old is used. Direct access via @@var works but produces a "deprecated" warning when the last release where the old name was not an alias reaches EOL, the alias is removed. How does that sound? Note, this is not something that should be done in this MDEV, this is just a discussion
            serg Sergei Golubchik made changes -
            Status Open [ 1 ] Needs Feedback [ 10501 ]
            greenman Ian Gilfillan added a comment -

            Sounds good. For the --old suggestion, I presume you mean an --old-mode option?

            greenman Ian Gilfillan added a comment - Sounds good. For the --old suggestion, I presume you mean an --old-mode option?

            right. a new old-mode value, which I didn't bother to find a name for

            serg Sergei Golubchik added a comment - right. a new old-mode value, which I didn't bother to find a name for

            I agree with the suggested approach for dealing with aliases, and can create a new ticket for it. The current PR for this ticket still needs a review.

            qinmic Michael Qin (Inactive) added a comment - I agree with the suggested approach for dealing with aliases, and can create a new ticket for it. The current PR for this ticket still needs a review.
            serg Sergei Golubchik made changes -
            Status Needs Feedback [ 10501 ] Open [ 1 ]
            serg Sergei Golubchik made changes -

            Why do you want an alias for an alias? --log-queries-not-using-indexes is already an alias for --log-slow-filter=not_using_index. I don't see why you need to create --log-slow-queries-not-using-indexes.

            serg Sergei Golubchik added a comment - Why do you want an alias for an alias? --log-queries-not-using-indexes is already an alias for --log-slow-filter=not_using_index . I don't see why you need to create --log-slow-queries-not-using-indexes .
            serg Sergei Golubchik made changes -
            Assignee Sergei Golubchik [ serg ]
            serg Sergei Golubchik made changes -
            Fix Version/s 10.10 [ 27530 ]
            serg Sergei Golubchik made changes -
            Status Open [ 1 ] In Progress [ 3 ]
            serg Sergei Golubchik made changes -
            Status In Progress [ 3 ] In Review [ 10002 ]

            The idea for that alias and the new aliases in general is to add the prefix log_slow and eventually deprecate old ones like --log-queries-not-using-indexes

            qinmic Michael Qin (Inactive) added a comment - The idea for that alias and the new aliases in general is to add the prefix log_slow and eventually deprecate old ones like --log-queries-not-using-indexes
            serg Sergei Golubchik added a comment - - edited

            I understand that. But *-queries-not-using-indexes is going to be eventually deprecated anyway, with any prefix.
            I'd say, there is no need to create a deprecated alias for an already deprecated option.

            serg Sergei Golubchik added a comment - - edited I understand that. But *-queries-not-using-indexes is going to be eventually deprecated anyway, with any prefix. I'd say, there is no need to create a deprecated alias for an already deprecated option.
            ralf.gebhardt Ralf Gebhardt made changes -
            Fix Version/s 10.11 [ 27614 ]
            Fix Version/s 10.10 [ 27530 ]

            also, log_slow_query_enable would be the first variable using xxx_enable naming pattern. Wouldn't it be more consistent to name it just log_slow_query ?

            serg Sergei Golubchik added a comment - also, log_slow_query_enable would be the first variable using xxx_enable naming pattern. Wouldn't it be more consistent to name it just log_slow_query ?
            serg Sergei Golubchik made changes -
            Priority Minor [ 4 ] Critical [ 2 ]
            serg Sergei Golubchik made changes -
            Status In Review [ 10002 ] In Testing [ 10301 ]
            serg Sergei Golubchik made changes -
            Assignee Sergei Golubchik [ serg ] Elena Stepanova [ elenst ]

            bb-10.11-MDEV-7567

            serg Sergei Golubchik added a comment - bb-10.11- MDEV-7567
            elenst Elena Stepanova added a comment - - edited

            There was some back-and-forth in this task, so, to summarize, as of bb-10.11-MDEV-7567 3b3ce1fbca here is what is de-facto there:

            log_slow_min_examined_row_limit (min_examined_row_limit)
            log_slow_query                  (slow_query_log)
            log_slow_query_file_name        (slow_query_log_file)
            log_slow_query_time             (long_query_time)
            

            It remains unclear what was the role-model for log_slow_query_file_name.
            We have a variety of patterns with similar meaning:
            general_log_file
            relay_log_info_file
            wsrep_status_file
            pid_file
            log_error
            log_bin_basename
            innodb_buffer_pool_filename

            but I couldn't find any %_file_name (maybe somewhere in optional plugins, those I didn't check).

            So, maybe it should be just log_slow_query_file, like several existing _file's. Or even just log_slow_file, given the variable list

            +---------------------------------+
            | log_slow_min_examined_row_limit |
            | log_slow_slave_statements       |
            | log_slow_query_time             |
            | log_slow_verbosity              |
            | log_slow_admin_statements       |
            | log_slow_disabled_statements    |
            | log_slow_query                  |
            | log_slow_query_file_name        |
            | log_slow_rate_limit             |
            | log_slow_filter                 |
            +---------------------------------+
            

            Filed as MDEV-29595 so that it's not forgotten, with an additional note for an extra fix in help text.

            elenst Elena Stepanova added a comment - - edited There was some back-and-forth in this task, so, to summarize, as of bb-10.11- MDEV-7567 3b3ce1fbca here is what is de-facto there: log_slow_min_examined_row_limit (min_examined_row_limit) log_slow_query (slow_query_log) log_slow_query_file_name (slow_query_log_file) log_slow_query_time (long_query_time) It remains unclear what was the role-model for log_slow_query_file_name . We have a variety of patterns with similar meaning: general_log_file relay_log_info_file wsrep_status_file pid_file log_error log_bin_basename innodb_buffer_pool_filename but I couldn't find any %_file_name (maybe somewhere in optional plugins, those I didn't check). So, maybe it should be just log_slow_query_file , like several existing _file 's. Or even just log_slow_file , given the variable list +---------------------------------+ | log_slow_min_examined_row_limit | | log_slow_slave_statements | | log_slow_query_time | | log_slow_verbosity | | log_slow_admin_statements | | log_slow_disabled_statements | | log_slow_query | | log_slow_query_file_name | | log_slow_rate_limit | | log_slow_filter | +---------------------------------+ Filed as MDEV-29595 so that it's not forgotten, with an additional note for an extra fix in help text.
            elenst Elena Stepanova made changes -
            elenst Elena Stepanova made changes -
            elenst Elena Stepanova made changes -

            There is an ambiguity in MDEV-29297 which, I think, may affect the approach to this task.
            If the idea of MDEV-29297 is that eventually the deprecated variables/options will start getting rejected, and server startup will start failing, then I think it would make sense to start deprecating (throwing a warning) about the old names of slow-log-related variables/options already now, not waiting for the total sweep in MDEV-29297. It wouldn't be unusual, we already have some deprecated variables here and there. The reason to rush is that slow-log-related options are old and quite widely used, it will take long time to get rid of them; the longer the period between the warning and startup abort, the more chance that the old configuration files will get amended in time.
            If, on the other hand, MDEV-29297 implies that the options will be accepted forever, despite the warnings and their absence in sysvars, then there is no such urgency.

            elenst Elena Stepanova added a comment - There is an ambiguity in MDEV-29297 which, I think, may affect the approach to this task. If the idea of MDEV-29297 is that eventually the deprecated variables/options will start getting rejected, and server startup will start failing, then I think it would make sense to start deprecating (throwing a warning) about the old names of slow-log-related variables/options already now, not waiting for the total sweep in MDEV-29297 . It wouldn't be unusual, we already have some deprecated variables here and there. The reason to rush is that slow-log-related options are old and quite widely used, it will take long time to get rid of them; the longer the period between the warning and startup abort, the more chance that the old configuration files will get amended in time. If, on the other hand, MDEV-29297 implies that the options will be accepted forever, despite the warnings and their absence in sysvars, then there is no such urgency.
            serg Sergei Golubchik made changes -
            elenst Elena Stepanova made changes -
            elenst Elena Stepanova made changes -
            elenst Elena Stepanova made changes -
            elenst Elena Stepanova made changes -
            elenst Elena Stepanova added a comment - - edited

            As of bb-10.11-MDEV-7567 957ac458a:

            • MDEV-29594 (32-bit test failures) – needs to be closed, as it's apparently fixed
            • MDEV-29626 (Assertion failure) – needs to be fixed
            • MDEV-29595, MDEV-29625 (names and uses) – need to be either fixed or demoted or closed as "won't fix"
            • MDEV-29598 (description reference) – optional

            Please reassign it back to me when all planned fixes are in and the branch is rebased, I'd like to take a look at the resulting status before it's pushed into main.

            elenst Elena Stepanova added a comment - - edited As of bb-10.11- MDEV-7567 957ac458a: MDEV-29594 (32-bit test failures) – needs to be closed, as it's apparently fixed MDEV-29626 (Assertion failure) – needs to be fixed MDEV-29595 , MDEV-29625 (names and uses) – need to be either fixed or demoted or closed as "won't fix" MDEV-29598 (description reference) – optional Please reassign it back to me when all planned fixes are in and the branch is rebased, I'd like to take a look at the resulting status before it's pushed into main.
            elenst Elena Stepanova made changes -
            Assignee Elena Stepanova [ elenst ] Sergei Golubchik [ serg ]
            Status In Testing [ 10301 ] Stalled [ 10000 ]
            serg Sergei Golubchik made changes -
            Status Stalled [ 10000 ] In Testing [ 10301 ]
            serg Sergei Golubchik made changes -
            Assignee Sergei Golubchik [ serg ] Elena Stepanova [ elenst ]
            elenst Elena Stepanova added a comment - - edited

            As of 36b42630:

            • the branch cannot be pushed into main as it fails in buildbot with numerous mismatches (result files not updated) and MTR aborts before all tests have been run. It needs to be fixed;
            • comment in MDEV-29625:

              From the list in the description, mariadb-report, mysqldumpslow.sh and mysql_client_test remained unchanged. Is it intentional?

              It doesn't necessarily have to be fixed, but needs to be clarified.

            Please reassign it back to me when all planned fixes are in and the branch is rebased.

            elenst Elena Stepanova added a comment - - edited As of 36b42630 : the branch cannot be pushed into main as it fails in buildbot with numerous mismatches (result files not updated) and MTR aborts before all tests have been run. It needs to be fixed; comment in MDEV-29625 : From the list in the description, mariadb-report, mysqldumpslow.sh and mysql_client_test remained unchanged. Is it intentional? It doesn't necessarily have to be fixed, but needs to be clarified. Please reassign it back to me when all planned fixes are in and the branch is rebased.
            elenst Elena Stepanova made changes -
            Assignee Elena Stepanova [ elenst ] Sergei Golubchik [ serg ]
            Status In Testing [ 10301 ] Stalled [ 10000 ]
            serg Sergei Golubchik made changes -
            Assignee Sergei Golubchik [ serg ] Elena Stepanova [ elenst ]
            serg Sergei Golubchik made changes -
            Status Stalled [ 10000 ] In Testing [ 10301 ]
            elenst Elena Stepanova made changes -

            In my opinion bb-10.11-MDEV-7567 as of 27b7d5d can be pushed into 10.11 main and released with 10.11.1.

            The final change is:

            new name old alias
            log_slow_min_examined_row_limit min_examined_row_limit
            log_slow_query slow_query_log
            log_slow_query_file slow_query_log_file
            log_slow_query_time long_query_time

            The new variables are already documented in the KB, with a minor error to fix MDEV-29689.

            elenst Elena Stepanova added a comment - In my opinion bb-10.11- MDEV-7567 as of 27b7d5d can be pushed into 10.11 main and released with 10.11.1. The final change is: new name old alias log_slow_min_examined_row_limit min_examined_row_limit log_slow_query slow_query_log log_slow_query_file slow_query_log_file log_slow_query_time long_query_time The new variables are already documented in the KB, with a minor error to fix MDEV-29689 .
            elenst Elena Stepanova made changes -
            Assignee Elena Stepanova [ elenst ] Sergei Golubchik [ serg ]
            Status In Testing [ 10301 ] Stalled [ 10000 ]
            serg Sergei Golubchik made changes -
            Fix Version/s 10.11.1 [ 28454 ]
            Fix Version/s 10.11 [ 27614 ]
            Resolution Fixed [ 1 ]
            Status Stalled [ 10000 ] Closed [ 6 ]
            ralf.gebhardt Ralf Gebhardt made changes -
            Labels beginner-friendly Preview_10.11 beginner-friendly

            People

              serg Sergei Golubchik
              stephane@skysql.com VAROQUI Stephane
              Votes:
              3 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.