Details
-
Task
-
Status: Closed (View Workflow)
-
Major
-
Resolution: Fixed
-
None
-
10.2.0-5, 10.2.0-6, 10.2.0-7, 10.2.0-8, 10.2.2-1, 10.2.2-2, 10.2.2-3, 10.2.2-4
Description
There is a class of window functions that can be computed on the fly, after ordering. These functions are:
rank(DONE)dense_rank(DONE)row_number(DONE)first_value (this is frame-based)(DONE)
These functions can be computed directly. In order to do this we must:
- Sort the rows.
- Detect partition boundaries (on the fly as well)
- Given partition boundaries, compute the corresponding function value, for each row.
Two-pass window functions:
percent_rank (test implementation needs review)cume_dist (seeMDEV-9746)ntilenth_value (this is frame-based)(DONE)last_value (this is frame-based)(DONE)
these require two passes over partition to compute. The extra information that we require is the number of rows in the partition. In order to find the number of rows, we must first detect partition boundaries and then we can compute the number of rows per partition.
Two-cursor window functions:
lag(DONE)lead(DONE)
these require an additional cursor that is traveling n rows ahead/behind the current_row cursor.
Key pieces for implementing this:
- Make use of the filesort interface, since we do not need temporary tables for these functions.
- It is a very similar use case to the GROUP BY statement. An important task is figuring out partition boundaries. The classes used for computing GROUP BY, might prove useful.
Attachments
Issue Links
- relates to
-
-
- Closed
-
Activity
Overview of the solution sketch that was pushed into 10.1-window branch:
JOIN::exec has a piece of code that detects that
- the select uses one table
- all windowing functions have the same ORDER BY clause
- all windowing functions allow for streaming computation
if this is the case
- it runs filesort() to sort the source table in the required ordering
- then, end_send() has a code that calls func->advance_window() for
all window function items
then
+void Item_window_func::advance_window() {
|
+ int changed = test_if_group_changed(partition_fields);
|
+
|
+ if (changed > -1) {
|
+ window_func->clear();
|
+ }
|
+ window_func->add();
|
+}
|
and this computes the window function. It is done on the fly.
¿Is possible to use Window Functions over columns which contain Aggregate Functions (For example: count(Column_Name)?
SELECT
count(Column_Name) AS MyCount,
PERCENT_RANK() OVER (MyCount)
FROM
myTable;
psergeyigorsanja