[#MDEV-22556] Incorrect result for window function when using encrypt-tmp-files=ON

Here is the mtr test case:

source include/have_file_key_management_plugin.inc;

source include/have_sequence.inc;

source include/have_innodb.inc;

select @@encrypt_tmp_files;

set sort_buffer_size= 2000;

create table t1( a DECIMAL(12,0) DEFAULT NULL, b VARCHAR(20) DEFAULT NULL, c DECIMAL(12,0) DEFAULT NULL)engine=INNODB;

insert into t1 select seq, seq, seq from seq_1_to_5000;

select count(*) from (select a, b, c, ROW_NUMBER() OVER (PARTITION BY a) FROM t1)q;

drop table t1;

and the opt file used is

--encrypt-tmp-files=ON

--loose-file-key-management-encryption-algorithm=aes_cbc

--file-key-management=FORCE

--loose-file-key-management-filename=$MTR_SUITE_DIR/t/filekeys-data.enc

--loose-file-key-management-filekey=FILE:$MTR_SUITE_DIR/t/filekeys-data.key

The result of the query is

MariaDB [test]> select count(*) from (select a, b, c, ROW_NUMBER() OVER (PARTITION BY a) FROM t1)q;

+----------+

| count(*) |

+----------+

|     4096 |

+----------+

1 row in set (0.373 sec)

Now lets run the query with encrypt-tmp-files=OFF

MariaDB [test]> select @@encrypt_tmp_files;

+---------------------+

| @@encrypt_tmp_files |

+---------------------+

|                   0 |

+---------------------+

1 row in set (0.001 sec)

and re run the query

MariaDB [test]> select count(*) from (select a, b, c, ROW_NUMBER() OVER (PARTITION BY a) FROM t1)q;

+----------+

| count(*) |

+----------+

|     5000 |

+----------+

1 row in set (0.378 sec)

The result returned with encrypt-tmp-files=OFF is correct. The table t1 has 5k rows.

[MDEV-22556] Incorrect result for window function when using encrypt-tmp-files=ON Created: 2020-05-14 Updated: 2020-10-02 Resolved: 2020-05-17
Status:	Closed
Project:	MariaDB Server
Component/s:	Encryption, Optimizer
Affects Version/s:	10.4
Fix Version/s:	10.5.4, 10.4.14