[MCOL-4811] COS() returns different last digit precision value for DECIMAL(38) column. Created: 2021-07-12  Updated: 2023-10-25  Resolved: 2023-10-25

Status: Closed
Project: MariaDB ColumnStore
Component/s: PrimProc
Affects Version/s: 6.1.1
Fix Version/s: Icebox

Type: Bug Priority: Major
Reporter: Gagan Goel (Inactive) Assignee: Unassigned
Resolution: Won't Fix Votes: 0
Labels: None

Issue Links:
Relates
relates to MCOL-641 Full DECIMAL support in ColumnStore Closed

 Description   

COS() function is returning different last digit precision value for Centos7 vs Centos8 for a DECIMAL(38) column:

On Centos8:

drop table if exists cs1;
 
create table cs1 (a decimal(38), b decimal(38) unsigned)engine=columnstore;
 
insert into cs1 values (-123456, 123456);
 
select cos(a), cos(b) from cs1;
 
+---------------------+---------------------+
 
| cos(a)              | cos(b)              |
 
+---------------------+---------------------+
 
| -0.6722948816565846 | -0.6722948816565846 |
 
+---------------------+---------------------+

On Centos7:

select cos(a), cos(b) from cs1;
 
+---------------------+---------------------+
 
| cos(a)              | cos(b)              |
 
+---------------------+---------------------+
 
| -0.6722948816565845 | -0.6722948816565845 |
 
+---------------------+---------------------+



 Comments   
Comment by Gagan Goel (Inactive) [ 2021-07-12 ]

Once this is fixed, be sure to update the MTR test: mysql-test/columnstore/basic/t/mcol641-functions.test

Generated at Thu Feb 08 02:53:11 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.