[MCOL-2107] execute tpc-ds performance test suite on dev v1.1.7 with purpose of regression performance testing Created: 2019-01-24  Updated: 2019-02-15  Resolved: 2019-01-28

Status: Closed
Project: MariaDB ColumnStore
Component/s: CI
Affects Version/s: None
Fix Version/s: 1.1.7

Type: Task Priority: Major
Reporter: Zdravelina Sokolovska (Inactive) Assignee: Zdravelina Sokolovska (Inactive)
Resolution: Fixed Votes: 0
Labels: None


 Description   

execute tpc-ds performance test suite on dev v1.1.7
with purpose of regression performance testing



 Comments   
Comment by Zdravelina Sokolovska (Inactive) [ 2019-01-28 ]

regression in comparison to old 1.1.x versions executed on the environment with the same hw capacity was not observed
load time is the same ; query mcs cold time statistics and mcs query warm time statistics
gathered with the tpc-ds supported query set do not show any significant difference
in comparison to the previous executes on such environment.
excluded query2 query4 query23 query29 query64 query75 query78 query95
due to " IDB-2003: Aggregation/Distinct memory limit is exceeded."
or "IDB-2001: Join or subselect exceeds memory limit." Internal errors
which break power test or are causing MCS system restarting for lack of memory.

updated sheets

https://docs.google.com/spreadsheets/d/1bkImloH6fHVJArx221z_3RJMLG8zQs9MVHkneYy0MSg/edit#gid=325151845

https://docs.google.com/spreadsheets/d/16yRblPOcDCtht3OOASx93phgat1p3dgE2xHRSKrLmro/edit#gid=827595034

https://docs.google.com/spreadsheets/d/16yRblPOcDCtht3OOASx93phgat1p3dgE2xHRSKrLmro/edit#gid=1702287313

https://docs.google.com/spreadsheets/d/1rLmD0dN6A5z4ypnJEZloTqePSNNAbpX__HP5CMEFlqU/edit#gid=1278512858

https://docs.google.com/spreadsheets/d/16yRblPOcDCtht3OOASx93phgat1p3dgE2xHRSKrLmro/edit#gid=553968149

https://docs.google.com/spreadsheets/d/1rLmD0dN6A5z4ypnJEZloTqePSNNAbpX__HP5CMEFlqU/edit#gid=1278512858

Generated at Thu Feb 08 02:33:47 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.