[MCOL-209] DBT3 Benchmark against InfiniDB Created: 2016-06-28  Updated: 2017-01-04  Resolved: 2017-01-04

Status: Closed
Project: MariaDB ColumnStore
Component/s: ExeMgr
Affects Version/s: None
Fix Version/s: 1.0.6.1

Type: Task Priority: Major
Reporter: Dipti Joshi (Inactive) Assignee: Daniel Lee (Inactive)
Resolution: Done Votes: 0
Labels: None

Issue Links:
Blocks
is blocked by MCOL-211 Resource Planning for DBT3 benchmarking Closed
PartOf
is part of MCOL-280 Beta issues Closed
Epic Link: TPCH Benchmarking
Sprint: 1.0.2-2

 Description   

ColumnStore vs InfiniDB TPCH performance benchamark using 1TB, 10TB and 100TB datasets

This should be on single node and multi-node configuration for both ColumnStore and InfiniDB.



 Comments   
Comment by Daniel Lee (Inactive) [ 2016-10-31 ]

Build tested: 1.0.4 beta 1

For both Columnstore and InfiniDB, both queries 1 and 21 did not run for the 100gb database.
For InfiniDB, query 11 did not run for all 1, 10, 100gb databases
For queries 2, 3, 5, 7, 8, 12, 20, and 21 returned empty set and queries 17 and 19 returned null, which is incorrect results. These queries returned actual results and I believe this is because we fixed some bugs in 1.0.3 and 1.0.4. The elapsed time for these queries on InfiniDB were less than they supposed to be and affected the overall timeing. If we compare only queries with match results, performance numbers for both Columnstore and InfiniDB are virtually identical, ranging from 0.1% to 1.79%.

Comment by Daniel Lee (Inactive) [ 2017-01-04 ]

Build tested: 1.0.6-1 GA

Performed the above tests on the GA release.

Generated at Thu Feb 08 02:19:19 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.