[MDEV-4308] DBT-3 Q1 benchmark: Check/profile reduced queries Created: 2013-03-20  Updated: 2014-04-12  Resolved: 2014-04-12

Status: Closed
Project: MariaDB Server
Component/s: None
Fix Version/s: None

Type: Task Priority: Minor
Reporter: Sergei Petrunia Assignee: Axel Schwenke
Resolution: Fixed Votes: 0
Labels: benchmarking, dbt-3

Attachments: File dbt3-q1a-profiles-mar21.ods     File q1simple-mar21.ods    
Issue Links:
PartOf
is part of MDEV-4150 Benchmark *execution* speed of simple... Closed

 Description   

Axel,

we're now in the same situation as we were in the previous iteration. In order to narrow down the problem, I need to get benchmark results and profiles for the simplified queries.

The queries are provided below; they should be ran on MyISAM, multiple times. Please check MariaDB 5.5 (with "the fix"), MariaDB 5.3, and MySQL 5.5.

I need profiles also. If one can observe a meaningful difference between different versions, please pick the runs that show the difference.

The queries:

explain
 
select
 
        sum(l_quantity) as sum_qty,
 
        sum(l_extendedprice) as sum_base_price,
 
        sum(l_extendedprice * (1 - l_discount)) as sum_disc_price,
 
        sum(l_extendedprice * (1 - l_discount) * (1 + l_tax)) as sum_charge,
 
        avg(l_quantity) as avg_qty,
 
        avg(l_extendedprice) as avg_price,
 
        avg(l_discount) as avg_disc,
 
        count(*) as count_order
 
from
 
        lineitem;
 
 
 

select
 
        sum(l_quantity) as sum_qty
 
from
 
        lineitem;



 Comments   
Comment by Sergei Petrunia [ 2013-03-21 ]

Profiles data from Axel. Built some more charts.

Comment by Sergei Petrunia [ 2013-03-21 ]

Q1a:
5.3.12 - 30.93
5.5.r-3696 - 34.36
MySQL-5.5.30 - 37.96

Q1b:
5.3.12 - 15.08
MySQL-5.5.30 - 15.53
5.5.r-3696 - 15.65

That is:

  • 5.3 is always the fastest.

For Q1b (the simplest query), MySQL 5.5 is the second, closely follwed by 5.5.

For Q1a, its other way around: MariaDB 5.5 is the second, and MySQL 5.5 is 3rd.

Comment by Axel Schwenke [ 2013-03-22 ]

Sergei, is there anything left to do for this task? Maybe running a different reduced 2nd query?

Comment by Sergei Petrunia [ 2013-03-22 ]

Axel,

right now, I am not sure if I need a different reduced query. Let's look at results of MDEV-4309 and then decide.

Comment by Sergei Petrunia [ 2013-03-25 ]

Reduced priority - don't know if we need to dig further in the profiles. For virtual call removal, it would be nice to finish with MDEV-4309 first.

Comment by Sergei Petrunia [ 2014-04-12 ]

Closing as MDEV-4309 has been closed.

Generated at Thu Feb 08 06:55:25 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.