[MCOL-1171] Introduce benchmarks to test the performance with regards to jdbc Created: 2018-01-19  Updated: 2023-10-26  Resolved: 2018-01-24

Status: Closed
Project: MariaDB ColumnStore
Component/s: None
Affects Version/s: None
Fix Version/s: 1.1.3

Type: New Feature Priority: Minor
Reporter: Jens Röwekamp (Inactive) Assignee: Daniel Lee (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Sprint: 2018-02

 Description   

Benchmark the scala and python ColumnStoreExporter against jdbc and columnstore and jdbc and innodb.



 Comments   
Comment by Jens Röwekamp (Inactive) [ 2018-01-20 ]

Added benchmarks for Scala and Python2/3 comparing the API with JDBC's write to ColumnStore and JDBC's write to InnoDB.

For Scala execute ./gradlew benchmark
For Python execute ./benchmark.sh PATH_TO_MARIADB_JDBC_CLIENT_JAR
in the representative directories.

Currently the second benchmark creates a java.lang.OutOfMemoryError which is assumed to be caused by MCOL-1091.

Comment by Daniel Lee (Inactive) [ 2018-01-24 ]

Build verified: mariadb-columnstore-api

[root@localhost mariadb-columnstore-api]# git show
commit cb69ca0eafa218510f2d78a327b5d84641abe564
Merge: 55e181c ef3f3c0
Author: Andrew Hutchings <andrew@linuxjedi.co.uk>
Date: Mon Jan 22 15:03:34 2018 +0000

Merge pull request #40 from mariadb-corporation/MCOL-1171

Mcol 1171

Verified on Centos7 using the following steps:

sudo yum install python-pip pytest python34-setuptools python34-devel
sudo pip install --upgrade pip
sudo pip install mysql-connector==2.1.6 six pytest pyspark
sudo easy_install-3.4 pip
sudo pip3 install mysql-connector==2.1.6 pytest six pyspark
git clone https://github.com/mariadb-corporation/mariadb-columnstore-api.git
cd mariadb-columnstore-api
git checkout develop-1.1
scl enable devtoolset-4 bash
cmake -DTEST_RUNNER=ON -DSPARK_CONNECTOR=ON .
make
sudo make install
make test

[root@localhost mariadb-columnstore-api]# make test
Running tests...
Test project /root/build/mariadb-columnstore-api
Start 1: version
1/23 Test #1: version .......................... Passed 0.00 sec
Start 2: commit
2/23 Test #2: commit ........................... Passed 6.13 sec
Start 3: million-row
3/23 Test #3: million-row ...................... Passed 1.41 sec
Start 4: chained
4/23 Test #4: chained .......................... Passed 0.53 sec
Start 5: dataconvert-int
5/23 Test #5: dataconvert-int .................. Passed 0.95 sec
Start 6: dataconvert-double
6/23 Test #6: dataconvert-double ............... Passed 0.94 sec
Start 7: dataconvert-string
7/23 Test #7: dataconvert-string ............... Passed 1.04 sec
Start 8: dataconvert-datetime
8/23 Test #8: dataconvert-datetime ............. Passed 0.93 sec
Start 9: dataconvert-decimal
9/23 Test #9: dataconvert-decimal .............. Passed 2.15 sec
Start 10: dataconvert-null
10/23 Test #10: dataconvert-null ................. Passed 0.98 sec
Start 11: bad-usage
11/23 Test #11: bad-usage ........................ Passed 6.78 sec
Start 12: truncation
12/23 Test #12: truncation ....................... Passed 1.14 sec
Start 13: summary
13/23 Test #13: summary .......................... Passed 3.97 sec
Start 14: system-catalog
14/23 Test #14: system-catalog ................... Passed 0.27 sec
Start 15: char4
15/23 Test #15: char4 ............................ Passed 0.75 sec
Start 16: test_basic
16/23 Test #16: test_basic ....................... Passed 17.16 sec
Start 17: test_million_row
17/23 Test #17: test_million_row ................. Passed 4.63 sec
Start 18: test_basic_python3
18/23 Test #18: test_basic_python3 ............... Passed 17.00 sec
Start 19: test_million_row_python3
19/23 Test #19: test_million_row_python3 ......... Passed 9.56 sec
Start 20: Java_BasicTest
20/23 Test #20: Java_BasicTest ................... Passed 3.07 sec
Start 21: SparkScalaConnector_BasicTest
21/23 Test #21: SparkScalaConnector_BasicTest .... Passed 11.01 sec
Start 22: pythonColumnStoreExporter
22/23 Test #22: pythonColumnStoreExporter ........ Passed 4.89 sec
Start 23: python3ColumnStoreExporter
23/23 Test #23: python3ColumnStoreExporter ....... Passed 4.43 sec

100% tests passed, 0 tests failed out of 23

Total Test time (real) = 99.73 sec
[root@localhost mariadb-columnstore-api]#

Generated at Thu Feb 08 02:26:44 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.