As an example, the table described below took 2 seconds to create and load 188 records on ColumnStore 1.2.5 and 23 seconds on MariaDB X5 10.5.6 Both tests used LOAD DATA LOCAL INFILE statements. That indicates our ETL process will take 11x longer to complete on MariaDB X5. This is a serious performance issue.
CREATE TABLE `areas` (
`id` int(11) NOT NULL,
`name` varchar(255) NOT NULL,
`deleted_at` datetime DEFAULT NULL,
`created_at` datetime DEFAULT NULL,
`updated_at` datetime DEFAULT NULL,
`lock_version` int(11) NOT NULL DEFAULT 0
) ENGINE=Columnstore DEFAULT CHARSET=utf8;
The table definition is the same on both systems.
The same data was loaded into each table.
> select count
from areas;
----------
| count |
----------
| 188 |
----------
The ColumnStore cluster has 1 um and 2 pm nodes. The MariaDB X5 system has 3 nodes running MaxScale in front of the pm's.