Columnstore Hybrid Transactional Analytical Processing Improvements

This epic aims to evolve MariaDB ColumnStore HTAP (Hybrid Transactional and Analytical Processing) capabilities by enabling real-time analytical queries on fresh transactional data with minimal latency or duplication. The goal is to reduce the gap between OLTP and OLAP workloads, allowing users to run insights and dashboards on operational data with minimal complex ETL pipelines. To achieve this, we must lean into our deep integration with MariaDB Server, leveraging its transactional engine, planner, and ecosystem, to deliver a seamless and accessible HTAP solution that works out-of-the-box for the majority of users.

Key objectives include:

• Improve support for mixed workloads across transactional and columnar engines
• Enable low-latency ingestion with immediate query visibility
• Optimize query planner for hybrid joins and aggregations across engines
• Align data freshness and consistency guarantees between transactional and analytical paths
• Explore unified interfaces for accessing HTAP data in multi-engine environments ( Query Accelerator, Multi-Engine Table Partitioning etc.)

We will prioritize solutions that are easy for users to adopt and operate, favoring designs that require minimal configuration, no complex tooling, and work naturally within existing workflows, reaching the largest audience to benefit from.

This initiative will unlock simplified architectures for modern data applications by reducing the need for separate operational and analytical databases.