[MXS-4333] Allow engine selection for Kafka Importer Created: 2022-10-03  Updated: 2022-10-04  Resolved: 2022-10-04

Status: Closed
Project: MariaDB MaxScale
Component/s: N/A
Affects Version/s: None
Fix Version/s: 22.08.2

Type: New Feature Priority: Major
Reporter: Todd Stoffel (Inactive) Assignee: markus makela
Resolution: Fixed Votes: 0
Labels: None


 Description   

This defaults to InnoDB

https://mariadb.com/kb/en/mariadb-maxscale-2208-kafkaimporter/#overview

but as of 22.08.1, Columnstore now supports JSON functions and I imagine this will be compatible with Xpand at some point.

We need to add a variable that allows the end user to change the engine.



 Comments   
Comment by markus makela [ 2022-10-03 ]

This can already be done with the existing kafkaimporter if the names of the tables are known before they need to be created. The module creates the tables using CREATE TABLE IF NOT EXISTS to allow the users to modify the created table if it needs to be. The minimum requirements for the table is that there's a field named data in it into which JSON documents can be inserted.

The limitations on the data can be removed by either creating the table before the KafkaImporter is started, in which case the CREATE TABLE IF NOT EXISTS does nothing, or by altering the structure of the existing table. The minimum requirement that must be met is that the table contains the data field to which string values can be inserted into.

Comment by markus makela [ 2022-10-04 ]

Added the engine option which makes the storage engine configurable.

Generated at Thu Feb 08 04:27:53 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.