SparkConnector runs out of memory for large datasets, JDBC can handle the datasets just fine

Both Scala and Python run out of memory while exporting large datasets to ColumnStore using their respective benchmark scripts.

Contrary JDBC handles the same datasets well and writes them to ColumnStore without major increases in memory demand.

Need to investigate the source of the huge demand of memory in the SparkConnector and reduce it if possible.