|
I'll start off with saying we can't have two instances writing to the same table in the same PM. That would not be possible due to the architecture of ColumnStore. It works by appending blocks to a file and moving a HWM, so best case scenario the writes would be serialised in the PM and it would be hell to coordinate.
So, we could parallelise by having two instances write to two different PMs for the same table in parallel for the same transaction (since table locks are at the transaction level). But there is a problem here... Ultimately one of the two instances needs to close the transaction.
The part I haven't figured out is how to figure that out with the current API. The alternative I think is to have writeRow() with a parameter determining which PM the data should go to.
Ideas on what the API should look like are welcome here.
|