Need to stream the binary logs directly to S3 bucket without storing locally.
This is new feature request please let me know your thoughts.
I have tested this in my test environment like below,
Step 1 :
Created new S3 bucket and provided all access to that bucket.
Step 2 :
Installed the maxscale 6 and configured binlog router.
Step 3 :
Then locally mounted that S3 bucket on my maxscale server.
Step 4 :
Added this mount path in my maxscale config.
Start the maxscale service. Now binlogs are stored to S3 bucket.
Problem statement 1 :
The streaming speed is too slow compared to local storage. I loaded some data using sysbench but it's taking more time stream to S3 bucket. The transfer speed is 4MB and it's streaming single threaded.
Is it possible to stream the binlogs without mounting locally ? or how can we speed up this process using binlog router.
Problem statement 2 :
If unexpectedly my maxscale crashes it removes existing binlogs from S3 bucket.