[MCOL-4583] S3 storage manager configuration error on Debian 9.1 and Ubuntu 18.04 Created: 2021-03-04  Updated: 2021-03-16  Resolved: 2021-03-15

Status: Closed
Project: MariaDB ColumnStore
Component/s: installation
Affects Version/s: 5.5.2
Fix Version/s: 5.6.1

Type: Bug Priority: Major
Reporter: Daniel Lee (Inactive) Assignee: Ben Thompson (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Sprint: 2021-4, 2021-5

 Description   

Build tested: 5.5.2-1 (Jenkin #1560)

NOTE:

There is another bug, MCOL-4582, opened and I am not sure these two are related. Even with MCOL-4582, S3 storage manager configuration worked on Debian 10 and Ubuntu 20.04. Please refer to MCOL-4582 for additional info.

When installing DEB packages on Debian 9.1 and Ubuntu 18.04, the following errors was reported and installation failed.

Configuration file '/etc/columnstore/storagemanager.cnf', does not exist on system.
s1pm1: Installing new config file as you requested.
s1pm1:
s1pm1: Configuration file '/etc/mysql/mariadb.conf.d/columnstore.cnf', does not exist on system.
s1pm1: Installing new config file as you requested.
s1pm1: checking for engine columnstore...
s1pm1: columnstore exists
s1pm1: S3 Storage Manager Configuration Error:
s1pm1: S3Storage: failed to PUT, check log files for specific error
s1pm1: There was an error validating the settings used to access S3.
s1pm1: The specified user or role must have GET, PUT, HEAD, and DELETE permissions to the bucket.
s1pm1: Verify the following environment variables are correct:
s1pm1: MCS_S3_BUCKET
s1pm1: MCS_S3_ENDPOINT
s1pm1: MCS_S3_ACCESS_KEY_ID
s1pm1: MCS_S3_SECRET_ACCESS_KEY
s1pm1: MCS_S3_REGION
s1pm1: MCS_S3_ROLE_NAME (optional)
s1pm1: MCS_S3_STS_REGION (optional)
s1pm1: MCS_S3_STS_ENDPOINT (optional)
s1pm1: After environment variables are fixed, run command: columnstore-post-install
s1pm1: dpkg: error processing package mariadb-plugin-columnstore (--install):
s1pm1: subprocess installed post-installation script returned error exit status 1

I made sure the environment variables are correct, as the same variables worked for other OSs.

On Debian 9.1

[debian9:root~]# ./columnstore-post-install
checking for engine columnstore...
columnstore exists
S3 Storage Manager Configuration Error:
S3Storage: failed to PUT, check log files for specific error
There was an error validating the settings used to access S3.
The specified user or role must have GET, PUT, HEAD, and DELETE permissions to the bucket.
Verify the following environment variables are correct:
MCS_S3_BUCKET
MCS_S3_ENDPOINT
MCS_S3_ACCESS_KEY_ID
MCS_S3_SECRET_ACCESS_KEY
MCS_S3_REGION
MCS_S3_ROLE_NAME (optional)
MCS_S3_STS_REGION (optional)
MCS_S3_STS_ENDPOINT (optional)
After environment variables are fixed, run command: columnstore-post-install

On Ubuntu 18.04

[ubuntu18:root~]# ./columnstore-post-install
There were authentication issues running install_mcs_mysql.sh script. The log is available in /var/log/mariadb/columnstore/install/mysql_install.log. Please re-run columnstore-post-install manually after solving the authentication issues.
There was an error installing MariaDB ColumnStore engine plugin. Continue to install the engine though. \
Please resolve the issues and run necessary scripts manually.
S3 Storage Manager Configuration Error:
S3Storage: failed to PUT, check log files for specific error
There was an error validating the settings used to access S3.
The specified user or role must have GET, PUT, HEAD, and DELETE permissions to the bucket.
Verify the following environment variables are correct:
MCS_S3_BUCKET
MCS_S3_ENDPOINT
MCS_S3_ACCESS_KEY_ID
MCS_S3_SECRET_ACCESS_KEY
MCS_S3_REGION
MCS_S3_ROLE_NAME (optional)
MCS_S3_STS_REGION (optional)
MCS_S3_STS_ENDPOINT (optional)
After environment variables are fixed, run command: columnstore-post-install

[ubuntu18:root~]# cat /var/log/mariadb/columnstore/install/mysql_install.log
ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: NO)
[ubuntu18:root~]#



 Comments   
Comment by Daniel Lee (Inactive) [ 2021-03-04 ]

I also made sure awscli is installed in the server under test.

Comment by Daniel Lee (Inactive) [ 2021-03-08 ]

This S3 issue is not related to MCOL-4582. For MCOL-4582, I changed my test script to use 'apt' instead of 'dpkg' to install DEB packages. The error message in MCOL-4582 no longer appearing. But the S3 issue described in this ticket still occurring.

Comment by Ben Thompson (Inactive) [ 2021-03-08 ]

I have no issues with this on Ubuntu18 installing with and without S3 enabled

Comment by Daniel Lee (Inactive) [ 2021-03-15 ]

Test environment issue. Issue resolved by:

1) Updated both Debian 9.1 and Ubuntu18.04 VMs
2) Corrected corrupted ca-certificate.crt file in Ubuntu18.04 VM

Generated at Thu Feb 08 02:51:27 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.