[MCOL-5177] Columnstore / libmarias3 treats HTTP response code 301 as successful Created: 2022-08-05  Updated: 2023-02-06  Resolved: 2022-10-19

Status: Closed
Project: MariaDB ColumnStore
Component/s: Storage Manager
Affects Version/s: 6.4.1
Fix Version/s: 22.08.8

Type: Bug Priority: Major
Reporter: Ben Thompson (Inactive) Assignee: Ben Thompson (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Assigned for Review: David Hall David Hall (Inactive)
Assigned for Testing: Daniel Lee Daniel Lee (Inactive)

 Description   

Setup with S3 bucket in us-east-1 and configuration file for that bucket pointing to regioin us-west-2 (bucket region and endpoint) in columnstore.cnf

Columnstore / StorageManager will treat this response code as if it was successful while not actually uploading any data to S3.

[root@test8PM1 ~]# testS3Connection 
StorageManager[4240]: Using the config file found at /etc/columnstore/storagemanager.cnf
 
StorageManager[4240]: S3Storage: S3 connectivity & permissions are OK
 
S3 Storage Manager Configuration OK

running with debug from libmarias3

[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:127 URI: https://delete-this-today.s3.us-west-2.amazonaws.com/beb939a2-1645-4f9d-98ac-c81b05a174d5connectivity_test
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:388 Signature data1: PUT
 
/beb939a2-1645-4f9d-98ac-c81b05a174d5connectivity_test
 
 
 
host:delete-this-today.s3.us-west-2.amazonaws.com
 
x-amz-content-sha256:6e340b9cffb37a989ca544e6bb780a2c78901d3fb33738768511a30617afa01d
 
x-amz-date:20220805T210731Z
 
 
 
host;x-amz-content-sha256;x-amz-date
 
6e340b9cffb37a989ca544e6bb780a2c78901d3fb33738768511a30617afa01d
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:399 Signature data: PUT
 
/beb939a2-1645-4f9d-98ac-c81b05a174d5connectivity_test
 
 
 
host:delete-this-today.s3.us-west-2.amazonaws.com
 
x-amz-content-sha256:6e340b9cffb37a989ca544e6bb780a2c78901d3fb33738768511a30617afa01d
 
x-amz-date:20220805T210731Z
 
 
 
host;x-amz-content-sha256;x-amz-date
 
6e340b9cffb37a989ca544e6bb780a2c78901d3fb33738768511a30617afa01d
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:400 Signature: 7826abadfd14482d9a73c7f0dafb198f4b0709a77987d72b05ffd2b89cfd6c88
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:551 Data to sign: AWS4-HMAC-SHA256
 
20220805T210731Z
 
20220805/us-west-2/s3/aws4_request
 
7826abadfd14482d9a73c7f0dafb198f4b0709a77987d72b05ffd2b89cfd6c88
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:605 Header: host:delete-this-today.s3.us-west-2.amazonaws.com
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:605 Header: x-amz-content-sha256:6e340b9cffb37a989ca544e6bb780a2c78901d3fb33738768511a30617afa01d
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:605 Header: x-amz-date:20220805T210731Z
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:605 Header: Authorization: AWS4-HMAC-SHA256 Credential=AKIA5437P37NAT7S44YY/20220805/us-west-2/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=a9dbc8ec25f9a1c31fbf0ddb4316ec0888087ec84c333a69bb95e1226558a920
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:605 Header: Transfer-Encoding:
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:605 Header: Content-Length:1
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 HTTP/1.1 301 Moved Permanently
 
 
 
 
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 x-amz-bucket-region: us-east-1
 
 
 
 
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 x-amz-request-id: TK9TQ482HG69TGAT
 
 
 
 
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 x-amz-id-2: gsaoTUJx7DxhcN1FvxxGZLEYXqFoWDsglLe4XqgcvufaFto6BhKrQe6H8RQUuUjevKBLkxgSbMc=
 
 
 
 
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 Content-Type: application/xml
 
 
 
 
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 Transfer-Encoding: chunked
 
 
 
 
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 Date: Fri, 05 Aug 2022 21:07:30 GMT
 
 
 
 
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 Server: AmazonS3
 
 
 
 
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 Connection: close
 
 
 
 
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 
 
 
 
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:705 Read 443 bytes, buffer 443 bytes
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:849 Response code: 301
 
[libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:127 URI: https://delete-this-today.s3.us-west-2.amazonaws.com/beb939a2-1645-4f9d-98ac-c81b05a174d5connectivity_test



 Comments   
Comment by Daniel Lee (Inactive) [ 2022-10-19 ]

Build verified: develop (5758)

Error will return when region and endpoint are not pointing to the same region.

Generated at Thu Feb 08 02:55:55 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.