Uploaded image for project: 'MariaDB ColumnStore'
  1. MariaDB ColumnStore
  2. MCOL-5177

Columnstore / libmarias3 treats HTTP response code 301 as successful

    XMLWordPrintable

Details

    Description

      Setup with S3 bucket in us-east-1 and configuration file for that bucket pointing to regioin us-west-2 (bucket region and endpoint) in columnstore.cnf

      Columnstore / StorageManager will treat this response code as if it was successful while not actually uploading any data to S3.

      [root@test8PM1 ~]# testS3Connection 
      StorageManager[4240]: Using the config file found at /etc/columnstore/storagemanager.cnf
      StorageManager[4240]: S3Storage: S3 connectivity & permissions are OK
      S3 Storage Manager Configuration OK
      

      running with debug from libmarias3

      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:127 URI: https://delete-this-today.s3.us-west-2.amazonaws.com/beb939a2-1645-4f9d-98ac-c81b05a174d5connectivity_test
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:388 Signature data1: PUT
      /beb939a2-1645-4f9d-98ac-c81b05a174d5connectivity_test
       
      host:delete-this-today.s3.us-west-2.amazonaws.com
      x-amz-content-sha256:6e340b9cffb37a989ca544e6bb780a2c78901d3fb33738768511a30617afa01d
      x-amz-date:20220805T210731Z
       
      host;x-amz-content-sha256;x-amz-date
      6e340b9cffb37a989ca544e6bb780a2c78901d3fb33738768511a30617afa01d
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:399 Signature data: PUT
      /beb939a2-1645-4f9d-98ac-c81b05a174d5connectivity_test
       
      host:delete-this-today.s3.us-west-2.amazonaws.com
      x-amz-content-sha256:6e340b9cffb37a989ca544e6bb780a2c78901d3fb33738768511a30617afa01d
      x-amz-date:20220805T210731Z
       
      host;x-amz-content-sha256;x-amz-date
      6e340b9cffb37a989ca544e6bb780a2c78901d3fb33738768511a30617afa01d
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:400 Signature: 7826abadfd14482d9a73c7f0dafb198f4b0709a77987d72b05ffd2b89cfd6c88
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:551 Data to sign: AWS4-HMAC-SHA256
      20220805T210731Z
      20220805/us-west-2/s3/aws4_request
      7826abadfd14482d9a73c7f0dafb198f4b0709a77987d72b05ffd2b89cfd6c88
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:605 Header: host:delete-this-today.s3.us-west-2.amazonaws.com
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:605 Header: x-amz-content-sha256:6e340b9cffb37a989ca544e6bb780a2c78901d3fb33738768511a30617afa01d
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:605 Header: x-amz-date:20220805T210731Z
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:605 Header: Authorization: AWS4-HMAC-SHA256 Credential=AKIA5437P37NAT7S44YY/20220805/us-west-2/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=a9dbc8ec25f9a1c31fbf0ddb4316ec0888087ec84c333a69bb95e1226558a920
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:605 Header: Transfer-Encoding:
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:605 Header: Content-Length:1
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 HTTP/1.1 301 Moved Permanently
       
       
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 x-amz-bucket-region: us-east-1
       
       
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 x-amz-request-id: TK9TQ482HG69TGAT
       
       
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 x-amz-id-2: gsaoTUJx7DxhcN1FvxxGZLEYXqFoWDsglLe4XqgcvufaFto6BhKrQe6H8RQUuUjevKBLkxgSbMc=
       
       
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 Content-Type: application/xml
       
       
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 Transfer-Encoding: chunked
       
       
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 Date: Fri, 05 Aug 2022 21:07:30 GMT
       
       
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 Server: AmazonS3
       
       
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 Connection: close
       
       
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:647 
       
       
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:705 Read 443 bytes, buffer 443 bytes
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:849 Response code: 301
      [libmarias3] /home/test/mariadb/mariadb-columnstore-engine/utils/libmarias3/libmarias3/src/request.c:127 URI: https://delete-this-today.s3.us-west-2.amazonaws.com/beb939a2-1645-4f9d-98ac-c81b05a174d5connectivity_test
      
      

      Attachments

        Activity

          People

            ben.thompson Ben Thompson (Inactive)
            ben.thompson Ben Thompson (Inactive)
            David Hall David Hall (Inactive)
            Daniel Lee Daniel Lee (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.