[MCOL-3953] 1.4.3 Columnstore Amazon install doesnt work when using existing EBS for dbroot Created: 2020-04-20  Updated: 2021-01-15  Resolved: 2021-01-15

Status: Closed
Project: MariaDB ColumnStore
Component/s: N/A
Affects Version/s: 1.4.3
Fix Version/s: N/A

Type: Bug Priority: Critical
Reporter: David Hill (Inactive) Assignee: Unassigned
Resolution: Won't Do Votes: 0
Labels: None
Environment:

Amazon EC2 with EBS setup



 Description   

Reported by customer and reproduced. Customer trying to install 1.4.3 using the Amazon EC2 setup using the Amazon AWS CLI Tools option with EBS storage. This is something that has been support in older versions, like 1.1 and 1.2. Customer tried it in 1.4 and it didnt work. They created their own EBS storage to use for the DBRoot and it stop during postConfigure installation. I reproduced the same issue.

From customer:

Our Ansible script created the nodes and the volumes, but did not mount the volumes.
Running posrConfigure, seems to be stalled here:

----- Performance Module Configuration -----

Enter number of Performance Modules [1,1024] (1) > 2

      • Parent OAM Module Performance Module #1 Configuration ***

EC2 Instance ID for pm1: i-0305ac7f2227f09fa
Getting Private IP Address for Instance i-0305ac7f2227f09fa, please wait...
Private IP Address of i-0305ac7f2227f09fa is 10.233.53.251

Enter the list (Nx,Ny,Nz) or range (Nx-Nz) of DBRoot IDs assigned to module 'pm1' (1) >

      • Setup External EBS Volume for DBRoot #1 ***
      • NOTE: You have the option to provide an
        existing EBS Volume ID or have a Volume created

Create a new EBS volume for DBRoot #1 ? [y,n] > n
Enter Volume ID for 'DBRoot1' () > vol-0bafb96c44f52b3f6

  1. So this is where its is currently sitting.

----------------------------------------
In my testing using a single pm install

sudo /usr/bin/postConfigure

This is the MariaDB ColumnStore System Configuration and Installation tool.
It will Configure the MariaDB ColumnStore System and will perform a Package
Installation of all of the Servers within the System that is being configured.

IMPORTANT: This tool requires to run on the Performance Module #1

Prompting instructions:

Press 'enter' to accept a value in (), if available or
Enter one of the options within [], if available, or
Enter a new value

A copy of the MariaDB ColumnStore Configuration file has been saved during Package install.
It's Configured for a Multi-Server Install.
You have an option of utilizing the configuration data from that file or starting
with the MariaDB ColumnStore Configuration File that comes with the MariaDB ColumnStore Package.
You will only want to utilize the old configuration data when performing the same
type of install, i.e. Single or Multi-Server

Do you want to utilize the configuration data from the saved copy? [y,n] > n

===== Setup System Server Type Configuration =====

There are 2 options when configuring the System Server Type: single and multi

'single' - Single-Server install is used when there will only be 1 server configured
on the system. It can also be used for production systems, if the plan is
to stay single-server.

'multi' - Multi-Server install is used when you want to configure multiple servers now or
in the future. With Multi-Server install, you can still configure just 1 server
now and add on addition servers/modules in the future.

Select the type of System Server install [1=single, 2=multi] (2) > 2

===== Setup System Module Type Configuration =====

There are 2 options when configuring the System Module Type: separate and combined

'separate' - User and Performance functionality on separate servers.

'combined' - User and Performance functionality on the same server

Select the type of System Module Install [1=separate, 2=combined] (1) > 2

Combined Server Installation will be performed.
The Server will be configured as a Performance Module.
All MariaDB ColumnStore Processes will run on the Performance Modules.

NOTE: The MariaDB ColumnStore Schema Sync feature will replicate all of the
schemas and InnoDB tables across the User Module nodes. This feature can be enabled
or disabled, for example, if you wish to configure your own replication post installation.

MariaDB ColumnStore Schema Sync feature is Enabled, do you want to leave enabled? [y,n] >

NOTE: Amazon AWS CLI Tools are installed and allow MariaDB ColumnStore
to create Instances and EBS Volumes

Do you want to have ColumnStore use the Amazon AWS CLI Tools [y,n] >

NOTE: MariaDB ColumnStore Replication Feature is enabled

Enter System Name (columnstore-1) >

===== Setup Storage Configuration =====

----- Setup Performance Module DBRoot Data Storage Mount Configuration -----

Columnstore supports the following storage options...
1 - internal. This uses the linux VFS to access files and does
not manage the filesystem.
2 - external *. If you have other mountable filesystems you would
like ColumnStore to use & manage, select this option.
3 - GlusterFS * Note: glusterd service must be running and enabled on
all PMs.
4 - S3-compatible cloud storage *. Note: that should be configured
before running postConfigure (see storagemanager.cnf)

  • - This option enables data replication and server failover in a
    multi-node configuration.

These options are available on this system: [1, 2, 4]
Select the type of data storage (1) > 2

NOTE: The volume type. This can be gp2 for General Purpose SSD, io1 for
Provisioned IOPS SSD, st1 for Throughput Optimized HDD, sc1 for Cold
HDD, or standard for Magnetic volumes.

Enter EBS Volume Type (gp2, io1, sc1, st1, standard) : (gp2) >

Enter EBS Volume storage size in GB: [1,16384] (1) >

===== Setup Memory Configuration =====

NOTE: Setting 'NumBlocksPct' to 50%
Setting 'TotalUmMemory' to 25%

===== Setup the Module Configuration =====

Amazon Install: For Module Configuration, you have the option to provide the
existing Instance IDs or have the Instances created.
You will be prompted during the Module Configuration setup section.

----- Performance Module Configuration -----

Enter number of Performance Modules [1,1024] (1) >

      • Parent OAM Module Performance Module #1 Configuration ***

EC2 Instance ID for pm1: i-0467e8342d8796a01
Getting Private IP Address for Instance i-0467e8342d8796a01, please wait...
Private IP Address of i-0467e8342d8796a01 is 172.30.0.147

Enter the list (Nx,Ny,Nz) or range (Nx-Nz) of DBRoot IDs assigned to module 'pm1' (1) >

      • Setup External EBS Volume for DBRoot #1 ***
      • NOTE: You have the option to provide an
        existing EBS Volume ID or have a Volume created

Create a new EBS volume for DBRoot #1 ? [y,n] > n
Enter Volume ID for 'DBRoot1' () > vol-00854c297307deb39

STOPS HERE



 Comments   
Comment by David Hill (Inactive) [ 2020-04-23 ]

This issue is impacting a customers renawal process when trying to upgrade from 1.2 to 1.4. They are a long term use of Columnstore using the Amazon CLI APIs to utilitize EBS storage. This now seems to not work in 1.4.

Additional testing shows that this fails, when they use postConfigure to try to create a new EBS storage. Again it just sits at this location.

Columnstore supports the following storage options...
1 - internal. This uses the linux VFS to access files and does
not manage the filesystem.
2 - external *. If you have other mountable filesystems you would
like ColumnStore to use & manage, select this option.
3 - GlusterFS * Note: glusterd service must be running and enabled on
all PMs.
4 - S3-compatible cloud storage *. Note: that should be configured
before running postConfigure (see storagemanager.cnf)

  • - This option enables data replication and server failover in a
    multi-node configuration.

These options are available on this system: [1, 2, 4]
Select the type of data storage (2) >

NOTE: The volume type. This can be gp2 for General Purpose SSD, io1 for
Provisioned IOPS SSD, st1 for Throughput Optimized HDD, sc1 for Cold
HDD, or standard for Magnetic volumes.

Enter EBS Volume Type (gp2, io1, sc1, st1, standard) : (gp2) >

Enter EBS Volume storage size in GB: [1,16384] (1) >

===== Setup Memory Configuration =====

NOTE: Setting 'NumBlocksPct' to 50%
Setting 'TotalUmMemory' to 25%

===== Setup the Module Configuration =====

Amazon Install: For Module Configuration, you have the option to provide the
existing Instance IDs or have the Instances created.
You will be prompted during the Module Configuration setup section.

----- Performance Module Configuration -----

Enter number of Performance Modules [1,1024] (1) >

      • Parent OAM Module Performance Module #1 Configuration ***

Enter EC2 Instance ID (i-0467e8342d8796a01) >
Getting Private IP Address for Instance i-0467e8342d8796a01, please wait...
Private IP Address of i-0467e8342d8796a01 is 172.30.0.147

Enter the list (Nx,Ny,Nz) or range (Nx-Nz) of DBRoot IDs assigned to module 'pm1' (1) >

      • Setup External EBS Volume for DBRoot #1 ***
      • NOTE: You have the option to provide an
        existing EBS Volume ID or have a Volume created

Create a new EBS volume for DBRoot #1 ? [y,n] >
Create AWS Volume for DBRoot #1
Formatting DBRoot #1, please wait...

Comment by David Hill (Inactive) [ 2020-04-30 ]

With discussions with Project Management, it was determined that 1.4 S3 support with replace the previously supported EBS storage. With this being the case, postConfigure needs to be changed to remove the code that checks for the existing of the Amazon CLI API existence. When users answers the prompt that they want to utilizes this, that is where the option of using EBS storage happens.

Comment by Todd Stoffel (Inactive) [ 2021-01-15 ]

OAM deprecated.

Generated at Thu Feb 08 02:46:41 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.