[MCOL-770] support pre-installed software in postConfigure and addModule - phase 2 Created: 2017-06-13  Updated: 2023-10-26  Resolved: 2017-09-18

Status: Closed
Project: MariaDB ColumnStore
Component/s: ?
Affects Version/s: 1.1.0
Fix Version/s: 1.1.0

Type: New Feature Priority: Major
Reporter: David Hill (Inactive) Assignee: Daniel Lee (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Sprint: 2017-12, 2017-13, 2017-14, 2017-15, 2017-16, 2017-17, 2017-18

 Description   

This feature is being in 2 parts - phase 1 required the user to preinstall the software and postConfigure and procmgr (addModule) would do the software install part, but would still send messages to the new node to set it up.

Phase 2 - remove the constraint of postConfigure and addModule to communicate with the new module to set it up. Looks at these options for phase 2

1. have the user manually do some scripts that would do the setup after he has installed the software
2. put the logic in ProcMon for it to do the setup on a newly installed server when it starts up. Procmon already will request a copy of the Columnstore.xml file at startup.



 Comments   
Comment by David Hill (Inactive) [ 2017-06-19 ]

I'm trying out option 2 where ProcMon will do the setup on a newly installed node once it detects that Procmgr is up on the pm1 node. If this works, user would just need to do the following to setup the non-pm1 nodes

1. install packages (if binary, run post-install)
2. start the columnstore service

Comment by David Hill (Inactive) [ 2017-06-29 ]

spent a of time this week working on getting the new changes working in amazon world. did a lot of addmodules and dbroot commands. That is looking good now.

rebuilding with the amazon changes and will retest the binary/rpm installs on centos and then will test on debian versions.

Comment by David Hill (Inactive) [ 2017-06-30 ]

MCOL-770 pull request

Comment by David Hill (Inactive) [ 2017-07-03 ]

one thing that changed between phase 1 and 2 on the non-distributed install is now no ssh/scp or anything of messaging happens between postConfigure and the remote nodes. So this means that it will not do any verification if the packages and the version of package that is installed. That is still being done in ProcMon/ProcMgr.

Comment by David Hill (Inactive) [ 2017-07-05 ]

still doing some develop testing before hand off to QA

Comment by David Hill (Inactive) [ 2017-07-05 ]

for non-distributed installs on remote nodes, just need to install packages and start the service.

This is also a new message that comes out when post-install runs:

./post-install
The next step is:

If installing on a pm1 node:

/usr/local/mariadb/columnstore/bin/postConfigure

If installing on a non-pm1 using the non-distrubuted option:

/usr/local/mariadb/columnstore/bin/columnstore start

Comment by Daniel Lee (Inactive) [ 2017-07-06 ]

Build verified: Github source 1.1.0

[root@localhost mariadb-columnstore-server]# git show
commit 60f2f261f81d994307762d6d93380873513a0be8
Author: david hill <david.hill@mariadb.com>
Date: Tue Jun 20 16:05:32 2017 -0500

[root@localhost mariadb-columnstore-engine]# git show
commit 3601c344ba8eaedb7ed780eab5da4377db361b07
Author: david hill <david.hill@mariadb.com>
Date: Tue Jul 4 03:51:27 2017 -0500

Verified for Centos 7 binary installation only. We will need to test for other packages when 1.1.0 is to be released.

Comment by Daniel Lee (Inactive) [ 2017-09-14 ]

Build tested: 1.1.0-1

Performed the following tests, only ubuntu16.04 failed.

Passed /home/dlee/tests/1.1.0-1/centos6.7/root.bin.1um2pm.default.s1.n
Passed /home/dlee/tests/1.1.0-1/centos7/root.bin.1um2pm.default.s1.n
Passed /home/dlee/tests/1.1.0-1/suse12/root.bin.1um2pm.default.s1.n
Failed /home/dlee/tests/1.1.0-1/ubuntu16.04/root.bin.1um2pm.default.s1.n
Passed /home/dlee/tests/1.1.0-1/debian8.5/root.bin.1um2pm.default.s1.n
Passed /home/dlee/tests/1.1.0-1/debian9.1/root.bin.1um2pm.default.s1.n

There is an issue with non-distributed installation for ubuntu16.04, binary. After installing the bin package on UM1.

/usr/local/mariadb/columnstore/bin/columnstore start
Please run the postConfigure install script, check the Installation Guide
for additional details

Comment by Daniel Lee (Inactive) [ 2017-09-15 ]

With 1.1.0-1 packages released last night, I centos6.7 failed with the same error, but ubuntu16.04 passed.

Failed with errors /home/dlee/tests/1.1.0-1/centos6.7/root.bin.1um2pm.default.n.s1
Passed /home/dlee/tests/1.1.0-1/centos7/root.bin.1um2pm.default.n.s1
Passed /home/dlee/tests/1.1.0-1/suse12/root.bin.1um2pm.default.n.s1
Passed /home/dlee/tests/1.1.0-1/ubuntu16.04/root.bin.1um2pm.default.n.s1
Passed /home/dlee/tests/1.1.0-1/debian8.5/root.bin.1um2pm.default.n.s1
Passed /home/dlee/tests/1.1.0-1/debian9.1/root.bin.1um2pm.default.n.s1

Comment by Daniel Lee (Inactive) [ 2017-09-18 ]

Build tested: 1.1.0 beta (packages released on Sun 09/17/2017 evening)

All non-distributed installation on all 6 supported OSs passed.

Generated at Thu Feb 08 02:23:42 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.