[MCOL-304] MariaDB ColumnStore Package Repository Created: 2016-09-20  Updated: 2020-05-04  Resolved: 2018-03-05

Status: Closed
Project: MariaDB ColumnStore
Component/s: Documentation
Affects Version/s: None
Fix Version/s: 1.1.3

Type: Task Priority: Major
Reporter: Dipti Joshi (Inactive) Assignee: David Hill (Inactive)
Resolution: Fixed Votes: 0
Labels: None
Environment:

CentOS 6, 7, Debian 7, 8, Ubuntu 14.04, 16.04, Suse 11, 12


Issue Links:
Duplicate
Relates
relates to MCOL-1136 Inconsistent engine typecode warning ... Closed
relates to MCOL-3942 Broken Repository URI for CentOS7 Closed
Sprint: 2016-24, 2016-25, 2017-01, 2017-2, 2017-3, 2017-4, 2017-5, 2017-6, 2017-7, 2017-8, 2017-9, 2017-10, 2017-11, 2017-12, 2017-13, 2017-14, 2017-15, 2017-16, 2017-17, 2017-18, 2017-19, 2017-20, 2017-21, 2017-22, 2017-23, 2017-24, 2017-25, 2018-01, 2018-02, 2018-03, 2018-04, 2018-05

 Description   

Create appropriate yum, apt, zypper repository.
Provide instructions to configure the repository access and installation from repository

See Example of how it is done for enterprise pacakge: https://mariadb.com/my_portal/download/10.1



 Comments   
Comment by David Thompson (Inactive) [ 2016-12-09 ]

When we push the builds to the download site can you make sure we use a directory structure like maxscale as this will help subsequent creation of the repo files.

Comment by David Hill (Inactive) [ 2016-12-14 ]

repor directories setup with DT review

Comment by David Thompson (Inactive) [ 2016-12-14 ]

Re-opening as we still need to do the actual package repo work.

Comment by David Thompson (Inactive) [ 2016-12-14 ]

removing fix version so can close the release though this is associated with 1.0.6.

Comment by David Hill (Inactive) [ 2017-04-19 ]

Progress - checking into this error

I have the repo setup on the Buildbot Master with rpms.

I'm trying to download to a centos 7 amazon instance and I'm getting this error. SO trying to figure this one out.

yum groupinstall "MariaDB ColumnStore"
Loaded plugins: priorities, update-motd, upgrade-helper
amzn-main/latest | 2.1 kB 00:00
amzn-main/latest/group | 35 kB 00:00
amzn-main/latest/primary_db | 3.6 MB 00:00
amzn-updates/latest | 2.3 kB 00:00
amzn-updates/latest/group | 35 kB 00:00
amzn-updates/latest/updateinfo | 376 kB 00:00
amzn-updates/latest/primary_db | 15 kB 00:00
http://x.x.x.x/repos/centos/7/x86_64/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404 Not Found"
Trying other mirror.

this the repo file on that server using the Elastic IP of the Master Instance. Can ping and I have http access setupo there.

[mariadb-columnstore]
name = MariaDB ColumnStore
baseurl = http://x.x.x.x/repos/centos/7/x86_64/
gpgkey=http://x.x.x.x/repos/RPM-GPG-KEY-MariaDB-ColumnStore
gpgcheck=1

file does exist on the master:

ll /repos/centos/7/x86_64/repodata/repomd.xml
rw-rr-. 1 root root 3700 Apr 19 09:11 /repos/centos/7/x86_64/repodata/repomd.xml

Comment by David Hill (Inactive) [ 2017-04-19 ]

UPDATE: resolved the file permissions issue...

Now the groupinstall is working...

yum groupinstall "MariaDB ColumnStore"
Loaded plugins: priorities, update-motd, upgrade-helper
amzn-main/latest | 2.1 kB 00:00
amzn-updates/latest | 2.3 kB 00:00
Resolving Dependencies
--> Running transaction check
---> Package mariadb-columnstore-client.x86_64 0:1.0.8-1.el7.centos will be installed
---> Package mariadb-columnstore-common.x86_64 0:1.0.8-1.el7.centos will be installed
---> Package mariadb-columnstore-gssapi-client.x86_64 0:1.0.8-1.el7.centos will be installed
---> Package mariadb-columnstore-gssapi-server.x86_64 0:1.0.8-1.el7.centos will be installed
---> Package mariadb-columnstore-libs.x86_64 0:1.0.8-1 will be installed
---> Package mariadb-columnstore-platform.x86_64 0:1.0.8-1 will be installed
---> Package mariadb-columnstore-server.x86_64 0:1.0.8-1.el7.centos will be installed
---> Package mariadb-columnstore-shared.x86_64 0:1.0.8-1.el7.centos will be installed
---> Package mariadb-columnstore-storage-engine.x86_64 0:1.0.8-1 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

==================================================================================
Package Arch Version Repository Size
==================================================================================
Installing for group install "MariaDB ColumnStore":
mariadb-columnstore-client x86_64 1.0.8-1.el7.centos mariadb-columnstore 12 M
mariadb-columnstore-common x86_64 1.0.8-1.el7.centos mariadb-columnstore 122 k
mariadb-columnstore-gssapi-client
x86_64 1.0.8-1.el7.centos mariadb-columnstore 19 k
mariadb-columnstore-gssapi-server
x86_64 1.0.8-1.el7.centos mariadb-columnstore 46 k
mariadb-columnstore-libs x86_64 1.0.8-1 mariadb-columnstore 3.5 M
mariadb-columnstore-platform x86_64 1.0.8-1 mariadb-columnstore 2.1 M
mariadb-columnstore-server x86_64 1.0.8-1.el7.centos mariadb-columnstore 70 M
mariadb-columnstore-shared x86_64 1.0.8-1.el7.centos mariadb-columnstore 1.2 M
mariadb-columnstore-storage-engine
x86_64 1.0.8-1 mariadb-columnstore 424 k

Transaction Summary
==================================================================================
Install 9 Packages

Total size: 89 M
Installed size: 403 M
Is this ok [y/d/N]: N
Exiting on user command
Your transaction was saved, rerun it with:
yum load-transaction /tmp/yum_save_tx.2017-04-19.19-43.K2otPO.yumtx
[root@ip-172-30-0-119 ~]# yum groupinstall "MariaDB ColumnStore"
Loaded plugins: priorities, update-motd, upgrade-helper
Resolving Dependencies
--> Running transaction check
---> Package mariadb-columnstore-client.x86_64 0:1.0.8-1.el7.centos will be installed
---> Package mariadb-columnstore-common.x86_64 0:1.0.8-1.el7.centos will be installed
---> Package mariadb-columnstore-gssapi-client.x86_64 0:1.0.8-1.el7.centos will be installed
---> Package mariadb-columnstore-gssapi-server.x86_64 0:1.0.8-1.el7.centos will be installed
---> Package mariadb-columnstore-libs.x86_64 0:1.0.8-1 will be installed
---> Package mariadb-columnstore-platform.x86_64 0:1.0.8-1 will be installed
---> Package mariadb-columnstore-server.x86_64 0:1.0.8-1.el7.centos will be installed
---> Package mariadb-columnstore-shared.x86_64 0:1.0.8-1.el7.centos will be installed
---> Package mariadb-columnstore-storage-engine.x86_64 0:1.0.8-1 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

==========================================================================================================================================
Package Arch Version Repository Size
==========================================================================================================================================
Installing for group install "MariaDB ColumnStore":
mariadb-columnstore-client x86_64 1.0.8-1.el7.centos mariadb-columnstore 12 M
mariadb-columnstore-common x86_64 1.0.8-1.el7.centos mariadb-columnstore 122 k
mariadb-columnstore-gssapi-client x86_64 1.0.8-1.el7.centos mariadb-columnstore 19 k
mariadb-columnstore-gssapi-server x86_64 1.0.8-1.el7.centos mariadb-columnstore 46 k
mariadb-columnstore-libs x86_64 1.0.8-1 mariadb-columnstore 3.5 M
mariadb-columnstore-platform x86_64 1.0.8-1 mariadb-columnstore 2.1 M
mariadb-columnstore-server x86_64 1.0.8-1.el7.centos mariadb-columnstore 70 M
mariadb-columnstore-shared x86_64 1.0.8-1.el7.centos mariadb-columnstore 1.2 M
mariadb-columnstore-storage-engine x86_64 1.0.8-1 mariadb-columnstore 424 k

Transaction Summary
==========================================================================================================================================
Install 9 Packages

Total size: 89 M
Installed size: 403 M
Is this ok [y/d/N]: y
Downloading packages:
warning: /var/cache/yum/x86_64/latest/mariadb-columnstore/packages/mariadb-columnstore-1.0.8-1-x86_64-centos7-client.rpm: Header V4 RSA/SHA1 Signature, key ID c12ebbf9: NOKEY
Retrieving key from http://54.172.106.13/repos/RPM-GPG-KEY-MariaDB-ColumnStore
Importing GPG key 0xC12EBBF9:
Userid : "David Hill (Columnstore Key) <support@mariadb.com>"
Fingerprint: 2561 235d 532e 3ce9 511b 8085 91d0 be3b c12e bbf9
From : http://54.172.106.13/repos/RPM-GPG-KEY-MariaDB-ColumnStore
Is this ok [y/N]: y
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Installing : mariadb-columnstore-common-1.0.8-1.el7.centos.x86_64 1/9
Installing : mariadb-columnstore-libs-1.0.8-1.x86_64 2/9
MariaDB ColumnStore RPM install completed
Installing : mariadb-columnstore-client-1.0.8-1.el7.centos.x86_64 3/9
Installing : mariadb-columnstore-server-1.0.8-1.el7.centos.x86_64 4/9
Installing : mariadb-columnstore-gssapi-server-1.0.8-1.el7.centos.x86_64 5/9
Installing : mariadb-columnstore-storage-engine-1.0.8-1.x86_64 6/9
MariaDB ColumnStore RPM install completed
Installing : mariadb-columnstore-platform-1.0.8-1.x86_64 7/9
The next step is:

/usr/local/mariadb/columnstore/bin/postConfigure

MariaDB ColumnStore RPM install completed
Installing : mariadb-columnstore-shared-1.0.8-1.el7.centos.x86_64 8/9
Installing : mariadb-columnstore-gssapi-client-1.0.8-1.el7.centos.x86_64 9/9
Verifying : mariadb-columnstore-client-1.0.8-1.el7.centos.x86_64 1/9
Verifying : mariadb-columnstore-shared-1.0.8-1.el7.centos.x86_64 2/9
Verifying : mariadb-columnstore-common-1.0.8-1.el7.centos.x86_64 3/9
Verifying : mariadb-columnstore-storage-engine-1.0.8-1.x86_64 4/9
Verifying : mariadb-columnstore-gssapi-server-1.0.8-1.el7.centos.x86_64 5/9
Verifying : mariadb-columnstore-platform-1.0.8-1.x86_64 6/9
Verifying : mariadb-columnstore-server-1.0.8-1.el7.centos.x86_64 7/9
Verifying : mariadb-columnstore-gssapi-client-1.0.8-1.el7.centos.x86_64 8/9
Verifying : mariadb-columnstore-libs-1.0.8-1.x86_64 9/9

Installed:
mariadb-columnstore-client.x86_64 0:1.0.8-1.el7.centos mariadb-columnstore-common.x86_64 0:1.0.8-1.el7.centos
mariadb-columnstore-gssapi-client.x86_64 0:1.0.8-1.el7.centos mariadb-columnstore-gssapi-server.x86_64 0:1.0.8-1.el7.centos
mariadb-columnstore-libs.x86_64 0:1.0.8-1 mariadb-columnstore-platform.x86_64 0:1.0.8-1
mariadb-columnstore-server.x86_64 0:1.0.8-1.el7.centos mariadb-columnstore-shared.x86_64 0:1.0.8-1.el7.centos
mariadb-columnstore-storage-engine.x86_64 0:1.0.8-1

Complete!
[root@ip-172-30-0-119 ~]#

Comment by Daniel Bartholomew [ 2017-11-15 ]

For debian and ubuntu packages, the tool we use for MariaDB Server is reprepro.

  1. To use it you first start with creating the repository directory, then a conf subdirectory.
  2. Inside the conf subdir create a distributions file
  3. once the distributions file is in place, from the repository directory, run reprepro to import the .deb files
    • you can either import each .deb file individually with, e.g.:
      • reprepro --basedir=. includedeb xenial /path/to/file.deb
    • or you can import all files listed in a .changes file (if your packaging scripts are creating one of those) with, e.g.:
      • reprepro --basedir=. include xenial /path/to/file.changes
  4. When reprepro is finished you'll have a directory that can be copied wherever and used as a repository
Comment by David Hill (Inactive) [ 2017-11-30 ]

Cool.... reprepro was available for centos 7 download and I got it working manually with setting up a ubuntu 16 repo on the centos 7 buildmaster node and then was able to install using apt-ge on another ubuntu 16 server...

So it does work, will need to automate it next... Did get a library error on install that doesnt happen with dpkg install, so will need to look into that future... BUT WE HAVE UBUNTU REPO PROGRESS.. WOO HOO

apt-get install mariadb-columnstore*
Reading package lists... Done
Building dependency tree
Reading state information... Done
Note, selecting 'mariadb-columnstore-storage-engine' for glob 'mariadb-columnstore*'
Note, selecting 'mariadb-columnstore-shared' for glob 'mariadb-columnstore*'
Note, selecting 'mariadb-columnstore-rocksdb-engine' for glob 'mariadb-columnstore*'
Note, selecting 'mariadb-columnstore-platform' for glob 'mariadb-columnstore*'
Note, selecting 'mariadb-columnstore-common' for glob 'mariadb-columnstore*'
Note, selecting 'mariadb-columnstore-libs' for glob 'mariadb-columnstore*'
Note, selecting 'mariadb-columnstore-devel' for glob 'mariadb-columnstore*'
Note, selecting 'mariadb-columnstore-tokudb-engine' for glob 'mariadb-columnstore*'
Note, selecting 'mariadb-columnstore-gssapi-server' for glob 'mariadb-columnstore*'
Note, selecting 'mariadb-columnstore-gssapi-client' for glob 'mariadb-columnstore*'
Note, selecting 'mariadb-columnstore-server' for glob 'mariadb-columnstore*'
Note, selecting 'mariadb-columnstore-client' for glob 'mariadb-columnstore*'
Note, selecting 'mariadb-columnstore-test' for glob 'mariadb-columnstore*'
mariadb-columnstore-gssapi-server is already the newest version (1.0.10).
mariadb-columnstore-gssapi-client is already the newest version (1.0.10).
The following packages were automatically installed and are no longer required:
linux-aws-headers-4.4.0-1013 linux-aws-headers-4.4.0-1016 linux-headers-4.4.0-1013-aws
linux-headers-4.4.0-1016-aws linux-image-4.4.0-1013-aws linux-image-4.4.0-1016-aws snap-confine
Use 'sudo apt autoremove' to remove them.
The following NEW packages will be installed:
mariadb-columnstore-devel mariadb-columnstore-rocksdb-engine mariadb-columnstore-test
mariadb-columnstore-tokudb-engine
The following packages will be upgraded:
mariadb-columnstore-client mariadb-columnstore-common mariadb-columnstore-libs
mariadb-columnstore-platform mariadb-columnstore-server mariadb-columnstore-shared
mariadb-columnstore-storage-engine
7 upgraded, 4 newly installed, 0 to remove and 120 not upgraded.
Need to get 410 MB of archives.
After this operation, 608 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://54.172.106.13/repos xenial/main amd64 mariadb-columnstore-common amd64 1.1.3 [166 kB]
Get:2 http://54.172.106.13/repos xenial/main amd64 mariadb-columnstore-client amd64 1.1.3 [18.4 MB]
Get:3 http://54.172.106.13/repos xenial/main amd64 mariadb-columnstore-devel amd64 1.1.3 [1,813 kB]
Get:4 http://54.172.106.13/repos xenial/main amd64 mariadb-columnstore-libs amd64 1.1.3 [96.6 MB]
Get:5 http://54.172.106.13/repos xenial/main amd64 mariadb-columnstore-platform amd64 1.1.3 [44.4 MB]
Get:6 http://54.172.106.13/repos xenial/main amd64 mariadb-columnstore-rocksdb-engine amd64 1.1.3 [89.4 MB]
Get:7 http://54.172.106.13/repos xenial/main amd64 mariadb-columnstore-server amd64 1.1.3 [98.3 MB]
Get:8 http://54.172.106.13/repos xenial/main amd64 mariadb-columnstore-shared amd64 1.1.3 [459 kB]
Get:9 http://54.172.106.13/repos xenial/main amd64 mariadb-columnstore-storage-engine amd64 1.1.3 [10.0 MB]
Get:10 http://54.172.106.13/repos xenial/main amd64 mariadb-columnstore-test amd64 1.1.3 [45.4 MB]
Get:11 http://54.172.106.13/repos xenial/main amd64 mariadb-columnstore-tokudb-engine amd64 1.1.3 [5,184 kB]
Fetched 410 MB in 56s (7,292 kB/s)
(Reading database ... 148981 files and directories currently installed.)
Preparing to unpack .../mariadb-columnstore-common_1.1.3_amd64.deb ...
Unpacking mariadb-columnstore-common (1.1.3) over (1.0.10) ...
Preparing to unpack .../mariadb-columnstore-client_1.1.3_amd64.deb ...
Unpacking mariadb-columnstore-client (1.1.3) over (1.0.10) ...
Selecting previously unselected package mariadb-columnstore-devel.
Preparing to unpack .../mariadb-columnstore-devel_1.1.3_amd64.deb ...
Unpacking mariadb-columnstore-devel (1.1.3) ...
Preparing to unpack .../mariadb-columnstore-libs_1.1.3_amd64.deb ...
Unpacking mariadb-columnstore-libs (1.1.3) over (1.0.10) ...
Preparing to unpack .../mariadb-columnstore-platform_1.1.3_amd64.deb ...
/usr/local/mariadb/columnstore/bin/getConfig: error while loading shared libraries: libmysqlcl_idb.so.1: cannot open shared object file: No such file or directory
/usr/local/mariadb/columnstore/bin/pre-uninstall: line 65: [: =: unary operator expected
/usr/local/mariadb/columnstore/bin/pre-uninstall: line 65: [: =: unary operator expected

Mariab Columnstore uninstall completed
Unpacking mariadb-columnstore-platform (1.1.3) over (1.0.10) ...
Selecting previously unselected package mariadb-columnstore-rocksdb-engine.
Preparing to unpack .../mariadb-columnstore-rocksdb-engine_1.1.3_amd64.deb ...
Unpacking mariadb-columnstore-rocksdb-engine (1.1.3) ...
Preparing to unpack .../mariadb-columnstore-server_1.1.3_amd64.deb ...
Unpacking mariadb-columnstore-server (1.1.3) over (1.0.10) ...
Preparing to unpack .../mariadb-columnstore-shared_1.1.3_amd64.deb ...
Unpacking mariadb-columnstore-shared (1.1.3) over (1.0.10) ...
Preparing to unpack .../mariadb-columnstore-storage-engine_1.1.3_amd64.deb ...
Unpacking mariadb-columnstore-storage-engine (1.1.3) over (1.0.10) ...
Selecting previously unselected package mariadb-columnstore-test.
Preparing to unpack .../mariadb-columnstore-test_1.1.3_amd64.deb ...
Unpacking mariadb-columnstore-test (1.1.3) ...
Selecting previously unselected package mariadb-columnstore-tokudb-engine.
Preparing to unpack .../mariadb-columnstore-tokudb-engine_1.1.3_amd64.deb ...
Unpacking mariadb-columnstore-tokudb-engine (1.1.3) ...
Processing triggers for libc-bin (2.23-0ubuntu9) ...
Setting up mariadb-columnstore-common (1.1.3) ...
Setting up mariadb-columnstore-client (1.1.3) ...
Setting up mariadb-columnstore-devel (1.1.3) ...
Setting up mariadb-columnstore-libs (1.1.3) ...
MariaDB ColumnStore install completed
Setting up mariadb-columnstore-platform (1.1.3) ...
The next step is:

If installing on a pm1 node:

/usr/local/mariadb/columnstore/bin/postConfigure

If installing on a non-pm1 using the non-distributed option:

/usr/local/mariadb/columnstore/bin/columnstore start

MariaDB ColumnStore install completed
Setting up mariadb-columnstore-rocksdb-engine (1.1.3) ...
Setting up mariadb-columnstore-server (1.1.3) ...
Setting up mariadb-columnstore-shared (1.1.3) ...
Setting up mariadb-columnstore-storage-engine (1.1.3) ...
MariaDB ColumnStore install completed
Setting up mariadb-columnstore-test (1.1.3) ...
Setting up mariadb-columnstore-tokudb-engine (1.1.3) ...
Processing triggers for libc-bin (2.23-0ubuntu9) ...

Comment by David Hill (Inactive) [ 2017-12-04 ]

to get 1.1.3 repo packages off of buildbot master

ubuntu 16

apt-get install apt-transport-https
vi /etc/apt/sources.list.d/mariab-columnstore.list
deb http://54.172.106.13/repos/1.1.3/repo/ubuntu xenial main
deb-src http://54.172.106.13/repos/1.1.3/repo/ubuntu xenial main

wget -qO - http://54.172.106.13/repos/1.1.3/repo/MariaDB-ColumnStore.gpg.key | sudo apt-key add -

apt-get update
apt-get install mariadb-columnstore*

debian 8

apt-get install apt-transport-https
vi /etc/apt/sources.list.d/mariab-columnstore.list
deb http://54.172.106.13/repos/1.1.3/repo/debian jessie main
deb-src http://54.172.106.13/repos/1.1.3/repo/debian jessie main

wget -qO - http://54.172.106.13/repos/1.1.3/repo/MariaDB-ColumnStore.gpg.key | sudo apt-key add -

apt-get update
apt-get install mariadb-columnstore*

centos6

vi /etc/yum.repos.d/mariadb-columnstore.repo
[mariadb-columnstore]
name=MariaDB ColumnStore
baseurl=http://54.172.106.13/repos/1.1.3/yum/centos/6/x86_64
gpgkey=http://54.172.106.13/repos/1.1.3/repo/MariaDB-ColumnStore.gpg.key
gpgcheck=1

  1. and try install
    yum --enablerepo=mariadb-columnstore clean metadata
    yum groupinstall "MariaDB ColumnStore"

centos7

vi /etc/yum.repos.d/mariadb-columnstore.repo
[mariadb-columnstore]
name=MariaDB ColumnStore
baseurl=http://54.172.106.13/repos/1.1.3/yum/centos/7/x86_64
gpgkey=http://54.172.106.13/repos/1.1.3/repo/MariaDB-ColumnStore.gpg.key
gpgcheck=1

  1. and try install
    yum --enablerepo=mariadb-columnstore clean metadata
    yum groupinstall "MariaDB ColumnStore"

suse12

zypper addrepo -n mariadb-columnstore -t rpm-md http://54.172.106.13/repos/1.1.3/yum/sles/12/x86_64 mariadb-columnstore

rpm --import http://54.172.106.13/repos/1.1.3/repo/MariaDB-ColumnStore.gpg.key

zypper refresh
zypper install mariadb-columnstore*

Comment by David Hill (Inactive) [ 2017-12-04 ]

work to be done...

debian - 9 buildbot worker

try to get api build on all versions with repo
try to ge data-adaptors building on all versions with repo

Comment by David Hill (Inactive) [ 2017-12-19 ]

got debian 8 repo working, but debian 9 using the same keys repos the following error on the client server... keys again. what a pain

W: GPG error: http://54.172.106.13/repos/1.1.3/repo/debian9 stretch InRelease: The following signatures were invalid: 2561235D532E3CE9511B808591D0BE3BC12EBBF9
W: The repository 'http://54.172.106.13/repos/1.1.3/repo/debian9 stretch InRelease' is not signed.
N: Data from such a repository can't be authenticated and is therefore potentially dangerous to use.
N: See apt-secure(8) manpage for repository creation and user configuration details.
root@debian-9-pm1:/var/lib/apt#

I run this on the server

vi /etc/apt/sources.list.d/mariab-columnstore.list
deb http://54.172.106.13/repos/1.1.3/repo/debian stretch main
deb-src http://54.172.106.13/repos/1.1.3/repo/debian stretch main

wget -qO - http://54.172.106.13/repos/1.1.3/repo/MariaDB-ColumnStore.gpg.key | sudo apt-key add -

apt-get update

and the key here matches the key in SignWith key...

Comment by David Hill (Inactive) [ 2017-12-19 ]

[root@ip-10-0-0-227 debian9]# gpg --list-keys --finger
/root/.gnupg/pubring.gpg
------------------------
pub 2048R/C12EBBF9 2017-04-19
Key fingerprint = 2561 235D 532E 3CE9 511B 8085 91D0 BE3B C12E BBF9
uid David Hill (Columnstore Key) <support@mariadb.com>
sub 2048R/BA114A21 2017-04-19

pub 4096R/97254D1E 2017-04-27
Key fingerprint = 0278 4156 F165 68FF C19E 2662 4084 AA18 9725 4D1E
uid david hill <support@mariadb.com>

[root@ip-10-0-0-227 debian9]# cat conf/distributions
Origin: MariaDB
Label: MariaDB Columnstore
Codename: stretch
Architectures: amd64 x86_64 source
Components: main
Description: MariaDB Columnstore Repository
SignWith: C12EBBF9

Comment by David Hill (Inactive) [ 2018-01-02 ]

still a few issues

centos 6 install

MariaDB ColumnStore RPM install completed
Installing : mariadb-columnstore-platform-1.1.3-1.x86_64 7/8
/usr/local/mariadb/columnstore/bin/cplogger: error while loading shared libraries: libmariadb.so.3: cannot open shared object file: No such file or directory
The next step is:

If installing on a pm1 node:

/usr/local/mariadb/columnstore/bin/postConfigure

If installing on a non-pm1 using the non-distributed option:

/usr/local/mariadb/columnstore/bin/columnstore start

centos 7

groupinstall now not showing all the packages

sudo yum groupinstall "MariaDB ColumnStore"
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile

  • base: mirror.rackspace.com
  • epel: mirror.steadfast.net
  • extras: bay.uchicago.edu
  • updates: mirrors.umflint.edu
    Resolving Dependencies
    --> Running transaction check
    ---> Package mariadb-columnstore-tokudb-engine.x86_64 0:1.1.2-1.el7.centos will be installed
    --> Processing Dependency: MariaDB = 1.1.2-1.el7.centos for package: mariadb-columnstore-tokudb-engine-1.1.2-1.el7.centos.x86_64
    --> Running transaction check
    ---> Package mariadb-columnstore-server.x86_64 0:1.1.2-1.el7.centos will be installed
    --> Processing Dependency: mariadb-columnstore-common for package: mariadb-columnstore-server-1.1.2-1.el7.centos.x86_64
    --> Processing Dependency: mariadb-columnstore-client for package: mariadb-columnstore-server-1.1.2-1.el7.centos.x86_64
    --> Running transaction check
    ---> Package mariadb-columnstore-client.x86_64 0:1.1.2-1.el7.centos will be installed
    ---> Package mariadb-columnstore-common.x86_64 0:1.1.2-1.el7.centos will be installed
    --> Finished Dependency Resolution

Dependencies Resolved

===================================================================================================================
Package Arch Version Repository Size
===================================================================================================================
Installing for group upgrade "MariaDB ColumnStore":
mariadb-columnstore-tokudb-engine x86_64 1.1.2-1.el7.centos mariadb-columnstore 5.0 M
Installing for dependencies:
mariadb-columnstore-client x86_64 1.1.2-1.el7.centos mariadb-columnstore 12 M
mariadb-columnstore-common x86_64 1.1.2-1.el7.centos mariadb-columnstore 154 k
mariadb-columnstore-server x86_64 1.1.2-1.el7.centos mariadb-columnstore 69 M

Transaction Summary
===================================================================================================================
Install 1 Package (+3 Dependent packages)

Total download size: 86 M
Installed size: 386 M

Comment by Sasha V [ 2018-01-03 ]

Note that the Ubuntu 16 URL for 1.1.3 repo packages for /etc/apt/sources.list.d/mariab-columnstore.list

deb http://54.172.106.13/repos/1.1.3/repo/ubuntu xenial main

is currently at

deb http://54.172.106.13/repos/1.1.3/repo/ubuntu16 xenial main

Comment by David Hill (Inactive) [ 2018-01-04 ]

resolved the centos 7 licence key issue...

Looking into the deb packages issue. during the repo script execution, the actual name of the packages are being changed... Need to investigate which package name we need for the finial repo releasing.

name from our build is:

mariadb-columnstore-1.1.2-1-x86_64-stretch-client.deb

name after going though the repo scripts:

mariadb-columnstore-client_1.1.2_amd64.deb

Comment by Sasha V [ 2018-01-04 ]

I tried multi-server install with Ubuntu 16 URL for 1.1.3 repo packages. The install step was successfull, with packages downloaded like
/var/cache/apt/archives/mariadb-columnstore-client_1.1.3_amd64.deb
The postConfigure step got affected by few issues. First, it looks for:

Performing a MariaDB ColumnStore System install using using DEB packages located in the /root directory.
ls: cannot access '/root/mariadb-columnstore-1.1.3-1*.deb': No such file or directory
 
 Error: can't locate /root/mariadb-columnstore-1.1.3-1*.deb Package in directory /root

Second, with packages renamed as expected and placed in the /root directory, the scp to other nodes failed because package_installer.sh has

send "scp -v $HOME/mariadb-columnstore*$VERSION*$PKGTYPE $USERNAME@$SERVER:.\n"

https://github.com/mariadb-corporation/mariadb-columnstore-engine/blob/1.1-merge-up/oam/install_scripts/package_installer.sh#L144
and in my environment, $HOME has not been set to /root

Comment by David Hill (Inactive) [ 2018-01-05 ]

centos 7 api install working

yum install mariadb-columnstore-api
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile

  • base: mirror.steadfast.net
  • epel: mirror.steadfast.net
  • extras: mirror.tzulo.com
  • updates: repos.forethought.net
    Resolving Dependencies
    --> Running transaction check
    ---> Package mariadb-columnstore-api.x86_64 0:1.1.2-1 will be installed
    --> Finished Dependency Resolution

Dependencies Resolved

======================================================================================================================
Package Arch Version Repository Size
======================================================================================================================
Installing:
mariadb-columnstore-api x86_64 1.1.2-1 mariadb-columnstore-api 184 k

Transaction Summary
======================================================================================================================
Install 1 Package

Total download size: 184 k
Installed size: 900 k
Is this ok [y/d/N]: y
Downloading packages:
mariadb-columnstore-api-1.1.2-1-x86_64-centos7.rpm | 184 kB 00:00:00
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Installing : mariadb-columnstore-api-1.1.2-1.x86_64 1/1
Verifying : mariadb-columnstore-api-1.1.2-1.x86_64 1/1

Installed:
mariadb-columnstore-api.x86_64 0:1.1.2-1

Comment by David Hill (Inactive) [ 2018-01-05 ]

Error with centos 7 data adapters package installed... libcdc_connentor is installed, so not sure why the error

[root@centos-7-yum-pm1 ~]# yum groupinstall mariadb-columnstore-data-adapters
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile

  • base: mirror.steadfast.net
  • epel: mirror.steadfast.net
  • extras: mirror.tzulo.com
  • updates: repos.forethought.net
    Resolving Dependencies
    --> Running transaction check
    ---> Package mariadb-columnstore-kafka-adapters.x86_64 0:1.1.2-1 will be installed
    --> Processing Dependency: librdkafka++.so.1()(64bit) for package: mariadb-columnstore-kafka-adapters-1.1.2-1.x86_64
    ---> Package mariadb-columnstore-maxscale-cdc-adapters.x86_64 0:1.1.2-1 will be installed
    --> Processing Dependency: libcdc_connector.so.1.0.0()(64bit) for package: mariadb-columnstore-maxscale-cdc-adapters-1.1.2-1.x86_64
    --> Running transaction check
    ---> Package librdkafka.x86_64 0:0.11.1-1.el7 will be installed
    --> Processing Dependency: liblz4.so.1()(64bit) for package: librdkafka-0.11.1-1.el7.x86_64
    ---> Package mariadb-columnstore-maxscale-cdc-adapters.x86_64 0:1.1.2-1 will be installed
    --> Processing Dependency: libcdc_connector.so.1.0.0()(64bit) for package: mariadb-columnstore-maxscale-cdc-adapters-1.1.2-1.x86_64
    --> Running transaction check
    ---> Package lz4.x86_64 0:1.7.3-1.el7 will be installed
    ---> Package mariadb-columnstore-maxscale-cdc-adapters.x86_64 0:1.1.2-1 will be installed
    --> Processing Dependency: libcdc_connector.so.1.0.0()(64bit) for package: mariadb-columnstore-maxscale-cdc-adapters-1.1.2-1.x86_64
    --> Finished Dependency Resolution
    Error: Package: mariadb-columnstore-maxscale-cdc-adapters-1.1.2-1.x86_64 (mariadb-columnstore-data-adapters)
    Requires: libcdc_connector.so.1.0.0()(64bit)
    You could try using --skip-broken to work around the problem
    You could try running: rpm -Va --nofiles --nodigest
    [root@centos-7-yum-pm1 ~]# find // -name libcdc_connector.so.1.0.0
    //root/maxscale-cdc-connector/build/libcdc_connector.so.1.0.0
    //usr/lib64/libcdc_connector.so.1.0.0
    [root@centos-7-yum-pm1 ~]#
Comment by David Hill (Inactive) [ 2018-01-05 ]

Will need a yum and apt-get repo for libcdc_connector to get the data adapters to install

Comment by David Hill (Inactive) [ 2018-01-10 ]

api and data-adapters repos are done for 1.1.2.. Document in same doc with columnstore

https://mariadb.com/kb/en/library/installing-mariadb-columnstore-from-the-package-repositories/

Comment by David Hill (Inactive) [ 2018-03-05 ]

completed with the 1.1.3 yum/apt-get repos becoming available at GA

Generated at Thu Feb 08 02:20:03 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.