[MCOL-2068] add support for using and defaulting memory based settings to docker image Created: 2019-01-07  Updated: 2019-04-03  Resolved: 2019-04-03

Status: Closed
Project: MariaDB ColumnStore
Component/s: Docker
Affects Version/s: 1.2.2
Fix Version/s: 1.2.4

Type: Task Priority: Major
Reporter: David Thompson (Inactive) Assignee: Daniel Lee (Inactive)
Resolution: Fixed Votes: 0
Labels: containers, relnote

Issue Links:
Relates
relates to MCOL-1847 need to be able to specify NumBlocksP... Closed
Sprint: 2018-21, 2019-01, 2019-02, 2019-03

 Description   

ColumnsStore now supports explicit memory settings for NumBlocksPct and TotalUmMemory however i believe there is not currently a way to force / override these in postConfigure.

The docker image should support 2 new env variables to allow overriding these and also default to some sensible small values like 1024m for NPB and 512m for TUM. Assuming my analysis is correct we'll need a mechanism to allow postCfg to take and default values for these (either as parameters or utilizing the values already in ColumnStore.xml (there is some logic for this in the upgrade path).

 Comments   
Comment by Jens Röwekamp (Inactive) [ 2019-01-17 ]

Added command line parameter to postConfigure to set the Columnstore.xml values

  • NumBlocksPct
  • TotalUmMemory

Further created a new branch develop-1.2 in mariadb-columnstore-docker that uses the yum repository build from the Columnstore 1.2.3 (develop-1.2) branches. Added and documented the necessary environment variables and code in mariadb-columnstore-docker to set this values through the initial dbinit script.

Note: The develop-1.2 mariadb-columnstore-docker repository can only be used and verified once the changes to mariadb-columnstore-engine are applied and the new packages are build by buildbot and uploaded to nightly. In the meantime one could use the yum repository:
http://34.238.186.75/repos/1.2.3-1/TestBuild-MCOL-2068/mariadb-columnstore/yum/centos/7/x86_64/

For QA:

  • do various install tests of Columnstore, and verify that the default settings for NumBlocksPct and TotalUmMemory haven't changed
  • do various install tests of Columnstore with applied -numBlocksPct and -totalUmMemory parameter, and verify that these settings are applied
  • the container tests will be handled in the DBAAS-544 ticket
Comment by Daniel Lee (Inactive) [ 2019-04-03 ]

Build verified: 1.2.4-1 nightly

server commit:
137b9a8
engine commit:
7b1f461
[dlee@master centos7]$

1. Verified postConfigure help text
2. Verified both -numBlocksPct and -totalUMMemory parameters and settings are applied correctly in ColumnStore.xml file
3. Verified that PrimProc observes memory settings, when postConfigure is run with or without these two parameters specified
4. Verified in both single node and milti-node installations

Generated at Thu Feb 08 02:33:29 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.