[MDBF-273] Create a Docker registry with pre-build Buildbot Docker images Created: 2021-09-17  Updated: 2022-08-09  Resolved: 2022-08-09

Status: Closed
Project: MariaDB Foundation Development
Component/s: None
Affects Version/s: N/A
Fix Version/s: N/A

Type: Task Priority: Major
Reporter: Vlad Bogolin Assignee: Vlad Bogolin
Resolution: Fixed Votes: 0
Labels: buildbot
Remaining Estimate: 2d 6h 40m
Time Spent: 4d 1h 20m
Original Estimate: 5d

Issue Links:
PartOf
includes MDBF-387 ppc64le-rhel-7 broken Closed
includes MDBF-443 Add MSAN Docker image to CI Open
includes MDBF-444 Add eco-* imaged to CI Open
includes MDBF-445 Add clang to CI pipeline Open
includes MDBF-446 Add Valgrind to CI Open
includes MDBF-447 Add OpenSUSE to CI Docker image Closed
includes MDBF-448 Add ICC docker image to CI Open
is part of MDBF-41 Milestone 5: Desirable fixes Open

 Description   

Background

For each build, buildbot starts by building the Docker image corresponding to the build environment. Each build environment is defined in a Dockerfile. This means that any image creation failure automatically translates into a failed build in buildbot. In order to mitigate this aspect, Buildbot should use pre-build images. In this way, any changes to the Dockerfile can be independently validated before being used by buildbot.

Proposed workflow

Step 1 - Define a consistent name scheme for pre-build images
Step 2 - Create a Docker registry that contains all images used by Buildbot
Step 3 - Change buildbot config to use pre-build images
Step 4 - Start templating dockerfiles and clearly define MariaDB server build requirements
Step 5 - Automatically rebuild all the Dockerfiles from time to time
Step 6 - Ensure an automated way to update images on all worker machines used by buildbot



 Comments   
Comment by Faustin Lammler [ 2021-09-17 ]

See a first attempt here: https://github.com/MariaDB/mariadb.org-tools/pull/79

Comment by Vlad Bogolin [ 2022-08-09 ]

The main workflow is create for a while now. All missing items have separate tasks which are linked from this, so closing this massive task.

Generated at Thu Feb 08 03:36:41 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.