Details
-
Task
-
Status: Closed (View Workflow)
-
Major
-
Resolution: Fixed
-
N/A
-
None
Description
Background
For each build, buildbot starts by building the Docker image corresponding to the build environment. Each build environment is defined in a Dockerfile. This means that any image creation failure automatically translates into a failed build in buildbot. In order to mitigate this aspect, Buildbot should use pre-build images. In this way, any changes to the Dockerfile can be independently validated before being used by buildbot.
Proposed workflow
Step 1 - Define a consistent name scheme for pre-build images
Step 2 - Create a Docker registry that contains all images used by Buildbot
Step 3 - Change buildbot config to use pre-build images
Step 4 - Start templating dockerfiles and clearly define MariaDB server build requirements
Step 5 - Automatically rebuild all the Dockerfiles from time to time
Step 6 - Ensure an automated way to update images on all worker machines used by buildbot
Attachments
Issue Links
- includes
-
MDBF-387 ppc64le-rhel-7 broken
-
- Closed
-
-
MDBF-443 Add MSAN Docker image to CI
-
- Closed
-
-
MDBF-444 Add eco-* imaged to CI
-
- Open
-
-
MDBF-445 Add clang to CI pipeline
-
- Closed
-
-
MDBF-446 Add Valgrind to CI
-
- Closed
-
-
MDBF-447 Add OpenSUSE to CI Docker image
-
- Closed
-
-
MDBF-448 Add ICC docker image to CI
-
- Closed
-
- is part of
-
MDBF-41 Milestone 5: Desirable fixes
-
- Closed
-
Activity
-
- Time Spent:
- 2d
-
For CentOS 7 ppc64le, in order to be able to successfully build on ppc64le, the following Python packages need to be installed:
{noformat}
pip==19.0.0
cffi==1.14.3
cryptography==3.1.1
pyOpenSSL==19.1.0
twisted[tls]==20.3.0
buildbot-worker==2.8.4
{noformat}
Also, solved the Debian 9 issues in https://github.com/MariaDB/mariadb.org-tools/pull/113
-
- Time Spent:
- 10m
- Enable the quay image for ppc64le-centos-7
-
- Time Spent:
- 1d
- Solve ppc64le RHEL 7 issues (https://github.com/MariaDB/mariadb.org-tools/pull/128)
-
- Time Spent:
- 3h
- Add gnutls for Debian 9 to solve systemd/initd issues.
-
- Time Spent:
- 5h
- Use a separate tag name for x86 images (https://github.com/MariaDB/mariadb.org-tools/pull/135). Updated buildbot to use the new images.