Details
-
Task
-
Status: Closed (View Workflow)
-
Major
-
Resolution: Fixed
-
N/A
-
None
Description
Background
For each build, buildbot starts by building the Docker image corresponding to the build environment. Each build environment is defined in a Dockerfile. This means that any image creation failure automatically translates into a failed build in buildbot. In order to mitigate this aspect, Buildbot should use pre-build images. In this way, any changes to the Dockerfile can be independently validated before being used by buildbot.
Proposed workflow
Step 1 - Define a consistent name scheme for pre-build images
Step 2 - Create a Docker registry that contains all images used by Buildbot
Step 3 - Change buildbot config to use pre-build images
Step 4 - Start templating dockerfiles and clearly define MariaDB server build requirements
Step 5 - Automatically rebuild all the Dockerfiles from time to time
Step 6 - Ensure an automated way to update images on all worker machines used by buildbot
Attachments
Issue Links
- includes
-
-
- Closed
-
-
-
- Closed
-
-
-
- Open
-
-
-
- Closed
-
-
-
- Closed
-
-
-
- Closed
-
-
-
- Closed
-
- is part of
-
-
- Closed
-
Activity
| Workflow | MFWA: Task Management Workflow [ 125126 ] | MariaDB v4 [ 162332 ] |
| Status | To Do [ 10003 ] | Open [ 1 ] |
| Component/s | None [ 18105 ] | |
| Fix Version/s | N/A [ 27305 ] | |
| Affects Version/s | N/A [ 27305 ] |
| Status | Open [ 1 ] | In Progress [ 3 ] |
-
- Time Spent:
- 2d
-
For CentOS 7 ppc64le, in order to be able to successfully build on ppc64le, the following Python packages need to be installed:
{noformat}
pip==19.0.0
cffi==1.14.3
cryptography==3.1.1
pyOpenSSL==19.1.0
twisted[tls]==20.3.0
buildbot-worker==2.8.4
{noformat}
Also, solved the Debian 9 issues in https://github.com/MariaDB/mariadb.org-tools/pull/113
| Worklog Id | 95519 [ 95519 ] | |
| Remaining Estimate | 0d [ 0 ] | |
| Time Spent | 2d [ 57600 ] |
| Worklog Id | 95519 [ 95519 ] |
| Worklog Id | 95519 [ 95519 ] |
| Remaining Estimate | 0d [ 0 ] | 5d [ 144000 ] |
| Original Estimate | 5d [ 144000 ] |
| Worklog Id | 95932 [ 95932 ] | |
| Remaining Estimate | 5d [ 144000 ] | 4d 7h [ 140400 ] |
| Time Spent | 2d [ 57600 ] | 2d 1h [ 61200 ] |
-
- Time Spent:
- 10m
- Enable the quay image for ppc64le-centos-7
| Worklog Id | 96606 [ 96606 ] | |
| Remaining Estimate | 4d 7h [ 140400 ] | 4d 6h 50m [ 139800 ] |
| Time Spent | 2d 1h [ 61200 ] | 2d 1h 10m [ 61800 ] |
-
- Time Spent:
- 1d
- Solve ppc64le RHEL 7 issues (https://github.com/MariaDB/mariadb.org-tools/pull/128)
| Worklog Id | 96611 [ 96611 ] | |
| Remaining Estimate | 4d 6h 50m [ 139800 ] | 3d 6h 50m [ 111000 ] |
| Time Spent | 2d 1h 10m [ 61800 ] | 3d 1h 10m [ 90600 ] |
| Worklog Id | 96853 [ 96853 ] | |
| Remaining Estimate | 3d 6h 50m [ 111000 ] | 3d 6h 40m [ 110400 ] |
| Time Spent | 3d 1h 10m [ 90600 ] | 3d 1h 20m [ 91200 ] |
-
- Time Spent:
- 3h
- Add gnutls for Debian 9 to solve systemd/initd issues.
| Worklog Id | 97011 [ 97011 ] | |
| Remaining Estimate | 3d 6h 40m [ 110400 ] | 3d 3h 40m [ 99600 ] |
| Time Spent | 3d 1h 20m [ 91200 ] | 3d 4h 20m [ 102000 ] |
-
- Time Spent:
- 5h
- Use a separate tag name for x86 images (https://github.com/MariaDB/mariadb.org-tools/pull/135). Updated buildbot to use the new images.
| Worklog Id | 97239 [ 97239 ] | |
| Remaining Estimate | 3d 3h 40m [ 99600 ] | 2d 6h 40m [ 81600 ] |
| Time Spent | 3d 4h 20m [ 102000 ] | 4d 1h 20m [ 120000 ] |
| Link | This issue includes MDBI-125 [ MDBI-125 ] |
| Status | In Progress [ 3 ] | Stalled [ 10000 ] |
| Link | This issue includes MDBI-139 [ MDBI-139 ] |
The main workflow is create for a while now. All missing items have separate tasks which are linked from this, so closing this massive task.
| Resolution | Fixed [ 1 ] | |
| Status | Stalled [ 10000 ] | Closed [ 6 ] |
| Component/s | Buildbot [ 18503 ] | |
| Labels | buildbot |
| Workflow | MariaDB v4 [ 162332 ] | MariaDB Foundation v1 [ 188516 ] |
| Component/s | None [ 18105 ] |
See a first attempt here: https://github.com/MariaDB/mariadb.org-tools/pull/79