Uploaded image for project: 'MariaDB Foundation Development'
  1. MariaDB Foundation Development
  2. MDBF-273

Create a Docker registry with pre-build Buildbot Docker images

Details

    • Task
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • N/A
    • N/A
    • Buildbot
    • None

    Description

      Background

      For each build, buildbot starts by building the Docker image corresponding to the build environment. Each build environment is defined in a Dockerfile. This means that any image creation failure automatically translates into a failed build in buildbot. In order to mitigate this aspect, Buildbot should use pre-build images. In this way, any changes to the Dockerfile can be independently validated before being used by buildbot.

      Proposed workflow

      Step 1 - Define a consistent name scheme for pre-build images
      Step 2 - Create a Docker registry that contains all images used by Buildbot
      Step 3 - Change buildbot config to use pre-build images
      Step 4 - Start templating dockerfiles and clearly define MariaDB server build requirements
      Step 5 - Automatically rebuild all the Dockerfiles from time to time
      Step 6 - Ensure an automated way to update images on all worker machines used by buildbot

      Attachments

        Issue Links

          Activity

            vladbogo Vlad Bogolin logged work - 2022-03-07 23:35 - edited
            • Time Spent:
              2d
               
              For CentOS 7 ppc64le, in order to be able to successfully build on ppc64le, the following Python packages need to be installed:

              {noformat}
              pip==19.0.0
              cffi==1.14.3
              cryptography==3.1.1
              pyOpenSSL==19.1.0
              twisted[tls]==20.3.0
              buildbot-worker==2.8.4
              {noformat}

              Also, solved the Debian 9 issues in https://github.com/MariaDB/mariadb.org-tools/pull/113
            vladbogo Vlad Bogolin logged work - 2022-04-04 14:17
            • Time Spent:
              10m
               
              Enable the quay image for ppc64le-centos-7
            vladbogo Vlad Bogolin logged work - 2022-04-04 17:48
            vladbogo Vlad Bogolin logged work - 2022-04-07 20:46
            • Time Spent:
              10m
               
              Enable RHEL 7 and 8 ppc64le quay images
            vladbogo Vlad Bogolin logged work - 2022-04-11 21:47
            • Time Spent:
              3h
               
              Add gnutls for Debian 9 to solve systemd/initd issues.
            vladbogo Vlad Bogolin logged work - 2022-04-18 13:44

            People

              vladbogo Vlad Bogolin
              vladbogo Vlad Bogolin
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 5d Original Estimate - 5d
                  5d
                  Remaining:
                  Time Spent - 4d 1h 20m Remaining Estimate - 2d 6h 40m
                  2d 6h 40m
                  Logged:
                  Time Spent - 4d 1h 20m Remaining Estimate - 2d 6h 40m
                  4d 1h 20m