[MDBF-347] bb 10.2 packages generated in CI ubuntu repository unusable Created: 2022-02-18 Updated: 2022-05-09 Resolved: 2022-02-23 |
|
| Status: | Closed |
| Project: | MariaDB Foundation Development |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | N/A |
| Type: | Bug | Priority: | Major |
| Reporter: | Daniel Black | Assignee: | Faustin Lammler |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | 0d | ||
| Time Spent: | 1h | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||
| Description |
|
The docker library builder cannot install mariadb packages from the generated repo. The result is the continuous delivery of 10.2 container images from quay.io is no-longer updating. All 10.3+ repositories are generated ok and are building on the docker-library buildbot.
This is used for the 10.2 based releases. Changing the build to:
Rebuilding with this in the same buildah command line as the bb generates the same error. This would eliminate the bionic vs focal apt versions being a cause of difference. This is generated with buildbot.mariadb.org/master.cfg -> dpkgDeb the same for all repos. I checked the Packages.gz paths and they seem fine. Supple differences in 10.2 packaging maybe? |
| Comments |
| Comment by Faustin Lammler [ 2022-02-22 ] | ||||||||||||||||||||||||||||||||||||||||||||||
|
Daniel,
This is really wired as iproute2 is available on bionic and if I am correct, the dependency is on either iproute or iproute2 https://github.com/MariaDB/server/commit/9f848da640dd6c3f44d56eae18204370ae7f835c Digging a bit further, https://ci.mariadb.org/22519/aarch64-ubuntu-1804-deb-autobake/debs/mariadb-server-10.2_10.2.44%2Bmaria~bionic_arm64.deb seems to have removed the iproute2 dependency:
Dependency is on:
instead of:
Not sure why but this is the pb I guess. | ||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Daniel Black [ 2022-02-23 ] | ||||||||||||||||||||||||||||||||||||||||||||||
|
Because the cache on the container image doesn't contain iproute2, its removed https://github.com/MariaDB/server/blob/10.2/debian/autobake-deb.sh#L46-L49 Did you fix something? https://buildbot.mariadb.org/#/grid?branch=10.2 appears to have come good https://quay.io/repository/mariadb-foundation/mariadb-devel?tab=history 10.2 releases there | ||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Faustin Lammler [ 2022-02-23 ] | ||||||||||||||||||||||||||||||||||||||||||||||
|
> Because the cache on the container image doesn't contain iproute2, its removed But it should not for bionic:
> Did you fix something? https://buildbot.mariadb.org/#/grid?branch=10.2 appears to have come good Nope | ||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Daniel Black [ 2022-02-23 ] | ||||||||||||||||||||||||||||||||||||||||||||||
|
The key point is the apt-get update which isn't part of the autobake.sh. If it wasn't in the cache locally it wouldn't be there.
So there now.
... but maybe not on < Feb 19 when the last bb-worker:18.04 change was made, same date quay.io/mariadb-foundation/mariadb-devel:10.2 updated. | ||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Faustin Lammler [ 2022-02-24 ] | ||||||||||||||||||||||||||||||||||||||||||||||
|
So, this might be the reason: And if this is a requirement to not clean the apt cache, then it was a smart move. There is still a problem with that approach: I am not sure how long apt will trust it's cache (/var/lib/apt/lists) but if the image is too old, an apt-get update may be needed for this to work as expected. | ||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Daniel Black [ 2022-02-25 ] | ||||||||||||||||||||||||||||||||||||||||||||||
|
Eventually I think I'd like the debian/autobake-deb.sh to build based on actual distro rather than cache contents. The Debian base image is updated about monthly https://github.com/docker-library/repo-info/commits/master/repos/debian/remote package updates but the time you include all the build dependencies, probably monthly, just enough to get updates, and enough to ensure the ccache can be stable based on dependencies pulled in. github actions on a schedule maybe? | ||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Faustin Lammler [ 2022-02-25 ] | ||||||||||||||||||||||||||||||||||||||||||||||
|
> github actions on a schedule maybe? Definitively! But not before we have a better solution for MDBF-336. | ||||||||||||||||||||||||||||||||||||||||||||||
| Comment by Daniel Black [ 2022-03-04 ] | ||||||||||||||||||||||||||||||||||||||||||||||
|
Seems the aarch64 version from bionic may have been used last release looking at https://doi-janky.infosiftr.net/job/multiarch/job/arm64v8/job/mariadb/ I don't suppose there's an easy work around on released packages? https://github.com/MariaDB/server/pull/2040 as a cleanup item in testing. |