[MDBF-637] missing debuginfo packages due to reprepro Created: 2024-01-16  Updated: 2024-01-25

Status: Open
Project: MariaDB Foundation Development
Component/s: Buildbot
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Critical
Reporter: Daniel Black Assignee: Faustin Lammler
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Relates
relates to MDEV-14888 Provide multi-version package reposit... Closed
relates to MDEV-16828 dbgsym / debuginfo packages missing f... Closed
relates to MDEV-33260 Crash at startup when unclean shutdown Open

 Description   

https://buildbot.mariadb.org/#/builders/358/builds/11042/steps/7/logs/stdio

 
 
 
+ cat ../conf/distributions
 
Origin: MariaDB
 
Label: MariaDB
 
Codename: jammy
 
Architectures: amd64 source
 
Components: main
 
Description: MariaDB Repository
 
+ reprepro -b .. --ignore=wrongsourceversion include jammy ../mariadb_10.11.7+maria~ubu2204_amd64.changes
 
Unknown file type: '9fea2498ccb3e610b185e707a18883a0 7566 debug optional libmariadb-dev-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb', assuming source format...
 
Warning: File 'libmariadb-dev-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb' looks like source but does not start with 'mariadb_'!
 
Unknown file type: 'c464ab3896c15529f37591139a96451f 568854 debug optional libmariadb3-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb', assuming source format...
 
Warning: File 'libmariadb3-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb' looks like source but does not start with 'mariadb_'!
 
Unknown file type: '4625b5bbe8b252b3df4b14b7a4bdfffe 87415600 debug optional libmariadbd19-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb', assuming source format...
 
Warning: File 'libmariadbd19-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb' looks like source but does not start with 'mariadb_'!
 
Unknown file type: 'e30f123c7e5872abf2152d5e393ecb28 104853360 debug optional mariadb-backup-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb', assuming source format...
 
Warning: File 'mariadb-backup-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb' looks like source but does not start with 'mariadb_'!
 
Unknown file type: '7cd1dc04566f3538aec9bb0cdc10069c 3561246 debug optional mariadb-client-core-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb', assuming source format...
 
Warning: File 'mariadb-client-core-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb' looks like source but does not start with 'mariadb_'!

So dbgsym packages aren't being saved.

Same as MDEV-16828.

https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=730572 - supported in reprepro-5.4.0 however Ubuntu still on 5.3.

{0,1}

[https://packages.ubuntu.com/search?keywords=reprepro|ref].

See also: https://askubuntu.com/questions/1217459/how-to-serve-ddeb-files-with-reprepro#1223342

 Comments   
Comment by Faustin Lammler [ 2024-01-17 ]

To be tested but we could use the version from https://packages.debian.org/experimental/reprepro.

❯ podman run -it ubuntu:22.04 bash
 
root@a24bf1a8641b:/# apt update && apt install wget -y
 
[...]
 
root@a24bf1a8641b:/# wget http://ftp.debian.org/debian/pool/main/r/reprepro/reprepro_5.4.3-1_amd64.deb
 
root@a24bf1a8641b:/# apt install -y ./reprepro_5.4.3-1_amd64.deb
 
root@a24bf1a8641b:/# reprepro --version
 
reprepro: This is reprepro version 5.4.3

Comment by Faustin Lammler [ 2024-01-17 ]

So, this would only work for recent OS (libc above 2.34 apparently), see https://github.com/MariaDB/buildbot/pull/276.

Comment by Daniel Black [ 2024-01-17 ]

ignoring libc-2.34 isn't sufficient apparently

20.04

 
root@17078fa4c869:/# reprepro --version
 
reprepro: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.34' not found (required by reprepro)
 
reprepro: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.33' not found (required by reprepro)

Also - missing s390x package http://ftp.debian.org/debian/pool/main/r/reprepro/

s390x on 22.04

 
 Reading package lists...
 
E: Invalid archive signature
 
E: Internal error, could not locate member control.tar{.zst,.lz4,.gz,.xz,.bz2,.lzma,}
 
E: Could not read meta data from /reprepro_5.4.3-1_s390x.deb
 
E: The package lists or status file could not be parsed or opened.

MDEV-16828 - aptly maybe - in deb, ubuntu, maintained.

see prev comment

Comment by Faustin Lammler [ 2024-01-18 ]

Temporary fix for 22.04 (except s390x) ready in https://github.com/MariaDB/buildbot/pull/276.
I will definitively consider and test the aptly alternative (I also asked dbart about it).

Comment by Daniel Bartholomew [ 2024-01-18 ]

For our Debian and Ubuntu repositories I use a patched version of reprepro that adds support for multiple versions and Ubuntu's .ddeb packages. Here's the README for how I compiled it: https://gist.github.com/dbart/0ba0f991e9b86d472e28e02998fce835

Comment by Faustin Lammler [ 2024-01-24 ]

temporary fix in https://github.com/MariaDB/buildbot/pull/287. I'll see with vlad when it can reach prod.

Results are in:
https://buildbot.dev.mariadb.org/#/builders/69/builds/21
https://ci.dev.mariadb.org/12/aarch64-debian-10-deb-autobake/debs/

Comment by Daniel Black [ 2024-01-25 ]

basic aptly useage (ubuntu2004 version)

 
 
 
root@feea0ebb4617:/#  aptly repo create mariadb10.4
 
Config file not found, creating default config at /root/.aptly.conf
 
 
 
 
 
Local repo [mariadb10.4] successfully added.
 
You can run 'aptly repo add mariadb10.4 ...' to add packages to repository.
 
 
 
root@feea0ebb4617:/# aptly repo add mariadb10.4 /mnt/*deb
 
Loading packages...
 
[+] libmariadb-dev-compat_1:10.4.33+maria~ubu2004_amd64 added
 
[+] libmariadb-dev-dbgsym_1:10.4.33+maria~ubu2004_amd64 added
 
[+] libmariadb-dev_1:10.4.33+maria~ubu2004_amd64 added
 
[+] libmariadb3-compat_1:10.4.33+maria~ubu2004_amd64 added
 
(/mnt is a mirrror of ci.mariadb.org/42713/amd64-ubuntu-2004-deb-autobake/debs) - this was quick appeared to be just creating a local DB (/root/.aptly/db/).
 
 
 
root@feea0ebb4617:/# aptly publish repo -distribution=focal -skip-signing  mariadb10.4 /repo/
 
Loading packages...
 
Generating metadata files and linking package files...
 
Finalizing metadata files...
 
 
 
Local repo mariadb10.4 has been successfully published.
 
Please setup your webserver to serve directory '/root/.aptly/public' with autoindexing.
 
 
 
root@feea0ebb4617:/# find  /root/.aptly/public/repo | more
 
/root/.aptly/public/repo
 
/root/.aptly/public/repo/dists
 
/root/.aptly/public/repo/dists/focal
 
/root/.aptly/public/repo/dists/focal/main
 
/root/.aptly/public/repo/dists/focal/main/Contents-amd64.gz
 
/root/.aptly/public/repo/dists/focal/main/binary-amd64
 
/root/.aptly/public/repo/dists/focal/main/binary-amd64/Packages.gz
 
/root/.aptly/public/repo/dists/focal/main/binary-amd64/Release
 
/root/.aptly/public/repo/dists/focal/main/binary-amd64/Packages
 
/root/.aptly/public/repo/dists/focal/main/binary-amd64/Packages.bz2
 
/root/.aptly/public/repo/dists/focal/Contents-amd64.gz
 
/root/.aptly/public/repo/dists/focal/Release
 
/root/.aptly/public/repo/pool
 
/root/.aptly/public/repo/pool/main
 
/root/.aptly/public/repo/pool/main/m
 
/root/.aptly/public/repo/pool/main/m/mariadb-10.4
 
/root/.aptly/public/repo/pool/main/m/mariadb-10.4/mariadb-plugin-oqgraph-dbgsym_10.4.33+maria~ubu2004_amd64.ddeb
 
/root/.aptly/public/repo/pool/main/m/mariadb-10.4/mariadb-plugin-mroonga-dbgsym_10.4.33+maria~ubu2004_amd64.ddeb

Comment by Faustin Lammler [ 2024-01-25 ]

Good! Let's wait for the release and test this after it.

Generated at Thu Feb 08 03:39:19 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.