[MDEV-16828] dbgsym / debuginfo packages missing from mirrors for Ubuntu artful/bionic Created: 2018-07-26  Updated: 2024-01-18  Resolved: 2020-05-04

Status: Closed
Project: MariaDB Server
Component/s: Packaging
Affects Version/s: 10.1, 10.3.8, 10.2, 10.3
Fix Version/s: 10.1.45, 10.2.32, 10.3.23, 10.4.13

Type: Bug Priority: Major
Reporter: Daniel Black Assignee: Daniel Bartholomew
Resolution: Fixed Votes: 1
Labels: None

Issue Links:
Duplicate
is duplicated by MDEV-18262 No debug info packages for recent Ubu... Closed
Relates
relates to MDBF-637 missing debuginfo packages due to rep... Open
relates to MDEV-14888 Provide multi-version package reposit... Closed

 Description   

Looking at mirror http://nyc2.mirrors.digitalocean.com/mariadb/repo/10.3/ubuntu/pool/main/m/mariadb-10.3/



 Comments   
Comment by Daniel Bartholomew [ 2018-08-07 ]

The tool we use for creating our repositories, reprepro, doesn't support .ddeb packages. See: https://bugs.launchpad.net/ubuntu/+source/reprepro/+bug/799889

It's been a while since I last looked into it (around the time of the 17.10 "artful" release), and the most recent message on the bug report says that there is a patch in the master branch to add support for .ddeb packages. So it's probably time to revist this and manually compile the latest source and try it out.

Comment by Daniel Black [ 2018-08-08 ]

Thanks dbart

Comment by Daniel Bartholomew [ 2018-10-09 ]

My tests with a locally compiled version of reprepro patched for multiversion and ddeb support have not yielded anything we can use. The binary throws all sorts of errors and refuses to include new packages.

I will try again later, but for now we're still unable to have multi-version repositories for Debian/Ubuntu.

Comment by Daniel Bartholomew [ 2019-01-22 ]

If we are unable to get a working version of `reprepro` then we need to investigate using a different tool to create/update our Debian/Ubuntu repositories.

Comment by Daniel Bartholomew [ 2019-01-22 ]

freight and aptly are two alternatives. It doesn't look like freight has been updated in a while, but maybe it just doesn't need to be, but it's also not in the Ubuntu repositories. Aptly seems better in both of those two areas. I'll give both a shot though, and I'm open to other suggestions.

The main criteria for any reprepro replacement are:

  1. able to integrate the solution into the release process
  2. able to include multiple versions
  3. able to include .ddeb files
  4. won't impact users (ideally users should not even know that how we create/update our repositories has changed)
Comment by Daniel Black [ 2019-01-23 ]

The only other things I can think of are cloud services like OBS and https://packagecloud.io/ and I don't know how well either will support requirement 4.

aptly doesn't seem too bad, seems to support multiple version and dbgsym packages (https://github.com/aptly-dev/aptly/pull/499) and ddebs (https://github.com/aptly-dev/aptly/commit/b877e06a02e96d3cdcb9728f9e587d4132a76b79).

Hope it goes well. Thanks for looking into it.

Comment by Daniel Black [ 2019-05-03 ]

I see Debian(buster,sid,stretch) and Ubuntu(xenial) on mirrors.

Lack of full distro support for Debian/Ubuntu is a notable gap in GeoffMontee wonderfully updated:
https://mariadb.com/kb/en/library/how-to-produce-a-full-stack-trace-for-mysqld/#installing-debug-info-packages-on-linux

Comment by Daniel Black [ 2019-12-06 ]

dbart, noticed you have amd64 debug symbols being generated for bionic, disco and eon,

Is the mechanism used supportable to have ppc64le and arm64 getting dbugsym packages for the LTS 18.04 bionic?

only looked at 10.4:
http://mirror.netinch.com/pub/mariadb/repo/10.4/ubuntu/pool/main/m/mariadb-10.4/

Comment by Daniel Bartholomew [ 2019-12-06 ]

Thanks for pointing out they were missing. I see what the problem is. I'll make sure they are included in the next release.

Comment by Daniel Bartholomew [ 2020-04-02 ]

I've updated the Repo Configuration Tool at https://downloads.mariadb.org/mariadb/repositories/ with instructions on how to enable `-dbgsym` packages to show up in APT for bionic, eoan, and focal.

On bionic there's an issue with some warnings that appear when the debug package component is configured and you run an `apt update`. Eoan and Focal don't show those warnings, so it might just be an issue with the version of apt in bionic and not the repository, and the warnings can be safely ignored. My testing hasn't uncovered any other issues, so I think I'm about ready to close this, unless there's something I'm forgetting.

Comment by Daniel Black [ 2020-04-03 ]

Thank you dbart I'll test next week. Can I assume focal support for aarch64/ppc64le is coming after its LTS release at the end of the month?

Comment by Daniel Bartholomew [ 2020-04-03 ]

danblack Yes, I'll be spinning up builders for aarch64 and ppc64le once the release is out.

Comment by Daniel Bartholomew [ 2024-01-18 ]

Basically, the fix for this MDEV was to use a patched version of reprepro that adds the multi-version capability and the ability to import Ubuntu's .ddeb packages. A README for how I compiled it is here: https://gist.github.com/dbart/0ba0f991e9b86d472e28e02998fce835

Generated at Thu Feb 08 08:31:52 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.