Details

    • Bug
    • Status: Closed (View Workflow)
    • Critical
    • Resolution: Fixed
    • None
    • N/A
    • Buildbot
    • None

    Description

      https://buildbot.mariadb.org/#/builders/358/builds/11042/steps/7/logs/stdio

       
      + cat ../conf/distributions
      Origin: MariaDB
      Label: MariaDB
      Codename: jammy
      Architectures: amd64 source
      Components: main
      Description: MariaDB Repository
      + reprepro -b .. --ignore=wrongsourceversion include jammy ../mariadb_10.11.7+maria~ubu2204_amd64.changes
      Unknown file type: '9fea2498ccb3e610b185e707a18883a0 7566 debug optional libmariadb-dev-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb', assuming source format...
      Warning: File 'libmariadb-dev-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb' looks like source but does not start with 'mariadb_'!
      Unknown file type: 'c464ab3896c15529f37591139a96451f 568854 debug optional libmariadb3-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb', assuming source format...
      Warning: File 'libmariadb3-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb' looks like source but does not start with 'mariadb_'!
      Unknown file type: '4625b5bbe8b252b3df4b14b7a4bdfffe 87415600 debug optional libmariadbd19-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb', assuming source format...
      Warning: File 'libmariadbd19-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb' looks like source but does not start with 'mariadb_'!
      Unknown file type: 'e30f123c7e5872abf2152d5e393ecb28 104853360 debug optional mariadb-backup-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb', assuming source format...
      Warning: File 'mariadb-backup-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb' looks like source but does not start with 'mariadb_'!
      Unknown file type: '7cd1dc04566f3538aec9bb0cdc10069c 3561246 debug optional mariadb-client-core-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb', assuming source format...
      Warning: File 'mariadb-client-core-dbgsym_10.11.7+maria~ubu2204_amd64.ddeb' looks like source but does not start with 'mariadb_'!
      

      So dbgsym packages aren't being saved.

      Same as MDEV-16828.

      https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=730572 - supported in reprepro-5.4.0 however Ubuntu still on 5.3.

      {0,1}

      [https://packages.ubuntu.com/search?keywords=reprepro|ref].

      See also: https://askubuntu.com/questions/1217459/how-to-serve-ddeb-files-with-reprepro#1223342

      Attachments

        Issue Links

          Activity

            danblack Daniel Black created issue -
            danblack Daniel Black made changes -
            Field Original Value New Value
            danblack Daniel Black made changes -
            faust Faustin Lammler added a comment - - edited

            To be tested but we could use the version from https://packages.debian.org/experimental/reprepro.

            ❯ podman run -it ubuntu:22.04 bash
            root@a24bf1a8641b:/# apt update && apt install wget -y
            [...]
            root@a24bf1a8641b:/# wget http://ftp.debian.org/debian/pool/main/r/reprepro/reprepro_5.4.3-1_amd64.deb
            root@a24bf1a8641b:/# apt install -y ./reprepro_5.4.3-1_amd64.deb
            root@a24bf1a8641b:/# reprepro --version
            reprepro: This is reprepro version 5.4.3
            

            faust Faustin Lammler added a comment - - edited To be tested but we could use the version from https://packages.debian.org/experimental/reprepro . ❯ podman run -it ubuntu:22.04 bash root@a24bf1a8641b:/# apt update && apt install wget -y [...] root@a24bf1a8641b:/# wget http://ftp.debian.org/debian/pool/main/r/reprepro/reprepro_5.4.3-1_amd64.deb root@a24bf1a8641b:/# apt install -y ./reprepro_5.4.3-1_amd64.deb root@a24bf1a8641b:/# reprepro --version reprepro: This is reprepro version 5.4.3

            So, this would only work for recent OS (libc above 2.34 apparently), see https://github.com/MariaDB/buildbot/pull/276.

            faust Faustin Lammler added a comment - So, this would only work for recent OS (libc above 2.34 apparently), see https://github.com/MariaDB/buildbot/pull/276 .
            serg Sergei Golubchik made changes -
            danblack Daniel Black added a comment - - edited

            ignoring libc-2.34 isn't sufficient apparently

            20.04

            root@17078fa4c869:/# reprepro --version
            reprepro: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.34' not found (required by reprepro)
            reprepro: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.33' not found (required by reprepro)
            

            Also - missing s390x package http://ftp.debian.org/debian/pool/main/r/reprepro/

            s390x on 22.04

             Reading package lists...
            E: Invalid archive signature
            E: Internal error, could not locate member control.tar{.zst,.lz4,.gz,.xz,.bz2,.lzma,}
            E: Could not read meta data from /reprepro_5.4.3-1_s390x.deb
            E: The package lists or status file could not be parsed or opened.
            

            MDEV-16828 - aptly maybe - in deb, ubuntu, maintained.

            see prev comment

            danblack Daniel Black added a comment - - edited ignoring libc-2.34 isn't sufficient apparently 20.04 root@17078fa4c869:/# reprepro --version reprepro: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.34' not found (required by reprepro) reprepro: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.33' not found (required by reprepro) Also - missing s390x package http://ftp.debian.org/debian/pool/main/r/reprepro/ s390x on 22.04 Reading package lists... E: Invalid archive signature E: Internal error, could not locate member control.tar{.zst,.lz4,.gz,.xz,.bz2,.lzma,} E: Could not read meta data from /reprepro_5.4.3-1_s390x.deb E: The package lists or status file could not be parsed or opened. MDEV-16828 - aptly maybe - in deb , ubuntu , maintained . see prev comment

            Temporary fix for 22.04 (except s390x) ready in https://github.com/MariaDB/buildbot/pull/276.
            I will definitively consider and test the aptly alternative (I also asked dbart about it).

            faust Faustin Lammler added a comment - Temporary fix for 22.04 (except s390x) ready in https://github.com/MariaDB/buildbot/pull/276 . I will definitively consider and test the aptly alternative (I also asked dbart about it).

            For our Debian and Ubuntu repositories I use a patched version of reprepro that adds support for multiple versions and Ubuntu's .ddeb packages. Here's the README for how I compiled it: https://gist.github.com/dbart/0ba0f991e9b86d472e28e02998fce835

            dbart Daniel Bartholomew added a comment - For our Debian and Ubuntu repositories I use a patched version of reprepro that adds support for multiple versions and Ubuntu's .ddeb packages. Here's the README for how I compiled it: https://gist.github.com/dbart/0ba0f991e9b86d472e28e02998fce835
            dbart Daniel Bartholomew made changes -
            faust Faustin Lammler added a comment - temporary fix in https://github.com/MariaDB/buildbot/pull/287 . I'll see with vlad when it can reach prod. Results are in: https://buildbot.dev.mariadb.org/#/builders/69/builds/21 https://ci.dev.mariadb.org/12/aarch64-debian-10-deb-autobake/debs/
            danblack Daniel Black added a comment -

            basic aptly useage (ubuntu2004 version)

             
            root@feea0ebb4617:/#  aptly repo create mariadb10.4
            Config file not found, creating default config at /root/.aptly.conf
             
             
            Local repo [mariadb10.4] successfully added.
            You can run 'aptly repo add mariadb10.4 ...' to add packages to repository.
             
            root@feea0ebb4617:/# aptly repo add mariadb10.4 /mnt/*deb
            Loading packages...
            [+] libmariadb-dev-compat_1:10.4.33+maria~ubu2004_amd64 added
            [+] libmariadb-dev-dbgsym_1:10.4.33+maria~ubu2004_amd64 added
            [+] libmariadb-dev_1:10.4.33+maria~ubu2004_amd64 added
            [+] libmariadb3-compat_1:10.4.33+maria~ubu2004_amd64 added
            (/mnt is a mirrror of ci.mariadb.org/42713/amd64-ubuntu-2004-deb-autobake/debs) - this was quick appeared to be just creating a local DB (/root/.aptly/db/).
             
            root@feea0ebb4617:/# aptly publish repo -distribution=focal -skip-signing  mariadb10.4 /repo/
            Loading packages...
            Generating metadata files and linking package files...
            Finalizing metadata files...
             
            Local repo mariadb10.4 has been successfully published.
            Please setup your webserver to serve directory '/root/.aptly/public' with autoindexing.
             
            root@feea0ebb4617:/# find  /root/.aptly/public/repo | more
            /root/.aptly/public/repo
            /root/.aptly/public/repo/dists
            /root/.aptly/public/repo/dists/focal
            /root/.aptly/public/repo/dists/focal/main
            /root/.aptly/public/repo/dists/focal/main/Contents-amd64.gz
            /root/.aptly/public/repo/dists/focal/main/binary-amd64
            /root/.aptly/public/repo/dists/focal/main/binary-amd64/Packages.gz
            /root/.aptly/public/repo/dists/focal/main/binary-amd64/Release
            /root/.aptly/public/repo/dists/focal/main/binary-amd64/Packages
            /root/.aptly/public/repo/dists/focal/main/binary-amd64/Packages.bz2
            /root/.aptly/public/repo/dists/focal/Contents-amd64.gz
            /root/.aptly/public/repo/dists/focal/Release
            /root/.aptly/public/repo/pool
            /root/.aptly/public/repo/pool/main
            /root/.aptly/public/repo/pool/main/m
            /root/.aptly/public/repo/pool/main/m/mariadb-10.4
            /root/.aptly/public/repo/pool/main/m/mariadb-10.4/mariadb-plugin-oqgraph-dbgsym_10.4.33+maria~ubu2004_amd64.ddeb
            /root/.aptly/public/repo/pool/main/m/mariadb-10.4/mariadb-plugin-mroonga-dbgsym_10.4.33+maria~ubu2004_amd64.ddeb
            

            danblack Daniel Black added a comment - basic aptly useage (ubuntu2004 version)   root@feea0ebb4617:/# aptly repo create mariadb10.4 Config file not found, creating default config at /root/.aptly.conf     Local repo [mariadb10.4] successfully added. You can run 'aptly repo add mariadb10.4 ...' to add packages to repository.   root@feea0ebb4617:/# aptly repo add mariadb10.4 /mnt/*deb Loading packages... [+] libmariadb-dev-compat_1:10.4.33+maria~ubu2004_amd64 added [+] libmariadb-dev-dbgsym_1:10.4.33+maria~ubu2004_amd64 added [+] libmariadb-dev_1:10.4.33+maria~ubu2004_amd64 added [+] libmariadb3-compat_1:10.4.33+maria~ubu2004_amd64 added (/mnt is a mirrror of ci.mariadb.org/42713/amd64-ubuntu-2004-deb-autobake/debs) - this was quick appeared to be just creating a local DB (/root/.aptly/db/).   root@feea0ebb4617:/# aptly publish repo -distribution=focal -skip-signing mariadb10.4 /repo/ Loading packages... Generating metadata files and linking package files... Finalizing metadata files...   Local repo mariadb10.4 has been successfully published. Please setup your webserver to serve directory '/root/.aptly/public' with autoindexing.   root@feea0ebb4617:/# find /root/.aptly/public/repo | more /root/.aptly/public/repo /root/.aptly/public/repo/dists /root/.aptly/public/repo/dists/focal /root/.aptly/public/repo/dists/focal/main /root/.aptly/public/repo/dists/focal/main/Contents-amd64.gz /root/.aptly/public/repo/dists/focal/main/binary-amd64 /root/.aptly/public/repo/dists/focal/main/binary-amd64/Packages.gz /root/.aptly/public/repo/dists/focal/main/binary-amd64/Release /root/.aptly/public/repo/dists/focal/main/binary-amd64/Packages /root/.aptly/public/repo/dists/focal/main/binary-amd64/Packages.bz2 /root/.aptly/public/repo/dists/focal/Contents-amd64.gz /root/.aptly/public/repo/dists/focal/Release /root/.aptly/public/repo/pool /root/.aptly/public/repo/pool/main /root/.aptly/public/repo/pool/main/m /root/.aptly/public/repo/pool/main/m/mariadb-10.4 /root/.aptly/public/repo/pool/main/m/mariadb-10.4/mariadb-plugin-oqgraph-dbgsym_10.4.33+maria~ubu2004_amd64.ddeb /root/.aptly/public/repo/pool/main/m/mariadb-10.4/mariadb-plugin-mroonga-dbgsym_10.4.33+maria~ubu2004_amd64.ddeb

            Good! Let's wait for the release and test this after it.

            faust Faustin Lammler added a comment - Good! Let's wait for the release and test this after it.

            https://buildbot.mariadb.org/#/builders/358 has been fixed by:

            That is a rollback to the previous state where we did not create the repository but copy deb packages directly to the buildbot master.

            We will still implement the repo creation (and testing from the repository in install/upgrade tests) and probably use aptly for that. But it will need more testing on the dev infra before pushing to production.

            faust Faustin Lammler added a comment - https://buildbot.mariadb.org/#/builders/358 has been fixed by: https://github.com/MariaDB/buildbot/pull/298 https://github.com/MariaDB/buildbot/pull/301 That is a rollback to the previous state where we did not create the repository but copy deb packages directly to the buildbot master. We will still implement the repo creation (and testing from the repository in install/upgrade tests) and probably use aptly for that. But it will need more testing on the dev infra before pushing to production.
            faust Faustin Lammler made changes -
            Fix Version/s N/A [ 27305 ]
            Resolution Fixed [ 1 ]
            Status Open [ 1 ] Closed [ 6 ]
            Remaining Estimate 0d [ 0 ]
            julien.fritsch Julien Fritsch made changes -
            Workflow MariaDB v4 [ 182807 ] MariaDB Foundation v1 [ 188797 ]

            People

              faust Faustin Lammler
              danblack Daniel Black
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: