[MDBF-294] Implement a backup primary mirror Created: 2021-11-10  Updated: 2022-06-07  Resolved: 2022-06-07

Status: Closed
Project: MariaDB Foundation Development
Component/s: None
Affects Version/s: None
Fix Version/s: N/A

Type: Task Priority: Major
Reporter: Ian Gilfillan Assignee: Faustin Lammler
Resolution: Incomplete Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Description   

osuosl.org is the primary mirror for downloads. Around the 10.7.1 release (8 November) if experienced problems, causing a snowball effect of most other mirrors running behind or missing files.

The task is to use archive as an alternative in case of another osuosl failure.



 Comments   
Comment by Daniel Black [ 2021-11-11 ]

archive has URL differences MDBF-285

rpm solution - MDBF-297

Comment by Faustin Lammler [ 2022-02-24 ]

As discussed with greenman and dbart, netcologne.de is a better candidate than archive.mariadb.org because we have bad IO performance on archive.mariadb.org (SSHFS storage based on Hetzner Storage Box).

An access for dbart has been created on the archive.mariadb.org machine, this way he can quicker and easier:

  • synchronise archive.mariadb.org with hasky.askmonty.org ;
  • upload from archive.mariadb.org to netcologne.de.

I'll ask corp (slack engineering team and any interested person) to test the new mirror.mariadb.org system MDBF-297.

Comment by Daniel Bartholomew [ 2022-02-24 ]

I think tturenko would probably be interested in incorporating the new mirror.mariadb.org system into his testing.

Comment by Faustin Lammler [ 2022-04-11 ]

dbart is there anything else that I can do to finish this task? I believe that we are now able to test this for the next release with netcologne?

Comment by Daniel Black [ 2022-04-11 ]

note - MDBF-388 - galera appears to be not on these mirrors.

Comment by Faustin Lammler [ 2022-04-13 ]

It is and MDBF-388 should be fixed since yesterday.
https://mirror.mariadb.org/mariadb-10.6.7/repo/debian/pool/main/g/galera-4/

Or am I missing something?

Comment by Daniel Black [ 2022-04-13 ]

I was somehow expecting galera at the top level beside the major branch versions on the mirror.

https://rpm.mariadb.org/10.9/centos74-amd64 missing per build. Others probably ok.

Comment by Faustin Lammler [ 2022-04-14 ]

Yes that was the change.
Quoting Elena:
> For galera, right, this repo was intentionally disabled recently, to check who is still using it and thus hopefully screams when it stops working. It hasn't been maintained for a long time and thus shouldn't be used.
> Depending on what you want to use in your tests, you can take either the last released galera package from the server release repos, or the last built package from hasky or from where you yourself build/store them.

For 10.9, true, not sure why packages are not present but it's probably related to the new release model. In that case, we should keep this in mind and make BB not generate false positive.

Comment by Daniel Bartholomew [ 2022-04-14 ]

https://rpm.mariadb.org/10.9/centos74-amd64 missing per build. Others probably ok.

10.9.0 was a bintar-only release (as are all 10.x.0 releases in the new release model), so no packages or repositories for them. Packages and repositories show up for 10.x.1+.

Comment by Faustin Lammler [ 2022-04-20 ]

Ok thanks for the clarification, so this is definitively something to take in consideration in the BB upgrade/install scripts.

Comment by Faustin Lammler [ 2022-04-26 ]

I have created MDBF-398 to track this.

Comment by Faustin Lammler [ 2022-06-07 ]

We now have 2 primary mirrors:

  • ftp.osuosl.org::mariadb
  • mirror.netcologne.de::mariadb

I have also implemented a check that will alert us if those mirror are not in sync.

Generated at Thu Feb 08 03:36:50 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.