[MDBF-15] Implement a fast, complete, archive download server Created: 2020-04-06 Updated: 2022-02-01 Resolved: 2021-11-10 |
|
| Status: | Closed |
| Project: | MariaDB Foundation Development |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Task | Priority: | Major |
| Reporter: | Ian Gilfillan | Assignee: | Faustin Lammler |
| Resolution: | Done | Votes: | 0 |
| Labels: | download | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||
| Description |
|
archive.mariadb.org contains all (actually there are a few releases missing) MariaDB releases. This server is very slow. http://ftp.hosteurope.de/mirror/archive.mariadb.org/ is an alternative archive, and much faster, but they unfortunately no longer mirror everything. We need a faster version of archive.mariadb.org - usage should be low, but when someone does request an old version, it should be delivered quickly! |
| Comments |
| Comment by Ian Gilfillan [ 2020-04-07 ] | ||
|
dbart has added the missing release (the others were pulled releases), so archive.mariadb.org is complete now | ||
| Comment by Faustin Lammler [ 2020-06-09 ] | ||
|
Will check what's happening to that server. One temporary solution could be to cache it with cloudflare. | ||
| Comment by Faustin Lammler [ 2020-06-09 ] | ||
|
Hi, 1. subscribe to https://www.hetzner.com/storage/storage-box/bx50
So starting with 5TB seems reasonable. 2. mount the storage box using SSHFS protocol on the hz-www VM 3. configure the new archive.mariadb.org website on hz-www (nginx) I suggest we use cloudflare caching for archive.mariadb.org because:
4. give dbart access to hz-www so he can update the new archive.mariadb.org by scp/rsync or his preferred solution. awren, kaj this would add a monthly fee of 26.28€ on our HZ invoice. | ||
| Comment by Faustin Lammler [ 2020-06-09 ] | ||
|
To complete this, maybe greenman or dbart can do some storage projection for the future (see bellow)?
So every release adds more ore less 53GB of data to the archive. | ||
| Comment by Faustin Lammler [ 2020-06-12 ] | ||
|
Due to https://mariadb.com/kb/en/mirror-sites-for-mariadb/+comments/4623#comment_4624, I removed DNS proxy on cloudflare for archive.mariadb.org. | ||
| Comment by Daniel Bartholomew [ 2020-06-12 ] | ||
|
rsync.mariadb.org is shorter and a bit easier to remember, we just need to document it on the Mirroring MariaDB page (once it is set up of course) | ||
| Comment by Faustin Lammler [ 2020-06-12 ] | ||
|
Ok! I propose we do not modify this for the moment. Once we have the new archive.mariadb.org (I note that I have to also implement rsync service!) we will see if it's necessary to cache it with cloudflare (we will then have metrics of the bandwitdh usage..). | ||
| Comment by Faustin Lammler [ 2020-09-09 ] | ||
|
A new archive server has been implemented: It's available in HTTPS and IPv4/IPv6. |