Details
-
Task
-
Status: Closed (View Workflow)
-
Major
-
Resolution: Fixed
-
BB V1.03
-
None
-
Sprint 4 (25.02.2025), Sprint 5 (10.03.2025)
Description
Recently getting a lot of OOM conditions in which libvirt VM's on hz-bbw4 are the victims of a too much Docker load on this machine.
This led to analyzing the theoretical load on the protected branches worker hosts, hz-bbw1 and hz-bbw4 and it doesn't surprise me that we assign more builders than the infrastructure allows us to do.
I propose to add hz-bbw7 as a protected branches worker host, as on hz-bbw7 currently only bintar (centos7, almalinux-8) run and we have enough room.
More on that, if multiple tarball's are triggered in a short amount of time, is a safer choice to decrease the locks value on hz-bbw 1,4,7 so that we don't risk over-provisioning builds.
hz-bbw4:
|
- CPU: 64
|
- MEM: 128 G
|
hz-bbw1:
|
- CPU: 64
|
- MEM: 128 G
|
-------------------------------------------------
|
Per host Docker Request CPU: 97
|
Per host Docker Request MEM: ~ nr.CPU x 2 : 194 G
|
-------------------------------------------------
|
|
|
hz-bbw1 -> locks:9
|
Docker:
|
- msan-clang-16 -> make:20 ; mtr:40 |
- deb-11-debug-ps-emb -> make:14 ; mtr:28 |
- deb-12 (release) -> make:7 ; mtr: 14 |
- deb-12-debug-emb -> make:14 ; mtr:28 |
- fedora-40 (release) -> make:7 ; mtr: 14 |
- last-N-failed -> make:7 ; mtr:14 |
- ub-2004-debug -> make:14 ; mtr:28 |
- ub-2204-debug-ps -> make:14 ; mtr 28 |
--------------------------------------------------
|
--------------------------------------------------
|
hz-bbw4 -> locks:9
|
Docker:
|
- msan-clang-16 -> make:20 ; mtr:40 |
- deb-11-debug-ps-emb -> make:14 ; mtr:14 |
- deb-12 (release) -> make:7 ; mtr: 14 |
- deb-12-debug-emb -> make:14 ; mtr:28 |
- fedora-40 (release) -> make:7 ; mtr: 14 |
- last-N-failed -> make:7 ; mtr:14 |
- ub-2004-debug -> make:14 ; mtr:28 |
- ub-2204-debug-ps -> make:14 ; mtr 28 |
VM:
|
- freebsd
|
- gitlab runner
|
- bb-rhel8-docker
|
