This is an old revision of the document!

braggi{01..14}

https://150.239.170.15/cabnavigator.php?cabinetid=32

Summary

Qty 14 ARM64 Jenkins builders purchased as part of IBM's 2025 investment in the lab migration.

Hardware Specs

	Count	Manufacturer	Model	Capacity	Notes
Chassis	N/A	Supermicro	ARS-110M-NR	N/A
Mainboard	N/A	Supermicro	R12SPD-A	N/A
CPU	1	Ampere	Altra(R) Processor Q64-30 CPU @ 3.0GHz	64 cores total
RAM	8 DIMMs	Samsung	M393A4K40EB3-CWE	32GB	256GB total
SSD	2	Samsung	PM9A3	960GB	1 for root, 1 for /home/jenkins-build
NIC	2 ports	Mellanox	ConnectX-4 Lx	25Gb	Port 1 cabled as uplink

Setting up as Jenkins slaves

sda race condition

There is an incredibly annoying race condition when installing CentOS 9 Stream on these nodes where sda and sdb get flip flopped. dgalloway tried fixing this with https://github.com/ceph/ceph-cm-ansible/pull/703/commits/1058a3d0ca85f00a0f7a2df416c4a22a2e08883c which did help but not entirely.

You can check if anaconda picked the right disk by pulling up the Java KVM, switching to another terminal (Ctrl+Alt+F2) and checking if /mnt/sysroot is on the 800GB or 400GB drive. You want it to be on the 400GB drive. If it's not, just reboot and try again.

How To

Reimage using Cobbler
Once the OS install is done,
1. Run the ceph-cm-ansible users role
2. Run ansible-playbook common.yml --tags vars,nagios,monitoring-scripts --limit braggi##
3. Run https://github.com/djgalloway/sepia/blob/master/ansible-playbooks/jenkins-build-home.yml
4. Run https://github.com/ceph/ceph-build/blob/master/ansible/examples/slave.yml
  1. ansible-playbook -M ./library/ -e permanent=True slave.yml --extra-vars '{"labels": "amd64 XXXXX huge sepia x86_64 braggi gigantic"}' --extra-vars '{"token": "XXXXX", "jenkins_credentials_uuid": "jenkins-build", "api_uri": "https://jenkins.ceph.com"}' --limit braggiXX*

Sepia Lab Wiki

Table of Contents