Table of Contents

omani{001..010}

Summary

These were donated by ARM in 2017. Ask dgalloway or dmick for our contact at ARM.

They are ARM64 Cavium ThunderX systems in 1U Gigabyte chassis.

Racking Tickets

omani{001..003}: https://engineering.redhat.com/rt/Ticket/Display.html?id=440635
omani{004..010}: https://engineering.redhat.com/rt/Ticket/Display.html?id=449435

Hardware Specs

Count Manufacturer Model Capacity Notes
Chassis 1U Gigabyte R120-T32 N/A
Mainboard N/A Gigabyte MT30-GS1 N/A
CPU 1 Cavium ThunderX 88XX N/A
RAM 8 DIMMs Micron/Crucial 18ASF1G72PZ-2G3B1 8GB 64GB Total
SSD 1 Various 500GB
NIC 2 ports Cavium THUNDERX BGX 1Gb
BMC 1 Gigabyte N/A N/A Reachable at $host.ipmi.sepia.ceph.com (HTTPS only works in Chrome)

PXE/Reimaging

These machines are configured in DHCP to receive /var/lib/tftpboot/aarch64/grubaa64.efi from the Cobbler host when PXE booting. This brings up the menu I manually created in /var/lib/tftpboot/aarch64/grub.cfg.

When reimaging with Xenial, it will appear to hang for a few minutes. Just let it sit and you'll eventually get to the NIC selection screen in the installer.

Also, if you need to install vagrant on Xenial for CI use, see https://stackoverflow.com/questions/36811863/cant-install-vagrant-plugins-in-ubuntu/36991648#36991648

Resetting root password via grub prompt

Hopefully we won't need this but I thought it was worth documenting since we didn't know the logins for the Xenial installation that came shipped with the systems.

let system boot and get to PXE grub menu
Press C for grub command prompt

Use `ls` to figure out where the boot partition is.  (e.g., ls (hd0,gpt2)/)

grub> linux (hd0,gpt2)/boot/vmlinuz root=/dev/sda2 init=/bin/sh
grub> initrd (hd0,gpt2)/boot/initrd.img
grub> boot

# mount -o remount,rw /
# passwd root

# /sbin/reboot -f

Serial Access

These are accessible via conserver using IPMI SOL as the driver. (e.g., console omani001)

These are also accessible via their IPMI web interfaces. omani###.ipmi.sepia.ceph.com using the standard ipmi credentials.

NOTE: If the output is gibberish, double check that the baudrate is 115200 under IPMI and Serial Over LAN in the BMC Web UI.