User Tools

Site Tools


Sidebar

General Lab Info (Mainly for Devs)

Hardware

Lab Infrastructure Services

Misc Admin Tasks
These are infrequently completed tasks that don't fit under any specific service

Production Services

OVH = OVH
RHEV = Sepia RHE instance
Baremetal = Host in Sepia lab

The Attic/Legacy Info

hardware:officinalis

This is an old revision of the document!


Officinalis | o{01..10}

Summary

10 nodes donated by Intel for Performance testing.

Hardware Specs

Count Manufacturer Model Capacity Notes
Chassis 1U Quanta D52B-1U N/A
Mainboard N/A Quanta S5B-MB (LBG-1G) N/A
CPU 2 Intel Intel(R) Xeon(R) Platinum 8276M CPU @ 2.20GHz 112 ARK
RAM 2 DIMMs Micron 36ASF4G72PZ-2G6H1 32GB 384GB Total
SSD 1 Intel SSDSC2KB960G8 1TB For OS
NVMe 2 Intel SSDPE21K750GA 1TB For OSD journals?
NVMe 8 Intel SSDPE2KX080T8 8TB For OSDs
NIC 2 NICs 2 x ports Intel XXV710 25Gb Not used
BMC 1 Quanta N/A N/A Reachable at $host.ipmi.sepia.ceph.com using usual IPMI credentials.

PXE/Reimaging

These machines are configured in DHCP to receive /var/lib/tftpboot/grub/grub-x86_64.efi from the Cobbler host when PXE booting. I had trouble PXEing using BIOS mode on these machines so we're using UEFI.

Our usual cephlab_rhel.ks kickstart is not set up to do UEFI so Anaconda will stop and say the Storage Configuration needs editing.

Network Config

There is an ansible module that is supposed to allow you to create bonds but it requires NetworkManager-glib which isn't in CentOS8. So I found and used https://github.com/linux-system-roles/network.

Here's the command I ran from the examples dir:

for num in {1..9}; do sed -i "s/172.21.3..*/172.21.3.$num\/20/g" officinalis.yml; ansible-playbook -e ansible_python_interpreter=/usr/bin/python3 officinalis.yml --limit o0${num}*; done; sed -i "s/172.21.3..*/172.21.3.10\/20/g" officinalis.yml; ansible-playbook -e ansible_python_interpreter=/usr/bin/python3 officinalis.yml --limit o10*

Here's the yml I used:

<pre> — - hosts: officinalis

become: true
vars:
  network_connections:
  1. name: ens20f0

persistent_state: absent

  1. name: ens20f1

persistent_state: absent

  1. name: ens49f0

persistent_state: absent

  1. name: ens49f1

persistent_state: absent

    # Create a bond profile
    - name: bond0
      state: up
      type: bond
      ip:
        address: 172.21.3.10/20
        gateway4: 172.21.15.254
      bond:
        mode: 802.3ad
      mtu: 1450
    # enslave an ethernet to the bond
    - name: ens20f0
      state: up
      type: ethernet
      master: bond0
    # enslave an ethernet to the bond
    - name: ens20f1
      state: up
      type: ethernet
      master: bond0
    # enslave an ethernet to the bond
    - name: ens49f0
      state: up
      type: ethernet
      master: bond0
    # enslave an ethernet to the bond
    - name: ens49f1
      state: up
      type: ethernet
      master: bond0
roles:
  - linux-system-roles.network

</pre>

hardware/officinalis.1569526997.txt.gz · Last modified: 2019/09/26 19:43 by djgalloway