User Tools

Site Tools


Sidebar

General Lab Info (Mainly for Devs)

Hardware

Lab Infrastructure Services

Misc Admin Tasks
These are infrequently completed tasks that don't fit under any specific service

Production Services

OVH = OVH
RHEV = Sepia RHE instance
Baremetal = Host in Sepia lab

The Attic/Legacy Info

hardware:incerta

incerta{01..08}

Summary

Intel no-model prototypes. Used primarily by Mark Nelson for Performance testing.

incerta{02,03,04,08} are connected to jenkins.ceph.com. /home/jenkins-build is mounted on an NVMe drive for incerta{02..04} using https://github.com/djgalloway/sepia/blob/master/ansible-playbooks/jenkins-build-home.yml

Hardware Specs

Count Manufacturer Model Capacity Notes
Chassis N/A Intel S2600WT2 N/A 2U
Mainboard N/A Intel S2600WT2 N/A Version H21573-360
CPU 2x Intel Xeon(R) CPU E5-2650 v3 @ 2.30GHz N/A ARK
RAM 8 DIMMs Micron 18ASF1G72PDZ-2G1A1 8GB 64GB total per system
HDD 8 Seagate ST91000640NS 1TB
NVMe 4 Intel ? 745.2GB
NIC 2 ports Intel I350 1Gb On-board
NIC 2 ports Intel XL710 40Gbps Cabled to mlx-sw01.ipmi.sepia.ceph.com

Donated Peripherals

ZNS Samples

Western Digital donated two of these in early 2020 for us to play with. They are installed in incerta05 at /dev/nvme0n1 and /dev/nvme1n1. I purchased some PCIe to U.2 adapters since we didn't have any systems that could accept U.2 drives natively.

Racking ticket for those is https://redhat.service-now.com/surl.do?n=TASK0837858

ZNS Samples Round 2

WDC sent two more in March 2021. Replaced old ones with these. Model WZS4C8T2TDSP303.

Racking ticket: https://redhat.service-now.com/surl.do?n=RITM0861862

I think maybe the old samples were crippled. WD claims they were M.2 form factor but I bought U.2 PCIe adapters.

Configuring the 40Gb NICs

The 40Gbps Infiniband switch the incerta are connected to does not have a DHCP server built in so the servers have to be configured manually. I wrote an ansible playbook to quickly take care of this on CentOS machines and Ubuntu machines that are not using netplan.

Example:

cd $(mktemp -d) # optional
git clone https://github.com/ceph/ceph-cm-ansible
git clone git@github.com:ceph/ceph-sepia-secrets
cd ceph-cm-ansible

# Change the ansible_ssh_user below as needed
ansible-playbook -e '{"ansible_ssh_user": "nhm"}' -i ../ceph-sepia-secrets/ansible/inventory tools/incerta-nic.yml --limit incerta02*
hardware/incerta.txt · Last modified: 2022/07/27 17:18 by djgalloway