incerta{01..08}

https://opendcim.engineering.redhat.com/cabnavigator.php?cabinetid=501

Intel no-model prototypes. Used primarily by Mark Nelson for Performance testing.

incerta{02,03,04,08} are connected to jenkins.ceph.com. /home/jenkins-build is mounted on an NVMe drive for incerta{02..04} using https://github.com/djgalloway/sepia/blob/master/ansible-playbooks/jenkins-build-home.yml

Western Digital donated two of these in early 2020 for us to play with. They are installed in incerta05 at /dev/nvme0n1 and /dev/nvme1n1. I purchased some PCIe to U.2 adapters since we didn't have any systems that could accept U.2 drives natively.

Racking ticket for those is https://redhat.service-now.com/surl.do?n=TASK0837858

WDC sent two more in March 2021. Replaced old ones with these. Model WZS4C8T2TDSP303.

Racking ticket: https://redhat.service-now.com/surl.do?n=RITM0861862

I think maybe the old samples were crippled. WD claims they were M.2 form factor but I bought U.2 PCIe adapters.

The 40Gbps Infiniband switch the incerta are connected to does not have a DHCP server built in so the servers have to be configured manually. I wrote an ansible playbook to quickly take care of this on CentOS machines and Ubuntu machines that are not using netplan.

Example:

cd $(mktemp -d) # optional
git clone https://github.com/ceph/ceph-cm-ansible
git clone git@github.com:ceph/ceph-sepia-secrets
cd ceph-cm-ansible

# Change the ansible_ssh_user below as needed
ansible-playbook -e '{"ansible_ssh_user": "nhm"}' -i ../ceph-sepia-secrets/ansible/inventory tools/incerta-nic.yml --limit incerta02*