====== incerta{01..08} ======
https://opendcim.engineering.redhat.com/cabnavigator.php?cabinetid=501

===== Summary =====
Intel no-model prototypes.  Used primarily by Mark Nelson for Performance testing.

incerta{02,03,04,08} are connected to [[production:jenkins.ceph.com]].  ''/home/jenkins-build'' is mounted on an NVMe drive for incerta{02..04} using https://github.com/djgalloway/sepia/blob/master/ansible-playbooks/jenkins-build-home.yml

===== Hardware Specs =====
|            ^ Count    ^ Manufacturer  ^ Model                             ^ Capacity  ^ Notes                                                                                           ^
^ Chassis    | N/A      | Intel         | S2600WT2                          | N/A       | 2U                                                                                              |
^ Mainboard  | N/A      | Intel         | S2600WT2                          | N/A       | Version H21573-360                                                                              |
^ CPU        | 2x       | Intel         | Xeon(R) CPU E5-2650 v3 @ 2.30GHz  | N/A       | [[http://ark.intel.com/products/81705/Intel-Xeon-Processor-E5-2650-v3-25M-Cache-2_30-GHz|ARK]]  |
^ RAM        | 8 DIMMs  | Micron        | 18ASF1G72PDZ-2G1A1                | 8GB       | 64GB total per system                                                                           |
^ HDD        | 8        | Seagate       | ST91000640NS                      | 1TB       |                                                                                                 |
^ NVMe       | 4        | Intel         | ?                                 | 745.2GB   |                                                                                                 |
^ NIC        | 2 ports  | Intel         | I350                              | 1Gb       | On-board                                                                                        |
^ NIC        | 2 ports  | Intel         | XL710                             | 40Gbps    | Cabled to mlx-sw01.ipmi.sepia.ceph.com                                                          |

===== Donated Peripherals =====
=== ZNS Samples ===
Western Digital donated two of [[https://www.cnet.com/products/hgst-ultrastar-sn200-husmr7616bdp301-solid-state-drive-1-6-tb-pci-express-3-0-x4-nvme/|these]] in early 2020 for us to play with.  They are installed in incerta05 at ''/dev/nvme0n1'' and ''/dev/nvme1n1''.  I purchased some PCIe to U.2 adapters since we didn't have any systems that could accept U.2 drives natively.

Racking ticket for those is https://redhat.service-now.com/surl.do?n=TASK0837858

=== ZNS Samples Round 2 ===
WDC sent two more in March 2021.  Replaced old ones with these.  Model ''WZS4C8T2TDSP303''.

Racking ticket: https://redhat.service-now.com/surl.do?n=RITM0861862

I think maybe the old samples were crippled.  WD claims they were M.2 form factor but I bought U.2 PCIe adapters.

===== Configuring the 40Gb NICs =====
The 40Gbps Infiniband switch the incerta are connected to does not have a DHCP server built in so the servers have to be configured manually.  I wrote an ansible playbook to quickly take care of this on CentOS machines and Ubuntu machines that are not using netplan.

**Example**:
<code>
cd $(mktemp -d) # optional
git clone https://github.com/ceph/ceph-cm-ansible
git clone git@github.com:ceph/ceph-sepia-secrets
cd ceph-cm-ansible

# Change the ansible_ssh_user below as needed
ansible-playbook -e '{"ansible_ssh_user": "nhm"}' -i ../ceph-sepia-secrets/ansible/inventory tools/incerta-nic.yml --limit incerta02*
</code>