Differences

This shows you the differences between two versions of the page.

--- hardware:incerta [2021/03/10 19:44] – djgalloway
+++ hardware:incerta [2022/07/27 17:18] (current) – djgalloway
@@ Line 16: / Line 16: @@
 ^ NVMe       | 4        | Intel         | ?                                 | 745.2GB   |                                                                                                 |
 ^ NIC        | 2 ports  | Intel         | I350                              | 1Gb       | On-board                                                                                        |
-^ NIC        | 2 ports  | Intel         | XL710                             | 40Gbps    |                                                                                                 |
+^ NIC        | 2 ports  | Intel         | XL710                             | 40Gbps    | Cabled to mlx-sw01.ipmi.sepia.ceph.com                                                          |
 ===== Donated Peripherals =====
@@ Line 25: / Line 25: @@
 === ZNS Samples Round 2 ===
-WDC sent two more in March 2021.  Replaced old ones with these.
+WDC sent two more in March 2021.  Replaced old ones with these.  Model ''WZS4C8T2TDSP303''.
 Racking ticket: https://redhat.service-now.com/surl.do?n=RITM0861862
+I think maybe the old samples were crippled.  WD claims they were M.2 form factor but I bought U.2 PCIe adapters.
+===== Configuring the 40Gb NICs =====
+The 40Gbps Infiniband switch the incerta are connected to does not have a DHCP server built in so the servers have to be configured manually.  I wrote an ansible playbook to quickly take care of this on CentOS machines and Ubuntu machines that are not using netplan.
+**Example**:
+<code>
+cd $(mktemp -d) # optional
+git clone https://github.com/ceph/ceph-cm-ansible
+git clone git@github.com:ceph/ceph-sepia-secrets
+cd ceph-cm-ansible
+# Change the ansible_ssh_user below as needed
+ansible-playbook -e '{"ansible_ssh_user": "nhm"}' -i ../ceph-sepia-secrets/ansible/inventory tools/incerta-nic.yml --limit incerta02*
+</code>