User Tools

Site Tools


hardware:incerta

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
hardware:incerta [2020/11/12 21:18] – [Donated Peripherals] djgallowayhardware:incerta [2022/07/27 17:18] (current) – djgalloway
Line 16: Line 16:
 ^ NVMe       | 4        | Intel         | ?                                 | 745.2GB   |                                                                                                 | ^ NVMe       | 4        | Intel         | ?                                 | 745.2GB   |                                                                                                 |
 ^ NIC        | 2 ports  | Intel         | I350                              | 1Gb       | On-board                                                                                        | ^ NIC        | 2 ports  | Intel         | I350                              | 1Gb       | On-board                                                                                        |
-^ NIC        | 2 ports  | Intel         | XL710                             | 40Gbps    |                                                                                                 |+^ NIC        | 2 ports  | Intel         | XL710                             | 40Gbps    | Cabled to mlx-sw01.ipmi.sepia.ceph.com                                                          |
  
 ===== Donated Peripherals ===== ===== Donated Peripherals =====
Line 23: Line 23:
  
 Racking ticket for those is https://redhat.service-now.com/surl.do?n=TASK0837858 Racking ticket for those is https://redhat.service-now.com/surl.do?n=TASK0837858
 +
 +=== ZNS Samples Round 2 ===
 +WDC sent two more in March 2021.  Replaced old ones with these.  Model ''WZS4C8T2TDSP303''.
 +
 +Racking ticket: https://redhat.service-now.com/surl.do?n=RITM0861862
 +
 +I think maybe the old samples were crippled.  WD claims they were M.2 form factor but I bought U.2 PCIe adapters.
 +
 +===== Configuring the 40Gb NICs =====
 +The 40Gbps Infiniband switch the incerta are connected to does not have a DHCP server built in so the servers have to be configured manually.  I wrote an ansible playbook to quickly take care of this on CentOS machines and Ubuntu machines that are not using netplan.
 +
 +**Example**:
 +<code>
 +cd $(mktemp -d) # optional
 +git clone https://github.com/ceph/ceph-cm-ansible
 +git clone git@github.com:ceph/ceph-sepia-secrets
 +cd ceph-cm-ansible
 +
 +# Change the ansible_ssh_user below as needed
 +ansible-playbook -e '{"ansible_ssh_user": "nhm"}' -i ../ceph-sepia-secrets/ansible/inventory tools/incerta-nic.yml --limit incerta02*
 +</code>
hardware/incerta.1605215912.txt.gz · Last modified: by djgalloway