hardware:incerta
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
hardware:incerta [2021/03/12 14:14] djgalloway |
hardware:incerta [2022/07/27 17:18] (current) djgalloway |
||
|---|---|---|---|
| Line 16: | Line 16: | ||
| ^ NVMe | 4 | Intel | ? | 745.2GB | | | ^ NVMe | 4 | Intel | ? | 745.2GB | | | ||
| ^ NIC | 2 ports | Intel | I350 | 1Gb | On-board | | ^ NIC | 2 ports | Intel | I350 | 1Gb | On-board | | ||
| - | ^ NIC | 2 ports | Intel | XL710 | 40Gbps | | | + | ^ NIC | 2 ports | Intel | XL710 | 40Gbps | Cabled to mlx-sw01.ipmi.sepia.ceph.com | |
| ===== Donated Peripherals ===== | ===== Donated Peripherals ===== | ||
| Line 30: | Line 30: | ||
| I think maybe the old samples were crippled. WD claims they were M.2 form factor but I bought U.2 PCIe adapters. | I think maybe the old samples were crippled. WD claims they were M.2 form factor but I bought U.2 PCIe adapters. | ||
| + | |||
| + | ===== Configuring the 40Gb NICs ===== | ||
| + | The 40Gbps Infiniband switch the incerta are connected to does not have a DHCP server built in so the servers have to be configured manually. I wrote an ansible playbook to quickly take care of this on CentOS machines and Ubuntu machines that are not using netplan. | ||
| + | |||
| + | **Example**: | ||
| + | <code> | ||
| + | cd $(mktemp -d) # optional | ||
| + | git clone https://github.com/ceph/ceph-cm-ansible | ||
| + | git clone git@github.com:ceph/ceph-sepia-secrets | ||
| + | cd ceph-cm-ansible | ||
| + | |||
| + | # Change the ansible_ssh_user below as needed | ||
| + | ansible-playbook -e '{"ansible_ssh_user": "nhm"}' -i ../ceph-sepia-secrets/ansible/inventory tools/incerta-nic.yml --limit incerta02* | ||
| + | </code> | ||
hardware/incerta.1615558465.txt.gz ยท Last modified: 2021/03/12 14:14 by djgalloway
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
