hardware:incerta
Differences
This shows you the differences between two versions of the page.
| Next revision | Previous revision | ||
|
hardware:incerta [2016/06/29 20:09] dgalloway created |
hardware:incerta [2022/07/27 17:18] (current) djgalloway |
||
|---|---|---|---|
| Line 4: | Line 4: | ||
| ===== Summary ===== | ===== Summary ===== | ||
| Intel no-model prototypes. Used primarily by Mark Nelson for Performance testing. | Intel no-model prototypes. Used primarily by Mark Nelson for Performance testing. | ||
| + | |||
| + | incerta{02,03,04,08} are connected to [[production:jenkins.ceph.com]]. ''/home/jenkins-build'' is mounted on an NVMe drive for incerta{02..04} using https://github.com/djgalloway/sepia/blob/master/ansible-playbooks/jenkins-build-home.yml | ||
| ===== Hardware Specs ===== | ===== Hardware Specs ===== | ||
| - | | ^ Count ^ Manufacturer ^ Model ^ Capacity ^ Notes ^ | + | | ^ Count ^ Manufacturer ^ Model ^ Capacity ^ Notes ^ |
| - | ^ Chassis | N/A | Supermicro | SYS-F517H6-FT | N/A | 4U | | + | ^ Chassis | N/A | Intel | S2600WT2 | N/A | 2U | |
| - | ^ Mainboard | N/A | Supermicro | X9SCFF | N/A | | | + | ^ Mainboard | N/A | Intel | S2600WT2 | N/A | Version H21573-360 | |
| - | ^ CPU | 1 | Intel | Xeon(R) CPU E3-1240 V2 @ 3.40GHz | N/A | [[http://ark.intel.com/products/65730/Intel-Xeon-Processor-E3-1240-v2-8M-Cache-3_40-GHz|ARK]] | | + | ^ CPU | 2x | Intel | Xeon(R) CPU E5-2650 v3 @ 2.30GHz | N/A | [[http://ark.intel.com/products/81705/Intel-Xeon-Processor-E5-2650-v3-25M-Cache-2_30-GHz|ARK]] | |
| - | ^ RAM | 4 DIMMs | Hynix/Hyundai | HMT41GU7MFR8C-PB | 8GB | 32GB total per system | | + | ^ RAM | 8 DIMMs | Micron | 18ASF1G72PDZ-2G1A1 | 8GB | 64GB total per system | |
| - | ^ HDD | 10 | HGST | HMT41GU7MFR8C-PB | 4TB | | | + | ^ HDD | 8 | Seagate | ST91000640NS | 1TB | | |
| - | ^ HDD | 2 | Western Digital | WD2503ABYX-01WERA1 | 250GB | | | + | ^ NVMe | 4 | Intel | ? | 745.2GB | | |
| - | ^ NIC | 2 ports | Intel | I350 | 1Gb | On-board | | + | ^ NIC | 2 ports | Intel | I350 | 1Gb | On-board | |
| - | ^ NIC | 1 port | Mellanox | MT27520 | 40Gbps | On front of system | | + | ^ NIC | 2 ports | Intel | XL710 | 40Gbps | Cabled to mlx-sw01.ipmi.sepia.ceph.com | |
| + | |||
| + | ===== Donated Peripherals ===== | ||
| + | === ZNS Samples === | ||
| + | Western Digital donated two of [[https://www.cnet.com/products/hgst-ultrastar-sn200-husmr7616bdp301-solid-state-drive-1-6-tb-pci-express-3-0-x4-nvme/|these]] in early 2020 for us to play with. They are installed in incerta05 at ''/dev/nvme0n1'' and ''/dev/nvme1n1''. I purchased some PCIe to U.2 adapters since we didn't have any systems that could accept U.2 drives natively. | ||
| + | |||
| + | Racking ticket for those is https://redhat.service-now.com/surl.do?n=TASK0837858 | ||
| + | |||
| + | === ZNS Samples Round 2 === | ||
| + | WDC sent two more in March 2021. Replaced old ones with these. Model ''WZS4C8T2TDSP303''. | ||
| + | |||
| + | Racking ticket: https://redhat.service-now.com/surl.do?n=RITM0861862 | ||
| + | |||
| + | I think maybe the old samples were crippled. WD claims they were M.2 form factor but I bought U.2 PCIe adapters. | ||
| + | |||
| + | ===== Configuring the 40Gb NICs ===== | ||
| + | The 40Gbps Infiniband switch the incerta are connected to does not have a DHCP server built in so the servers have to be configured manually. I wrote an ansible playbook to quickly take care of this on CentOS machines and Ubuntu machines that are not using netplan. | ||
| + | |||
| + | **Example**: | ||
| + | <code> | ||
| + | cd $(mktemp -d) # optional | ||
| + | git clone https://github.com/ceph/ceph-cm-ansible | ||
| + | git clone git@github.com:ceph/ceph-sepia-secrets | ||
| + | cd ceph-cm-ansible | ||
| + | |||
| + | # Change the ansible_ssh_user below as needed | ||
| + | ansible-playbook -e '{"ansible_ssh_user": "nhm"}' -i ../ceph-sepia-secrets/ansible/inventory tools/incerta-nic.yml --limit incerta02* | ||
| + | </code> | ||
hardware/incerta.1467230964.txt.gz · Last modified: 2016/06/29 20:09 by dgalloway
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
