hardware:infrastructure
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Last revision Both sides next revision | ||
|
hardware:infrastructure [2016/08/22 20:58] dgalloway [Networking] |
hardware:infrastructure [2022/06/10 14:40] djgalloway |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== Infrastructure Hardware ====== | ====== Infrastructure Hardware ====== | ||
| This page covers all other hardware that doesn't fit under the umbrella of testnode hardware. | This page covers all other hardware that doesn't fit under the umbrella of testnode hardware. | ||
| + | |||
| + | ===== Spare Hardware ===== | ||
| + | Present as of: --- //[[dgallowa@redhat.com|David Galloway]] 2022/01/18 19:29// | ||
| + | |||
| + | ^ Hardware ^ Quantity ^ | ||
| + | | Intel Optane P5800X 400GB PCIe cards | 10 | | ||
| + | | STARTECH 2PT 10G FIBER NIC-OPEN SFP+ | 5 | | ||
| ===== gw1/gw2 ===== | ===== gw1/gw2 ===== | ||
| Line 6: | Line 13: | ||
| These two hosts are 1U custom-built Supermicro systems. | These two hosts are 1U custom-built Supermicro systems. | ||
| - | gw1 can currently be accessed at ''irv-gw.front.sepia.ceph.com''. It is the old gateway host from when the Sepia lab was in Irvine | + | gw1 was repurposed as [[hardware:infrastructure#store03frontsepiacephcom|store03]] to use as an arbiter node for the Gluster storage backing RHEV VMs. |
| gw2 is not powered on or accessible | gw2 is not powered on or accessible | ||
| Line 41: | Line 48: | ||
| ==== Networking ==== | ==== Networking ==== | ||
| - | * store01 has a 1Gb bridge on the ipmi network from when it was the OpenVPN gateway | + | * store01 has a 1Gb bridge on the ipmi network from when it was the OpenVPN gateway. |
| - | * store01 has a 10Gb uplink with address 8.43.84.133 | + | * store01 has a 10Gb uplink with address 8.43.84.133 mainly as a backup "in" to the lab. This is leftover from when the host was the OpenVPN gateway. |
| * Both nodes have an add-on dual-port 10Gb SFP+ card with both ports cabled and configured as bond0 (bond type 6) | * Both nodes have an add-on dual-port 10Gb SFP+ card with both ports cabled and configured as bond0 (bond type 6) | ||
| + | |||
| + | ---- | ||
| + | |||
| + | ===== store03.front.sepia.ceph.com ===== | ||
| + | ==== Summary ==== | ||
| + | Sole purpose is to serve as an arbiter node for the Gluster volume backing [[services:rhev]] VMs. | ||
| + | |||
| + | store03 was formerly gw1. | ||
| + | |||
| + | ==== Hardware Information ==== | ||
| + | http://wiki.front.sepia.ceph.com/doku.php?id=hardware:infrastructure#hardware_specs | ||
| + | |||
| + | ---- | ||
| + | |||
| + | ===== ssdstore{01,02}.front.sepia.ceph.com ===== | ||
| + | ==== Summary ==== | ||
| + | Serve as new NVMe Gluster storage nodes for the [[services:rhev]] cluster. They're running RHEL 7. Purchased/donated by OSAS. | ||
| + | |||
| + | ==== Hardware Information ==== | ||
| + | | ^ Count ^ Manufacturer ^ Model ^ Capacity ^ Notes ^ | ||
| + | ^ Chassis | N/A | Supermicro | SYS-2028U-TN24R4T+ | N/A | | | ||
| + | ^ Mainboard | N/A | Supermicro | X10DRU-i+ | N/A | | | ||
| + | ^ CPU | 2 | Intel | Xeon X3220 @2.40GHz | N/A | [[https://ark.intel.com/products/92981/Intel-Xeon-Processor-E5-2630-v4-25M-Cache-2_20-GHz|ARK]] | | ||
| + | ^ RAM | 6 DIMMs | Samsung | M393A1G40EB1-CRC | 8GB | DDR4 2400MHz -- 48GB total | | ||
| + | ^ SSD | 2 | Intel | S3520 | 480GB | Software RAID1 for OS | | ||
| + | ^ SSD | 8 | Intel | DC P3600 | 1.6TB | Software RAID6 for Gluster brick | | ||
| + | ^ NIC | 1 | Intel | 82599 (AOC-STGN-I2S) | 2 ports | 10Gbps SFP+ bonded in balance-alb mode | | ||
| ---- | ---- | ||
| ===== teuthology.front.sepia.ceph.com ===== | ===== teuthology.front.sepia.ceph.com ===== | ||
| - | Hosts main [[services:teuthology]] service for Sepia lab. Running Trusty with a custom kernel so the LRC can be mounted. | + | Hosted previous [[services:teuthology]] service for Sepia lab. Running Trusty with a custom kernel so the LRC can be mounted. **Now only up for legacy purposes. Can be moved to another rack and/or repurposed.** |
| [[hardware:Mira]]-type chassis with 32GB RAM and 2x Intel(R) Xeon(R) X3440 @ 2.53GHz | [[hardware:Mira]]-type chassis with 32GB RAM and 2x Intel(R) Xeon(R) X3440 @ 2.53GHz | ||
| Line 60: | Line 94: | ||
| * 1x cabled but unused 1Gbps link (eth0) | * 1x cabled but unused 1Gbps link (eth0) | ||
| * 1x 10Gbps uplink for all traffic (eth3) | * 1x 10Gbps uplink for all traffic (eth3) | ||
| + | |||
| + | ---- | ||
| + | |||
| + | ===== pulpito.front.sepia.ceph.com ===== | ||
| + | Hosts [[services:pulpito]] and [[services:paddles]]. Running Ubuntu Precise. | ||
| + | |||
| + | [[hardware:Mira]]-type chassis with 16GB RAM and Intel(R) Xeon(R) X3440 @ 2.53GHz | ||
| + | |||
| + | ==== Storage ==== | ||
| + | <code> | ||
| + | root@pulpito:~# cli64 vsf info | ||
| + | # Name Raid Name Level Capacity Ch/Id/Lun State | ||
| + | =============================================================================== | ||
| + | 1 ARC-1222-VOL#000 Raid Set # 000 Raid6 400.0GB 00/00/00 Normal | ||
| + | 2 ARC-1222-VOL#001 Raid Set # 000 Raid1+0 60.0GB 00/00/01 Normal | ||
| + | 3 ARC-1222-VOL#002 Raid Set # 000 Raid6 5510.0GB 00/00/02 Normal | ||
| + | =============================================================================== | ||
| + | |||
| + | root@pulpito:~# lsblk | ||
| + | NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT | ||
| + | sda 8:0 0 372.5G 0 disk | ||
| + | ├─sda1 8:1 0 356.5G 0 part / | ||
| + | ├─sda2 8:2 0 1K 0 part | ||
| + | └─sda5 8:5 0 16G 0 part [SWAP] | ||
| + | sdb 8:16 0 55.9G 0 disk /var/lib/postgresql | ||
| + | sdc 8:32 0 5T 0 disk | ||
| + | </code> | ||
| + | |||
| + | ==== Networking ==== | ||
| + | * 1x cabled 1Gbps link (eth0) | ||
| ---- | ---- | ||
| Line 66: | Line 130: | ||
| ==== Summary ==== | ==== Summary ==== | ||
| AKA [[services:apt-mirror]] or gitbuilder-archive. | AKA [[services:apt-mirror]] or gitbuilder-archive. | ||
| + | |||
| + | OOB access is available at ''ipmitool -I lanplus -U root -P XXXXX -H 172.21.39.25 sol activate'' | ||
| ==== Services ==== | ==== Services ==== | ||
| Line 71: | Line 137: | ||
| * [[services:backups]] | * [[services:backups]] | ||
| * Serves packages built by [[services:gitbuilders]] | * Serves packages built by [[services:gitbuilders]] | ||
| + | * [[tasks:lab-extras|lab-extras]] | ||
| ==== Storage ==== | ==== Storage ==== | ||
| Line 79: | Line 146: | ||
| ==== Networking ==== | ==== Networking ==== | ||
| * 1x 10Gb uplink at address 8.43.84.130 | * 1x 10Gb uplink at address 8.43.84.130 | ||
| - | * <del>Temporary VPN tunnel for drop.ceph.com access to the [[services:longrunningcluster]] | + | * <del>Temporary VPN tunnel for drop.ceph.com access to the [[services:longrunningcluster]]</del> |
| - | * (Must be restarted ''service openvpn restart'' anytime the VPN service is restarted)</del> | + | * <del>(Must be restarted ''service openvpn restart'' anytime the VPN service is restarted)</del> ((drop.ceph.com moved to separate VM in RHEV)) |
| ---- | ---- | ||
| - | ===== hv01/hv02 ===== | + | ===== hv{01..03} ===== |
| ==== Summary ==== | ==== Summary ==== | ||
| Main [[services:RHEV]] highly available hypervisor nodes. Running RHEL7. | Main [[services:RHEV]] highly available hypervisor nodes. Running RHEL7. | ||
| - | root login using standard root password. | + | Infra admins have standard ssh access as their user. |
| ==== Hardware Specs ==== | ==== Hardware Specs ==== | ||
| Line 104: | Line 171: | ||
| Dual PSU redundantly cabled to two PDUs. | Dual PSU redundantly cabled to two PDUs. | ||
| + | |||
| + | ===== hv04 ===== | ||
| + | ==== Summary ==== | ||
| + | Just another [[services:RHEV]] highly available hypervisor node. Model and specs are slightly different due to former models being EOL. | ||
| + | |||
| + | ==== Hardware Specs ==== | ||
| + | | ^ Count ^ Manufacturer ^ Model ^ Capacity ^ Notes ^ | ||
| + | ^ Chassis | N/A | Supermicro | SYS-1029U-TRTP2 | N/A | | | ||
| + | ^ Mainboard | N/A | Supermicro | X11DPU | N/A | | | ||
| + | ^ CPU | 2 | Intel | Xeon(R) Gold 5115 CPU @ 2.40GHz | N/A | [[https://ark.intel.com/products/120484/Intel-Xeon-Gold-5115-Processor-13_75M-Cache-2_40-GHz|ARK]] | | ||
| + | ^ RAM | 8 DIMMs | Hynix Semiconductor | HMA82GR7AFR8N-VK | 16GB | 128GB total | | ||
| + | ^ HDD | 0 | | | | | | ||
| + | ^ SSD | 4 | Intel | SSDSC2KB480G7 | 480GB | Software RAID5 | | ||
| + | ^ NIC | 2 ports | Intel | I350 | 1Gbps | On-board RJ45. Port 1 for WAN | | ||
| + | ^ NIC | 2 ports | Intel | X710 | 10Gbps | SFP+ Port 1 for front/ipmi / Port 2 for rhevm | | ||
| + | |||
| + | ===== cnv{01..03}.front.sepia.ceph.com ===== | ||
| + | ==== Summary ==== | ||
| + | Purchased by Red Hat in 2021 to create a new Openshift cluster with CNV. This cluster is intended to replace [[services:RHEV]]. | ||
| + | |||
| + | Purchasing ticket: https://redhat.service-now.com/surl.do?n=PNT1028261 \\ | ||
| + | Racking ticket: https://redhat.service-now.com/surl.do?n=PNT1028262 | ||
| + | |||
| + | ==== Hardware Information ==== | ||
| + | | ^ Count ^ Manufacturer ^ Model ^ Capacity ^ Notes ^ | ||
| + | ^ Chassis | N/A | Supermicro | SYS-2028U-TN24R4T+ | N/A | | | ||
| + | ^ Mainboard | N/A | Supermicro | X10DRU-i+ | N/A | | | ||
| + | ^ CPU | 2 | Intel | Xeon X3220 @2.40GHz | N/A | [[https://ark.intel.com/products/92981/Intel-Xeon-Processor-E5-2630-v4-25M-Cache-2_20-GHz|ARK]] | | ||
| + | ^ RAM | 6 DIMMs | Samsung | M393A1G40EB1-CRC | 8GB | DDR4 2400MHz -- 48GB total | | ||
| + | ^ SSD | 2 | Intel | S3520 | 480GB | Software RAID1 for OS | | ||
| + | ^ SSD | 8 | Intel | DC P3600 | 1.6TB | Software RAID6 for Gluster brick | | ||
| + | ^ NIC | 1 | Intel | 82599 (AOC-STGN-I2S) | 2 ports | 10Gbps SFP+ bonded in balance-alb mode | | ||
| + | |||
| + | ==== Installation Notes ==== | ||
| + | Followed https://access.redhat.com/documentation/en-us/openshift_container_platform/4.8/html-single/installing/index#deploying-installer-provisioned-clusters-on-bare-metal | ||
| + | |||
| + | ---- | ||
hardware/infrastructure.txt · Last modified: 2023/08/21 22:05 by zmc
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
