This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
hardware:robsoni [2021/06/03 00:24] djgalloway |
hardware:robsoni [2021/06/03 00:30] (current) djgalloway [Table] |
||
|---|---|---|---|
| Line 25: | Line 25: | ||
| ===== Network Config ===== | ===== Network Config ===== | ||
| ==== qfx-rgw ==== | ==== qfx-rgw ==== | ||
| - | These nodes have a regular 1Gb uplink but then 2x 25Gb connections per server to a QFX5120 for backend storage traffic. | + | These nodes have a regular 1Gb uplink but then 2x 25Gb connections per server to a QFX5120-32C for backend storage traffic. This switch is managed by Ceph Infra and not uplinked. |
| + | |||
| + | I purchased qty 5 100Gb -> 4x 25Gb breakout cables with this. See https://docs.google.com/spreadsheets/d/1_ETaz5ollV_66ODFGXiVWEibecdBZIvHg9X1zN1pF88/edit#gid=0 | ||
| + | |||
| + | I just created a ''/24'' vlan on the switch giving each server it's own Aggregated Ethernet interface. | ||
| + | |||
| + | ^ Server ^ Private IP ^ | ||
| + | | robsoni01 | 172.20.23.1 | | ||
| + | | robsoni02 | 172.20.23.2 | | ||
| + | | robsoni03 | 172.20.23.3 | | ||
| + | | robsoni04 | 172.20.23.4 | | ||
| + | | robsoni05 | 172.20.23.5 | | ||
| The switch is named ''qfx-rgw.ipmi.sepia.ceph.com'' and can be accessed via SSH. Here's the current switch config that seems to be working. | The switch is named ''qfx-rgw.ipmi.sepia.ceph.com'' and can be accessed via SSH. Here's the current switch config that seems to be working. | ||