Differences

This shows you the differences between two versions of the page.

--- services:dccmirrors [2017/04/27 18:38] – created dgalloway
+++ services:dccmirrors [2017/06/13 15:58] (current) – dgalloway
@@ Line 1: / Line 1: @@
-====== download.ceph.com mirrors ======
+====== WIP - download.ceph.com mirrors ======
 ===== Summary =====
 We have two RHCS clusters running on mira that serve as mirrors for download.ceph.com.
 ===== Purpose/Background =====
-The goal of this project is to use/dogfood downstream RHCS to uncover difficulties in installing and maintaining the product.
+The goal of this project is to use/dogfood downstream RHCS software, docs, and ceph-ansible to uncover difficulties in installing and maintaining the product.
+Setup notes: https://docs.google.com/document/d/197cRnSA8QF1vYcAejvIT6tCG9Vi1nhUWrX987HTg7P4/edit
 ===== Architecture =====
-There are two clusters.  One uses RGW and one uses RBD as the backend/client.
+==== Systems ====
+There are two clusters.  One uses RGW and one uses RBD as the client.  Both have 3 MONs running on VMs in [[services:RHEV]].  Their public gateways are also VMs in RHEV.
+There are affinity rules in place to ensure the RGW and RBD public gateways all run on separate baremetal hyperisors.
+There are also affinity rules in place in RHEV to ensure the MONs all run on separate baremetal hyperisors.
+=== RBD Cluster ===
+The RBD cluster's OSDs run on mira046, mira052, and mira084.
+The MONs run on dl-rbd-mon{01..03}.front.sepia.ceph.com.
+Since the RBD cluster is just serving a single block device, only one public VM (dl-rbd-pub) is required.
+=== RGW Cluster ===
+The RGW cluster's OSDs run on mira102, mira103, and mira106.
+According to Red Hat [[https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/2/html-single/object_gateway_guide_for_red_hat_enterprise_linux/#configuring_gateways_for_static_web_hosting|downstream docs]], at least two gateway hosts (dl-rgw-pub{01,02}) and two HAProxy servers (dl-rgw-ha{01,02}) are required to serve a static website.
+==== Networking ====
+The clusters were set up to have all Ceph traffic go over the front VLAN.
+The RBD cluster's public VM has a NIC on front and a NIC on the WAN VLAN.
-The RBD cluster currently runs on mira046, mira0
+The RGW cluster's HAProxy VMs have a NIC on front and a NIC on the WAN VLAN.  The RGW clients themselves only have a NIC on the front VLAN.