services:longrunningcluster
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
services:longrunningcluster [2023/02/12 17:58] akraitman [One-liners] |
services:longrunningcluster [2023/02/19 15:18] (current) akraitman [Summary] |
||
|---|---|---|---|
| Line 16: | Line 16: | ||
| Cluster dashboard | Cluster dashboard | ||
| - | https://reesi006.front.sepia.ceph.com:8443/ | + | https://reesi004.front.sepia.ceph.com:8443/ |
| - | https://reesi005.front.sepia.ceph.com:8443/ | + | |
| ===== Topology ===== | ===== Topology ===== | ||
| <code> | <code> | ||
| Line 72: | Line 71: | ||
| </code> | </code> | ||
| - | === LRC iscsi volume === | + | === LRC iscsi volume for the RHEV cluster=== |
| - | On Nov 2022 we started seeing data corruption on our main gluster volume where we have all our critical VM's so we connected an iscsi volume from the LRC, those are the steps to connect an iscsi volume to a rhev cluster according to this doc | + | On Nov 2022 we started seeing data corruption on our main gluster volume where we have all our critical VM's so we connected an iscsi volume from the LRC, those are the steps to connect an iscsi volume to a rev cluster according to this doc |
| https://docs.google.com/document/d/1GYwv5y4T5vy-1oeAzw-zoLgQs0I3y5v_xD1wXscAA7M/edit | https://docs.google.com/document/d/1GYwv5y4T5vy-1oeAzw-zoLgQs0I3y5v_xD1wXscAA7M/edit | ||
| + | |||
| + | First, make sure you configured the iscsi clients(the RHEV hypervisor hosts in our case) according to this doc and copy the iscsi initiator located under(we will need it for step 11 when we create the hosts on the lrc) /etc/iscsi/initiatorname.iscsi on each host | ||
| + | https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/5/html-single/block_device_guide/index#configuring-the-iscsi-initiator-for-rhel_block | ||
| + | also configure CHAP on each rhev host by adding this in /etc/iscsi/iscsid.conf | ||
| + | |||
| + | node.session.auth.authmethod = CHAP | ||
| + | node.session.auth.username = <username> | ||
| + | node.session.auth.password = <password> | ||
| + | |||
| + | |||
| + | ssh to one of the reesi hosts(I configured it from reesi005) and follow the next steps to configure iscsi and create a volume on the LRC | ||
| 1. Create an rbd pool | 1. Create an rbd pool | ||
| Line 98: | Line 108: | ||
| </code> | </code> | ||
| - | 3. Connect to the iscsi container on one of the deployed hosts, to find the exact container id run "podman ps" and look for a container with the word "tcmu" in the end. | + | 3. Connect to the iscsi container on one of the deployed hosts, to find the exact container id run "podman ps" and look for the iscsi container with the word "tcmu" in the end. |
| <code> | <code> | ||
| Podman exec -it <iscsi container id> /bin/bash | Podman exec -it <iscsi container id> /bin/bash | ||
| Line 108: | Line 118: | ||
| </code> | </code> | ||
| - | 4. Enter gwcli | + | 4. Enter the gwcli |
| <code> | <code> | ||
| gwcli | gwcli | ||
| </code> | </code> | ||
| - | 5. Go to iscsi-targets | + | 5. Go to the iscsi-targets |
| <code> | <code> | ||
| cd iscsi-targets/ | cd iscsi-targets/ | ||
| Line 123: | Line 133: | ||
| </code> | </code> | ||
| - | 7. Create all four gateway as specified in the yaml on step 2 | + | 7. Go to gateways |
| + | <code> | ||
| + | cd gateways | ||
| + | </code> | ||
| + | |||
| + | 8. Create all four gateway's as you specified in the yaml file on step 2 | ||
| <code> | <code> | ||
| create reesi002.front.sepia.ceph.com 172.21.2.202 | create reesi002.front.sepia.ceph.com 172.21.2.202 | ||
| + | create reesi003.front.sepia.ceph.com 172.21.2.203 | ||
| + | create reesi004.front.sepia.ceph.com 172.21.2.204 | ||
| + | create reesi005.front.sepia.ceph.com 172.21.2.205 | ||
| </code> | </code> | ||
| - | 8. Go to disks | + | 9. Go to disks |
| <code> | <code> | ||
| - | cd /disks | + | cd .. |
| + | cd disks/ | ||
| </code> | </code> | ||
| Line 137: | Line 156: | ||
| create pool=lrc image=vol1 size=20T image=rbdimage size=50g | create pool=lrc image=vol1 size=20T image=rbdimage size=50g | ||
| </code> | </code> | ||
| + | |||
| + | 10. Go to hosts | ||
| + | <code> | ||
| + | cd .. | ||
| + | cd hosts/ | ||
| + | </code> | ||
| + | |||
| + | 11. Create the hosts(RHEV hosts, if you have four rhev hosts you will need to run this four times one for each iqn ) | ||
| + | <code> | ||
| + | create client_iqn=<iqn from the rhev host> | ||
| + | </code> | ||
| + | |||
| + | 12. cd to each iqn you created in step 11 and enable chap | ||
| + | <code> | ||
| + | auth username=<username> password=<password> | ||
| + | </code> | ||
| + | |||
| + | 13. cd to each iqn you added in step 11 and add the RBD image created in step 9 | ||
| + | <code> | ||
| + | disk add <pool_name>/<RBD image name> | ||
| + | </code> | ||
| + | |||
| + | 14. Set discovery auth to CHAP on the iscsi-targets | ||
| + | <code> | ||
| + | cd ../../ | ||
| + | discovery_auth username=<username> password=<password> | ||
| + | </code> | ||
| + | |||
| + | The final step is to mount this RBD_image/lun in RHEV-M Dashboard | ||
| + | |||
| + | go to https://mgr01.front.sepia.ceph.com/ovirt-engine/webadmin/?locale=en_US#storage | ||
| + | Create a new Storage domain and choose the iscsi storage type and fill out the discovery targets section with an IP on one of the iscsi gateway ip's you configured in the yaml in step 2 and fill out the auth with the CHAP username & password you configured in step 14 | ||
| + | |||
| + | |||
services/longrunningcluster.1676224714.txt.gz · Last modified: 2023/02/12 17:58 by akraitman
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
