This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
services:cephfs [2023/06/12 19:49] pdonnell |
services:cephfs [2024/01/05 20:05] (current) ljflores Need sudo unless you are running as root. |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== CephFS ====== | ====== CephFS ====== | ||
- | There are a few CephFS file systems available in the sepia lab. These reside on the [[services:longrunningcluster|Long Running Cluster]]. Access to this Ceph cluster is available for any machine on the VPN. | + | There are a few CephFS file systems available in the sepia lab. These reside on the [[services:longrunningcluster|Long Running Cluster]]. |
- | Below we ssh to the ''reesi001.front.sepia.ceph.com'' machine. When given access to the [[:vpnaccess|sepia VPN]], the ssh key you shared should allow accessing this machine. | + | Access to this Ceph cluster is available for any machine on the [[:vpnaccess|sepia VPN]]. You can and **should** mount these file systems on your laptop or development machine. This reduces load on some shared machines, like [[services:teuthology|teuthology]], and usually provides faster access depending on your client or network. However, for everyday use, you may prefer to access CephFS from a machine co-located with the other lab infrastructure, such as a [[:devplayground|Developer Playground]] machine, where OSD latency/bandwidth will be optimal. |
+ | |||
+ | In the scripts/commands below, we will ssh to the ''reesi001.front.sepia.ceph.com'' machine. When [[:vpnaccess#requesting_access|given access to the sepia VPN]], the ssh key you shared should allow accessing this machine. | ||
==== Authorization ==== | ==== Authorization ==== | ||
- | Get access to CephFS with the LRC ''ceph.conf'' and ''client.sepian'' credential: | + | On your development machine or laptop, get access to CephFS with the LRC ''ceph.conf'' and ''client.sepian'' credential: |
<code bash> | <code bash> | ||
Line 23: | Line 25: | ||
==== Mounting all Sepia CephFS file systems ==== | ==== Mounting all Sepia CephFS file systems ==== | ||
+ | |||
+ | Generate mounts for your ''/etc/fstab'' using the script below. Copy it locally, mark it executable, and run: | ||
<code bash> | <code bash> | ||
Line 41: | Line 45: | ||
genmount / /scratch scratch | sudo tee -a /etc/fstab | genmount / /scratch scratch | sudo tee -a /etc/fstab | ||
genmount / /postfile postfile | sudo tee -a /etc/fstab | genmount / /postfile postfile | sudo tee -a /etc/fstab | ||
+ | </code> | ||
+ | |||
+ | The fstab changes will cause these file systems to mount on boot. After adding these entries for the first time, you need to manually mount them: | ||
+ | |||
+ | <code bash> | ||
+ | sudo mount /teuthology | ||
+ | sudo mount /scratch | ||
+ | sudo mount /postfile | ||
</code> | </code> | ||
Line 51: | Line 63: | ||
abhi-2019-12-04_08:55:20-rgw-wip-abhi-testing-2019-12-03-1859-distro-basic-smithi | abhi-2019-12-04_08:55:20-rgw-wip-abhi-testing-2019-12-03-1859-distro-basic-smithi | ||
abhi-2019-12-04_17:41:25-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi | abhi-2019-12-04_17:41:25-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi | ||
+ | </code> | ||
+ | |||
+ | It's also common for test artifact paths shared among developers to include a ''/a/'' prefix, such as: | ||
+ | |||
+ | ''/a/teuthology-2023-06-10_14\:23\:08-upgrade\:pacific-x-reef-distro-default-smithi/7301152/teuthology.log'' | ||
+ | |||
+ | You can generate this helper link using: | ||
+ | |||
+ | <code bash> | ||
+ | sudo ln -s /teuthology /a | ||
</code> | </code> | ||
Line 61: | Line 83: | ||
The [[https://docs.ceph.com/en/latest/man/8/ceph-post-file/|ceph-post-file]] utility dumps results in this file system. Users are encouraged to use this utility to share artifacts with Ceph developers. | The [[https://docs.ceph.com/en/latest/man/8/ceph-post-file/|ceph-post-file]] utility dumps results in this file system. Users are encouraged to use this utility to share artifacts with Ceph developers. | ||
+ | |||
+ | ==== The home FS ==== | ||
+ | |||
+ | There is a "home" file system which hosts the home directories of users of teuthology and potentially other development nodes. Its access is restricted to administrators. |