services:cephfs
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
services:cephfs [2023/06/12 19:36] pdonnell |
services:cephfs [2024/01/05 20:05] (current) ljflores Need sudo unless you are running as root. |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== CephFS ====== | ====== CephFS ====== | ||
| - | There are a few CephFS file systems available in the sepia lab. These reside on the [[services:longrunningcluster]]. Access to this Ceph cluster is available for any machine on the VPN. | + | There are a few CephFS file systems available in the sepia lab. These reside on the [[services:longrunningcluster|Long Running Cluster]]. |
| + | |||
| + | Access to this Ceph cluster is available for any machine on the [[:vpnaccess|sepia VPN]]. You can and **should** mount these file systems on your laptop or development machine. This reduces load on some shared machines, like [[services:teuthology|teuthology]], and usually provides faster access depending on your client or network. However, for everyday use, you may prefer to access CephFS from a machine co-located with the other lab infrastructure, such as a [[:devplayground|Developer Playground]] machine, where OSD latency/bandwidth will be optimal. | ||
| + | |||
| + | In the scripts/commands below, we will ssh to the ''reesi001.front.sepia.ceph.com'' machine. When [[:vpnaccess#requesting_access|given access to the sepia VPN]], the ssh key you shared should allow accessing this machine. | ||
| ==== Authorization ==== | ==== Authorization ==== | ||
| - | Get access to CephFS with the LRC ''ceph.conf'' and ''client.sepian'' credential: | + | On your development machine or laptop, get access to CephFS with the LRC ''ceph.conf'' and ''client.sepian'' credential: |
| <code bash> | <code bash> | ||
| Line 18: | Line 22: | ||
| </code> | </code> | ||
| + | The ''client.sepian'' credential is suitable for all Ceph developers to access appropriate LRC resources. In particular, it gives access to the ''teuthology'', ''scratch'', and ''postfile'' CephFS file systems. | ||
| ==== Mounting all Sepia CephFS file systems ==== | ==== Mounting all Sepia CephFS file systems ==== | ||
| + | |||
| + | Generate mounts for your ''/etc/fstab'' using the script below. Copy it locally, mark it executable, and run: | ||
| <code bash> | <code bash> | ||
| Line 38: | Line 45: | ||
| genmount / /scratch scratch | sudo tee -a /etc/fstab | genmount / /scratch scratch | sudo tee -a /etc/fstab | ||
| genmount / /postfile postfile | sudo tee -a /etc/fstab | genmount / /postfile postfile | sudo tee -a /etc/fstab | ||
| + | </code> | ||
| + | |||
| + | The fstab changes will cause these file systems to mount on boot. After adding these entries for the first time, you need to manually mount them: | ||
| + | |||
| + | <code bash> | ||
| + | sudo mount /teuthology | ||
| + | sudo mount /scratch | ||
| + | sudo mount /postfile | ||
| </code> | </code> | ||
| ==== The teuthology FS ==== | ==== The teuthology FS ==== | ||
| - | The majority of CephFS use is directed at the "teuthology" file system which hosts QA artifacts for analysis. Each test run has a directory in ''/teuthology-archive'': | + | The majority of CephFS use is directed at the "teuthology" file system which hosts QA artifacts for analysis. Each test run has a directory in ''/teuthology-archive''. The ''/etc/fstab'' file (generated above) has this directory mounted locally at ''/teuthology'': |
| <code bash> | <code bash> | ||
| Line 48: | Line 63: | ||
| abhi-2019-12-04_08:55:20-rgw-wip-abhi-testing-2019-12-03-1859-distro-basic-smithi | abhi-2019-12-04_08:55:20-rgw-wip-abhi-testing-2019-12-03-1859-distro-basic-smithi | ||
| abhi-2019-12-04_17:41:25-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi | abhi-2019-12-04_17:41:25-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi | ||
| + | </code> | ||
| + | |||
| + | It's also common for test artifact paths shared among developers to include a ''/a/'' prefix, such as: | ||
| + | |||
| + | ''/a/teuthology-2023-06-10_14\:23\:08-upgrade\:pacific-x-reef-distro-default-smithi/7301152/teuthology.log'' | ||
| + | |||
| + | You can generate this helper link using: | ||
| + | |||
| + | <code bash> | ||
| + | sudo ln -s /teuthology /a | ||
| </code> | </code> | ||
| ==== The scratch FS ==== | ==== The scratch FS ==== | ||
| - | This is a general purpose file system for "scratch" space. Do what you want with it but consider all data in it is eligible for deletion at any time. You're encouraged to create a personal top-level directory. | + | This is a general purpose file system for "scratch" space. Do what you want with it but consider all data in it as eligible for deletion at any time. You're encouraged to create a personal top-level directory. |
| Line 58: | Line 83: | ||
| The [[https://docs.ceph.com/en/latest/man/8/ceph-post-file/|ceph-post-file]] utility dumps results in this file system. Users are encouraged to use this utility to share artifacts with Ceph developers. | The [[https://docs.ceph.com/en/latest/man/8/ceph-post-file/|ceph-post-file]] utility dumps results in this file system. Users are encouraged to use this utility to share artifacts with Ceph developers. | ||
| + | |||
| + | ==== The home FS ==== | ||
| + | |||
| + | There is a "home" file system which hosts the home directories of users of teuthology and potentially other development nodes. Its access is restricted to administrators. | ||
services/cephfs.1686598599.txt.gz · Last modified: 2023/06/12 19:36 by pdonnell
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
