User Tools

Site Tools


Sidebar

General Lab Info (Mainly for Devs)

Hardware

Lab Infrastructure Services

Misc Admin Tasks
These are infrequently completed tasks that don't fit under any specific service

Production Services

OVH = OVH
RHEV = Sepia RHE instance
Baremetal = Host in Sepia lab

The Attic/Legacy Info

services:cephfs

This is an old revision of the document!


CephFS

There are a few CephFS file systems available in the sepia lab. These reside on the longrunningcluster. Access to this Ceph cluster is available for any machine on the VPN.

Below we ssh to the reesi001.front.sepia.ceph.com machine. When given access to the sepia VPN, the ssh key you shared should allow accessing this machine.

Authorization

Get access to CephFS with the LRC ceph.conf and client.sepian credential:

sudo mkdir -p -m 755 /etc/ceph
ssh reesi001.front.sepia.ceph.com 'env CEPH_KEYRING=/etc/ceph/client.sepian.keyring ceph --id sepian config generate-minimal-conf' | sudo tee /etc/ceph/ceph.conf
sudo chmod 644 /etc/ceph/ceph.conf
ssh reesi001.front.sepia.ceph.com 'cat /etc/ceph/client.sepian.keyring' | sudo tee /etc/ceph/client.sepian.keyring
sudo chmod 644 /etc/ceph/client.sepian.keyring
ssh reesi001.front.sepia.ceph.com 'ceph-authtool /etc/ceph/client.sepian.keyring -n client.sepian -p' | sudo tee /etc/ceph/client.sepian.secret
sudo chmod 600 /etc/ceph/client.sepian.secret

Mounting all Sepia CephFS file systems

#!/bin/bash
 
function genmount {
  local secret=$(sudo cat /etc/ceph/client.sepian.secret)
  # create mountpoint
  sudo mkdir -p -- "$2"
  # make the mountpoint directory (shadowed) unwriteable to prevent accidental modification
  sudo chmod 000 -- "$2"
  # set it immutable to enforce that even for root
  sudo chattr +i -- "$2"
  printf '172.21.2.201,172.21.2.202,172.21.2.203:%s\t%s\tceph\tname=sepian,secret=%s,mds_namespace=%s,_netdev\t0\t2\n' "$1" "$2" "$secret" "$3"
}
 
genmount /teuthology-archive /teuthology teuthology | sudo tee -a /etc/fstab
genmount / /scratch scratch | sudo tee -a /etc/fstab
genmount / /postfile postfile | sudo tee -a /etc/fstab

The teuthology FS

The majority of CephFS use is directed at the “teuthology” file system which hosts QA artifacts for analysis. Each test run has a directory in /teuthology-archive. Our /etc/fstab has this directory mounted locally at /teuthology:

ls /teuthology/ | head -n 2
abhi-2019-12-04_08:55:20-rgw-wip-abhi-testing-2019-12-03-1859-distro-basic-smithi
abhi-2019-12-04_17:41:25-rgw-wip-abhi-testing-2019-12-04-1433-distro-basic-smithi

The scratch FS

This is a general purpose file system for “scratch” space. Do what you want with it but consider all data in it as eligible for deletion at any time. You're encouraged to create a personal top-level directory.

The postfile FS

The ceph-post-file utility dumps results in this file system. Users are encouraged to use this utility to share artifacts with Ceph developers.

services/cephfs.1686598960.txt.gz · Last modified: 2023/06/12 19:42 by pdonnell