6 doli systems comprise this Ceph cluster. It was deployed using the Dashboard at https://10.20.192.104:8443/.
Here's a rundown of what this cluster stores
Primarily this cluster serves cephfs for the lab. Notably this includes teuthology artifacts (logs, etc.).
root@doli01:~# cephadm shell -- ceph status
Inferring fsid b6f4aaad-d45d-11f0-b949-905a08286547
Inferring config /var/lib/ceph/b6f4aaad-d45d-11f0-b949-905a08286547/mon.doli01/config
cluster:
id: b6f4aaad-d45d-11f0-b949-905a08286547
health: HEALTH_OK
(muted: AUTH_INSECURE_CLIENT_KEY_TYPE AUTH_INSECURE_KEYS_ALLOWED AUTH_INSECURE_KEYS_CREATABLE)
services:
mon: 5 daemons, quorum doli01,doli03,doli06,doli05,doli04 (age 4d) [leader: doli01]
mgr: doli04.uzocyw(active, since 4d), standbys: doli01.tabmpz
mds: 12/12 daemons up, 4 standby
osd: 54 osds: 54 up (since 4d), 54 in (since 6w)
rgw: 6 daemons active (6 hosts, 1 zones)
data:
volumes: 6/6 healthy
pools: 27 pools, 3009 pgs
objects: 290.52M objects, 310 TiB
usage: 474 TiB used, 280 TiB / 755 TiB avail
pgs: 2994 active+clean
10 active+clean+scrubbing+deep
5 active+clean+scrubbing
io:
client: 169 B/s rd, 14 MiB/s wr, 0 op/s rd, 28 op/s wr
root@doli01:~# cephadm shell -- ceph osd tree
Inferring fsid b6f4aaad-d45d-11f0-b949-905a08286547
Inferring config /var/lib/ceph/b6f4aaad-d45d-11f0-b949-905a08286547/mon.doli01/config
ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF
-1 754.52014 root default
-3 125.75336 host doli01
0 ssd 13.97260 osd.0 up 1.00000 1.00000
1 ssd 13.97260 osd.1 up 1.00000 1.00000
2 ssd 13.97260 osd.2 up 1.00000 1.00000
3 ssd 13.97260 osd.3 up 1.00000 1.00000
4 ssd 13.97260 osd.4 up 1.00000 1.00000
5 ssd 13.97260 osd.5 up 1.00000 1.00000
6 ssd 13.97260 osd.6 up 1.00000 1.00000
7 ssd 13.97260 osd.7 up 1.00000 1.00000
8 ssd 13.97260 osd.8 up 1.00000 1.00000
-9 125.75336 host doli02
12 ssd 13.97260 osd.12 up 1.00000 1.00000
14 ssd 13.97260 osd.14 up 1.00000 1.00000
21 ssd 13.97260 osd.21 up 1.00000 1.00000
26 ssd 13.97260 osd.26 up 1.00000 1.00000
31 ssd 13.97260 osd.31 up 1.00000 1.00000
36 ssd 13.97260 osd.36 up 1.00000 1.00000
41 ssd 13.97260 osd.41 up 1.00000 1.00000
46 ssd 13.97260 osd.46 up 1.00000 1.00000
50 ssd 13.97260 osd.50 up 1.00000 1.00000
-11 125.75336 host doli03
11 ssd 13.97260 osd.11 up 1.00000 1.00000
17 ssd 13.97260 osd.17 up 1.00000 1.00000
22 ssd 13.97260 osd.22 up 1.00000 1.00000
28 ssd 13.97260 osd.28 up 1.00000 1.00000
33 ssd 13.97260 osd.33 up 1.00000 1.00000
40 ssd 13.97260 osd.40 up 1.00000 1.00000
44 ssd 13.97260 osd.44 up 1.00000 1.00000
49 ssd 13.97260 osd.49 up 1.00000 1.00000
52 ssd 13.97260 osd.52 up 1.00000 1.00000
-7 125.75336 host doli04
9 ssd 13.97260 osd.9 up 1.00000 1.00000
15 ssd 13.97260 osd.15 up 1.00000 1.00000
19 ssd 13.97260 osd.19 up 1.00000 1.00000
24 ssd 13.97260 osd.24 up 1.00000 1.00000
29 ssd 13.97260 osd.29 up 1.00000 1.00000
34 ssd 13.97260 osd.34 up 1.00000 1.00000
39 ssd 13.97260 osd.39 up 1.00000 1.00000
43 ssd 13.97260 osd.43 up 1.00000 1.00000
48 ssd 13.97260 osd.48 up 1.00000 1.00000
-13 125.75336 host doli05
13 ssd 13.97260 osd.13 up 1.00000 1.00000
18 ssd 13.97260 osd.18 up 1.00000 1.00000
23 ssd 13.97260 osd.23 up 1.00000 1.00000
27 ssd 13.97260 osd.27 up 1.00000 1.00000
32 ssd 13.97260 osd.32 up 1.00000 1.00000
38 ssd 13.97260 osd.38 up 1.00000 1.00000
45 ssd 13.97260 osd.45 up 1.00000 1.00000
51 ssd 13.97260 osd.51 up 1.00000 1.00000
53 ssd 13.97260 osd.53 up 1.00000 1.00000
-5 125.75336 host doli06
10 ssd 13.97260 osd.10 up 1.00000 1.00000
16 ssd 13.97260 osd.16 up 1.00000 1.00000
20 ssd 13.97260 osd.20 up 1.00000 1.00000
25 ssd 13.97260 osd.25 up 1.00000 1.00000
30 ssd 13.97260 osd.30 up 1.00000 1.00000
35 ssd 13.97260 osd.35 up 1.00000 1.00000
37 ssd 13.97260 osd.37 up 1.00000 1.00000
42 ssd 13.97260 osd.42 up 1.00000 1.00000
47 ssd 13.97260 osd.47 up 1.00000 1.00000