User Tools

Site Tools


Sidebar

General Lab Info (Mainly for Devs)

Hardware

Lab Infrastructure Services

Misc Admin Tasks
These are infrequently completed tasks that don't fit under any specific service

Production Services

OVH = OVH
RHEV = Sepia RHE instance
Baremetal = Host in Sepia lab

The Attic/Legacy Info

hardware:reesi

This is an old revision of the document!


reesi{001..006}

Summary

The Sepia lab has 6 storage hosts purchased January 2018 to replace the miras used in the LONGRUNNINGCLUSTER.

Purchasing details

Hardware Specs

Count Manufacturer Model Capacity Notes
Chassis 2U Supermicro SSG-6028R-E1CR12H N/A
Mainboard N/A Supermicro X10DRH-iT N/A
CPU 1 Intel Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz N/A ARK
RAM 4 DIMMs Samsung M393A2G40EB1-CRC 16GB 64GB total
SSD 2 Intel SSDSC2BB150G7 (S3520) 150GB Software RAID1 for OS
HDD 12 Seagate ST4000NM0025 4TB SAS 7200RPM for OSDs
NVMe 1 Micron MTFDHBG800MCG-1AN1ZABYY 800GB Carved up as logical volumes on two partitions. 400GB as an OSD and the other 400GB divided by 12 for HDD OSD journals
NIC 2 ports Intel X540-AT2 10Gb RJ45 (not used)
NIC 2 ports Intel 82599ES 10Gb 1 port cabled per system on front VLAN
BMC 1 Supermicro N/A N/A Reachable at $host.ipmi.sepia.ceph.com

NVMe Partitions/Provisioning

Here's my bash history that can be used to set up a reesi machine's NVMe card.

ansible -a "sudo parted -s /dev/nvme0n1 mktable gpt" reesi001*
ansible -a "sudo parted /dev/nvme0n1 unit '%' mkpart foo 0 50" reesi001*
ansible -a "sudo parted /dev/nvme0n1 unit '%' mkpart foo 51 100" reesi001*
ansible -a "sudo pvcreate /dev/nvme0n1p1" reesi001*
ansible -a "sudo pvcreate /dev/nvme0n1p2" reesi001*
ansible -a "sudo vgcreate journals /dev/nvme0n1p1" reesi001*
ansible -a "sudo vgcreate osd /dev/nvme0n1p2" reesi001*
ansible -a "sudo vgcreate journals /dev/nvme0n1p1" reesi001*
for disk in sd{a..l}; do ansible -a "sudo lvcreate -L 31G -n $disk journals" reesi001*; done

Set up a new OSD with journal on NVMe logical volume

ceph-volume lvm create --bluestore --data /dev/sda --block.db journals/sda

Checking NVMe Card SMART Data

cd /tmp
git clone https://github.com/linux-nvme/nvme-cli.git
cd nvme-cli/
make
sudo ./nvme smart-log-add /dev/nvme0

Updating BIOS

TBD

hardware/reesi.1518818274.txt.gz · Last modified: 2018/02/16 21:57 by djgalloway