hardware:reesi
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| hardware:reesi [2018/02/16 22:02] – [Checking NVMe Card SMART Data] djgalloway | hardware:reesi [2019/08/01 23:49] (current) – djgalloway | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== reesi{001..006} ====== | ====== reesi{001..006} ====== | ||
| ===== Summary ===== | ===== Summary ===== | ||
| - | The Sepia lab has 6 storage hosts purchased | + | The Sepia lab has 6 storage hosts purchased |
| ===== Purchasing details ===== | ===== Purchasing details ===== | ||
| Line 10: | Line 10: | ||
| ===== Hardware Specs ===== | ===== Hardware Specs ===== | ||
| - | | ^ Count ^ Manufacturer | + | | ^ Count ^ Manufacturer |
| - | ^ Chassis | + | ^ Chassis |
| - | ^ Mainboard | + | ^ Mainboard |
| - | ^ CPU | 1 | Intel | Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz | + | ^ CPU | 1 | Intel | Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz |
| - | ^ RAM | 4 DIMMs | Samsung | + | ^ RAM | 4 DIMMs | Samsung |
| - | ^ SSD | 2 | Intel | SSDSC2BB150G7 (S3520) | + | ^ SSD | 2 | Intel | SSDSC2BB150G7 (S3520) |
| - | ^ HDD | 12 | Seagate | + | ^ HDD | 11 | Seagate |
| + | ^ HDD | 1 | HGST | HUH721212AL5200 | ||
| ^ NVMe | 1 | Micron | ^ NVMe | 1 | Micron | ||
| - | ^ NIC | 2 ports | Intel | X540-AT2 | + | ^ NIC | 2 ports | Intel | X540-AT2 |
| - | ^ NIC | 2 ports | Intel | 82599ES | + | ^ NIC | 2 ports | Intel | 82599ES |
| - | ^ BMC | 1 | Supermicro | + | ^ BMC | 1 | Supermicro |
| - | ===== NVMe Partitions/Provisioning | + | ===== OSD/Block Device Information ===== |
| + | The reesi have 11x 4TB HDD, 1x 12TB HDD, and 1x 800GB NVMe. | ||
| + | |||
| + | The 12TB were added to so we can say we're testing on drives larger than 8TB. | ||
| + | |||
| + | The NVMe device is split into two equal partitions: | ||
| + | - Split into 12 LVMs to serve as block.db for each HDD OSD | ||
| + | - Used as an SSD OSD | ||
| + | |||
| + | < | ||
| + | root@reesi001: | ||
| + | NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT | ||
| + | sda | ||
| + | └─ceph--28f7427e--5558--4ffd--ae1a--51ec3042759a-osd--block--63c0a64e--a0d2--4daf--87ec--c4b00b9f3ab9 | ||
| + | sdb | ||
| + | └─ceph--9ddb7c35--20a6--4099--9127--947141c5452e-osd--block--7233f174--6402--4094--a48b--9aaabf508cb2 | ||
| + | sdc | ||
| + | └─ceph--cbfd182d--02e9--4c5a--b06e--7497d6109c87-osd--block--58eecdfe--b984--46da--a37a--cd04867b4e3f | ||
| + | sdd | ||
| + | └─ceph--9632797e--c4d3--45df--a2bc--03e466c16224-osd--block--20171f57--5931--4402--bbe8--a7f703aa47db | ||
| + | sde | ||
| + | sdf | ||
| + | sdg | ||
| + | sdh | ||
| + | sdi | ||
| + | sdj | ||
| + | sdk | ||
| + | sdl | ||
| + | sdm | ||
| + | ├─sdm1 | ||
| + | │ └─md2 | ||
| + | ├─sdm2 | ||
| + | │ └─md1 | ||
| + | └─sdm3 | ||
| + | sdn | ||
| + | ├─sdn1 | ||
| + | │ └─md2 | ||
| + | └─sdn2 | ||
| + | └─md1 | ||
| + | nvme0n1 | ||
| + | ├─nvme0n1p1 | ||
| + | │ ├─journals-sda | ||
| + | │ ├─journals-sdb | ||
| + | │ ├─journals-sdc | ||
| + | │ ├─journals-sdd | ||
| + | │ ├─journals-sde | ||
| + | │ ├─journals-sdf | ||
| + | │ ├─journals-sdg | ||
| + | │ ├─journals-sdh | ||
| + | │ ├─journals-sdi | ||
| + | │ ├─journals-sdj | ||
| + | │ ├─journals-sdk | ||
| + | │ └─journals-sdl | ||
| + | └─nvme0n1p2 | ||
| + | └─ceph--9f7b3261--4778--47f9--9291--55630a41c262-osd--block--90e64c51--3344--47ce--a390--7931be9f95f1 252: | ||
| + | </ | ||
| + | |||
| + | ==== How to partition/ | ||
| Here's my bash history that can be used to set up a reesi machine' | Here's my bash history that can be used to set up a reesi machine' | ||
| < | < | ||
| - | ansible -a "sudo parted -s / | + | ansible -a "sudo parted -s / |
| - | ansible -a "sudo parted / | + | ansible -a "sudo parted / |
| - | ansible -a "sudo parted / | + | ansible -a "sudo parted / |
| - | ansible -a "sudo pvcreate / | + | ansible -a "sudo pvcreate / |
| - | ansible -a "sudo pvcreate / | + | ansible -a "sudo vgcreate journals / |
| - | ansible -a "sudo vgcreate journals / | + | for disk in sd{a..l}; do ansible -a "sudo lvcreate -L 31G -n $disk journals" |
| - | ansible -a "sudo vgcreate osd / | + | |
| - | for disk in sd{a..l}; do ansible -a "sudo lvcreate -L 31G -n $disk journals" | + | |
| </ | </ | ||
| + | |||
| + | ===== Replacing Drives ===== | ||
| + | Like the [[hardware: | ||
| + | |||
| + | While watching the front of a system, send '' | ||
| ===== Set up a new OSD with journal on NVMe logical volume ===== | ===== Set up a new OSD with journal on NVMe logical volume ===== | ||
hardware/reesi.1518818572.txt.gz · Last modified: by djgalloway
