hardware:irvingi
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
hardware:irvingi [2020/03/07 01:23] djgalloway [Table] |
hardware:irvingi [2021/06/24 18:35] (current) djgalloway [Hardware Specs] |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== irvingi{01..08} ====== | ====== irvingi{01..08} ====== | ||
| - | https://opendcim.engineering.redhat.com/cabnavigator.php?cabinetid=501 | + | https://opendcim.engineering.redhat.com/cabnavigator.php?cabinetid=504 |
| ===== Summary ===== | ===== Summary ===== | ||
| - | We have 22 braggi systems. The Ceph Foundation graciously purchased these late 2019/early 2020 to help reduce our reliance on ephemeral Jenkins slaves in OVH's Openstack public cloud. | + | We have 8 irvingi systems. All are connected to [[production:jenkins.ceph.com|Jenkins]] as a builder. |
| ===== Hardware Specs ===== | ===== Hardware Specs ===== | ||
| - | | ^ Count ^ Manufacturer ^ Model ^ Capacity ^ Notes ^ | + | | ^ Count ^ Manufacturer ^ Model ^ Capacity ^ Notes ^ |
| - | ^ Chassis | N/A | Supermicro | SYS-1029P-MTR | N/A | | | + | ^ Chassis | N/A | Supermicro | SYS-1028R-TDW | N/A | | |
| - | ^ Mainboard | N/A | Supermicro | X11DPL-i | N/A | | | + | ^ Mainboard | N/A | Supermicro | X10DDW-i | N/A | | |
| - | ^ CPU | 2 | Intel | Intel(R) Xeon(R) Silver 4214 CPU @ 2.20GHz | 48 cores | [[https://ark.intel.com/content/www/us/en/ark/products/193385/intel-xeon-silver-4214-processor-16-5m-cache-2-20-ghz.html|ARK]] | | + | ^ CPU | 2 | Intel | Xeon(R) CPU E5-2620 v3 @ 2.40GHz | 24 cores total | [[http://ark.intel.com/products/83352/Intel-Xeon-Processor-E5-2620-v3-15M-Cache-2_40-GHz|ARK]] | |
| - | ^ RAM | 8 DIMMs | Micron Technology | 36ASF4G72PZ-2G6E1 | 32GB | 256GB total | | + | ^ RAM | 4 DIMMs | Samsung | M393A2G40DB0-CPB | 16GB | 64GB total | |
| - | ^ SSD | 1 | Intel | MZ7KH480HAHQ-00005 | 480GB | | | + | ^ HDD | 0 | | | | | |
| - | ^ SSD | 1 | Intel | MZ7LH960HAJR-00005 | 960GB | Mounted at /home/jenkins-build | | + | ^ SSD | 2 | Intel | SSDSC2BB240G4 | 240GB | | |
| - | ^ NIC | 2 ports | Intel | ? | 1Gb | Unused | | + | ^ SSD | 1 | Samsung | EVO 850 | 1TB | | |
| - | ^ NIC | 2 ports | Intel | 82599ES | 10Gb | Port 1 cabled as uplink | | + | ^ NIC | 2 ports | Intel | I350 | 1Gb | On-board | |
| - | ===== Setting up as Jenkins slaves ===== | + | The irvingi have 8x 2.5" drive bays per chassis. |
| - | - Reimage using Cobbler | + | ===== BIOS Update ===== |
| - | - Once the OS install is done, | + | **WARNING:** I had to hand modify/rename the ''/etc/sysconfig/network-scripts/ifcfg'' files after this BIOS update. udev changed the name from enp11s0f0 to enp8s0f0. I also lost access to the BMC Java KVM so make sure you can get SOL access to the machine/OS. |
| - | - Run the ceph-cm-ansible ''users'' role | + | |
| - | - Run https://github.com/djgalloway/sepia/blob/master/ansible-playbooks/braggi-home.yml | + | The Supermicro X10 series BIOS can only be updated in a UEFI shell, Windows, or DOS prompt. I roughly followed [[https://siliconmechanics.zendesk.com/hc/en-us/articles/201466115-Creating-FreeDOS-bootable-ISO|this guide]] to create a bootable DOS image with the BIOS embedded. Here's a brief rundown. |
| - | - Run https://github.com/ceph/ceph-build/blob/master/ansible/examples/slave_static.yml | + | |
| + | <code> | ||
| + | # Download and unzip the BIOS zip file somewhere... then: | ||
| + | |||
| + | wget http://www.fdos.org/bootdisks/ISO/FDOEMCD.builder.zip | ||
| + | unzip FDOEMCD.builder.zip | ||
| + | cp -r /path/to/BIOS/ /path/to/FDOEMCD/CDROOT/ | ||
| + | cd /path/to/FDOEMCD/CDROOT/BIOS/DOS/ | ||
| + | mv AFUDOSU.SMC AFUDOS.EXE | ||
| + | mv CHOICE.SMC CHOICE.EXE | ||
| + | mv FDT.smc FDT.EXE | ||
| + | cd /path/to/FDOEMCD | ||
| + | mkisofs -o irvingibiosupdate.iso -p "Silicon Mechanics Support" -publisher "www.siliconmechanics.com" -V "SiMech OEM CD" -b isolinux/isolinux.bin -no-emul-boot -boot-load-size 4 -boot-info-table -N -J -r -c boot.catalog -hide boot.catalog -hide-joliet boot.catalog CDROOT | ||
| + | </code> | ||
| + | |||
| + | I then copied irvingibiosupdate.iso to cobbler.front.sepia.ceph.com:/samba/anonymous and mounted it via the irvingi BMC Web UI and booted to it. | ||
| + | |||
| + | * **Share Host:** ''172.21.0.11'' | ||
| + | * **Path:** ''\Anonymous\irvingibiosupdate.iso'' | ||
| + | |||
| + | Run ''cd X10DDW46\DOS'', ''flash.bat $FW_BIN_FILE''. The system will check if a firmware update is needed and put the system board in [Flash Mode] if needed. The system will reboot. Boot back into FreeDOS and run the flash.bat script again. | ||
| + | |||
| + | Basically, read the README and follow prompts. | ||
| + | |||
| + | {{ :hardware:screenshot_at_2016-11-30_15-03-56.png?nolink |}} | ||
hardware/irvingi.1583544216.txt.gz · Last modified: 2020/03/07 01:23 by djgalloway
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
