Infrastructure:mnemosyne

mnemosyne is to be the new main NFS storage engine.

It has 18 front-loader 3.5" HDD bays connected to the Broadcom SAS3008 hard drive controller that provide mass storage. Currently ten Seagate Exos 12TB disks are installed in RAID-6. Rough performance: Sustained sequential write is roughly 600MBps. Time to unzip linux-5.0 kernel source is roughly 24 seconds.

The OS resides on two rear-facing 2.5" Micron SSDs in RAID-1. Sustained write is 600MBps. Time to unzip linux-5.0 kernel source is ~6 seconds.

Storage network connectivity is at 10Gbps; In tests, sustained sequential transfer over NFS4 to /vol ran at 500MBps (stripe size 32KB). We note that jumbo frames have not been enabled yet, and that the xfs stripe size is 128K.

Basics

• SuperMicro SuperServer 3U body
• 8x Xeon Silver 4112 @ 2.6GHz
• 64GB RAM
• Storage:
  • OS: 2x480GB Micron 5200 in RAID-1
  • /vol: 10xSeagate Exos 12TB (ST12000NM0007) in RAID-6 (95TB available)
• Network
  • Intel x722 10Gbps ethernet
  • HMC
• OS
  • Centos 8
  • Kernel 4.18.0-147

OS Configuration

Mnemosyne has a standard CentOS 8 server install.