Service:storage: Difference between revisions

From OACISS Systems Wiki
Jump to navigation Jump to search
No edit summary
Line 5: Line 5:
OACISS runs two NAS storage drives for user data and programs.
OACISS runs two NAS storage drives for user data and programs.


== Mnemosyne ==
In addition, certain systems may have additional local disks, most often for storage of images related to container infrastructure like Docker.


Most systems access NAS on [[Infrastructure:mnemosyne | Mnemosyne]]. This is the powerful primary storage engine utilizing 10x12TB Seagate Exos disks in RAID-6.
== Main storage ==


It has 90TB of disk available in one large volume and has a 10Gbps connection to the storage network. Its spindles are tested capable of sustaining 600MBps sequential read+write over NFS4.
Most systems access NAS on [[Infrastructure:mnemosyne | Mnemosyne]]. This is the primary storage engine utilizing 14x12TB Seagate Exos disks in RAID-6. It has 135TB of disk available in a single large volume.
 
Mnemosyne is connected to the storage network at 40Gbps and has 128GB of memory. It can absorb data at 2.5GBps until ram cache is filled, and can sustain roughly 750MBps sequential IO continuously.


Package trees for architectures and various major versions of OS are exported and normally mounted sync. All user directories are mounted NFS4 async.
Package trees for architectures and various major versions of OS are exported and normally mounted sync. All user directories are mounted NFS4 async.


Hosts are granted the right to mount the packages and user directories on Mnemosyne one by one in Mnemosyne's /etc/exports file.  
== NVME NFS ==
 
In addition, Mnemosyne hosts and exports an 8TB volume made from two 4T Sabrent Rocket NVME gumsticks. This volume is capable of delivering 2.5GBps of read and write simultaneously nonstop (limited to somewhat under 1GBps per client by the client network speed), or up to 80K IOPS, over the storage network.


== Cerberus ==
== Cerberus ==


Cerberus, Chymera, and the nuc + jetson cluster have access to a smaller 22TB NAS, accessed over 1Gbe, located on Cerberus.
Cerberus, Chymera, and the nuc + jetson cluster have access to a smaller 22TB NAS, accessed over 1Gbit ethernet, located on Cerberus.
 
This storage, and package tree, is entirely separate from main storage.

Revision as of 09:19, 17 September 2020

Storage on OACISS systems

OACISS runs two NAS storage drives for user data and programs.

In addition, certain systems may have additional local disks, most often for storage of images related to container infrastructure like Docker.

Main storage

Most systems access NAS on Mnemosyne. This is the primary storage engine utilizing 14x12TB Seagate Exos disks in RAID-6. It has 135TB of disk available in a single large volume.

Mnemosyne is connected to the storage network at 40Gbps and has 128GB of memory. It can absorb data at 2.5GBps until ram cache is filled, and can sustain roughly 750MBps sequential IO continuously.

Package trees for architectures and various major versions of OS are exported and normally mounted sync. All user directories are mounted NFS4 async.

NVME NFS

In addition, Mnemosyne hosts and exports an 8TB volume made from two 4T Sabrent Rocket NVME gumsticks. This volume is capable of delivering 2.5GBps of read and write simultaneously nonstop (limited to somewhat under 1GBps per client by the client network speed), or up to 80K IOPS, over the storage network.

Cerberus

Cerberus, Chymera, and the nuc + jetson cluster have access to a smaller 22TB NAS, accessed over 1Gbit ethernet, located on Cerberus.

This storage, and package tree, is entirely separate from main storage.