OACISS Systems Wiki - User contributions [en]

Infrastructure:NS

2020-02-04T01:54:11Z

128.223.202.201: Created page with "Primary DNS/LDAP/DHCP server == Basics == This is now the ldap1 virtual machine living on Nicstor. * OS: CentOS 5.11 [old & busted] == Installed Software == * OpenSSL (for N..."

Primary DNS/LDAP/DHCP server

== Basics ==
This is now the ldap1 virtual machine living on Nicstor.
* OS: CentOS 5.11 [old & busted]

== Installed Software ==
* OpenSSL (for NIC Root CA) See [[Software:OpenSSL]]
* ISC Bind 9 Master for nic.uoregon.edu, tau.uoregon.edu, nic.local, 202.223.128.17.172.in-addr.arpa
* ISC DHCPd Sole DHCP server for net-202
* OpenLDAP 2.3 LDAP+StartTLS on the internal network; LDAPS on both internal and public networks.
* Tivoli Storage Manager Backing up local configuration, OpenSSL PKI, zone files, DHCPd cache file, LDAP database snapshots.

[[Category:Infrastructure]]

Infrastructure:storage

2020-02-04T01:53:11Z

128.223.202.201: Created page with "Spiffy new NFS server once upon a time, now the old and busted backup (with increasing numbers of marginal disks as time goes by) == Basics == * Silicon Mechanics 4U box * 4..."

Spiffy new NFS server once upon a time, now the old and busted backup (with increasing numbers of marginal disks as time goes by)

== Basics ==
* Silicon Mechanics 4U box
* 4 quad-core Xeon E5620 @ 2.4GHz
* 24GB of RAM.
* 23 x 2TB disks in hardware SAN provide 39TB available storage
* Dual Intel 82574L GigE NICs
* OS & Drivers
** CentOS 6.2 (Final)
** Kernel 2.6.32-220.13.1

== Systems Specifications: ==

This is a large server that replaces the NetApp for providing dedicated NFS services. Notably, it has twice the disk and fills 4U instead of its own entire cabinet.

RAID: LSI MegaRaid SAS 2108 (Liberator) 24-disk controller (23 + hot spare)

== Installed Software ==

* NFS. Lots and lots of NFS.
* Private network MTU is set to 9000 to improve speed

[[Category:Infrastructure]]

Infrastructure:newstorage

2020-02-04T01:52:59Z

128.223.202.201: Created page with "NewStorage is the current production storage engine. Current total capacity is 71TB, with 44TB used and 28TB free."

NewStorage is the current production storage engine.

Current total capacity is 71TB, with 44TB used and 28TB free.

Infrastructure:motion

2020-02-04T01:52:43Z

128.223.202.201: Created page with "Primary WWW for NIC and related homepages == Basics == * Silicon Mechanics 2U body * Supermicro X7DWT motherboard * Quad core Xeon E5410 @ 2.33GHz * 16GB of RAM. * 2TB RAID0..."

Primary WWW for NIC and related homepages

== Basics ==
* Silicon Mechanics 2U body
* Supermicro X7DWT motherboard
* Quad core Xeon E5410 @ 2.33GHz
* 16GB of RAM.
* 2TB RAID0 local HDD + NFS to Storage (40TB)
* Dual Intel 80003ES2LAN GigE controllers
* OS and Drivers
** CentOS 5.11 (Final)
** Kernel 2.6.18-406

== Systems Specifications: ==

This is 1/4 of a silicon mechanics 2U box in the Deschutes machine room, along with Motion, Silica and (???)

== Installed Software ==

Motion is a production machine:
* mysql host
* svn server
* web server vhosts: (nic., systems.nic, tracker.nic, tau.nic, trac.nic).uoregon.edu

Real interface:
* 128.223.202.29 - nic.uoregon.edu and true machine IP (sshable)
Virtual interface bindings:
* 128.223.202.23 - trac.nic
* 128.223.202.24 - systems.nic
* 128.223.202.28 - oaciss.uoregon.edu

Others:
* tau.nic.uoregon - .26 (fripp)

[[Category:Infrastructure]]

Infrastructure:fripp

2020-02-04T01:52:25Z

128.223.202.201: Created page with "Storage network (172.x) DHCP server == Basics == * Silicon Mechanics 1U frame * Supermicro X7DWT motherboard * Quad core Xeon E5410 2.3Ghz processor * 16GB of RAM. * 160GB lo..."

Storage network (172.x) DHCP server

== Basics ==
* Silicon Mechanics 1U frame
* Supermicro X7DWT motherboard
* Quad core Xeon E5410 2.3Ghz processor
* 16GB of RAM.
* 160GB local HDD + 1TB local HDD (/home2) + NFS to Storage (40TB)
* 2 Intel 80003ES2LAN GigE onboard
* OS & Drivers
** CentOS 6.6 (Final)
** Kernel 2.6.32-504

== Systems Specifications: ==

This is 1/4 of a 2U Silicon Mechanics rackmount system, along with Motion, Silica and (??) in the Deschutes machine room

== Installed Software ==
* DHCPD server for storage network
* Mysql
* Postgresql
* VMWare host for WinXP virtual machine

[[Category:Infrastructure]]

Compute: OD1K

2020-02-04T01:51:06Z

128.223.202.201: Created page with "== Info == * Hardware ** NVidia Xavier-Jetson (3rd generation Tegra) ** CPU: 4 core ARM A57 ** 8GB of RAM ** Storage: *** 1TB internal *** /home and packages from Cerberus NF..."

== Info ==
* Hardware
** NVidia Xavier-Jetson (3rd generation Tegra)
** CPU: 4 core ARM A57
** 8GB of RAM
** Storage:
*** 1TB internal
*** /home and packages from Cerberus NFS (22TB)
** Gigabit ethernet
* Software
** Ubuntu 16.04.5 LTS
** Kernel 4.15.0

== Parallel processing ==

OD1K is not currently available via slurm.

Compute: Xavier Cluster

2020-02-04T01:50:53Z

128.223.202.201: Created page with "== Info == * Hardware ** NVidia Xavier-Jetson (3rd generation Tegra) ** CPU: 8 core ARMv8 (64 bit ARM) ** 4GB of RAM ** Storage: *** 16GB internal (~3GB free locally) *** /hom..."

== Info ==
* Hardware
** NVidia Xavier-Jetson (3rd generation Tegra)
** CPU: 8 core ARMv8 (64 bit ARM)
** 4GB of RAM
** Storage:
*** 16GB internal (~3GB free locally)
*** /home and packages from Cerberus NFS (22TB)
** Gigabit ethernet
** 256-core Maxwell GPU (CUDA-8.0 runtime)
* Software
** Ubuntu 18 LTS
** Kernel 4.9.140
** 256 core Tegra X1 CUDA processor (compute 5.3 arch)

Node counts: 12 x TX-1 (jetson01-12), 4 x TX-2 (jetson21-24)

== Parallel processing ==

Xavier is not currently available via slurm.

Compute: Jetson cluster

2020-02-04T01:50:36Z

128.223.202.201: Created page with "== Info == * Hardware ** NVidia Jetson SBC systems ** CPU: 4 core (tx-1) or 5 core (tx-2) ARMv8 (aarch64) ** 4GB of RAM ** Storage: *** 16GB internal (~3GB free locally) *** /..."

== Info ==
* Hardware
** NVidia Jetson SBC systems
** CPU: 4 core (tx-1) or 5 core (tx-2) ARMv8 (aarch64)
** 4GB of RAM
** Storage:
*** 16GB internal (~3GB free locally)
*** /home and packages from Cerberus NFS (22TB)
** Gigabit ethernet
** 256-core Maxwell GPU (CUDA-8.0 runtime)
* Software
** Ubuntu 18 LTS
** Kernel 4.9.140
** 256 core Tegra X1 CUDA processor (compute 5.3 arch)

Node counts: 12 x TX-1 (jetson01-12), 4 x TX-2 (jetson21-24)

== Parallel processing ==

The Jetsons are available via cerberus' SLURM under the 'jetson' partition.

mpirun works.

Compute: NUC cluster

2020-02-04T01:50:24Z

128.223.202.201: Created page with "'''NUC Cluster''' == Use of == The NUC cluster lives in a standalone cabinet shared with the Jetsons, on a private network shared also with Cerberus, Chymera, Xavier and OD1..."

'''NUC Cluster'''

== Use of ==

The NUC cluster lives in a standalone cabinet shared with the Jetsons, on a private network shared also with Cerberus, Chymera, Xavier and OD1K. NUC access and the scheduler live on Cerberus.

== Basics per NUC ==
* Intel NUC workstations
* Quad-core Intel i5-4250 @ 1.3GHz
* 16GB of RAM.
* 64GB local SSD + packages & homedirs on Cerberus (22TB)
* Intel I218 gigabit NIC
* OS: Centos 7.7
* Drivers:
** Kernel 3.10-0-1062

== OS Configuration ==

* Standard CentOS installations

=== MPI ===

Utilize SLURM scheduler to run jobs on NUC cluster

Compute: Pegasus

2020-02-04T01:50:11Z

128.223.202.201: Created page with "'''pegasus.nic.uoregon.edu''' == Basics == Hardware * 36c Xeon Cold 6140 @ 2.3GHz * 192GB of RAM. * 1TB local HDD + NFS to Storage (40TB) * Network: ** GigE to public & stor..."

'''pegasus.nic.uoregon.edu'''

== Basics ==
Hardware
* 36c Xeon Cold 6140 @ 2.3GHz
* 192GB of RAM.
* 1TB local HDD + NFS to Storage (40TB)
* Network:
** GigE to public & storage networks
** 100 gigabit Omnipath NIC

Software
* CentOS 7.6
* Kernel 3.10.0-957 (-1062 on reboot)

Compute: Voltar

2020-02-04T01:49:45Z

128.223.202.201: Created page with "'''voltar.nic.uoregon.edu''' Pascal / Volta-class GPU testbed system. Has a local license for a GPU-accelerating compiler. == Basics == Hardware * 6c Xeon Bronze 3104 @ 1.7G..."

'''voltar.nic.uoregon.edu'''

Pascal / Volta-class GPU testbed system. Has a local license for a GPU-accelerating compiler.

== Basics ==
Hardware
* 6c Xeon Bronze 3104 @ 1.7GHz
* 96GB of RAM.
* 1TB local HDD + NFS to Storage (40TB)
* Network:
** GigE to public & storage networks
** 100 gigabit OmniPath NIC
* 1 x V100 (PciE), 16GB HBM, 5120 cores
* 1 x P100 (PciE), 16GM HBM, 3584 cores

Software
* CentOS 7.5.1804
* Kernel 3.10.0-957 (-1062 on reboot)
* nvidia module versions 410.27 and 440.33.01
* PGI accelerating compiler

Compute: Godzuki

2020-02-04T01:49:32Z

128.223.202.201: Created page with "'''godzuki.nic.uoregon.edu''' * Godzuki is down for OS upgrade * == Basics == * Dell Poweredge T620 * Dual quad-core E5-2603 Xeon processors @ 1.8GHz * 16GB of RAM. * 450GB..."

'''godzuki.nic.uoregon.edu'''

* Godzuki is down for OS upgrade *

== Basics ==
* Dell Poweredge T620
* Dual quad-core E5-2603 Xeon processors @ 1.8GHz
* 16GB of RAM.
* 450GB local HDD + NFS to Cerberus (22TB)
* Dual Intel I350 gigabit NICs
* Coprocessors
** nVidia Tesla K20c (GK110GL)
** nVidia GeForce GTX-480 (GF100)
* OS: RHEL-6.7 (Santiago)
* Drivers:
** Kernel 2.6.32-573.7.1
** nvidia-346.72 driver, CUDA runtime 7.0

== OS Configuration ==

* Normal RHEL installation

Compute: Godzilla

2020-02-04T01:49:19Z

128.223.202.201: Created page with "'''godzilla.nic.uoregon.edu''' Hardware: * Intel demo machine with MIC card [Knight's Corner] * Silicon Mechanics Rackform R2504.v5 system * dual 6-core E2620 3.4Ghz Xeon pro..."

'''godzilla.nic.uoregon.edu'''

Hardware:
* Intel demo machine with MIC card [Knight's Corner]
* Silicon Mechanics Rackform R2504.v5 system
* dual 6-core E2620 3.4Ghz Xeon processors (HT enabled)
* Storage
** 64GB of RAM.
** 900GB local HDD
** NFS to Storage (70TB)
* Networking
** Dual Intel I350 gigabit NICs
** Intel OmniPath 100 gigabit network
* Coprocessors
** 1x Xeon Phi SE10/7120 (rev 20)
** 1x nVidia K80 (GK210GL)
** 1x nVidia GP100GL (Tesla P100)

Software
* CentOS-7.6
* Kernel 3.10.0-1062
* nVidia driver 396.37

(mic no longer installed? )

== MIC Configuration ==

From MOTD:
Initial setup for the Intel MIC device:

* cp /opt/intel/mic/id_rsa ~/.ssh/id_rsa.mic
* chmod 600 ~/.ssh/id_rsa.mic
* cp /opt/intel/mic/id_rsa.pub ~/.ssh/id_rsa.pub.mic

To use the Beta Intel compilers:
* . /opt/intel/composer_xe_2013/bin/compilervars.sh (for bash)
or
* source /opt/intel/composer_xe_2013/bin/compilervars.csh (for tcsh)

Sample programs for the MIC can be found in:
/opt/intel/composer_xe_2013/Samples/en_US/

Documentation (PDFs) for the MIC can be found in:
/opt/intel/mic/docs/en

== nVidia CUDA configuration ==

* module av cuda

lists available CUDA runtimes.

Infrastructure: Castor

2020-02-04T01:49:06Z

128.223.202.201: Created page with "'''castor.nic.uoregon.edu''' == Basics == * HP ProLiant SL390s G7 body * dual 6-core X5650 2.7Ghz Xeon processors * 48GB of RAM. * 500GB local HDD + NFS to Storage (40TB) * D..."

'''castor.nic.uoregon.edu'''

== Basics ==
* HP ProLiant SL390s G7 body
* dual 6-core X5650 2.7Ghz Xeon processors
* 48GB of RAM.
* 500GB local HDD + NFS to Storage (40TB)
* Dual Intel 82576 gigabit NICs
* Mellanox 10Gbit/s Infiniband card?
* OS & Drivers
** Centos 6.6 (Final)
** Kernel 2.6.32-504

== OS Configuration ==

* Normal CentOS 6.6 install
* Castor is one of two machines intended to be used as VM hosts

Compute: Manticore

2020-02-04T01:48:55Z

128.223.202.201: Created page with "'''manticore.nic.uoregon.edu''' == Basics == * ACISS demo node - HP Proliant SL390 case * dual 6-core E5650 2.7Ghz Xeon processors * 48GB of RAM. * 500GB local HDD + NFS to S..."

'''manticore.nic.uoregon.edu'''

== Basics ==
* ACISS demo node - HP Proliant SL390 case
* dual 6-core E5650 2.7Ghz Xeon processors
* 48GB of RAM.
* 500GB local HDD + NFS to Storage (40TB)
* Dual Intel 82574 gigabit NICs
* Coprocessors
** 3x Tesla M2070
* OS & Drivers
** RHEL 6.6 (Santiago)
** Kernel 2.6.32-504
** nVidia-346.46 kernel driver
** CUDA runtime 7.0

== OS Configuration ==

RHEL 6

Compute: Gorgon

2020-02-04T01:48:38Z

128.223.202.201: Created page with "'''gorgon.nic.uoregon.edu''' IBM SL-922 supercomputer node == Basics == * Hardware ** 160 core POWER9 @ 3.66GHz w/altivec ** 384GB of RAM. ** 1TB local HDD + NFS to Storage..."

'''gorgon.nic.uoregon.edu'''

IBM SL-922 supercomputer node

== Basics ==
* Hardware
** 160 core POWER9 @ 3.66GHz w/altivec
** 384GB of RAM.
** 1TB local HDD + NFS to Storage (40TB)
** Four Broadcom NextXtreme II BCM57800 1/10 Gig NICs (1Gbps to NIC public & private networks)
** Infiniband HDR to Cyclops (50Gbps)
** 4 nVidia V100 GPU (V100-SXM2, 32GB HBM) with all-all peer RDMA
* Software
** RHEL 7.6
** Kernel 4.14.0-115
** nVidia kernel module 418.67, CUDA 10.1 R.T.
** IBM XLC/XLF beta compilers

Compute: Cyclops

2020-02-04T01:48:25Z

128.223.202.201: Created page with "'''cyclops.nic.uoregon.edu''' IBM SL-922 supercomputer node == Basics == * Hardware ** 160 core POWER9 @ 3.66GHz w/altivec ** 384GB of RAM. ** 1TB local HDD + NFS to Storage..."

'''cyclops.nic.uoregon.edu'''

IBM SL-922 supercomputer node

== Basics ==
* Hardware
** 160 core POWER9 @ 3.66GHz w/altivec
** 384GB of RAM.
** 1TB local HDD + NFS to Storage (40TB)
** Four Broadcom NextXtreme II BCM57800 1/10 Gig NICs (1Gbps to NIC public & private networks)
** Infiniband HDR to Gorgon (50Gbps)
** 4 nVidia V100 GPU (V100-SXM2, 32GB HBM) with all-all peer RDMA
* Software
** RHEL 7.6
** Kernel 4.14.0-115
** nVidia kernel module 418.67, CUDA 10.1 R.T.
** IBM XLC/XLF beta compilers

Compute: Minotaur

2020-02-04T01:48:14Z

128.223.202.201: Created page with "'''minotaur.nic.uoregon.edu''' IBM S822 supercomputer node with dual K80 GPUs. == Basics == * IBM Power8 processor, 160 cores @ 3.5GHz * 256GB of RAM. * 1TB local HDD + NFS..."

'''minotaur.nic.uoregon.edu'''

IBM S822 supercomputer node with dual K80 GPUs.

== Basics ==
* IBM Power8 processor, 160 cores @ 3.5GHz
* 256GB of RAM.
* 1TB local HDD + NFS to Storage (40TB)
* Four Broadcom NextXtreme II BCM57800 1/10Gig NICs
* Coprocessors
** 2x nVidia K80 (GK210GL)
* Software
** OS: Ubuntu 18.04.3
** Kernel 5.0.0-22
** nvidia drivers - not installed yet

Compute: Centaur

2020-02-04T01:48:03Z

128.223.202.201: Created page with "'''centaur.nic.uoregon.edu''' == Basics == * Hardware ** 160 core POWER8 @ 3.5GHz w/altivec ** 256GB of RAM. ** 1TB local HDD + NFS to Storage (40TB) ** Four Broadcom NextXtr..."

'''centaur.nic.uoregon.edu'''

== Basics ==
* Hardware
** 160 core POWER8 @ 3.5GHz w/altivec
** 256GB of RAM.
** 1TB local HDD + NFS to Storage (40TB)
** Four Broadcom NextXtreme II BCM57800 1/10 Gig NICs
** 2x nVidia K80 (GK210GL)
* Software
** RHEL 7.2
** Kernel 3.10.0-514
** nVidia kernel module 361.119
** IBM XLC/XLF beta compilers

Compute: KNL Grover

2020-02-04T01:47:41Z

128.223.202.201: Created page with "* Hardware ** Xeon Phi prototype hardware ** 272 Xeon Phi 7250 cores running at 1.4GHz ** 115GB memory ** 875GB local storage ** 40TB nfs on Storage ** Network: Intel I210 dua..."

* Hardware
** Xeon Phi prototype hardware
** 272 Xeon Phi 7250 cores running at 1.4GHz
** 115GB memory
** 875GB local storage
** 40TB nfs on Storage
** Network: Intel I210 dual GigE NICs
* Software
** CentOS 7.2
** Kernel 4.8.4

Compute: Delphi

2020-02-04T01:47:27Z

128.223.202.201: duplicate page from original wiki

'''delphi.nic.uoregon.edu'''

Hardware
* ASUS box
* 72-core Xeon Phi @ 1.2GHz W/46MB cache
* 128GB of RAM.
* Storage
** 700GB local HDD
** 70TB of NAS storage
* Networking
** Intel dual-port X540-AT2 10GigE (running @ 1G)
** 100 Gigabit Omnipath NIC

Software
* OS: Centos
* Kernel 3.10.0-513