NetworkInfrastructure

OACISS naming / DNS

The majority of OACISS hardware has two network connections: One which is publicly routable, and one that provides access to the storage/NFS network.

Public connections are currently 1Gbps (this is likely to change in the relatively near future). The storage network is mixed 10Gbps/1Gbps. The majority of nodes currently have 10Gbps access.

The public interface of a machine is associated with its public DNS record under the nic.uoregon.edu domain (e.g. delphi.nic.uoregon.edu, or just delphi from within UO).

If a racked OACISS node is connected to the storage network, this interface will have a private name.stor DNS record (e.g. delphi.stor). If the node has IPMI/LOM/iDRAC/ILO/BMC available, this will be reached under name-ipmi.stor (e.g. centaur-ipmi.stor). These records resolve only from within the UO NIC subnet.

High speed networks

Intel OmniPath

OACISS has a 100Gbps Intel OmniPath switch and several nodes with OP hardware:

• Pegasus
• Godzilla
• Voltar
• Delphi

They are accessed by $HOST-op; These are stored in /etc/hosts on these machines.

EDR InfiniBand

OACISS has a 36 port SB7700 100Gbps EDR Infiniband switch, with access to the following hosts:

• Cyclops
• Gorgon
• Eagle
• Aurora (sx-aurora)

All hosts are available using IPoIB as $HOST-ib; These designations are stored in /etc/hosts

Network Hardware

The NIC Ethernet setup has four switches, two per cabinet, one each for private/storage and public networks.

• Dell N4032 x 2: Private network
  • Switches are stacked. R35 unit is master (#1) and R34 is failover/member (#2)
  • 40Gbps trunk link between racks (Fo1/1/1 and Fo2/1/1)
  • 40GbE to Mnemosyne (Fo1/1/2)
• Dell PowerConnect 8024 + N4032: Public network
  • PC8024 in R34
    • 10Gbps UOnet uplink (Te1/0/1)
    • 2 ports LAG trunk to R35 (Te1/0/21 & 22)