NetworkInfrastructure: Difference between revisions

From OACISS Systems Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
Line 9: Line 9:


If a racked OACISS node is connected to the storage network, this interface will have a private name.stor DNS record (e.g. ''delphi.stor''). If the node has IPMI/LOM/iDRAC/ILO/BMC available, this will be reached under name-ipmi.stor (e.g. ''centaur-ipmi.stor''). These records resolve only from within the UO NIC subnet.
If a racked OACISS node is connected to the storage network, this interface will have a private name.stor DNS record (e.g. ''delphi.stor''). If the node has IPMI/LOM/iDRAC/ILO/BMC available, this will be reached under name-ipmi.stor (e.g. ''centaur-ipmi.stor''). These records resolve only from within the UO NIC subnet.
== High speed networks ==
OACISS has an OmniPath and an EDR Infiniband switch
Pegasus, Godzilla, Voltar and Delphi are accessible on the Omnipath network (as $HOST-op).
Cyclops, Gorgon, Eagle and Aurora are on the Infiniband network (as $HOST-ib)


= Hardware =
= Hardware =

Revision as of 02:03, 30 June 2020

OACISS naming / DNS

The majority of OACISS hardware has two network connections: One which is publicly routable, and one that provides access to the storage/NFS network.

Public connections are currently 1Gbps (this is likely to change in the relatively near future). The storage network is mixed 10Gbps/1Gbps. The majority of nodes currently have 10Gbps access.

The public interface of a machine is associated with its public DNS record under the nic.uoregon.edu domain (e.g. delphi.nic.uoregon.edu, or just delphi from within UO).

If a racked OACISS node is connected to the storage network, this interface will have a private name.stor DNS record (e.g. delphi.stor). If the node has IPMI/LOM/iDRAC/ILO/BMC available, this will be reached under name-ipmi.stor (e.g. centaur-ipmi.stor). These records resolve only from within the UO NIC subnet.

High speed networks

OACISS has an OmniPath and an EDR Infiniband switch

Pegasus, Godzilla, Voltar and Delphi are accessible on the Omnipath network (as $HOST-op).

Cyclops, Gorgon, Eagle and Aurora are on the Infiniband network (as $HOST-ib)

Hardware

The NIC switching infrastructure has a total of five switches currently.

A total of three are utilized for the private network (red):

  • Dell PowerConnect 8024 is a 24 port 10Gbps switch
    • Web monitor interface at 172.17.202.249
  • The Cisco Catalyst 2960s is a 24 port 1Gb switch with two 10Gbps SFP+ trunk ports
    • Console connection available on Mecha at ttyS0
    • 10Gbps optical trunk port to Powerconnect
      • If connection fails, cisco side may "lose" transmit power; this can be restored by turning the sfp port off and back on
    • Backup 1Gbe wire connection to Cisco port 17 [deactivated by STP]
  • The R35 private network switch is present to allow IPMI ports on R35 hosts to use shorter cables

Two switches are used for the public-facing (128.223.202.0/25) network.

  • The R34 switch has the actual WAN link
  • The R35 switch has one 1Gbps link to the R34 switch

The R34 switch is a ProCurve 3500yl. It has 10Gbps trunk capability but not in RJ45 format.

New HP A5500 switch is coming which has 10Gbit SFP+ ports as is an SFP+ RJ45 transceiver. From this we will connect to the 10G WAN link, and to the R35 public switch at 10G as well.

Oaciss switches.png