Storage Network: Difference between revisions

From OACISS Systems Wiki
Jump to navigation Jump to search
mNo edit summary
 
(5 intermediate revisions by the same user not shown)
Line 29: Line 29:


  '''128.223.202.25''' becomes '''127.17.202.25'''
  '''128.223.202.25''' becomes '''127.17.202.25'''
  '''128.223.8.66'''  becomes '''172..17.8.66'''
  '''128.223.8.66'''  becomes '''172.17.8.66'''


==== Private-only ====
==== Private-only ====
Line 38: Line 38:


== VLANs ==
== VLANs ==
VLANs are used across the storage network to facilitate the overlay of multiple logical networks on to a single physical infrastructure. For the most part, they are used to extend the Rocks MPI and Management networks across the street, while not interfering with the primary NFS network.
Generally, the following VLAN layout is used:
{| border="1" cellspacing="0" cellpadding="5"
! VLAN Tag || Name || Description
|-
| 1  || NIC Storage || NFS Private network, as described above.<BR>Untagged on core switches.
|-
| 2  || NIC Storage || Used on Mist and Neuronic switches to overlay the Storage net on Rocks Management ports.<BR>Tagged on Rocks '''eth0''' interfaces.
|-
| 3  || Rocks Management || Rocks cluster node SSH access, reinstallation, config file syncronization, etc.<BR>Untagged on Rocks '''eth0''' interfaces.
|-
| 4  || Rocks MPI || Dedicated to MPI communication between nodes.<BR>Untagged on Rocks '''eth2/eth3''' interfaces.
|-
| 8  || Net-8 || The Research Rack switch is uplinked to CIS's Net-8 switch.<BR>Untagged on Research Rack switch ports 0-24
|-
| 22 || Net-202 || This is not currently used, but was reserved to match the usage of Net-8.<BR> No ports
|}

Latest revision as of 22:01, 17 April 2009

The storage network provides a dedicated backbone for access to the Netapp Filers, and acts as a trusted network for NIC internal services.

Layout

Addressing

The storage network uses a class-B private subnet of 172.17.0.0/16, or 172.17.0.0 to 172.17.255.255. Currently, only the 0, 1, 8, and 223 class-C ranges are in use.

Settings
IP Address See Below
Netmask 255.255.0.0
Default Gateway 172.17.0.0
Domain Name nic.local
DNS Servers 172.17.202.25 172.17.8.66


Address Allocation Schemes

Hosts are assigned addresses in several ranges depending on configuration.

Multi-homed

The general idea is that any host that has a public IP address is assigned a similar address on the storage network. Simply replace the first two octets with 172.17. For example

128.223.202.25 becomes 127.17.202.25
128.223.8.66   becomes 172.17.8.66

Private-only

Permanent systems without a public interface are assigned an address in the 172.17.0.[0-255] range.

DHCP

For temporary access, there is a DHCP server hanging out addresses in the 172.17.1.[0-255] range.

VLANs

VLANs are used across the storage network to facilitate the overlay of multiple logical networks on to a single physical infrastructure. For the most part, they are used to extend the Rocks MPI and Management networks across the street, while not interfering with the primary NFS network.

Generally, the following VLAN layout is used:

VLAN Tag Name Description
1 NIC Storage NFS Private network, as described above.
Untagged on core switches.
2 NIC Storage Used on Mist and Neuronic switches to overlay the Storage net on Rocks Management ports.
Tagged on Rocks eth0 interfaces.
3 Rocks Management Rocks cluster node SSH access, reinstallation, config file syncronization, etc.
Untagged on Rocks eth0 interfaces.
4 Rocks MPI Dedicated to MPI communication between nodes.
Untagged on Rocks eth2/eth3 interfaces.
8 Net-8 The Research Rack switch is uplinked to CIS's Net-8 switch.
Untagged on Research Rack switch ports 0-24
22 Net-202 This is not currently used, but was reserved to match the usage of Net-8.
No ports