Storage Network: Difference between revisions

From OACISS Systems Wiki
Jump to navigation Jump to search
No edit summary
 
(11 intermediate revisions by 2 users not shown)
Line 1: Line 1:
The storage network provides a dedicated backbone for access to the [[NetApp Filers]], and acts as a trusted network for NIC internal services.
The storage network provides a dedicated backbone for access to the [[Netapp Filers]], and acts as a trusted network for NIC internal services.
__TOC__


== 172.17.0.x ==
== Layout ==
Address space for hosts with no public IP
<pre>
00 - 09 : Routers/other
        1      Router/DHCP server - eth1:1 on geogenic.cs.uoregon.edu
10 - 19 : Switches
        10      Deschutes 3500yl
        11      RRP 3400cl
        12      RRP Dell
20 - 29 : BladeCenter chassis
        20      MM external (eth0)
        21      MM internal (eth1)
        22      Bay 1 Ethernet switch
        23      Bay 2 Ethernet switch
        24      Bay 3 Fibre Channel switch
30 - 39 : BladeCenter blades
        30      Iconicblade0
        31      Iconicblade1
        32      Iconicblade2
        33      Iconicblade3
        34      Iconicblade4
        35      Iconicblade5
        36      Iconicblade6
        37      Iconicblade7
40 - 49 : IBM Management hosts
        40      NIC-HMC
        41      Deschutes-HMC
100 - 129 : Private user-accessable servers
        100    mojojojo
130 - 159 : Private infrastructure servers
        130    oink
200 - 229 : Private DHCP pool
        (automatically assigned by DHCP server)
230 - 254 : Neuronic back-end nodes
        (automatically assigned by Rocks Cluster Management)
</pre>


== 172.17.8.x ==
== Addressing ==
Address space for systems with CS Dept external addresses
The storage network uses a class-B private subnet of 172.17.0.0/16, or 172.17.0.0 to 172.17.255.255. Currently, only the 0, 1, 8, and 223 class-C ranges are in use.
<pre>
        [[List to be compiled at a later date]]
</pre>


== 172.17.202.x ==
{| border="1" cellspacing="0" cellpadding="5"
Address space for systems with NIC external addresses
! colspan=2 align=center | Settings
<pre>
|-
        [[List to be compiled at a later date]]
| IP Address || See Below
</pre>
|-
| Netmask || 255.255.0.0
|-
| Default Gateway || 172.17.0.0
|-
| Domain Name || nic.local
|-
| DNS Servers || 172.17.202.25 172.17.8.66
|}
 
 
=== Address Allocation Schemes ===
Hosts are assigned addresses in several ranges depending on configuration.
 
==== Multi-homed ====
The general idea is that any host that has a public IP address is assigned a similar address on the storage network. Simply replace the first two octets with 172.17. For example
 
'''128.223.202.25''' becomes '''127.17.202.25'''
'''128.223.8.66'''  becomes '''172.17.8.66'''
 
==== Private-only ====
Permanent systems without a public interface are assigned an address in the 172.17.0.[0-255] range.
 
==== DHCP ====
For temporary access, there is a DHCP server hanging out addresses in the 172.17.1.[0-255] range.
 
== VLANs ==
 
VLANs are used across the storage network to facilitate the overlay of multiple logical networks on to a single physical infrastructure. For the most part, they are used to extend the Rocks MPI and Management networks across the street, while not interfering with the primary NFS network.
 
Generally, the following VLAN layout is used:
 
{| border="1" cellspacing="0" cellpadding="5"
! VLAN Tag || Name || Description
|-
| 1  || NIC Storage || NFS Private network, as described above.<BR>Untagged on core switches.
|-
| 2  || NIC Storage || Used on Mist and Neuronic switches to overlay the Storage net on Rocks Management ports.<BR>Tagged on Rocks '''eth0''' interfaces.
|-
| 3  || Rocks Management || Rocks cluster node SSH access, reinstallation, config file syncronization, etc.<BR>Untagged on Rocks '''eth0''' interfaces.
|-
| 4  || Rocks MPI || Dedicated to MPI communication between nodes.<BR>Untagged on Rocks '''eth2/eth3''' interfaces.
|-
| 8  || Net-8 || The Research Rack switch is uplinked to CIS's Net-8 switch.<BR>Untagged on Research Rack switch ports 0-24
|-
| 22 || Net-202 || This is not currently used, but was reserved to match the usage of Net-8.<BR> No ports
|}

Latest revision as of 22:01, 17 April 2009

The storage network provides a dedicated backbone for access to the Netapp Filers, and acts as a trusted network for NIC internal services.

Layout

Addressing

The storage network uses a class-B private subnet of 172.17.0.0/16, or 172.17.0.0 to 172.17.255.255. Currently, only the 0, 1, 8, and 223 class-C ranges are in use.

Settings
IP Address See Below
Netmask 255.255.0.0
Default Gateway 172.17.0.0
Domain Name nic.local
DNS Servers 172.17.202.25 172.17.8.66


Address Allocation Schemes

Hosts are assigned addresses in several ranges depending on configuration.

Multi-homed

The general idea is that any host that has a public IP address is assigned a similar address on the storage network. Simply replace the first two octets with 172.17. For example

128.223.202.25 becomes 127.17.202.25
128.223.8.66   becomes 172.17.8.66

Private-only

Permanent systems without a public interface are assigned an address in the 172.17.0.[0-255] range.

DHCP

For temporary access, there is a DHCP server hanging out addresses in the 172.17.1.[0-255] range.

VLANs

VLANs are used across the storage network to facilitate the overlay of multiple logical networks on to a single physical infrastructure. For the most part, they are used to extend the Rocks MPI and Management networks across the street, while not interfering with the primary NFS network.

Generally, the following VLAN layout is used:

VLAN Tag Name Description
1 NIC Storage NFS Private network, as described above.
Untagged on core switches.
2 NIC Storage Used on Mist and Neuronic switches to overlay the Storage net on Rocks Management ports.
Tagged on Rocks eth0 interfaces.
3 Rocks Management Rocks cluster node SSH access, reinstallation, config file syncronization, etc.
Untagged on Rocks eth0 interfaces.
4 Rocks MPI Dedicated to MPI communication between nodes.
Untagged on Rocks eth2/eth3 interfaces.
8 Net-8 The Research Rack switch is uplinked to CIS's Net-8 switch.
Untagged on Research Rack switch ports 0-24
22 Net-202 This is not currently used, but was reserved to match the usage of Net-8.
No ports