Storage Network: Difference between revisions

From OACISS Systems Wiki
Jump to navigation Jump to search
No edit summary
 
(9 intermediate revisions by 2 users not shown)
Line 1: Line 1:
The storage network provides a dedicated backbone for access to the [[Netapp Filers]], and acts as a trusted network for NIC internal services.
__TOC__
__TOC__
The storage network provides a dedicated backbone for access to the [[Netapp Filers]], and acts as a trusted network for NIC internal services.


== 172.17.0.x ==
== Layout ==
Address space for hosts with no public IP
 
<pre>
== Addressing ==
00 - 09 : Routers/other
The storage network uses a class-B private subnet of 172.17.0.0/16, or 172.17.0.0 to 172.17.255.255. Currently, only the 0, 1, 8, and 223 class-C ranges are in use.
        1      Router/DHCP server - eth1:1 on geogenic.cs.uoregon.edu
 
10 - 19 : Switches
{| border="1" cellspacing="0" cellpadding="5"
        10      Deschutes 3500yl
! colspan=2 align=center | Settings
        11      RRP 3400cl
|-
        12      RRP Dell
| IP Address || See Below
20 - 29 : BladeCenter chassis
|-
        20      MM external (eth0)
| Netmask || 255.255.0.0
        21      MM internal (eth1)
|-
        22      Bay 1 Ethernet switch
| Default Gateway || 172.17.0.0
        23      Bay 2 Ethernet switch
|-
        24      Bay 3 Fibre Channel switch
| Domain Name || nic.local
30 - 39 : BladeCenter blades
|-  
        30      Iconicblade0
| DNS Servers || 172.17.202.25 172.17.8.66
        31      Iconicblade1
|}
        32      Iconicblade2
 
        33      Iconicblade3
 
        34      Iconicblade4
=== Address Allocation Schemes ===
        35      Iconicblade5
Hosts are assigned addresses in several ranges depending on configuration.
        36      Iconicblade6
 
        37      Iconicblade7
==== Multi-homed ====
40 - 49 : IBM Management hosts
The general idea is that any host that has a public IP address is assigned a similar address on the storage network. Simply replace the first two octets with 172.17. For example
        40      NIC-HMC
 
        41      Deschutes-HMC
'''128.223.202.25''' becomes '''127.17.202.25'''
100 - 129 : Private user-accessable servers
'''128.223.8.66'''  becomes '''172.17.8.66'''
        100    mojojojo
 
130 - 159 : Private infrastructure servers
==== Private-only ====
        130    oink
Permanent systems without a public interface are assigned an address in the 172.17.0.[0-255] range.
200 - 229 : Private DHCP pool
 
        (automatically assigned by DHCP server)
==== DHCP ====
230 - 254 : Neuronic back-end nodes
For temporary access, there is a DHCP server hanging out addresses in the 172.17.1.[0-255] range.
        (automatically assigned by Rocks Cluster Management)
 
</pre>
== VLANs ==
 
VLANs are used across the storage network to facilitate the overlay of multiple logical networks on to a single physical infrastructure. For the most part, they are used to extend the Rocks MPI and Management networks across the street, while not interfering with the primary NFS network.


== 172.17.8.x ==
Generally, the following VLAN layout is used:
Address space for systems with CS Dept external addresses
<pre>
        [[List to be compiled at a later date]]
</pre>


== 172.17.202.x ==
{| border="1" cellspacing="0" cellpadding="5"
Address space for systems with NIC external addresses
! VLAN Tag || Name || Description
<pre>
|-
        [[List to be compiled at a later date]]
| 1  || NIC Storage || NFS Private network, as described above.<BR>Untagged on core switches.
</pre>
|-
| 2  || NIC Storage || Used on Mist and Neuronic switches to overlay the Storage net on Rocks Management ports.<BR>Tagged on Rocks '''eth0''' interfaces.
|-
| 3  || Rocks Management || Rocks cluster node SSH access, reinstallation, config file syncronization, etc.<BR>Untagged on Rocks '''eth0''' interfaces.
|-
| 4  || Rocks MPI || Dedicated to MPI communication between nodes.<BR>Untagged on Rocks '''eth2/eth3''' interfaces.
|-
| 8  || Net-8 || The Research Rack switch is uplinked to CIS's Net-8 switch.<BR>Untagged on Research Rack switch ports 0-24
|-
| 22 || Net-202 || This is not currently used, but was reserved to match the usage of Net-8.<BR> No ports
|}

Latest revision as of 22:01, 17 April 2009

The storage network provides a dedicated backbone for access to the Netapp Filers, and acts as a trusted network for NIC internal services.

Layout

Addressing

The storage network uses a class-B private subnet of 172.17.0.0/16, or 172.17.0.0 to 172.17.255.255. Currently, only the 0, 1, 8, and 223 class-C ranges are in use.

Settings
IP Address See Below
Netmask 255.255.0.0
Default Gateway 172.17.0.0
Domain Name nic.local
DNS Servers 172.17.202.25 172.17.8.66


Address Allocation Schemes

Hosts are assigned addresses in several ranges depending on configuration.

Multi-homed

The general idea is that any host that has a public IP address is assigned a similar address on the storage network. Simply replace the first two octets with 172.17. For example

128.223.202.25 becomes 127.17.202.25
128.223.8.66   becomes 172.17.8.66

Private-only

Permanent systems without a public interface are assigned an address in the 172.17.0.[0-255] range.

DHCP

For temporary access, there is a DHCP server hanging out addresses in the 172.17.1.[0-255] range.

VLANs

VLANs are used across the storage network to facilitate the overlay of multiple logical networks on to a single physical infrastructure. For the most part, they are used to extend the Rocks MPI and Management networks across the street, while not interfering with the primary NFS network.

Generally, the following VLAN layout is used:

VLAN Tag Name Description
1 NIC Storage NFS Private network, as described above.
Untagged on core switches.
2 NIC Storage Used on Mist and Neuronic switches to overlay the Storage net on Rocks Management ports.
Tagged on Rocks eth0 interfaces.
3 Rocks Management Rocks cluster node SSH access, reinstallation, config file syncronization, etc.
Untagged on Rocks eth0 interfaces.
4 Rocks MPI Dedicated to MPI communication between nodes.
Untagged on Rocks eth2/eth3 interfaces.
8 Net-8 The Research Rack switch is uplinked to CIS's Net-8 switch.
Untagged on Research Rack switch ports 0-24
22 Net-202 This is not currently used, but was reserved to match the usage of Net-8.
No ports