Page1    Page40                                                                        Page42  Page177

Each fiber segment on the MAN ring is capable of supporting up to thirty-three 10Gb/s channels,

using the current state of hardware technology for the DWDM equipment.  The hardware

technology for 40Gb/s channels is expected to become available within the next 1-2 years. The

MAN provides a very scalable and flexible infrastructure to meet the Laboratory's wide-area

network data movement requirements, in particular the anticipated ramp-up of LHC data

movement, following startup. Additional bandwidth capacity can be provided for a one-time,

fixed hardware cost, and implemented in relatively short, deterministic period.

The architecture of the MAN is point-to-point 10 gigabit Ethernet (10GE) channels between the

Laboratory and either of the Chicago network exchange points. Individual 10GE channels are

carried on assigned wavelengths, multiplexed across the underlying fiber infrastructure. The

architecture is based on ethernet technology, not SONET ring technology. Therefore, SONET-

like failover is not provided, and redundancy is left to the failover capabilities of higher level

protocols. However, the ethernet-based architecture provides an infrastructure that supports

multiple, dedicated 10GE channels at far lower cost than corresponding SONET technology

would.

In the initially deployed MAN configuration, Fermilab has six 10Gb/s channels, four to StarLight

and two to the Level-3 PoP. Two channels are allocated for general routed IP service, providing

an aggregate bandwidth capacity of 20Gb/s. One channel connects to the ESnet backbone at

StarLight; the other connects to the ESnet backbone at the Level-3 PoP. The Laboratory's four

remaining MAN channels support end-to-end data circuits for high impact data movement. One

of those four channels is dedicated to the LHC Optical Private Network (LHCOPN), supporting

the movement of CMS experiment data between the Tier-0 Facility (CERN), and the US-CMS

Tier-1 Center at the Laboratory. The other three 10Gb/s channels support end-to-end circuits to

remote sites involved in Laboratory collaborations. Two of those three channels provide end-to-

end circuits to StarLight, where connections to a large number of national and international R&E

networks are available. The remaining channel provides circuit support to the Level-3 PoP,

where Internet-2 and National Lambda Rail have a presence. Figure 17 depicts the Laboratory's

current channel configuration across the MAN.

41