ICFA Report

Page1

Page81

Appendix 14. Network Connectivity for HEP in Japan

Submitted by Yukio Karita(Yukio.Karita@kek.jp)

January 2008

HEP-related inter-university facilities, Kamioka, SPRING8, JAEA, and RIKEN, became new

SuperSINET nodes in 2006. Among them, SuperSINET node at JAEA changed the networking

at J-PARC. JLAN, J-PARC LAN, was in AS2505 (KEK's AS) and had the Internet connection

via KEK, but was assigned a new AS (AS37889) and had a direct Internet connection by

SuperSINET in April 2006. SuperSINET was also expected to provide a L2 path connecting

JAEA (J-PARC Tokai campus) and KEK (J-PARC Tsukuba campus) in JLAN. This wasn't

achieved in SuperSINET but was accomplished in SINET3 in April 2007.

SINET3, NII's new network service, started in April 2007 and replaced SuperSINET and SINET.

SuperSINET was for promoting some advanced sciences including HEP, while SINET was for

providing the Internet connectivity to universities. SINET3 provides the same service to both ex-

SuperSINET nodes and ex-SINET nodes. So especially in ex-SINET nodes there was a big

upgrade both in bandwidth and in services. Bandwidth to each SINET3 node is at least 1Gbps,

which was 10-100 Mbps in SINET. VPN's that were unavailable in SINET are now available in

all SINET3 nodes.

SINET3 provides L1-, L2-, and L3-VPN's. L1-VPN provides protected bandwidth, while L2- and

L3-VPN provide non-protected bandwidth. Dedicated GbE lines provided in SuperSINET were

converted to either L1-VPN's or L2-VPN's. Considering that L1-VPN's lowers the total

bandwidth available for the rest, HEP group decided not to request L1-VPN's. The dedicated

GbE lines in SuperSINET connecting KEK and HEP lab's in universities are now provided by

L2-VPN's in SINET3. Each bandwidth is not protected any more. Adding another dedicated GbE

line in SuperSINET was very expensive and difficult, while adding another L2-VPN in SINET3

was neither expensive nor difficult. The MPLS-VPN's provided by SuperSINET, connecting

KEK and HEP labs in universities, remain in SINET3 in the same way with a new name (L3-

VPN).

A SINET3 edge node was located at KEK and was connected with a SINET3 core node with 2 x

OC192 (20Gbps) in March 2007. KEK was connected to this edge node with 2 x 10GE in April

2007. So the bandwidth for each L2- or L3-VPN is able to be as large as 10Gbps depending on

the connection at the university side.

HEPnet-J, the connectivity to Universities in Japan for HEP, was reconstructed mainly with L2-

VPN's and L3-VPN's in SINET3. Most universities in HEP are SINET3 edge nodes and has no

complain. The universities in non-SINET nodes in HEPnet-J were connected with low-bandwidth

(1-10Mbps) wide-area Ethernet and were in Digital-Divide. To remove this Digital-Divide in

HEPnet-J, the connectivity to these universities was reorganized with either by protected

100Mbps wide-area Ethernet or non-protected 100Mbps Internet-VPN in early FY2007. Now

there is no Digital-Divide in HEPnet-J.

SINET3 and APAN provides international connectivity for HEP. SINET3 has a 10Gbps line to

New York and a 2.5Gbps line to Los Angeles at present. An ISP is connected at 2Gbps at New

York and at Los Angels for the default Internet traffic. Thus 8Gbps is protected for Research and

Educational traffic at New York and 0.5Gbps for Los Angeles. SINET3 is connected to

MANLAN at New York with 10GE, where ESnet, Geant, and Abilene are with 10GE. At present