iSGTW - International Science Grid This Week
iSGTW - International Science Grid This Week

Home > iSGTW 19 August 2009 > Feature - Recovery Act funds speed up high-speed ethernet

Feature - Recovery Act funds speed up high-speed ethernet

Photo courtesy of Phil Edon, stock.xchng.

ESnet will build the world’s fastest supercomputing network and test subnetwork for future technology using $62 million in American Recovery and Reinvestment Act funds.

ESnet, which is based at Lawrence Berkeley National Laboratory, described their plans for the network in an announcement on the 10 August. Dubbed the Advanced Networking Initiative, it will serve as a pilot for 100 gigabit per second ethernet technology.

“We’re moving to 100 gigabits because the standard today is 10 gigabits, and we already have individual streams of data that are bumping against that limit,” said Steve Cotter, ESnet department head, in a recent interview. “We’d like to have a system out there that can handle more.”

The Initiative will build 100 gigabit connections between the National Energy Research Scientific Computing Center at Lawrence Berkeley National Laboratory in California, Argonne National Laboratory in Illinois, and Oak Ridge National Laboratory in Tennessee. A fourth as of yet undetermined location in New York City will serve as a peering point – a sort of gateway – to international collaborators in Europe and Asia.

The Advanced Networking Initiative is being designed with the needs of some of today's largest international science collaborations in mind. For example, the next-generation archive of climate modeling data, which is maintained by the Program for Climate Model Diagnosis and Intercomparison at Lawrence Livermore National Laboratory in California, will contain at least 650 terabytes of data accessed by more than 2500 researchers worldwide. Likewise, once the Large Hadron Collider in Switzerland goes online, it will be able to generate in excess of 100 gigabits of data per second.

Fermi National Accelerator Laboratory and Argonne National Laboratory have been invited to propose upgrades to their local network (the Chicago Metropolitan Area Network); the upgrades would link both labs to the Advanced Network Initiative. “Although no other LHC physics centers would initially have 100 gigabits per second access, this could raise the aggregate speed of all sites to access the 18 petabytes of data at Fermilab," said Matt Crawford, head of data movement and storage at Fermilab.

Inside the Fermilab Grid Computing Center.
Photo credit: Reidar Hahn, Fermilab Visual Media Services.

To make sure the pilot network keeps up with the needs of cutting-edge science, between $8 million and $9 million of the initiative money will go towards a national network test bed. All researchers and industry will be able to access the prototype network via the test bed. This will give them the opportunity to test forward-thinking computer technologies so that when 100 gigabit ethernet becomes more widespread, they are prepared to use the network immediately.

The U.S. Department of Energy is also putting $5 million into a fund for related research grants. “It will fund technologies for which we can help do the technology transfer from research to production,” Cotter said. “So we’ll provide the platform where we take it out of the laboratory and move it into a real network environment.”

In order to create this super-speed network, researchers will have to overcome a number of technological difficulties, such as designing a new power and cooling system for routers. . Nonetheless, Cotter said that he expects the prototype to be up and running by the end of 2010. “We hope to run it in prototype format for two years until all the kinks are worked out,” Cotter said.

IEEE, an international non-profit that often sets standards for new technologies, is scheduled to establish a 100 gigabit per second ethernet standard sometime next year, and ,with Recovery Act funds in hand, Cotter expects the project to move forward at a rapid pace. “Our objective is to try to accelerate this,” Cotter explained. “We want to kind of push the vendors towards getting this out.”

Miriam Boon, iSGTW


 iSGTW 22 December 2010

Feature – Army of Women allies with CaBIG for online longitudinal studies

Special Announcement - iSGTW on Holiday

Video of the Week - Learn about LiDAR


NeHC launches social media

PRACE announces third Tier-0 machine

iRODS 2011 User Group Meeting

Jobs in distributed computing


Enter your email address to subscribe to iSGTW.


 iSGTW Blog Watch

Keep up with the grid’s blogosphere

 Mark your calendar

December 2010

13-18, AGU Fall Meeting

14-16, UCC 2010

17, ICETI 2011 and ICSIT 2011

24, Abstract Submission deadline, EGI User Forum


January 2011

11, HPCS 2011 Submission Deadline

11, SPCloud 2011

22, ALENEX11

30 Jan – 3 Feb, ESCC/Internet2


February 2011

1 - 4, GlobusWorld '11

2, Lift 11

15 - 16, Cloudscape III

More calendar items . . .


FooterINFSOMEuropean CommissionDepartment of EnergyNational¬†Science¬†Foundation RSSHeadlines | Site Map