GCN Home > 09/29/08 issue
A faster Internet lane
By William Jackson
MANY OF THE WORLDS research and education networks face a conundrum: After upgrading network backbones to multigigabit speeds, performance for users often lags.

So several of the nations high-performance networks are experimenting with new protocols to make better use of network capacity for large science projects that require moving gigabytes, and even terabytes, of data.

The problem we are addressing is more effective end-to-end utilization of existing resources, said Martin Swany, assistant professor of computer and information sciences at the University of Delaware and lead developer of Phoebus.

Phoebus is a platform through which applications communicate with networks to better allocate resources, based on the applications needs and network conditions. It is being deployed experimentally on the Internet2 backbone and also is being studied by the Energy Departments Energy Sciences Network and the New York State Education and Research Network, NYSERNet. When appropriate, a file transfer can be shunted off the traditional TCP/IP portion of a network and moved onto a dedicated path between Phoebus gateways, eliminating the latency associated with TCP.

Our Phoebus testing has shown dramatic performance increases, even while using well-tuned applications that were already achieving good performance over the routed IP network, said Bill Owens, NYSERNets director of advanced technology and networking.

One NYSERNet project, the Laser Interferometer Gravitational Wave Observatory (Ligo), illustrates the challenges and opportunities in moving massive amounts of data. One Ligo researcher in our region has been able to increase his application performance by over 10 times, reducing the time needed to transfer a dataset from 40 days to less than four, Owens said.

Raw bandwidth is not enough to provide high performance on large-scale networks. The Energy Departments Office of Science, which runs ESnet, heard about that when it held a series of workshops to determine requirements for its science community, said Brian Tierney, leader of DOEs Advanced Technologies Group at Lawrence Berkeley National Laboratory.

One of the scientists told us about a year ago, We dont use the network because its too slow; we use portable USB drives, Tierney said.

And yet ESnet provides some big pipes for its scientists through a partnership with Internet2, a network operated by a consortium of companies, universities and research organizations. Internet2 recently built a new 13,500-mile fiber-optic backbone with Level 3 Communications (GCN.com, Quickfind 1198). Some Internet2 segments are operating at 100 gigabits/ sec now, and plans call for speeding that rate to 200 gigabits/sec.

With current technology, the network can easily scale to 400 gigabits/sec, but TCP imposes restrictions on using that bandwidth over long distances. TCP was designed for shared networks such as the Internet, and it acknowledges receipt of packets so that errors can be corrected. With large data flows over long distances, the latency associated with this process interferes with performance, creating a gap between network capacity and performance experienced by users.

More news on related topics: Communications / Networks, Content / Record Management, Data Management, Enterprise Architecture, IT Management, Workflow / Collaboration