iSGTW - International Science Grid This Week
iSGTW - International Science Grid This Week
Null

Home > iSGTW 20 February 2008 > iSGTW Feature - New bridge over muddled waters of grid storage

 

Feature - New bridge over muddled waters of grid storage


Interoperability between the two islands of SRM and SRB opens up opportunities for different grids to share data; for example, scientists using the Worldwide LHC Computing Grid could now process data from the U.S. TeraGrid
Image courtesy of The Gentle

Two islands of storage technology have been joined, according to a presentation at the EGEE User Forum in Clermont-Ferrand, France, last week.

Jens Jensen, of Rutherford Appleton Laboratory in the UK, told attendees how his team have successfully bridged two key grid technologies: the Storage Resource Broker (SRB) and Storage Resource Management (SRM).

A demonstration of the bridging was first run at SC07 in Reno, Nevada, on behalf of the GridPP-led team.

Two storage islands 

SRM and SRB are both ways of accessing the storage available on a grid—either using tapes, disks or disk arrays. Usually, storage elements running SRB can’t be seen by a grid running SRM, and vice versa. Most grids run one or the other technology, but if different grids are to interoperate, the two standards will need to work together.

“SRM and SRB are traditionally the two separate ‘storage islands’ in grids,” says Jensen, “each providing interoperability within its own island, but not between the islands. We used the GridFTP protocol and advanced data management tools from the EGEE project to transfer data between SRM and SRBs, and bridge these islands.”

Interoperability between different grids and grid technologies is key to the success of many applications, and essential to the idea of a universal, interoperable “Grid.”
Images courtesy of wsdot

GridPP and NGS: our powers combined

The team built on a GridFTP server developed for SRB by the San Diego Supercomputer Center and Argonne National Laboratory, to make an SRB look like a Classic Storage Element. This allowed the gLite tools to transfer files between SRMs and SRBs.

One of Jensen’s activities is working on interoperability between the UK’s two main science grids: GridPP, the UK particle physics grid, which runs various implementations of SRM, and the UK National Grid Service, which mainly runs SRB.

This work also opens up opportunities for other grids to share data—for example between Worldwide LHC Computing Grid and the U.S. TeraGrid.

Grid Interoperation Now

Erwin Laure, technical director of the EGEE project, is also coordinator of the Grid Interoperation Now activities in the Open Grid Forum. He says interoperability of different grid infrastructures is a necessity for many applications. “The OGF GIN community is aiming at pragmatic solutions for achieving interoperation,” he says. “This interoperation between the two most commonly deployed data solutions, SRM and SRB, achieved by Jens’ team, is a great step forward towards achieving this goal.”

Alex Sim of Lawrence Berkeley National Laboratory in the U.S. demonstrated the data transfer for the UK team at SC07.

“The demo showed interoperability of eleven different SRM implementations around the world based on the same specification, including data transfers between an SRB at Rutherford Appleton Laboratory and BeStMan SRM at Lawrence Berkeley National Laboratory,” Sim explains. “This caused great interest among delegates, and it is of interest for scientists—especially in the Worldwide LHC Computing Grid Project, as they can now access data directly in SRB.”

Jensen is particularly enthusiastic about how well the current work fits the GIN group. “The important aspect of this work is that it builds on existing tools and requires no development effort. It really is Grid Interoperability Now!”

- Sarah Pearce, GridPP

Tags:



Null
 iSGTW 22 December 2010

Feature – Army of Women allies with CaBIG for online longitudinal studies

Special Announcement - iSGTW on Holiday

Video of the Week - Learn about LiDAR

 Announcements

NeHC launches social media

PRACE announces third Tier-0 machine

iRODS 2011 User Group Meeting

Jobs in distributed computing

 Subscribe

Enter your email address to subscribe to iSGTW.

Unsubscribe

 iSGTW Blog Watch

Keep up with the grid’s blogosphere

 Mark your calendar

December 2010

13-18, AGU Fall Meeting

14-16, UCC 2010

17, ICETI 2011 and ICSIT 2011

24, Abstract Submission deadline, EGI User Forum

 

January 2011

11, HPCS 2011 Submission Deadline

11, SPCloud 2011

22, ALENEX11

30 Jan – 3 Feb, ESCC/Internet2

 

February 2011

1 - 4, GlobusWorld '11

2, Lift 11

15 - 16, Cloudscape III


More calendar items . . .

 

FooterINFSOMEuropean CommissionDepartment of EnergyNational¬†Science¬†Foundation RSSHeadlines | Site Map