iSGTW - International Science Grid This Week
iSGTW - International Science Grid This Week

Home > iSGTW - 19 May 2010 > Feature - Magellan explores scientific clouds - scientifically

Magellan explores scientific clouds – scientifically

The Magellan management and network control racks at NERSC. To test cloud computing for scientific capability, NERSC and the ALCF installed purpose-built test beds for running scientific applications on the IBM iDataplex cluster. Magellan systems at both NERSC and the ALCF will be built using QDR InfiniBand fabric. Image courtesy R. Kaltschmidt, LBNL

It’s clear that cloud computing is today’s hot computing buzzword. All the cool kids are doing it, and scientists are no exception. But how much do we really know about the intersection between science and cloud?

“Cloud computing has become a very exciting new field with several companies making offerings that are already being used by scientists around the world,” said Pete Beckman, director of Argonne Leadership Computing Facility and leader of the ALCF Magellan team. “The question the Department of Energy has is pretty straightforward: what kind of science can be done on clouds, and are there specializations or customizations that we can do on the software to get more science out of clouds?”

Jeff Broughton, head of the systems department at the National Energy Research Scientific Computing Center and lead for the NERSC Magellan team, explained, “There are a couple of different aspects to that” question.

The first is whether or not cloud technology — as modeled by companies such as Amazon, Microsoft and Yahoo — is applicable to science. The second, Broughton continued, is whether or not cloud computing can be used to enable science to be done in a different way.

To answer those questions, the NERSC team decided to set up several small clouds with differing architectures.

“We’re going to be running applications in all of those environments to get performance information,” Broughton said. Then, they’ll try to understand whether or not there are specific disciplines of science, or specific kinds of algorithms that are well-suited to cloud computing.”

Preliminary results suggest that some application areas are not well-suited to cloud computing, while others, such as some aspects of genome processing, are good matches for the technology.

The main system console for Magellan at NERSC.

Image courtesy R. Kaltschmidt, LBNL

The ALCF team has also made significant progress.

“We have a large system currently deployed and we’ve opened it up for a variety of users,” Beckman said. Already, about 20 projects have applied for time on the system and had their applications approved. These range from earth science to bioinformatics to computer science.

“The Open Science Grid has an allocation on our machine and will be exploring how to use cloud computing in the context of this experiment,” Beckman added.

Users on the ALCF system will also have the option of getting access to the actual compute node in order to install their own operating system. For example, the project doing genome work on the ALCF Magellan are installing whole software stacks capable of using their tool chain — a feature not supported by standard cluster software.

It’s an exciting feature, but it introduces some new problems.

“The notion of a cloud, and running your own software stack, poses new challenges that the software and science communities have not addressed before,” Beckman said. “As a simple example, if you want to show up and run your own operating system, what sort of vulnerability testing should it undergo? What kind of probes should it undergo to make sure it’s not accidentally opening things up and causing mischief?”

By the time the funding draws to a close in September 2011, the two sites are expected to demonstrate effective cross-site administration. Realizing that mandate means that each site will have to ensure interoperability from both a technological and policy viewpoint.

“The people already talk; we work together on the software and architecture all the time,” Beckman said. “The more difficult technical question is what sorts of software as a service or storage as a service might make sense to fluidly exchange and transfer between multiple sites.”

—Miriam Boon, iSGTW

 iSGTW 22 December 2010

Feature – Army of Women allies with CaBIG for online longitudinal studies

Special Announcement - iSGTW on Holiday

Video of the Week - Learn about LiDAR


NeHC launches social media

PRACE announces third Tier-0 machine

iRODS 2011 User Group Meeting

Jobs in distributed computing


Enter your email address to subscribe to iSGTW.


 iSGTW Blog Watch

Keep up with the grid’s blogosphere

 Mark your calendar

December 2010

13-18, AGU Fall Meeting

14-16, UCC 2010

17, ICETI 2011 and ICSIT 2011

24, Abstract Submission deadline, EGI User Forum


January 2011

11, HPCS 2011 Submission Deadline

11, SPCloud 2011

22, ALENEX11

30 Jan – 3 Feb, ESCC/Internet2


February 2011

1 - 4, GlobusWorld '11

2, Lift 11

15 - 16, Cloudscape III

More calendar items . . .


FooterINFSOMEuropean CommissionDepartment of EnergyNational¬†Science¬†Foundation RSSHeadlines | Site Map