iSGTW - International Science Grid This Week
iSGTW - International Science Grid This Week
Null

Home > iSGTW 11 June 2008 > iSGTW Feature - Kepler 1.0

Feature - Placing Kepler at the center of your computing system


A scientific workflow describes a series of structured computations that arise in scientific problem-solving. Typically a sequence of analysis tools are invoked in a routine manner. Workflows often include sequences of format translations that ensure that the tools can process each other's outputs, and perform routine verification and validation of the data and the outputs to ensure that the computation as a whole remains on track. (Adapted from Munindar P. Singh and Mladen A. Vouk )

The LiDAR workfow communicates both with the portal and the Grid layers (click for larger version showing layers ). This central workflow layer, controlled by the Kepler workfow manager, coordinates the multiple distributed Grid components in a single environment as a data analysis pipeline. It submits and monitors jobs onto the Grid, and handles third party transfer of derived intermediate products among consecutive compute clusters, as defned by the workfow description. In addition, it sends control information to the portal client about the overall execution of the process.

Image courtesy of LiDAR.

Scientists want to concentrate on science.  They appreciate handy tools that simplify the process of analyzing data, especially when the data are stored in a complicated variety of systems and formats.

The open source Kepler workflow system, for which version 1.0 was just released, is just such a tool; it helps scientists from a wide range of disciplines design scientific workflows and execute them efficiently. Kepler’s native support of parallel processing allows these workflows to leverage the compute power of grid technologies.

Kepler has attracted collaborators and users from ecology, molecular biology, genetics, physics, chemistry, conservation science, oceanography, hydrology, library science, and computer science. Scientists have adopted earlier Kepler versions to study the effect of climate change on species distribution, simulate supernova explosions, and perform complex statistical analyses.

Researchers from the National Center for Ecological Analysis and Synthesis (NCEAS) at UC Santa Barbara, the San Diego Supercomputer Center at UC San Diego, and the Science Environment for Ecological Knowledge (SEEK) and Scientific Data Management (SDM) projects at UC Davis founded the Kepler Project in 2002. Kepler extends Ptolemy II , a system developed at UC Berkeley for modeling, simulation and design of concurrent, real-time embedded systems .

Artificially illuminated digital elevation model derived from LiDAR data hosted by GEON and produced by the GEON LiDAR system which uses the Kepler workflow. The image, in greyscale, is rendered in Google Earth with some transparency to show fusion with the imagery. The location is a famous site on the San Andreas Fault in central California known as Wallace Creek where stream channels have been offset by repeated earthquakes.  View is to the south, south-east.

Image courtesy of LiDAR

“We wanted to create an open, customizable, extensible and robust scientific workflow environment for solving scientific problems, and Kepler 1.0 realizes our goal,” said Ilkay Altintas, lab director of the Scientific Workflow Automation Technologies (SWAT) group at SDSC. “It provides access to diverse technologies, and also furnishes a basis for many exciting features in the works.”

Kepler 1.0 comes with a searchable library containing more than 350 ready-to-use processing components that can be customized and operated from a desktop environment to perform analysis, automate data management, and integrate applications efficiently.


-Anne Heavey

The Kepler project is funded through various grants from the National Science Foundation and the Department of Energy. To download the Kepler application or learn more about the project, see http://www.kepler-project.org


Tags:



Null
 iSGTW 22 December 2010

Feature – Army of Women allies with CaBIG for online longitudinal studies

Special Announcement - iSGTW on Holiday

Video of the Week - Learn about LiDAR

 Announcements

NeHC launches social media

PRACE announces third Tier-0 machine

iRODS 2011 User Group Meeting

Jobs in distributed computing

 Subscribe

Enter your email address to subscribe to iSGTW.

Unsubscribe

 iSGTW Blog Watch

Keep up with the grid’s blogosphere

 Mark your calendar

December 2010

13-18, AGU Fall Meeting

14-16, UCC 2010

17, ICETI 2011 and ICSIT 2011

24, Abstract Submission deadline, EGI User Forum

 

January 2011

11, HPCS 2011 Submission Deadline

11, SPCloud 2011

22, ALENEX11

30 Jan – 3 Feb, ESCC/Internet2

 

February 2011

1 - 4, GlobusWorld '11

2, Lift 11

15 - 16, Cloudscape III


More calendar items . . .

 

FooterINFSOMEuropean CommissionDepartment of EnergyNational¬†Science¬†Foundation RSSHeadlines | Site Map