Pegasus: A Framework for Mapping Complex Scientific Workflows onto Distributed Systems
Ewa Deelman, Gurmeet Singh, Mei-Hui Su et al. · Scientific Programming · 2005
This paper describes the Pegasus framework that can be used to map complex scientific workflows onto distributed resources. Pegasus enables users to represent the workflows at an abstract level without needing to worry about the particulars of the target execution systems. The paper describes general issues in mapping applications and the functionality of Pegasus. We present the results of improving application performance through workflow restructuring which clusters multiple tasks in a workflow into single entities. A real‐life astronomy application is used as the basis for the study.
Cited by 1,222 works. doi:10.1155/2005/128026 Open-access PDF
Authors
- Ewa Deelman
- Gurmeet Singh
- Mei-Hui Su
- Yolanda Gil
- Carl Kesselman
- Gaurang Mehta
- Karan Vahi
- G. Bruce Berriman
- John Good
- A. C. Laity
- Joseph C. Jacob
- Daniel S. Katz
References
- The Grid 2: Blueprint for a New Computing Infrastructure
- MPI: A Message-Passing Interface Standard
- Grid information services for distributed resource sharing
- A resource management architecture for metacomputing systems
- The MPI Message Passing Interface Standard
- The Grid 2: Blueprint for a New Computing Infrastructure
- Why and Where: A Characterization of Data Provenance
- Nimrod/G: an architecture for a resource management and scheduling system in a global computational grid
- Condor-G: A Computation Management Agent for Multi-Institutional Grids
- Condor-G: a computation management agent for multi-institutional grids