Pwrake: A parallel and distributed flexible workflow management tool for wide-area data intensive computing

HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Volumn , Issue , 2010, Pages 356-359

  Tanaka, Masahiro ^a   Tatebe, Osamu ^a  

^a UNIVERSITY OF TSUKUBA   (Japan)

Author keywords

File system; Performance evaluation; Workflow

Indexed keywords

ASTRONOMICAL DATA; DATA ANALYSIS; DATA-INTENSIVE COMPUTING; DOMAIN SPECIFIC LANGUAGES; E-SCIENCE; FILE LOCATION; FILE SYSTEMS; FLEXIBLE WORKFLOWS; GFARM FILE SYSTEMS; JOB SUBMISSION; LANGUAGE FEATURES; PARALLEL EXECUTIONS; PC CLUSTERS; PERFORMANCE EVALUATION; PROGRAMMING LANGUAGE; SPEED-UPS; WIDE AREA; WORKFLOW; WORKFLOW EXECUTION; WORKFLOW MANAGEMENTS;

DATA HANDLING; DISTRIBUTED COMPUTER SYSTEMS; PARALLEL PROGRAMMING; RUBY; SCHEDULING ALGORITHMS; WORK SIMPLIFICATION;

MANAGEMENT;

EID: 78650032755     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1851476.1851529     Document Type: Conference Paper

References (14)

1. DAGMan (Directed Acyclic Graph Manager). http://www.cs.wisc.edu/condor/ dagman/.
2. E. Deelman, G. Singh, M.-H. Su, J. Blythe, et al. Pegasus: a Framework for Mapping Complex Scientific Workflows onto Distributed Systems. Scientific Programming Journal, 13(3):219-237, 2005.
3. EGEE. http://www.eu-egee.org/.
4. Gfarm. http://datafarm.apgrid.org/.
5. Kepler. http://kepler-project.org/.
6. L. Meyer, J. Annis, M. Wilde, M. Mattoso, and I. Foster. Planning spatial workflows to optimize grid performance. In SAC '06: Proceedings of the 2006 ACM symposium on Applied computing, pages b786-790, New York, NY, USA, 2006. ACM.
7. Montage. http://montage.ipac.caltech.edu/.
8. Rake. http://rake.rubyforge.org/.
9. Ruby. http://www.ruby-lang.org/.
10. K. Taura. Grid Explorer : A Tool for Discovering, Selecting, and Using Distributed Resources Efficiently. IPSJ SIG Technical Report 2004-HPC-99, pages 235-240, 2004.
11. Taverna. http://www.taverna.org.uk/.
12. TeraGrid. http://www.teragrid.org/.
13. Triana. http://www.trianacode.org/.
14. Y. Zhao, M. Hategan, B. Clifford, I. Foster, G. von Laszewski, V. Nefedova, I. Raicu, T. Stef-Praun, and M. Wilde. Swift: Fast, reliable, loosely coupled parallel computation. 1st IEEE International Workshop on Scientific Workows, pages 199-206, 2007.