Fault-tolerant execution of large parameter sweep applications across multiple VOs with storage constraints

Concurrency and Computation: Practice and Experience

Volumn 21, Issue 3, 2009, Pages 377-392

  Ayyub, Shahaan ^a   Abramson, David Abramson ^a   Enticott, Colin ^a   Garic, Slavisa ^a   Tan, Jefferson ^a  

^a MONASH UNIVERSITY   (Australia)

Author keywords

E science; Parameter sweep applications Grid

Indexed keywords

DATA TRANSFER; DIGITAL STORAGE; E-SCIENCE; FAULT TOLERANCE;

GARBAGE COLLECTION; PARAMETER SWEEP APPLICATION; SCALE PARAMETER; SCIENCE COMMUNITY; STORAGE CONSTRAINTS; THIRD PARTY DATUM; TRUST MANAGEMENT; VIRTUAL ORGANIZATION;

INFORMATION MANAGEMENT;

EID: 62349112211     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.1353     Document Type: Conference Paper

References (26)

1. Abramson D, Giddy J, Foster I, Kotler L. High performance parametric modeling with Nimrod/G: Killer application for the global Grid? International Parallel and Distributed Processing Symposium (IPDPS), Cancun, Mexico, May 2000; 520-528.
2. Amsden A, Ramshaw J, Rourke OP, Kiva DJ. A computer program for 2- and 3-dimensional fluid flows with chemical reactions and fuel sprays. LASL Report: LA-10245-MS, Los Alamos National Laboratory, 1985.
3. Basney J, Livny M, Mazzanti P. Harnessing the capacity of computational grids for high energy physics. Conference on Computing in High Energy and Nuclear Physics, Padova, Italy, 2000.
4. Rogers S. A comparison of implicit schemes for the incompressible Navier-Stokes equations with artificial compressibility. AIAA Journal 1995; 33(10):2066-2072.
5. Stiles JR, Bartol TM, Salpeter EE, Salpeter MM. Monte Carlo simulation of neuromuscular transmitter release using MCell, a general simulator of cellular physiological processes. Computational Neuroscience, Bower JM (ed.). Plenum Press: New York, 1998; 279-284.
6. Casanova H, Berman F, Zagorodnov D, Legrand A. Heuristics for scheduling parameter sweep applications in Grid environments. Ninth Heterogeneous Computing Workshop (HCW00), Cancun, Mexico, May 2000; 349-363.
7. Buyya R, Venugopal S. The Gridbus toolkit for service oriented grid and utility computing: An overview and status report. The 1st IEEE International Workshop on Grid Economics and Business Models (GECON 2004), New Jersey, 2004.
8. Tamir Y, Sequin CH. Error recovery in multicomputers using global checkpoints. Proceedings of the International Conference on Parallel Processing, Bellaire, MI, 1984; 32-41.
9. Meyer LAVC, Annis J, Wilde M, Mattoso M, Foster I. Planning spatial workflows to optimize grid performance. ACM Symposium on Applied Computing, Proceedings of the 2006 ACM Symposium on Applied Computing (SAC 2006), Dijon, France, 2006; 786-790.
10. Zheng C, Abramson D, Arzberger P, Ayyub S, Enticott C, Garic S, Katz M, Kwak J, Lee BS, Papadopoulos P, Phatanapherom S, Sriprayoonsakul S, Tanaka Y, Tanimura Y, Tatebe O, Uthayopas P. The PRAGMA testbed-building a multi-application international Grid. Sixth IEEE International Symposium on Cluster Computing and the Grid Workshops (CCGRIDW'06), Singapore, May 2006; 57.
11. McGregor JL, Nguyen KC, Katzfey JJ. Regional climate simulations using a stretched-grid global model. Report No. 32, WMO/TD-No. 1105, Research Activities in Atmospheric and Oceanic Modelling, Geneva, 2002; 3.15-3.16.
12. Beringer J, Hutley L, Lynch A, Siems S, Tapper N. The Savanna Fire Experiment (SAFE). http://arts.monash.edu.au/ges/research/climate/fire/safe.php [1 May 2008].
13. Buyya R, Abramson D, Giddy J. An evaluation of economy-based resource trading and scheduling on computational power Grids for parameter sweep applications. Workshop on Active Middleware Services (AMS 2000) (in conjuction with Ninth IEEE International Symposium on High Performance Distributed Computing). Kluwer Academic Press: Dordrecht, 2000.
14. Abramson D, Buyya R, Giddy J. A computational economy for Grid computing and its implementation in the Nimrod-G resource broker. Future Generation Computer Systems 2002; 18(8):1061-1074.
15. Tan J, Abramson D, Enticott C. Bridging organizational network boundaries on the grid. IEEE Grid 2005, Seattle, November 2005.
16. Gulamali MY, McGough AS, Newhouse SJ, Darlington J. Using ICENI to run parameter sweep applications across multiple Grid resources. Case Studies on Grid Applications Workshop, Global Grid Forum 10, Berlin, Germany, March 2004.
17. Casanova H, Obertelli G, Berman F, Wolski R. The AppLeS parameter sweep template: User-level middleware for the Grid. Proceedings of the Super Computing Conference (SC'2000), Dallas, TX, 2001.
18. Casanova H. APST XML Man Page, 2001, http://grail.sdsc.edu/projects/apst/ apst xml man.html.
19. Buyya R, Abramson D, Murshed M. A deadline and budget constrained cost-time optimization algorithm for scheduling task farming applications on global Grids. The 2002 International Conference on Parallel and Distributed Processing Techniques and Applications, Las Vegas, NV, 2002.
20. Wolski R, Spring NT, Hayes J. The network weather service: A distributed resource performance forecasting service for metacomputing. Future Generation Computer Systems 1999; 15:757-768.
21. Massie ML, Chun BN, Culler D. The Ganglia distributed monitoring system: Design, implementation, and experience. Parallel Computing 2004; 30(7):817-840.
22. Chaitanya B, Moore R, Rajasekar A, Wan M. The SDSC storage resource broker. Proceedings of CASCON'98, 30 November-3 December, Toronto, Canada, 1998.
23. The Portable Batch System (OpenPBS). http://www.pbsgridworks.com/ PBSTemp1.3.aspx?top nav name=Products&item name=OpenPBS&top nav str=1 [1 May 2008].
24. Gentzsh W. Sun grid engine: Towards creating a compute power grid. Proceedings of the First IEEE/ACM International Symposium on Cluster Computing and the Grid, May 2001; 35.
25. Hendriks EA. BProc: The Beowulf distributed process space. The 16th International Conference on Supercomputing, New York, NY, 2002; 129-136.
26. O'Callaghan DW, Coghlan BA. Bridging secure WebCom and European DataGrid security for multiple VOs over multiple Grids. Proceedings of the Third International Symposium on Parallel and Distributed Computing/Third International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Networks (ISPDC/HeteroPar'04), Washington, DC, 2004; 225-231.