Parameter exploration in science and engineering using many-task computing

IEEE Transactions on Parallel and Distributed Systems

Volumn 22, Issue 6, 2011, Pages 960-973

  Abramson, David ^a   Bethwaite, Blair ^a   Enticott, Colin ^a   Garic, Slavisa ^a   Peachey, Tom ^a  

^a MONASH UNIVERSITY   (Australia)

Author keywords

Kepler; many task computing.; parameter exploration; Scientific workflows

Indexed keywords

COMPLEX SOFTWARE; DATAFLOW; DISTRIBUTED RESOURCES; EXPERIMENTAL DESIGN; INDEPENDENT TASKS; KEPLER; MANY-TASK COMPUTING.; NUMERICAL OPTIMIZATION TECHNIQUES; PARALLEL MACHINE; PARAMETER EXPLORATION; PARAMETER SPACES; REAL PROBLEMS; ROBUST DESIGNS; RUNTIMES; SCIENCE AND ENGINEERING; SCIENTIFIC METHOD; SCIENTIFIC WORKFLOWS; STATE SPACE EXPLORATION; TASK COMPUTING; WORKFLOW ENGINES;

DESIGN; MACHINE COMPONENTS; NUMERICAL METHODS; SPACE RESEARCH;

CLOUD COMPUTING;

EID: 79955524641     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2010.177     Document Type: Article

References (57)

1. D. Abramson, A. Lewis, T. Peachey, and C. Fletcher, "An Automatic Design Optimization Tool and Its Application to Computational Fluid Dynamics," Proc. ACM/IEEE Conf. Supercomputing '01, Nov. 2001.
2. D. Abramson and G. Egan, "The RMIT Dataflow Computer: A Hybrid Architecture," The Computer J., vol. 33, no. 3, pp 230-240, June 1990.
3. D. Abramson, B. Bethwaite, C. Enticott, S. Garic, and T. Peachey, "Parameter Space Exploration Using Scientific Workflows," Proc. Int'l Conf. Computational Science (ICCS '09), May 2009.
4. D. Abramson, C. Enticott, and I. Altinas, "Nimrod/K: Towards Massively Parallel Dynamic Grid Workflows," Proc. IEEE Conf. Supercomputing '08, Nov. 2008.
5. D. Abramson, J. Giddy, and L. Kotler, "High Performance Parametric Modeling with Nimrod/G: Killer Application for the Global Grid," Proc. Int'l. Parallel and Distributed Processing Symp. (IPDPS), http://www.csse. monash.edu.au/~davida/nimrod/, May 2000.
6. I. Altintas, C. Berkley, E. Jaeger, M. Jones, B. Ludäscher, and S. Mock, "Kepler: Towards a Grid-Enabled System for Scientific Workflows," Proc. Workflow in Grid Systems Workshop GGF10-10th Global Grid Forum, Mar. 2004.
7. I. Altintas, A. Birnbaum, K. Baldridge, W. Sudholt, M. Miller, C. Amoreira, Y. Potier, and B. Ludaescher, "A Framework for the Design and Reuse of Grid Workflows," Proc. Int'l. Workshop Scientific Applications on Grid Computing (SAG '05), 2005.
8. S. Amirriazi, S. Chang, T. Peachey, D. Abramson, and A. Michailova, "Optimizing Cardiac Excitation-Metabolic Model by Using Parallel Grid Computing," Proc. Biophysics '08, Feb. 2008.
9. Arvind and R.S. Nikhil, "Executing a Program on the MIT Tagged-Token Dataflow Architecture," IEEE Trans. Computers, vol. 39, no. 3, pp. 300-319, Mar. 1990.
10. S. Ayyub and D. Abramson, "GridRod-A Service Oriented Dynamic Runtime Scheduler for Grid Workflows," Proc. 21st ACM Int'l Conf. Supercomputing, June 2007.
11. S. Ayyub, D. Abramson, C. Enticott, S. Garic, and J. Tan, "Fault- Tolerant Execution of Large Parameter Sweep Applications across Multiple VOs with Storage Constraints," Concurrency and Computation: Practice and Experience, vol. 21, no. 3, pp. 377-392, Aug. 2008.
12. B. Bethwaite, D. Abramson, and A. Buckle, "Grid Interoperability: An Experiment in Bridging Grid Islands," Proc. PRAGMA Workshop e-Science and Fourth IEEE Int'l Conf. e-Science, Dec. 2008.
13. G.E. Box, W.G. Hunter, and J.S. Hunter, Statistics for Experimenters. Wiley, 1978.
14. R. Buyya and D. Abramson, "The Nimrod/G Grid Resource Broker for Economic-Based Scheduling," Market-Oriented Grid and Utility Computing, R. Buyya and K. Bubendorfer, eds., Wiley, Nov. 2009.
15. H. Casanova and F. Berman, Parameter Sweeps on the Grid with APST. F. Berman, G. Fox, and T. Hey, eds. Wiley Publisher, Inc., 2002.
16. D. Culler, "Managing Parallelism and Resources in Scientific Dataflow Programs," PhD thesis, Dept. of Electrical Eng. and Computer Science, Massachusetts Inst. of Technology, Mar. 1990.
17. E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, S. Patil, M. Su, K. Vahi, and M. Livny, "Pegasus: Mapping Scientific Workflows onto the Grid," Proc. across Grids Conf., 2004.
18. E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, S. Patil, M. Su, K. Vahi, and M. Livny, "Pegasus: Mapping Scientific Workflows onto the Grid," Proc. across Grids Conf., 2004.
19. e-Science Grid Environments Workshop, http://www.nesc.ac.uk/ esi/events/, May 2004.
20. J. Eker, J.W. Janneck, E.A. Lee, J. Liu, X. Liu, J. Ludvig, S. Neuendorffer, S. Sachs, and Y. Xiong, "Taming Heterogeneity- The Ptolemy Approach," Proc. IEEE, vol. 91, no. 2, pp. 127-144, Jan. 2003.
21. T. Fahringer, A. Jugravu, S. Pllana, R. Prodan, Jr., C.S., and H.L. Truong, "ASKALON: A Tool Set for Cluster and Grid Computing," Concurrency and Computation: Practice and Experience, vol. 17, pp. 143-169, 2005. (Pubitemid 40285773)
22. K.-T. Fang, R. Li, and A. Sudjianto, Design and Modelling for Computer Experiments. Chapman and Hall/CRC, 2006.
23. R.A. Fisher, The Design of Experiments. Oliver and Boyd, 1935.
24. I. Foster and C. Kesselman, "Globus: A Metacomputing Infrastructure Toolkit," Int'l J. Supercomputer Applications, vol. 11, no. 2, pp. 115-128, 1997. (Pubitemid 127673968)
25. I. Foster, "Globus Toolkit Version 4: Software for Service-Oriented Systems," Proc. Conf. Network and Parallel Computing, 2005.
26. A. Goderis, C. Brooks, I. Altintas, E. Lee, and C. Goble, "Composing Different Models of Computation in Kepler and Ptolemy II," Proc. Int'l Conf. Computational Science (ICCS '07), Apr. 2007.
27. J.R. Gurd and I. Watson, "Data Driven System for High Speed Parallel Computing (1 & 2)," Computer Design, vol. 9, nos. 6/7, pp. 91-100 and 97-106, June/July 1980.
28. http://kepler-project.org, 2010.
29. http://messagelab.monash.edu.au/EScienceApplications, 2010.
30. http://ptolemy.eecs.berkeley.edu/ptolemyII/ptIIfaq.htm, 2010.
31. http://taverna.sourceforge.net, 2010.
32. http://www.lmsfrance.fr/LMS-Releases-OPTIMUS-22-For- Automated-Design- Space-Exploration, 2010.
33. http://www.mathworks.co.uk/access/helpdesk/help/toolbox/ sldo/ug/brzapme-1.html, 2009.
34. E. Lee et al., "Overview of the Ptolemy Project," Technical Memorandum UCB/ERL M01/11, Univ. of California, Mar. 2001.
35. B. Ludäscher, I. Altintas, C. Berkley, D. Higgins, E. Jaeger-Frank, M. Jones, E. Lee, J. Tao, and Y. Zhao, "Scientific Workflow Management and the Kepler System," Concurrency and Computation: Practice and Experience, Special Issue on Scientific Workflows, vol. 18, no. 6, pp. 1039-1065, 2006. (Pubitemid 44258497)
36. A.H. Lynch, D. Abramson, K.J. Beringer, and P. Uotila, "Influence of Savanna Fire on Australian Monsoon Season Precipitation and Circulation as Simulated Using a Distributed Computing Environment," Geophysical Research Letters, vol. 34, 2007, doi:10.1029/ 2007GL030879.
37. A. Michailova, W. Lorentz, and A. McCulloch, "Modelling Transmural Heterogeneity of KATP Current in Rabbit Ventricular Myocytes," AJP-Cell Physiology, vol. 293, pp. C542-C557, 2007. (Pubitemid 47235174)
38. T. Oinn, M. Addis, J. Ferris, D. Marvin, M. Senger, M. Greenwood, T. Carver, K. Glover, M.R. Pocock, A. Wipat, and P. Li, "Taverna: A Tool for the Composition and Enactment of Bioinformatics Workflows," Bioinformatics J., vol. 20, no. 17, pp. 3045-3054, 2004. (Pubitemid 39619196)
39. T.C. Peachey, N.T. Diamond, D.A. Abramson, W. Sudholt, A. Michailova, and S. Amirriazi, "Fractional Factorial Design for Parameter Sweep Experiments Using Nimrod/E," J. Scientific Programming, vol. 16, nos. 2/3, 2008.
40. T. Peachey, D. Abramson, and A. Lewis, "Model Optimization and Parameter Estimation with Nimrod/O," Proc. Int'l Conf. Computational Science, pp. 28-31, May 2006.
41. T. Peachey, D. Abramson, A. Lewis, D. Kurniawan, and R. Jones, "Optimization Using Nimrod/O and Its Application to Robust Mechanical Design," Proc. Parallel Processing and Applied Math. (PPAM '03), pp. 730-737, Sept. 2003.
42. I. Raicu, I. Foster, and Y. Zhao, "Many-Task Computing for Grids and Supercomputers," Proc. IEEE Workshop Many-Task Computing on Grids and Supercomputers (MTAGS), 2008.
43. A. Ravindran, K.M. Ragsdell, and G.V. Reklaitis, Engineering Optimization, second ed. Wiley, 2006.
44. T. Santner, B. Williams, and W. Notz, The Design and Analysis of Computer Experiments. Springer Verlag, 2003.
45. M.W. Schmidt, K.K. Baldridge, J.A. Boatz, S.T. Elbert, M.S. Gordon, J.H. Jensen, S. Koseki, N. Matsunaga, K. Nguyen, S. Su, T.L. Windus, M. Dupuis, and J.A. Montgomery, "General Atomic and Molecular Electronic Structure System," J. Computational Chemistry, vol. 14, pp. 1347-1363, 1993.
46. H.P. Schwefel, Numerical Optimization of Computer Models. Wiley, 1981.
47. Scientific Data Management Framework Workshop, http:// sdm.lbl.gov/~arie/sdm/SDM.Framework.wshp.htm, Aug. 2003.
48. T.R. Shannon, F. Wang, J. Puglisi, C. Weber, and D.M. Bers, "A Mathematical Treatment of Integrated Ca Dynamics within the Ventricular Myocyte," Biophysical J., vol. 87, pp 3351-3371, 2004. (Pubitemid 40468590)
49. S. Smanchat, M. Indrawan, S. Ling, C. Enticott, and D. Abramson, "Scheduling Multiple Parameter Sweep Workflow Instances on the Grid," Proc. IEEE Fifth Int'l Conf. e-Science, Dec. 2009.
50. W. Sudholt, K.K. Baldridge, D. Abramson, C. Enticott, and S. Garic, "Applying Grid Computing to the Parameter Sweep of a Group Difference Pseudopotential," Proc. Fourth Int'l Conf. Computational Science (ICCS '04), pp. 148-155, 2004.
51. W. Sudholt, K.K. Baldridge, D. Abramson, C. Enticott, and S. Garic, "Parameter Scan of an Effective Group Difference Pseudopotential Using Grid Computing," New Generation Computing, vol. 22, pp. 125-136, 2004.
52. T. Tannenbaum, D. Wright, K. Miller, and M. Livny, "Condor-A Distributed Job Scheduler," Beowulf Cluster Computing with Linux, MIT Press, 2002.
53. I. Taylor, M. Shields, and I. Wang, "Resource Management of Triana P2P Services," Grid Resource Management, Kluwer, June 2003.
54. G. von Laszewski, K. Amin, M. Hategan, N.J. Zaluzec, S. Hampton, and A. Rossi, "GridAnt: A Client-Controllable Grid Workflow System," Proc. 37th Ann. Hawaii Int'l Conf. System Sciences (HICSS '04), Jan. 2004.
55. G. Xue, W. Song, S.J. Cox, and A.J. Keane, "Numerical Optimisation as Grid Services for Engineering Design," J. Grid Computing, vol. 2, no. 3, pp. 223-238, 2004.
56. J. Yu and R. Buyya, "A Taxonomy of Workflow Management Systems for Grid Computing," J. Grid Computing, vol. 3, no. 3, pp. 171-200, 2005. (Pubitemid 43280301)
57. Y. Zhao, M. Hategan, B. Clifford, I. Foster, G. von Laszewski, I. Raicu, T. Stef-Praun, and M. Wilde, "Swift: Fast, Reliable, Loosely Coupled Parallel Computation," Proc. IEEE Workshop Scientific Workflows, 2007.