An integrated framework for parameter-based optimization of scientific workflows

Proc. 18th ACM International Symposium on High Performance Distributed Computing, HPDC 09, Co-located with the 2009 International Symposium on High Performance Distributed Computing Conf., HPDC'09

Volumn , Issue , 2009, Pages 177-186

  Kumar, Vijay S ^a   Sadayappan, P ^a   Mehta, Gaurang ^b   Vahi, Karan ^b   Deelman, Ewa ^b   Ratnakar, Varun ^b   Kim, Jihie ^b   Gil, Yolanda ^b   Hall, Mary ^c   Kurc, Tahsin ^d   Saltz, Joel ^d  

^a Ohio State University   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^c Department of Electrical and Computer Engineering   (United States)

^d EMORY UNIVERSITY   (United States)

Author keywords

Application QoS; Grid; Performance parameters; Scientific workflow; Semantic representations

Indexed keywords

APPLICATION QOS; COMPLEX DATA; DATA ANALYSIS; DATA FLOW DEPENDENCIES; EXPERIMENTAL EVALUATION; GRID PERFORMANCE; INDIVIDUAL COMPONENTS; INTEGRATED FRAMEWORKS; MULTI-DIMENSIONAL PARAMETERS; MULTIPLE DIMENSIONS; OPTIMAL VALUES; OUTPUT QUALITY; PARAMETER SPACES; PERFORMANCE OPTIMIZATIONS; PERFORMANCE PARAMETERS; PROCESSING OPERATIONS; REAL-WORLD APPLICATION; SCIENTIFIC APPLICATIONS; SCIENTIFIC WORKFLOWS; SEMANTIC REPRESENTATION; SPATIAL DATA ANALYSIS; WORK-FLOWS;

COMPUTER SCIENCE; DATA HANDLING; DIE CASTING; MANAGEMENT; OPTIMIZATION; SEMANTICS; THREE TERM CONTROL SYSTEMS;

DATA FLOW ANALYSIS;

EID: 70449633075     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1551609.1551638     Document Type: Conference Paper

References (21)

1. M. D. Beynon, T. Kurc, U. Catalyurek, C. Chang, A. Sussman, and J. Saltz. Distributed processing of very large datasets with DataCutter. Parallel Computing, 27(11):1457-1478, November 2001.
2. I. Brandic, S. Pllana, and S. Benkner. Specification, planning, and execution of QoS-aware Grid workflows within the Amadeus environment. Concurrency and Computation: Practice and Experience, 20(4):331-345, 2008.
3. F. Chang and V. Karamcheti. Automatic configuration and run-time adaptation of distributed applications. In High Performance Distributed Computing, pages 11-20, 2000.
4. D. Chiu, S. Deshpande, G. Agrawal, and R. Li. Cost and accuracy sensitive dynamic workflow composition over Grid environments. 9th IEEE/ACM International Conference on Grid Computing, pages 9-16, Oct. 2008.
5. S. K. Chow, H. Hakozaki, D. L. Price, N. A. B. MacLean, T. J. Deerinck, J. C. Bouwer, M. E. Martone, S. T. Peltier, and M. H. Ellisman. Automated microscopy system for mosaic acquisition and processing. Journal of Microscopy, 222(2):76-84, May 2006.
6. I.-H. Chung and J. Hollingsworth. A case study using automatic performance tuning for large-scale scientific programs. 15th IEEE International Symposium on High Performance Distributed Computing, pages 45-56, 2006.
7. I.-H. Chung and J. K. Hollingsworth. Using information from prior runs to improve automated tuning systems. In SC '04: Proceedings of the 2004 ACM/IEEE conference on Supercomputing, page 30, Washington, DC, USA, 2004. IEEE Computer Society.
8. V. Cortellessa, F. Marinelli, and P. Potena. Automated selection of software components based on cost/reliability tradeoff. In Software Architecture, Third European Workshop, EWSA 2006, volume 4344 of Lecture Notes in Computer Science. Springer, 2006.
9. E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, S. Patil, M.-H. Su, K. Vahi, and M. Livny. Pegasus: Mapping scientific workflows onto the Grid. Lecture Notes in Computer Science: Grid Computing, pages 11-20, 2004.
10. Y. Gil, V. Ratnakar, E. Deelman, G. Mehta, and J. Kim. Wings for Pegasus: Creating large-scale scientific applications using semantic representations of computational workflows. In Proceedings of the 19th Annual Conference on Innovative Applications of Artificial Intelligence (IAAI), July 2007.
11. T. Glatard, J. Montagnat, and X. Pennec. Efficient services composition for Grid-enabled data-intensive applications. In Proceedings of the IEEE International Symposium on High Performance Distributed Computing (HPDC'06), Paris, France, June 19, 2006.
12. J. Kong, O. Sertel, H. Shimada, K. Boyer, J. Saltz, and M. Gurcan. Computer-aided grading of neuroblastic differentiation: Multi-resolution and multi-classifier approach. IEEE International Conference on Image Processing, ICIP 2007, 5:525-528, Oct. 2007.
13. V. Kumar, B. Rutt, T. Kurc, U. Catalyurek, T. Pan, S. Chow, S. Lamont, M. Martone, and J. Saltz. Large-scale biomedical image analysis in Grid environments. IEEE Transactions on Information Technology in Biomedicine, 12(2):154-161, March 2008.
14. V. S. Kumar, S. Narayanan, T. M. Kurç, J. Kong, M. N. Gurcan, and J. H. Saltz. Analysis and semantic querying in large biomedical image datasets. IEEE Computer, 41(4):52-59, 2008.
15. I. Lera, C. Juiz, and R. Puigjaner. Performance-related ontologies and semantic web applications for on-line performance assessment intelligent systems. Sci. Comput. Program., 61(1):27-37, 2006.
16. B. Ludäscher, I. Altintas, C. Berkley, D. Higgins, E. Jaeger, M. Jones, E. A. Lee, J. Tao, and Y. Zhao. Scientific workflow management and the Kepler system: Research articles. Concurr. Comput.: Pract. Exper., 18(10):1039-1065, 2006.
17. B. Norris, J. Ray, R. Armstrong, L. C. Mcinnes, and S. Shende. Computational quality of service for scientific components. In Proceedings of the International Symposium on Component-based Software Engineering (CBSE7), pages 264-271. Springer, 2004.
18. T. Oinn, M. Addis, J. Ferris, D. Marvin, M. Senger, M. Greenwood, T. Carver, K. Glover, M. R. Pocock, A. Wipat, and P. Li. Taverna: a tool for the composition and enactment of bioinformatics workflows. Bioinformatics, 20(17):3045-3054, 2004.
19. D. Thain, T. Tannenbaum, and M. Livny. Distributed computing in practice: the Condor experience: Research articles. Concurr. Comput. : Pract. Exper., 17(2-4):323-356, 2005.
20. R. Wolski, N. Spring, and J. Hayes. The Network Weather Service: A Distributed Resource Performance Forecasting Service for Metacomputing. Journal of Future Generation Computing Systems, 15:757-768, 1999.
21. J. Zhou, K. Cooper, and I.-L. Yen. A rule-based component customization technique for QoS properties. Eighth IEEE International Symposium on High Assurance Systems Engineering, pages 302-303, March 2004.