A hybrid intelligent method for performance modeling and prediction of workflow activities in grids

2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009

Volumn , Issue , 2009, Pages 339-347

  Duan, Rubing ^a,b   Nadeem, Farrukh ^a   Wang, Jie ^a,c   Zhang, Yun ^d   Prodan, Radu ^a   Fahringer, Thomas ^a  

^a UNIVERSITY OF INNSBRUCK   (Austria)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^c INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^d UNIVERSITY OF TENNESSEE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; CLUSTER COMPUTING; COMPUTER ARCHITECTURE; GRID COMPUTING; PROBABILITY DISTRIBUTIONS; RADIAL BASIS FUNCTION NETWORKS; SCHEDULING;

BAYESIAN NEURAL NETWORKS; HYBRID INTELLIGENT METHOD; PERFORMANCE MODELING AND PREDICTION; PERFORMANCE PREDICTION; RADIAL BASIS FUNCTION NEURAL NETWORKS; SCHEDULING SYSTEMS; SCIENTIFIC APPLICATIONS; WORKFLOW APPLICATIONS;

FORECASTING;

EID: 70349751510     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGRID.2009.58     Document Type: Conference Paper

References (41)

1. EGEE Team LCG, 2004. http://lcg.web.cern.ch.
2. Grid 5000 project, 2007. https://www.grid5000.fr.
3. Open Science Grid, 2007. http://www.opensciencegrid.org.
4. The Austrian Grid Consortium. http://www.austriangrid.at.
5. The TeraGrid Project, 2006. http://www.teragrid.org.
6. S.F. et al. Altschul. Gapped blast and psi-blast: a new generation of protein database search programs. Nucleic Acids Res, 1997.
7. Laura et al Carrington. A performance prediction framework for scientific applications. Future Gener. Comput. Syst., 22(3):336-346, 2006.
8. Mark J. Clement and Michael J. Quinn. Analytical performance prediction on multicomputers. In Supercomputing, pages 886-894, 1993.
9. Gregory F. Cooper and Edward Herskovits. A bayesian method for the induction of probabilistic networks from data. Machine Learning, 9(4):309-347, 1992.
10. M.M. Eshaghian. Heterogeneous Computing. Prentice-Hall, 1996.
11. Alfredo Tirado-Ramos et al. Grid resource selection by application benchmarking for computational haemodynamics applications. In International Conference on Computational Science, pages 534-543, 2005.
12. Benjamin C. Lee et al. Methods of inference and learning for performance modeling of parallel applications. In PPoPP '07. ACM, 2007.
13. Bradley J. Barnes et al. A regression-based approach to scalability prediction. In ICS '08, 2008.
14. David A. Bacigalupo et al. An investigation into the application of different performance prediction methods to distributed enterprise applications. J. Supercomput., pages 93-111, 2005.
15. Engin Ipek et al. An approach to performance prediction for parallel applications. In Euro-Par, pages 196-205, 2005.
16. Farrukh Nadeem et al. Soft benchmarks-based application performance prediction using a minimum training set. In E-SCIENCE '06, page 71, Washington, DC, USA, 2006. IEEE Computer Society.
17. G. R. Nudd et al. Pace-a toolset for the performance prediction of parallel and distributed systems. Int. J. High Perform. Comput. Appl., pages 228-251, 2000.
18. Junwei Cao et al. Performance prediction technology for agent-based resource management in grid environments. In IPDPS '02, page 265, Washington, DC, USA, 2002. IEEE Computer Society.
19. P. Blaha et al. WIEN2k: An Augmented Plane Wave plus Local Orbitals Program for Calculating Crystal Properties. Institute of Physical and Theoretical Chemistry, Vienna University of Technology, Vienna., 2001.
20. Ryutaro Susukita et al. Performance prediction of large-scale parallell system and application using macro-level simulation. In SC '08. IEEE Press, 2008.
21. S. Schindler et al. Metal enrichment processes in the intracluster medium. Astronomy and Astrophysics, pages 435:L25-L28, May 2005.
22. Sukhdeep Sodhi et al. Performance prediction with skeletons. Cluster Computing, pages 151-165, 2008.
23. Valerie Taylor et al. Using kernel couplings to predict parallel application performance. In HPDC '02, Washington, DC, USA, 2002.
24. Vasanth Balasundaram et al. A static performance estimator to guide data partitioning decisions. In PPOPP, pages 213-223, 1991.
25. C. Feng and D. Michie. Machine learning of rules and trees. pages 50-83, 1994.
26. Nir Friedman, Dan Geiger, and Moises Goldszmidt. Bayesian network classifiers. Machine Learning, 29(2-3):131-163, 1997.
27. Richard Gibbons. A historical application profiler for use by parallel schedulers. In Job Scheduling Strategies for Parallel Processing. Springer Verlag, 1997.
28. M. Henrion, G. Provan, B. Del Favero, and G. Sanders. An experimental comparison of numerical and qualitative probabilistic reasoning. In n Proceedings of the 10th Conference on Uncertainty in Artificial Intelligence, 1994.
29. Michael A. Iverson, Fusun ner, and Gregory J. Follen. Run-time statistical estimation of task execution times for heterogeneous distributed computing. In HPDC, pages 263-, 1996.
30. W. Kapferer, W. Domainko, S. Schindler, E. Van Kampen, S. Kimeswenger, M. Mair, T. Kronberger, and D. Breitschwerdt. Metal enrichment and energetics of galactic winds in galaxy clusters. Advances in Space Research, 36:682, 2005.
31. Hui Li, David Groep, and Lex Wolters. Efficient response time predictions by exploiting application and resource state similarities. In In proceedings of 6th IEEE/ACM International Workshop on Grid Computing (Grid2005), Seattle, Washington, USA, 2005., 2005.
32. Petri Myllymäki. Mapping Bayesian networks to stochastic neural networks: a foundation for hybrid Bayesian-neural systems. PhD thesis, University of Helsinki, 1995.
33. Radu Prodan and Thomas Fahringer. Overhead analysis of scientific workflows in grid environments. IEEE Transactions on Parallel and Distributed Systems, 2007.
34. Invmod Wasim project. The water flow and balance simulation model (WaSiM-ETH). http://www.dps.uibk.ac.at/ marek/projects.
35. Brian Reistad and David K. Gifford. Static dependent costs for estimating execution time. In LISP and Functional Programming, 1994.
36. Warren Smith, Ian Foster, and Valerie Taylor. Predicting application run times with historical information. J. Parallel Distrib. Comput., 2004.
37. George W. Snedecor and William G. Cochran. Statistical Methods. Ames, IA: Iowa State Press, 1980.
38. Jiang Su and Harry Zhang. Full bayesian network classifiers. In ICML '06: Proceedings of the 23rd international conference on Machine learning, pages 897-904, New York, NY, USA, 2006. ACM.
39. L. Wang and X. Fu. LSF: load sharing in large-scale heterogeneous distributed systems. In Data Mining with Computational Intelligence (Advanced Information and Knowledge Processing). Springer-Verlag New York, Inc., 2005.
40. Ian H. Witten and Eibe Frank. Data Mining: Practical Machine Learning Tools and Techniques (Second Edition). Morgan Kaufmann, 2005.
41. E.̌J.H. et al Yero. Contention-sensitive static performance prediction for parallel distributed applications. Perform. Eval., pages 265-277, 2006.