Predicting the execution time of grid workflow applications through local learning

Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, SC '09

Volumn , Issue , 2009, Pages

  Nadeem, Farrukh ^a,b   Fahringer, Thomas ^b  

^a NATIONAL UNIVERSITY OF COMPUTER AND EMERGING SCIENCES   (Pakistan)

^b UNIVERSITY OF INNSBRUCK   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

CONFIDENCE VALUES; DATA FLOW DEPENDENCIES; DEGREE OF CONFIDENCE; DYNAMIC WEIGHING; EVALUATION RESULTS; EXECUTION TIME; GRID WORKFLOWS; LOCAL LEARNING; NUMBER OF GRIDS; PREDICTION ACCURACY; PROBLEM SIZE; RUN-TIME INFORMATION; WORK-FLOWS; WORKFLOW EXECUTION;

MANAGEMENT;

EID: 74049136080     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1654059.1654093     Document Type: Conference Paper

References (30)

1. C. Atkeson, A. Moore, and S. Schaal. Locally weighted learning. Artificial Intelligence Review, 11(1-5):11-73, April 1997.
2. K. Deb. Multi-objective Optimization Using Evolutionary Algorithms. John Wiley and Sons, 2nd edition, 2002.
3. E. Deelman, G. Singh, M.-H. Su, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, G. B. Berriman, J. Good, A. Laity, J. C. Jacob, and D. S. Katz. Pegasus: A framework for mapping complex scientific workflows onto distributed systems. Scientific Programming Journal, 13(3):219-237, 2005.
4. Enabling Grids for E-science. www.eu-egee.org/.
5. T. Fahringer, R. Prodan, R. Duan, J. Hofer, F. Nadeem, F. Nerieri, S. Podlipnig, J. Qin, M. Siddiqui, H. L. Truong, A. Villazon, and M. Wieczorek. Scientific Workflows for Grids, chapter ASKALON: A Development and Grid Computing Environment for Scientific Workflows. Springer Verlag, 2007.
6. D. G. Feitelson and B. Nitzberg. Job characteristics of a production parallel scientific workload on the NASA ames iPSC/860. In workshop on job scheduling strategies for parallel processing, Santa Barbara, USA, 1995.
7. E. Gelenbe, E. Montagne, R. Suros, and C. M. Woodside. A performance model of block structured parallel programs. In Proceedings of the international workshop on Parallel algorithms & architectures, pages 127-138, Amsterdam, The Netherlands, The Netherlands, 1986. North-Holland Publishing Co.
8. T. Glatard, J. Montagnat, and X. Pennec. A probabilistic model to analyse workflow performance on production grids. In CCGRID '08: Proceedings of the Eighth IEEE International Symposium on Cluster Computing and the Grid, pages 510-517, Lyon, France, 2008. IEEE Computer Society.
9. T. Haluk, H. Salim, and W. Min-you. Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Transactions on Parallel and Distribributed Systems, 13(3):260-274, 2002.
10. S. Haykin. Neural Networks and Learning Machines. Prentice Hall, 3rd edition, 2008.
11. H. Li, J. Chen, Y. Tao, D. Gro, and L. Wolters. Improving a local learning technique for queuewait time predictions. In CCGRID '06: Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid, pages 335-342, Singapore, 16-19 May 2006. IEEE Computer Society.
12. P. Mussi and P. Nain. Evaluation of parallel execution of program tree structures. SIGMETRICS Performance Evaluation Review, 12(3):78-87, 1984.
13. F. Nadeem and T. Fahringer. Similarity templates based distributed application workow performance prediction. In Proc. of the Eighth IEEE International Symposium on Cluster Computing and the Grid, Shanghai, China, May 18-21 2009.
14. F. Nadeem, M. M. Yousaf, R. Prodan, and T. Fahringer. Soft benchmarks-based application performance prediction using a minimum training set. In E-SCIENCE '06: Proceedings of the Second IEEE International Conference on e-Science and Grid Computing, page 71, Amsterdam, The Netherlands, 2006. IEEE Computer Society.
15. T. Oinn, M. Addis, J. Ferris, D. Marvin, M. Senger, M. Greenwood, T. Carver, K. Glover, M. R. Pocock, A. Wipat, and P. Li. Taverna: a tool for the composition and enactment of bioinformatics workflows. Bioinformatics, 20(17):3045-3054, Nov. 2004.
16. P. Blaha et al. WIEN2k: An Augmented Plane Wave plus Local Orbitals Program for Calculating Crystal Properties. Institute of Physical and Theoretical Chemistry, TU Vienna, 2001.
17. Platform Computing. Load sharing facility (lsf). www.platform.com.
18. J. Qin and T. Fahringer. Advanced data ow support for scientific grid workow applications. In ACM/IEEE conference on Supercomputing, Reno, USA, 2007.
19. F. Schüller, J. Qin, F. Nadeem, R. Prodan, T. Fahringer, and G. Mayr. Performance, Scalability and Quality of the Meteorological Grid Workflow. In 2nd Austrian Grid Symposium, Innsbruck, Austria. OCG Verlag, Sep. 2006.
20. W. Smith, I. Foster, and V. Taylor. Predicting application run times with historical information. J. Parallel Distrib. Comput., 64(9):1007-1016, 2004.
21. Sun Microsystems. Sun grid engine (sge). www.sun.com/software/sge/.
22. I. Taylor, I. Wang, M. Shields, and S. Majithia. Distributed computing with triana on the grid. Concurrency and Computation: Practice & Experience, 17(9):1197-1214, 2005.
23. V. Taylor, X. Wu, J. Geisler, and R. Stevens. Using kernel couplings to predict parallel application performance. In HPDC '02: Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing, page 125, Washington, DC, USA, 2002. IEEE Computer Society.
24. The Austrian Grid Consortium. www.austriangrid.at.
25. The Grid5000. www.grid5000.fr.
26. D. Theiner and M. Wieczorek. Reduction of calibration time of distributed hydrological models by use of grid computing and nonlinear optimisation algorithms. In 7th International Conference on Hydroinformatics (HIC 2006), Acropolis, Nice, France, September 2006 2006.
27. D. R. Wilson and T. R. Martinez. Improved heterogeneous distance functions. Journal of Artificial Intelligence Research, 6:1-34, 1997.
28. I. H. Witten and E. Frank. Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, 2nd edition, 2005.
29. A. Wombacher and M. Rozie. Piloting an empirical study on measures for workow similarity. In IEEE International Conference on Services Computing, Chicago, USA, 2006.
30. E. J. H. Yero and M. A. A. Henriques. Contention-sensitive static performance prediction for parallel distributed applications. Perform. Eval., 63(4):265-277, 2006.