Performance modeling of parallel applications for grid scheduling

Journal of Parallel and Distributed Computing

Volumn 68, Issue 8, 2008, Pages 1135-1145

  Sanjay, H A ^a   Vadhiyar, Sathish ^a  

^a INDIAN INSTITUTE OF SCIENCE   (India)

Author keywords

Cross platform modeling; Grids; Non dedicated systems; Parallel applications; Performance modeling; Predictions; Scheduling

Indexed keywords

COMPUTER NETWORKS; CONFORMAL MAPPING; FORECASTING; LEAD; LOADS (FORCES); METROPOLITAN AREA NETWORKS; MULTITASKING; NETWORK PROTOCOLS; SCHEDULING; SCHEDULING ALGORITHMS; TRANSIENTS;

ELSEVIER (CO); EXECUTION TIMES; GRID RESOURCES; GRID SCHEDULING; GRID SYSTEMS; METASCHEDULER; NON-DEDICATED CLUSTERS; NON-DEDICATED ENVIRONMENTS; PARALLEL APPLICATIONS; PERFORMANCE MODELING; PREDICTED EXECUTION; PREDICTION ERRORS; RANDOM LOADS;

PARALLEL PROCESSING SYSTEMS;

EID: 45449112326     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2008.02.006     Document Type: Article

References (41)

1. Adve V., and Vernon M. Parallel program performance prediction using deterministic task graph analysis. ACM Transactions on Computer Systems 22 1 (2004) 94-136
2. Alkindi A.M., Kerbyson D.J., and Nudd G.R. Dynamic instrumentation and performance prediction of application execution. In High Performance Computing and Networking (HPCN2001) 2110 (2001) 313-323
3. G. Allen, T. Dramlitsch, I. Foster, N. Karonis, M. Ripeanu, E. Seidel, B. Toonen, Supporting efficient execution in heterogeneous distributed computing environments with cactus and globus, in: Supercomputing '01: Proceedings of the 2001 ACM/IEEE conference on Supercomputing (CDROM), 2001
4. C. Anglano, Predicting parallel applications performance on non-dedicated cluster platforms, in: ICS '98: Proceedings of the 12th international conference on Supercomputing, 1998
5. ApGrid - Asia Pacific Grid, http://apgrid.org
6. R. Badia, J. Labarta, J. Gimenez, F. Escale, DIMEMAS: Predicting MPI applications behavior in grid enviornaments., in: In Workshop on Grid Applications and Programming Tools (GGF8), Seattle York, U.S.A, 2003
7. O. Beaumont, L. Carter, J. Ferrante, A. Legrand, L. Marchal, Y. Robert, Centralized versus distributed schedulers for multiple bag-of-task applications, in: 20th International Parallel and Distributed Processing Symposium, 2006
8. F. Berman, R. Wolski, The AppLeS Project: A Status Report, in: Proceedings of the 8th NEC Research Symposium
9. L.S. Blackford, J. Choi, A. Cleary, E. D'Azevedo, J. Demmel, I. Dhillon, J. Dongarra, S. Hammarling, G. Henry, A. Petitet, K. Stanley, D. Walker, R.C. Whaley, ScaLAPACK Users' Guide, Society for Industrial and Applied Mathematics, Philadelphia, PA, 1997
10. R. Block, S. Sarukkai, P. Mehra, Automated performance prediction of message-passing parallel programs, in: Supercomputing '95: Proceedings of the 1995 ACM/IEEE conference on Supercomputing (CDROM), 1995
11. Carrington L., Snavely A., and Wolter N. A performance prediction framework for scientific applications. Future Generation Computer Systems 22 3 (2006) 336-346
12. CurveExpert, http://curveexpert.webhop.biz
13. DataFit, http://www.curvefitting.com
14. A. Dhodapkar, J. Smith, Comparing program phase detection techniques, in: Proceedings of the 36th Annual IEEE/ACM International Symposium on Microarchitecture, 2003
15. W. Dick, M. Heath, Whole system simulation of solid propellant rockets, in: Proceedings of the 38th Joint Propulsion Conference and Exhibit, Indianapolis, IN, USA, 2002
16. C. Ding, S. Dwarkadas, M. Huang, K. Shen, J. Carter, Program Phase Detection and Exploitation, in: 20th International Parallel and Distributed Processing Symposium, 2006
17. M. Frigo, S. Johnson, The design and implementation of FFTW3, Proceedings of the IEEE 93 (2) (2005) 216-231, special issue on Program Generation, Optimization, and Platform Adaptation
18. The GrADS Project, http://www.hipersoft.rice.edu/grads
19. GrADS Traces, http://pompone.cs.ucsb.edu/rich/data
20. Grove D.A., and Coddington P.D. Modeling message-passing programs with a performance evaluating virtual parallel machine. Performance Evaluation 60 1-4 (2005) 165-187
21. Ipek E., de Supinski B., Schulz M., and McKee S. An Approach to Performance Prediction for Parallel Applications. Euro-Par vol. 3648 (2005), Springer LNCS
22. D. Kerbyson, H. Alme, A. Hoisie, F. Petrini, H. Wasserman, M. Gittings, Predictive performance and scalability modeling of a large-scale application, in: Supercomputing '01: Proceedings of the 2001 ACM/IEEE conference on Supercomputing (CDROM), Denver, Colorado, USA, 2001
23. LabFit, http://www.angelfire.com/rnb/labfit
24. Lee B., Brooks D., de Supinski B., Schulz M., Singh K., and McKee S. Methods of inference and learning for performance modeling of parallel applications. Proceedings of Symposium on Principles and Practice of Parallel Programming (PPoPP'07) (2007), San Jose, California, U.S.A
25. Nudd G., Kerbysin D., Papaefstathiou E., Perry S., Harper J., and Wilcox D. PACE - a toolset for the performance prediction of parallel and distributed systems. The International Journal of High Performance Computing Applications 14 3 (2000) 228-251
26. L. Oliker, R. Biswas, H. Shan, J. Singh, Design strategies for irregularly adapting parallel applications, in: Proceedings of the Tenth SIAM Conference on Parallel Processing for Scientific Computing, 2001
27. E. Perelman, M. Polito, J.-Y. Bouguet, J. Sampson, B. Calder, C. Dulong, Detecting phases in parallel applications on shared memory architectures, in: 20th International Parallel and Distributed Processing Symposium, 2006
28. Petitet A., Blackford S., Dongarra J., Ellis B., Fagg G., Roche K., and Vadhiyar S. Numerical libraries and the grid: The grads experiments with scalapack. Journal of High Performance Applications and Supercomputing 15 4 (2001) 359-374
29. J. Schopf, Structural prediction models for high performance distriuted applications, in: Proceedings of Cluster Computing Conference (CCC'97), Atlanta, USA, 1997
30. J. Schopf, F. Berman, Performance prediction in production environments, in: Proceedings of 12th International Parallel Processing Symposium, Orlando, USA, 1998
31. Schopf J., and Berman F. Using stochastic information to predict application behavior on contended resources. International Journal on Foundation in Computer Science 12 3 (2001) 341-364
32. T. Sherwood, S. Sair, B. Calder, Phase tracking and prediction, in: ISCA '03: Proceedings of the 30th Annual International Symposium on Computer architecture, 2003
33. V. Taylor, X. Wu, J. Geisler, X. Li, Z. Lan, M. Hereld, I. Judson, R. Stevens, Prophesy: Automating the modeling process, in: Proceedings of the Third Annual International Workshop on Active Middleware Services, Tokyo, Japan, 2001
34. Taylor V., Wu X., and Stevens R. Prophesy: An infrastructure for performance analysis and modeling of parallel and grid applications. ACM SIGMETRICS Performance Evaluation Review 30 4 (2003) 13-18
35. TeraGrid, http://www.teragrid.org
36. UK e-Science, http://www.rcuk.ac.uk/escience/default.htm
37. Wolski R. Dynamically forecasting network performance using the network weather service. Journal of Cluster Computing 1 1 (1998) 119-132
38. Wolski R., Spring N., and Hayes J. The network weather service: A distributed resource performance forecasting service for metacomputing. Journal of Future Generation Computing Systems 15 5-6 (1999) 757-768
39. Xu Z., Zhang X., and Sun L. Semi-empirical multiprocessor performance predictions. Journal of Parallel and Distributed Computing 39 1 (1996) 14-28
40. J. Yagnik, H.A. Sanjay, S. Vadhiyar, Performance modeling based on multidimensional surface learning for performance predictions of parallel applications in non-dedicated environments, in: ICPP '06: Proceedings of the 2006 International Conference on Parallel Processing, 2006
41. Yan Y., Zhang X., and Song Y. An effective and practical performance prediction model for parallel computing on nondedicated heterogeneous NOW. Journal of Parallel and Distributed Computing 38 1 (1996) 63-80