Task profiling model for load profile prediction

Future Generation Computer Systems

Volumn 27, Issue 3, 2011, Pages 245-255

  Seneviratne, Sena ^a   Levy, David C ^a  

^a UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Cluster computing; Division of load; Free load profile; Grid computing; Load average; Performance prediction; Task profiling model

Indexed keywords

DIVISION OF LOAD; LOAD AVERAGE; LOAD PROFILES; PERFORMANCE PREDICTION; TASK PROFILING MODEL;

CLUSTER COMPUTING; GRID COMPUTING; MATHEMATICAL MODELS;

ELECTRIC LOAD FORECASTING;

EID: 78649324261     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2010.09.004     Document Type: Article

References (44)

1. U. Schwiegelshohn, R.S. Badia, M. Bubak, M. Danelutto, S. Dustdar, F. Gagliadi, A. Geiger, L. Hluchy, D. Kranzlmuller, E. Laure, T. Priol, A. Reinfeld, M. Resch, A. Reuter, O. Rienhoff, T. Ruter, P. Sloot, D. Talia, K. Ullmann, R. Yahyapour, and G. von Voigt Perspectives on grid computing Future Generation Computer Systems 26 8 2010 1104 1115
2. A. Afzal, A.S. McGough, and J. Darlington Capacity planning and scheduling in grid computing environments Future Generation Computer Systems 24 5 2008 404 414
3. F. Nadeem, R. Prodan, T. Fahringer, Characterizing, modeling and predicting dynamic resource availability in a large scale multi-purpose grid, in: 8th Int'l Symp. on Cluster Computing and the Grid, CCGRID'08, Lyon, France, 2008, pp. 348357.
4. S.A. Jarvis, D.P. Spooner, H.N.L.C. Keung, J. Cao, S. Saini, and G.R. Nudd Performance prediction and its use in parallel and distributed computing systems Future Generation Computer Systems (FGCS) 22 7 2006 745 754
5. M. Dobber, R.V.D. Mei, and G. Koole A prediction method for job runtime on shared processors: survey, statistical analysis and new avenues Performance Evaluation 64 78 2007 755 781
6. R.M. Piro, A. Guarise, G. Patania, and A. Werbrouck Using historical accounting information to predict the resource usage of grid jobs Future Generation Computer Systems 25 5 2009 499 510
7. R. Buyya, D. Abramson, and S. Venugopal The grid economy Grid Computing Proceedings of the IEEE 93 3 2005 698 714 (special issue)
8. D. Abramson, R. Buyya, and J. Giddy A computational economy for grid computing and its implementation in the Nimrod-G resource broker Future Generation Computer Systems (FGCS) 18 8 2002 1061 1074
9. S. Seneviratne, and D. Levy Cost profile prediction for grid computing Concurrency and Computation: Practice and Experience 22 1 2010 107 142
10. A.C. Sodan, G. Gupta, L. Han, L. Liu, and B. Lafreniere Time and space adaptation for computational grids with the ATOP-grid middleware Future Generation Computer Systems 24 6 2008 561 581
11. D. Spinellis Code Quality: The Open Source Perspective 2006 Addison-Wesley Professional Publishers, Adobe Press New York, USA
12. P.A. Dinda Online prediction of running time of tasks Cluster Computing 5 3 2002 225 236
13. P.A. Dinda, D.R. O'Hallaron, An evaluation of linear models for host load prediction, in: 8th IEEE Int'l Symp. on High-Performance Distributed Computing, HPDC-8, Redondo Beach, CA, USA, 1999, pp. 8796.
14. P.A. Dinda, and D.R. O'Hallaron Host load prediction using linear models Cluster Computing 3 4 2000 265 280
15. R. Wolski Dynamically forecasting network performance using the network weather service Cluster Computing 1 1 1998 119 132
16. P.A. Dinda The statistical properties of host load Scientific Programming 7 34 1999 211 229
17. P.A. Dinda, Resource signal prediction and its application to real time scheduling advisors, Ph.D. School of Computer Science, Carnegie Mellon University, USA, 2000.
18. A.B. Downey, Predicting queue times on space-sharing parallel computers, in: 11th Int'l Symp. on Parallel Processing, Geneva, Switzerland, 1997, pp. 209218.
19. B.D. Lee, J.M. Schopf, Run-time prediction of parallel applications on shared environment, in: IEEE Int'l Conf. on Cluster Computing 2003, Hong Kong, China, 2003, pp. 487491.
20. W. Smith, I. Foster, and V. Taylor Predicting application run times with historical information Parallel and Distributed Computing 64 9 2004 1007 1016
21. W. Smith, V. Taylor, I. Foster, Using runtime predictions to estimate queue wait times and improve scheduler performance, in: Int'l Workshop on Job Scheduling Strategies for Parallel Processing, San Juan, Puerto Rico, 1999, pp. 202219.
22. R. Wolski, N. Spring, C. Peterson, Implementing a performance forecasting system for metacomputing: the network weather service, in: ACM/IEEE Int'l Conf. on Super Computing, San Jose, California, USA, 1997, pp. 726.
23. R.M. Badia, F. Escale, E. Gabriel, J. Gimenez, R. Keller, J. Labarta, M.S. Muller, Performance prediction in a grid environment, in: Int'l Conf. on Grid Computing, in First European Across Grids Conference, Santiago de Compostela, Spain, 2003, pp. 257264.
24. L.A. Steffenel, LaPIe: communications collectives adaptes aux grilles de calcul, Ph.D. INPG, Grenoble, France, 2005.
25. R. Prodan Specification and runtime workflow support in the ASKALON grid environment Scientific Programming 15 4 2007 193 211 (Pubitemid 350261822)
26. M. Faerman, A. Su, R. Wolski, F. Berman, Adaptive performance prediction for distributed data-intensive applications, in: ACM/IEEE Int'l Conf. on Super Computing, Portland, OR, USA, 1999. Article No. 36 (CDROM).
27. F. Virili, and B. Freisleben Neural network model selection for financial time series prediction Computational Statistics 16 2001 451 463 (Pubitemid 33660762)
28. A. Lendasse, E.D. Bodt, V. Wertz, and M. Verleysen Nonlinear financial time series forecasting-application to the Bel 20 stock market index Economic and Social Systems 14 1 2000 81 91
29. L.M. Lawson, E.E. Hofmann, and Y.H. Spitz Time Series sampling and data assimilation in a simple marine ecosystems model Deep Sea Research Part II: Topical Studies in Oceanography 43 2 1996 625 651
30. R. Wolski, N. Spring, and J. Hayes Predicting the CPU availability of time-shared Unix systems on the computational grid Cluster Computing 3 4 2000 293 301
31. R. Wolski, N. Spring, and J. Hayes The network weather service: a distributed resource performance forecasting service for metacomputing Future Generation Computer Systems 15 5 1999 757 768
32. S. Seneviratne, D. Levy, Enhanced host load prediction by division of user load signal for grid computing, in: Presented at the 6th Int'l Conf. on Algorithms and Architectures for Parallel Processing, ICA3PP 2005, Melbourne, Australia, 2005.
33. Y. Zhang, W. Sun, and Y. Inoguchi Predict task running time in grid environments based on CPU load predictions Future Generation Computer Systems 24 6 2008 489 497
34. N.T. Karonis, B. Toonen, and I. Foster Mpich-g2: a grid-enabled implementation of the message passing interface Parallel and Distributed Computing 63 5 2003 551 563
35. R.F. Van der Wijngaart, M.A. Frumkin, Evaluating the information power grid using NAS grid benchmarks, in: 18th Int'l Symp. on Parallel and Distributed Processing, Santa Fe, New Mexico, USA, 2004, p. 275 (CDROM).
36. C.J. Cotsapas, The genetics of variation in gene expression, Ph.D. Thesis, School of Biotechnology and Biomolecular Sciences, University of New South Wales, Sydney, Australia, 2005.
37. R. Buyya, K. Branson, J. Giddy, and D. Abramson The Virtual laboratory: enabling molecular modelling for drug design on the World Wide Gride Concurrency and Computation: Practice and Experience (CCPE) 15 1 2003 1 25
38. R. Buyya, S. Date, Y.M. Matsumoto, S. Venugopal, and D. Abramson Neuroscience instrumentation and distributed analysis of brain activity data: a case for escience on global grids Concurrency and Computation: Practice and Experience 17 5 2005 1783 1798
39. S. Krishnaswamy, A. Zaslasvky, S.W. Loke, Estimating computation times in data intensive E-services, in: 4th Int'l Conf. on Web Information Systems Engineering, WISE 2003, Rome, Italy, 2003, pp. 7280.
40. D. Ferrari, S. Zhou, An empirical investigation of load indices for load balancing applications, in: 12th Int'l Symp. on Computer Performance Modeling, Measurement, 1987, pp. 515528.
41. N.J. Gunther Analysing Computer System Performance with Perl: PDQ 2005 Springer-Verlag Heidelberg, Germany
42. S. Seneviratne, A framework for load profile prediction for grid computing, Ph.D. Electical & Information Engineering, Sydney University, Sydney, 2009.
43. J. Komorowski, L. Polkowski, and A. Skowron Rough Sets: A Tutorial 1999 Springer-Verlag Singapore
44. A. Ali, A. Anjum, J. Bunn, R. Cavanaugh, F. van Lingen, R. McClatchey, M.A. Mehmood, H. Newman, C. Steenberg, M. Thomas, I. Willers, Predicting the resource requirements of a job submission, in: Int'l Conf. on the Computing in High Energy and Nuclear Physics, CHEP2004, Interlaken, Switzerland, 2004. Article No. 273 (CDROM).