Locality of sampling and diversity in parallel system workloads

Proceedings of the International Conference on Supercomputing

Volumn , Issue , 2007, Pages 53-63

  Feitelson, Dror G ^a  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

Author keywords

Locality; Workload characterization; Workload modeling

Indexed keywords

ADAPTIVE SYSTEMS; MATHEMATICAL MODELS; PARAMETER ESTIMATION; SUPERCOMPUTERS;

NON-STATIONARY MODELS; WORKLOAD CHARACTERIZATION; WORKLOAD MODELING;

PARALLEL PROCESSING SYSTEMS;

EID: 34548037669     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1274971.1274982     Document Type: Conference Paper

References (39)

1. A. O. Allen, Probability, Statistics, and Queueing Theory with Computer Science Applications. Academic Press, 1978.
2. V. Almeida, A. Bestavros, M. Crovella, and A. de Oliveira, "Characterizing reference locality in the WWW". In Parallel & Distributed Inf. Syst., pp. 92-103, Dec 1996.
3. M. F. Arlitt and C. L. Williamson, "A synthetic workload model for Internet Mosaic traffic". In Summer Computer Simulation Conf., pp. 852-857, Jul 1995.
4. M. Calzarossa and G. Serazzi, "Construction and use of multiclass workload models". Performance Evaluation 19(4), pp. 341-352, 1994.
5. W. Cirne and F. Berman, "A comprehensive model of the supercomputer workload". In 4th Workshop on Workload Characterization, Dec 2001.
6. P. J. Denning, "The locality principle". Comm. ACM 48(7), pp. 19-24, Jul 2005.
7. A. B. Downey, "A parallel workload model and its implications for processor allocation". Cluster Computing 1(1), pp. 133-145, 1998.
8. B. Efron, "Computers and the theory of statistics: thinking the unthinkable". SIAM Rev. 21(4), pp. 460-480, Oct 1979.
9. B. Efron and G. Gong, "A leisurely look at the bootstrap, the jackknife, and cross-validation". The American Statistician 37(1), pp. 36-48, Feb 1983.
10. D. G. Feitelson, "Packing schemes for gang scheduling". In Job Scheduling Strategies for Parallel Processing, pp. 89-110, Springer-Verlag LNCS vol. 1162, 1996.
11. D. G. Feitelson and M. Naaman, "Self-tuning systems". IEEE Softw. 16(2), pp. 52-60, Mar/Apr 1999.
12. D. G. Feitelson and D. Tsafrir, "Workload sanitation for performance evaluation". In IEEE Intl. Symp. Performance Analysis Syst. & Software., pp. 221-230, Mar 2006.
13. D. Ferrari, "On the foundation of artificial workload design". In SIGMETRICS Conf. Measurement & Modeling of Comput. Syst., pp. 8-14, Aug 1984.
14. R. Gibbons, "A historical application profiler for use by parallel schedulers". In Job Scheduling Strategies for Parallel Processing, pp. 58-77, Springer Verlag LNCS vol. 1291, 1997.
15. R Hernández-Campos, K. Jeffay, and F. D. Smith, "Tracking the evolution of web traffic: 1995-2003". In 11th Modeling, Anal. & Simulation of Comput. & Telecomm. Syst., pp. 16-25, Oct 2003.
16. S. Hotovy, "Workload evolution on the Cornell Theory Center IBM SP2". In Job Scheduling Strategies for Parallel Processing, pp. 27-40, Springer-Verlag LNCS vol. 1162, 1996.
17. R. Jain, The Art of Computer Systems Performance Analysis. John Wiley & Sons, 1991.
18. J. Jann, P. Pattnaik, H. Franke, F. Wang, J. Skovira, and J. Riodan, "Modeling of workload in MPPs". In Job Scheduling Strategies for Parallel Processing, pp. 95-116, Springer Verlag LNCS vol. 1291, 1997.
19. L. Kleinrock, Queueing Systems, Vol II: Computer Applications. John Wiley & Sons, 1976.
20. A. M. Law and W. D. Kelton, Simulation Modeling and Analysis. McGraw Hill, 3rd ed., 2000.
21. W. E. Leland, M. S. Taqqu, W. Willinger, and D. V. Wilson, "On the self-similar nature of Ethernet traffic". IEEE/ACM Trans. Networking 2(1), pp. 1-15, Feb 1994.
22. U. Lublin and D. G. Feitelson, "The workload on parallel supercomputers: modeling the characteristics of rigid jobs". J. Parallel & Distributed Comput. 63(11), pp. 1105-1122, Nov 2003.
23. D. Michie, "Memo functions and machine learning". Nature 218(5136), pp. 19-22, Apr 6 1968.
24. T. D. Nguyen, R. Vaswani, and J. Zahorjan, "Parallel application characterization for multiprocessor scheduling policy design". In Job Scheduling Strategies for Parallel Processing, pp. 175-199, Springer-Verlag LNCS vol. 1162, 1996.
25. V. Paxson and S. Floyd, "Wide-area traffic: the failure of Poisson modeling". IEEE/ACM Trans. Networking 3(3), pp. 226-244, Jun 1995.
26. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition". Proc. IEEE 77(2), pp. 257-286, Feb 1989.
27. S. V. Raghavan, N. Swaminathan, and J. Srinivasan, "Predicting behavior patterns using adaptive workload models". In 7th Modeling, Anal. & Simulation of Comput. & Telecomm. Syst., pp. 226-233, Oct 1999.
28. W. Shi, M. H. MacGregor, and P. Gburzynski, "Synthetic trace generation for the Internet: an integrated model". In Intl. Symp. Performance Evaluation of Computer and Telecommunication Syst., pp. 471-477, Jul. 2004.
29. W. Smith, I. Foster, and V. Taylor, "Predicting application run times using historical information". In Job Scheduling Strategies for Parallel Processing, pp. 122-142, Springer Verlag LNCS vol. 1459, 1998.
30. B. Song, C. Ernemann, and R. Yahyapour, "Parallel computer workload modeling with Markov chains". In Job Scheduling Strategies for Parallel Processing, pp. 47-62, Springer Verlag LNCS vol. 3277, 2004.
31. J. R. Spirn, Program Behavior: Models and Measurements. Elsevier North Holland Inc., 1977.
32. A. Streit, "A self-tuning job scheduler family with dynamic policy switching". In Job Scheduling Strategies for Parallel Processing, pp. 1-23, Springer Verlag LNCS vol. 2537, 2002.
33. D. Talby and D. G. Feitelson, "Improving and stabilizing parallel computer performance using adaptive scheduling". In 19th Intl. Parallel & Distributed Processing Symp., Apr 2005.
34. D. Thiébaut, J. L. Wolf, and H. S. Stone, "Synthetic traces for trace-driven simulation of cache memories". IEEE Trans. Comput. 41(4), pp. 388-410, Apr 1992.
35. (Corrected in IEEE Trans. Comput. 42(5) p. 635, May 1993).
36. M. Wang, A. Ailamaki, and C. Faloutsos, "Capturing the spatio-temporal behavior of real traffic data". Performance Evaluation 49(1-4), pp. 147-163, Aug 2002.
37. P. R. Wilson, M. S. Johnstone, M. Neely, and D. Boles, "Dynamic storage allocation: a survey and critical review". In Intl. Workshop Memory Management, Sep 1995.
38. L. Zhang, Z. Liu, A. Riabov, M. Schulman, C. Xia, and F. Zhang, "A comprehensive toolset for workload characterization, performance modeling, and online control". In Computer Performance Evaluations, Modelling Techniques and Tools, P. Kemper and W. H. Sanders (eds.), pp. 63-77, Springer-Verlag LNCS vol. 2794, Sep 2003.
39. Q. Zhang, A. Riska, W. Sun, E. Smirni, and G. Ciardo, "Workload-aware load balancing for clustered web servers". IEEE Trans. Parallel & Distributed Syst. 16(3), pp. 219-233, Mar 2005.