Modeling correlated workloads by combining model based clustering and a localized sampling algorithm

Proceedings of the International Conference on Supercomputing

Volumn , Issue , 2007, Pages 64-72

  Li, Hui ^a   Muskulus, Michael ^a   Wolters, Lex ^a  

^a LEIDEN UNIVERSITY   (Netherlands)

Author keywords

Autocorrelation; Localized sampling; Model based clustering; Workload modeling

Indexed keywords

CLUSTERING ALGORITHMS; COMPUTER SIMULATION; DISTRIBUTED COMPUTER SYSTEMS; MATHEMATICAL MODELS; PROBABILITY DENSITY FUNCTION;

LOCALIZED SAMPLING; MODEL BASED CLUSTERING; WORKLOAD MODELING;

AUTOCORRELATION;

EID: 34548021227     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1274971.1274983     Document Type: Conference Paper

References (17)

1. W. Cirne and F. Berman. A comprehensive model of the supercomputer workload. In proceedings of IEEE 4th Annual Workshop on Workload Characterization, 2001.
2. A. Dempster, N. Laird, and D. Rubin. Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society, Series B, 39(1), 1977.
3. P. J. Denning. The locality principle. Communications of ACM, 48(7):19-24, 2005.
4. D. G. Feitelson. Workload modeling for performance evaluation. Lecture Notes in Computer Science, 2459:114-141, 2002.
5. D. G. Feitelson. Locality of sampling. Technical Report 2006-16, School of Computer Science and Engineering, The Hebrew University of Jerusalem, 2006.
6. C. Fraley and A. E. Raftery. Model-based clustering, discriminant analysis, and density estimation. Journal of the American Statistical Association, 97:611-631, 2002.
7. C. Fraley and A. E. Raftery. Mclust version 3 for r: Normal mixture modeling and model-based clustering. Technical Report 504, Department of Statistics, University of Washington, 2006.
8. G. R. Ganger. Generating representative synthetic workloads: An unsolved problem. In Proceedings of the Computer Management Group (CMG) Conference, pages 1263-1269, 1995.
9. R. E. Kass and A. E. Raftery. Bayes factors. Technical Report 254, Department of Statistics, University of Washington, 1993.
10. H. Li. Workload dynamics on clusters and grids. Technical Report 2006-04, Leiden Institute of Advanced Computer Science, Leiden University, 2006.
11. H. Li, D. Groep, and L. Wolters. Workload characteristics of a multi-cluster supercomputer. In International Workshop on Job Scheduling Strategies for Parallel Processing, volume 3277 of Lecture Notes in Computer Science, pages 176-193. Springer, 2005.
12. H. Li, R. Heusdens, M. Muskulus, and L. Wolters. Analysis and synthesis of pseudo-periodic job arrivals in grids: A matching pursuit approach. In proceedings of IEEE Intl. Symposium on Cluster Computing and the Grid (CCGrid), 2007, to appear.
13. H. Li and M. Muskulus. Analysis and modeling of job arrivals in a production grid. ACM SIGMETRICS Performance Evaluation Review, March 2007.
14. H. Li, M. Muskulus, and L. Wolters. Modeling long range dependent and fractal job traffic in data-intensive grids. Technical Report 2007-03, Leiden Institute of Advanced Computer Science, Leiden University, 2007.
15. U. Lublin and D. G. Feitelson. The workload on parallel supercomputers: modeling the characteristics of rigid jobs. J. Para. and Dist. Comput., 63(11):1105-1122, 2003.
16. B. Song, C. Ernemann, and R. Yahyapour. Parallel computer workload modeling with markov chains. In International Workshop on Job Scheduling Strategies for Parallel Processing, volume 3277 of Lecture Notes in Computer Science, pages 47-62. Springer, 2004.
17. B. Song, C. Ernemann, and R. Yahyapour. User group-based workload analysis and modeling. In in proceedings of IEEE Intl. Symposium on Cluster Computing and the Grid (CCGrid), pages 953-961, 2005.