Towards a better understanding of workload dynamics on data-intensive clusters and grids

Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM

Volumn , Issue , 2007, Pages

  Li, Hui ^a   Wolters, Lex ^a  

^a LEIDEN UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTER ANALYSIS; FRACTALS; STATISTICAL METHODS; STORAGE ALLOCATION (COMPUTER); VIRTUAL REALITY;

DATA INTENSIVE CLUSTERS; MEMORY CONSUMPTION; SCALING ANALYSIS; WORKLOAD DYNAMICS;

GRID COMPUTING;

EID: 34548785494     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2007.370250     Document Type: Conference Paper

References (27)

1. Selected and revised papers: Workshop on job scheduling strategies for parallel processing. Lecture Notes in Computer Science. Springer, 1995-2005.
2. P. Abry, R. Baraniuk, P. Flandrin, R. Riedi, and D. Veitch. The multiscale nature of network traffic: discovery, analysis, and modelling. IEEE Signal Processing magazine, 19(3):28-46, May 2002.
3. P. Abry, M. S. Taqqu, P. Flandrin, and D. Veitch. Self-Similar Network Traffic and Performance Evaluation, K. Park and W. Willinger, editors, chapter Wavelets for the analysis, estimation, and synthesis of scaling data. Wiley, 2000.
4. P. Abry and D. Veitch. Wavelet analysis of long-range dependent traffic. IEEE Trans. on Info. Theory, 44(1):2-15, January 1998.
5. A.-L. Barabasi. The origin of bursts and heavy tails in human dynamics. Nature, 435:207-211, 2005.
6. W. Cime and F. Berman. A comprehensive model of the supercomputer workload. In proceedings of IEEE 4th Annual Workshop on Workload Characterization, 2001.
7. D. G. Feitelson. Workload modeling for performance evaluation. LNCS, 2459:114-141, 2002.
8. D. G. Feitelson. Workload Modeling for Computer Systems Performance Evaluation, draft version 0.7, 2006.
9. A. Feldmann, A. C. Gilbert, and W. Willinger. Data networks as cascades: Investigating the multifractal nature of internet WAN traffic. In SIGCOMM, pages 42-55, 1998.
10. I. Foster, C. Kesselman, and S. Tuecke. The anatomy of the Grid: Enabling scalable virtual organizations. Lecture Notes in Computer Science, 2150, 2001.
11. D. L. Jagerman, B. Melamed, and W. Willinger. Stochastic modeling of traffic processes. Frontiers in Queueing: Models, Methods and Problems, 1996.
12. W. Leland, M. Taqqu, W. Willinger, and D. Wilson. On the self-similar nature of ethernet traffic (extended version). IEEE/ACM Trans. on Networking, 2(1):1-15, 1994.
13. H. Li. Complete data and results for workload dynamics on clusters and grids. Technical Report 2006-04, Leiden Institute of Advanced Computer Science, Leiden University, 2006.
14. H. Li, D. Groep, and L. Wolters. Workload characteristics of a multi-cluster supercomputer. LNCS, 3277:176-193, 2005.
15. H. Li, D. Groep, and L. Wolters. Mining performance data for metascheduling decision support in the grid. Future Generation Computer Systems, 23:92-99, 2007.
16. H. Li and M. Muskulus. Analysis and modeling of job arrivals in a production grid. ACM SIGMETRICS Performance Evaluation Review, March 2007.
17. S. B. Lowen and M. C. Teich. Fractal-Based Point Processes. John Wiley and Sons, Inc., 2005.
18. U. Lublin and D. G. Feitelson. The workload on parallel supercomputers: modeling the characteristics of rigid jobs. J. Para. and Dist. Comput., 63(11):1105-1122, 2003.
19. E. Medernach. Workload analysis of a cluster in a grid environment. In proceedings of 11th workshop on Job Scheduling Strategies for Parallel processing, 2005.
20. V. Paxson. Fast, approximate synthesis of fractional gaussian noise for generating self-similar network traffic. Computer Communications Review, 27(5):5-18, Oct. 1997.
21. Y Qiao, J. Skicewicz, and P. Dinda. Multiscale predictability of network traffic. Technical Report NWU-CS-02-13, Department of Computer Science, Northwestern University, 2002.
22. R. H. Riedi, M. S. Crouse, V. J. Ribeiro, and R. G. Baraniuk. A multifractal wavelet model with application to network traffic. IEEE Transactions on Information Theory, 45(3):992-1019, April 1999.
23. R. H. Riedi and W. Willinger. Self-Similar Network Traffic and Performance Evaluation, K. Park and W. Willinger, editors, chapter Toward an Improved Understanding of Network Traffic Dynamics. Wiley, 2000.
24. B. Song, C. Ernemann, and R. Yahyapour. Parallel computer workload modeling with markov chains. LNCS, 3277:47-62, 2004.
25. M. S. Squillante, D. D. Yao, and L. Zhang. The impact of job arrival patterns on parallel scheduling. ACM SIGMETRICS Performance Evaluation Review, 26(4):52-59, Dec. 1999.
26. J. L. Vehel and R. Riedi. Fractional brownian motion and data traffic modeling: The other end of the spectrum. Fractals in Engineering, pages 185-202, 1997.
27. D. Veitch and P. Abry. A wavelet based joint estimator of the parameters of long-range dependence. IEEE Transactions on Information Theory special issue on "Multiscale Statistical Signal Analysis and its Applications", 45(3):878-897, April 1999.