Parallel computer workload modeling with Markov chains

Lecture Notes in Computer Science

Volumn 3277, Issue , 2005, Pages 47-62

  Song, Baiyi ^a   Ernemann, Garsten ^a   Yahyapour, Ramin ^a  

^a TU DORTMUND UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; JOB ANALYSIS; MARKOV PROCESSES; MATHEMATICAL MODELS; PROBABILITY DISTRIBUTIONS; SCHEDULING; STRATEGIC PLANNING;

JOB PARAMETERS; PARALLEL MACHINES; SCHEDULING STRATEGIES; WORKLOAD MODELS;

PARALLEL PROCESSING SYSTEMS;

EID: 23944459087     PISSN: 03029743     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1007/11407522_3     Document Type: Conference Paper

References (31)

1. Kento Aida. Effect of Job Size Characteristics on Job Scheduling Performance. In Dror G. Feitelson and Larry Rudolph, editors, Job Scheduling Strategies for Parallel Processing, volume 1911, pages 1-17. Springer Verlag, 2000. Lecture Notes in Computer Science (LNCS).
2. George E.P. Box and Gwilym M. Jenkins. Time Series Analysis. Holden Day Publishing, 1976. ISBN:0-8162-1104-3.
3. Walfredo Cirne and Francine Berman. A Comprehensive Model of the Supercomputer Workload. In 4th Workshop on Workload Characterization, December 2001.
4. Walfredo Cirne and Francine Berman. A Model for Moldable Supercomputer Jobs. In Proceedings of the IPDPS 2001 - International Parallel and Distributed Processing Symposium, April 2001.
5. Jerome T. Connor, R. Douglas Martin, and L.E. Atlas. Recurrent Neural Networks and Robust Time Series Prediction. IEEE Transactions on Neural Networks, 5(2):240-254, 1994.
6. Allen B. Downey. A Parallel Workload Model and its Implications for Processor Allocation. Technical Report CSD-96-922, University of California, Berkeley, November 1996.
7. Allen B. Downey and Dror G. Feitelson. The Elusive Goal of Workload Characterization. ACM SIGMETRICS Performance Evaluation Review, 26(4):14-29, March 1999.
8. Rakesh Dugad. A Tutorial on Hidden Markov Models and Selected Apllications in Speech Recognition. In A. Waibel and K.-F. Lee, editors, Readings in Speech Recognition, pages 267-296. Kaufmann, San Mateo, CA, 1990.
9. Carsten Ernemann, Volker Hamscher, Uwe Schwiegelshohn, Achim Streit, and Ramin Yahyapour. Enhanced Algorithms for Multi-Site Scheduling. In Proceedings of the 3rd International Workshop on Grid Computing, Baltimore. SpringerVerlag, Lecture Notes in Computer Science LNCS, 2002.
10. Carsten Ernemann, Volker Hamscher, Uwe Schwiegelshohn, Achim Streit, and Ramin Yahyapour. On Advantages of Grid Computing for Parallel Job Scheduling. In Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid, Berlin, May 2002. IEEE Press.
11. Carsten Ernemann, Volker Hamscher, Achim Streit, and Ramin Yahyapour. On Effects of Machine Configurations on Parallel Job Scheduling in Computational Grids. In International Conference on Architecture of Computing Systems, ARCS, pages 169-179, Karlsruhe, April 2002. VDE.
12. Carsten Ernemann, Volker Hamscher, and Ramin Yahyapour. Economic Scheduling in Grid Computing. In Dror G. Feitelson, Larry Rudolph, and Uwe Schwiegelshohn, editors, Job Scheduling Strategies for Parallel Processing, volume 2537, pages 128-152. Springer Verlag, 2002. Lecture Notes in Computer Science (LNCS).
13. Carsten Ernemann, Baiyi Song, and Ramin Yahyapour. Scaling of Workload Traces. In Dror G. Feitelson, Larry Rudolph, and Uwe Schwiegelshohn, editors, Job Scheduling Strategies for Parallel Processing: 9th International Workshop, JSSPP 2003 Seattle, WA, USA, June 24, 2003, volume 2862 of Lecture Notes in Computer Science (LNCS), pages 166-183. Springer-Verlag Heidelberg, October 2003.
14. Carsten Ernemann and Ramin Yahyapour. "Grid Resource Management - State of the Art and Future Trends", chapter "Applying Economic Scheduling Methods to Grid Environments", pages 491-506. Kluwer Academic Publishers, 2003.
15. Dror G. Feitelson. Packing Schemes for Gang Scheduling. In Dror G. Feitelson and Larry Rudolph, editors, Job Scheduling Strategies for Parallel Processing, volume 1162, pages 89-110. Springer-Verlag, 1996. Lecture Notes in Computer Science (LNCS).
16. Dror G. Feitelson. Workload Modeling for Performance Evaluation. In Mariacarla Calzarossa and Sara Tucci, editors, Performance Evaluation of Complex Systems: Techniques and Tools, volume 2459, pages 114-141. Springer Verlag, 2002. Lecture Notes in Computer Science (LNCS).
17. Dror G. Feitelson, Larry Rudolph, Uwe Schwiegelshohn, Kenneth C. Sevcik, and Parkson Wong. Theory and practice in parallel job scheduling. In IPPS'97 Workshop: Job Scheduling Strategies for Parallel Processing, volume 1291 of Lecture Notes in Computer Science (LNCS), pages 1-34. Springer, Berlin, April 1997.
18. Steven Hotovy. Workload Evolution on the Cornell Theory Center IBM SP2. In Dror G. Feitelson and Larry Rudolph, editors, IPPS'96 Workshop: Job Scheduling Strategies for Parallel Processing, pages 27-40. Springer, Berlin, Lecture Notes in Computer Science LNCS 1162, 1996.
19. Ross Ihaka and Robert Gentleman. R: A Language for Data Analysis and Graphics. Journal of Computational and Graphical Statistics, 5(3):299-314, 1996.
20. Joefon Jann, Pratap Pattnaik, Hubertus Franke, Fang Wang, Joseph Skovira, and Joseph Riodan. Modeling of Workload in MPPs. In Dror G. Feitelson and Larry Rudolph, editors, IPPS'97 Workshop: Job Scheduling Strategies for Parallel Processing, pages 94-116. Springer-Verlag, Lecture Notes in Computer Science LNCS 1291, 1997.
21. J. H. Jenkins. Stationary joint distributions arising in the analysis of the M/G/1 queue by the method of the imbedded Markov chain. Journal of Applied Physics, 3:512-520, 1966.
22. Hubert Lilliefors. On the Kolmogorov-Smirnov Test for the Exponential Distribution with Mean Unknown. Journal of the American Statistical Association, 64:387-389, 1969.
23. Virginia Lo, Jens Mache, and Kurt Windisch. A comparative study of real workload traces and synthetic workload models for parallel job scheduling. In Dror G. Feitelson and Larry Rudolph, editors, Job Scheduling Strategies for Parallel Processing, volume 1459 of Lecture Notes in Computer Science, pages 25-46. Springer-Verlag, 1998.
24. Uri Lublin and Dror G. Feitelson. The Workload on Parallel Supercomputers: Modeling the Characteristics of Rigid Jobs. Journal of Parallel and Distributed Computing, 63(11):1105-1122, Nov 2003.
25. Jens Mache, Virginia Lo, and Kurt Windisch. Minimizing message-passing contention in fragmentation-free processor allocation. In Proceedings of the 10th International Conference on Parallel and Distributed Computing Systems, 1997.
26. Ara V. Nefian and Monson H. Hayes. Face recognition using an embedded HMM. In Proceedings of the IEEE Conference on Audio and Video-based Biometric Person Authentication, pages 19-24, 1999.
27. Bahl Lalit R, Frederick Jelinek, and Robert L. Mercer. A maximum likelihood approach to continuous speech recognition. In IEEE Transactions on Pattern Analysis and Machine Intelligenc PAMI-5, pages 179-190, 1983. Reprinted in (Waibel and Lee 1990), pp. 308-319.
28. Emilia Rosti, Evgenia Smirni, Lawrence W. Dowdy, Giuseppe Serazzi, and Brian M. Carlson. Robust Partitioning Policies of Multiprocessor Systems. Performance Evaluation Journal, Special Issue on Parallel Systems, 19(2-3): 141-165, 1994.
29. Jaspal Subhlok, Thomas Gross, and Takashi Suzuoka. Impact of Job Mix on Optimizations for Space Sharing Schedulers. In Proceedings of the 1996 ACM/IEEE conference on Supercomputing, 1996.
30. Parallel Workloads Archive, http://www.cs.huji.ac.il/labs/parallel/ workload/, July 2004.
31. Gautama Temujin and Marc M. Van Hulle. Separation of Acoustic Signals Using Self-organizing Neural Networks. In Proceedings IEEE Neural Network for Signal Processing Workshop 1999, Madison, WI, USA, pages 324-332, 1999.