On grid performance evaluation using synthetic workloads

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4376 LNCS, Issue , 2007, Pages 232-255

  Iosup, Alexandru ^a,c   Epema, Dick H J ^a,c   Franke, Carsten ^b,c   Papaspyrou, Alexander ^b,c   Schley, Lars ^b,c   Song, Baiyi ^b,c   Yahyapour, Ramin ^b,c  

^a Delft University of Technology ^*  (Netherlands)

^b TU DORTMUND UNIVERSITY   (Germany)

^c CoreGRID European Virtual Institute on Grid Resource Management and Scheduling ^*

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER ARCHITECTURE; PROBLEM SOLVING; RESOURCE ALLOCATION;

PERFORMANCE METRICS; WORKLOAD GENERATION; WORKLOAD MODELS;

GRID COMPUTING;

EID: 38049125427     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-71035-6_12     Document Type: Conference Paper

References (52)

1. The Parallel Workloads Archive Team. The parallel workloads archive logs, June 2006. [Online]. Available: http://www.cs.huji.ac.il/labs/parallel/ workload/logs.html.
2. Francine Berman, Richard Wolski, Henri Casanova, Walfredo Cirne, Holly Dail, Mareio Faerman, Silvia M. Figueira, Jim Hayes, Graziano Obertelli, Jennifer M. Schopf, Gary Shao, Shava Smadlen, Neil T. Spring, Alan Su, and Dmitrii Zagorodnov. Adaptive computing on the grid using apples. IEEE Trans. Parallel Distrib. Syst., 14(4):369-382, 2003.
3. N. Beume, M. Emmerich, C. Ernemann, L. Schnemann, and U. Schwiegelshohn. Scheduling Algorithm Development based on Complex Owner Defined Objectives. Technical Report CI-190/05, University of Dortmund, January 2005.
4. Anca I. D. Bucur and Dick H. J. Epema. The performance of processor co-allocation in multicluster systems. In Proc. of the 3rd IEEE Int'l. Symp. on Cluster Computing and the Grid (CCGrid), pages 302-309, 2003.
5. Anca I. D. Bucur and Dick H. J. Epema. Trace-based simulations of processor co-allocation policies in multiclusters. In Proc. of the 12th Intl. Symposium on High-Performance Distributed Computing (HPDC), pages 70-79, 2003.
6. R. Buyya, D. Abramson, and S. Venugopal. The grid economy. In Special Issue of the Proceedings of the IEEE on Grid Computing. IEEE Press, 2005. (To appear).
7. Maria Calzarossa and Giuseppe Serazzi. A characterization of the variation in time of workload arrival patterns. IEEE Trans. Comput., C-34(2): 156-162, Feb 1985.
8. Steve J. Chapin, Walfredo Cirne, Dror G. Feitelson, James Patton Jones, Scott T. Leutenegger, Uwe Schwiegelshohn, Warren Smith, and David Talby. Benchmarks and standards for the evaluation of parallel job schedulers. In Dror G. Feitelson and Larry Rudolph, editors, Proc. of the 5th Int'l. Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP), volume 1659 of Lecture Notes in Computer Science, pages 67-90. Springer, 1999.
9. Brent N. Chun, Philip Buonadonna, Alvin AuYoung, Chaki Ng, David C. Parkes, Jeffrey Shneidman, Alex C. Snoeren, and Amin Vahdat. Mirage: A microeconomic resource allocation system for sensornet testbeds. In Proc. of 2nd IEEE Workshop on Embedded Networked Sensors (EmNetsII), 2005.
10. Greg Chun, Holly Dail, Henri Casanova, and Allan Snavely. Benchmark probes for grid assessment. In Proc. of the 18th International Parallel and Distributed Processing Symposium (IPDPS), 2004.
11. Walfredo Cirne and Francine Berman. A Comprehensive Model of the Supercomputer Workload. In 4th Workshop on Workload Characterization, December 2001.
12. Walfredo Cirne and Francine Berman. A model for moldable supercomputer jobs. In Proc. of the 15th International Parallel and Distributed Processing Symposium (IPDPS), pages 59-79, 2001.
13. Allen B. Downey. A parallel workload model and its implications for processor allocation. Cluster Computing, 1(1):133-145, 1998.
14. Catalin Dumitrescu, Ioan Raicu, and Ian T. Foster. Experiences in running workloads over grid3. In Hai Zhuge and Geoffrey Fox, editors, Grid and Cooperative Computing (GCC), volume 3795 of Lecture Notes in Computer Science, pages 274-286. Springer, 2005.
15. C. Ernemann and R. Yahyapour. Grid Resource Management - State of the Art and Future Trends, chapter Applying Economic Scheduling Methods to Grid Environments, pages 491-506. Kluwer Academic Publishers, 2003.
16. Carsten Ernemann, Volker Hamscher, Uwe Schwiegelshohn, Ramin Yahyapour, and Achim Streit. On advantages of grid computing for parallel job scheduling. In Proc. of the 2nd IEEE Int'l. Symp. on Cluster Computing and the Grid (CCGrid), pages 39-49, 2002.
17. Carsten Ernemann, Volker Hamscher, and Ramin Yahyapour. Benefits of global grid computing for job scheduling. In Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, Pittsburgh, November 2004. IEEE Computer Society.
18. Carsten Ernemann, Baiyi Song, and Ramin Yahyapour. Scaling of Workload Traces. In Dror G. Feitelson, Larry Rudolph, and Uwe Schwiegelshohn, editors, Job Scheduling Strategies for Parallel Processing, volume 2862 of Lecture Notes in Computer Science, pages 166-183. Springer, October 2003.
19. Dror G. Feitelson. Packing Schemes for Gang Scheduling. In Dror G. Feitelson and Larry Rudolph, editors, Job Scheduling Strategies for Parallel Processing, volume 1162 of Lecture Notes in Computer Science, pages 89-110. Springer, 1996.
20. Dror G. Feitelson. The forgotten factor: facts on performance evaluation and its dependence on workloads. In B. Monien and R. Feldmann, editors, Euro-Par 2002 Parallel Processing, volume 2400, pages 49-60. Springer, 2002. Lecture Notes in Computer Science.
21. Dror G. Feitelson. Workload Modeling for Performance Evaluation. In Mariacarla Calzarossa and Sara Tucci, editors, Performance Evaluation of Complex Systems: Techniques and Tools, volume 2459 of Lecture Notes in Computer Science, pages 114-141. Springer, 2002.
22. Dror G. Feitelson. Metric and workload effects on computer systems evaluation. IEEE Computer, 36(9): 18-25, 2003.
23. Dror G. Feitelson. Experimental analysis of the root causes of performance evaluation results: a backfilling case study. IEEE Transactions on Parallel and Distributed Systems, 16(2): 175-182, Feb 2005.
24. Dror G. Feitelson and Larry Rudolph. Metrics and benchmarking for parallel job scheduling. In Dror G. Feitelson and Larry Rudolph, editors, Proc. of the 4th Int'l. Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP), volume 1459 of Lecture Notes in Computer Science, pages 1-24. Springer, 1998.
25. Dror G. Feitelson, Larry Rudolph, Uwe Schwiegelshohn, Kenneth C. Sevcik, and Parkson Wong. Theory and Practice in Parallel Job Scheduling. In Dror G. Feitelson and Larry Rudolph, editors, Proc. of the 3rd Int'l. Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP), volume 1291 of Lecture Notes in Computer Science, pages 1-34, Geneva, April 1997. Springer-Verlag.
26. Ian Foster, Markus Fidler, Alain Roy, Volker Sander, and Linda Winkler. End-to-end quality of service for high-end applications. Computer Communications, 27(14):1375-1388, September 2004.
27. Michael A. Frumkin and Rob F. Van der Wijngaart. Nas grid benchmarks: A tool for grid space exploration. In Proc. of the 10th Intl. Symposium on High-Performance Distributed Computing (HPDC), pages 315-326, 2001.
28. R. L. Graham, E. L. Lawler, J. K. Lenstra, and A. H. G. Rinnooy Kan. Optimization and approximation in deterministic sequencing and scheduling: A survey. Annals of Discrete Mathematics, 15:287-326, 1979.
29. Soonwook Hwang and Caxl Kesselman. Gridworkflow: A flexible failure handling framework for the grid. In Proc. of the 12th Intl. Symposium on High-Performance Distributed Computing (HPDC), pages 126-137, 2003.
30. Alexandru Iosup, Catalin Dumitrescu, D.H.J. Epema, Hui Li, and Lex Wolters. How are real grids used? the analysis of four grid traces and its implications. In The 7th IEEE/ACM International Conference on Grid Computing (Grid), Barcelona, ES, Sep 28-29 2006. (accepted).
31. Alexandra Iosup and D.H.J. Epema. GrenchMark: A framework for analyzing, testing, and comparing grids. In Proc. of the 6th IEEE/ACM Int'l. Symp. on Cluster Computing and the GRID (CCGrid), May 2006. (accepted).
32. Alexandru Iosup, Jason Maassen, Rob V. van Nieuwpoort, and Dick H.J. Epema. Synthetic grid workloads with Ibis, KOALA, and GrenchMark. In Proceedigs of the CoreGRID Integrated Research in Grid Computing, Pisa, Italy, November 2005. LNCS, 2006.
33. David Jackson, Quinn Snell, and Mark Clement. Core algorithms of the Maui scheduler. In Dror G. Feitelson and Larry Rudolph, editors, Proc. of the 7th Int'l. Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP), volume 2221 of Lecture Notes in Computer Science, pages 87-102. Springer, 2001.
34. R. Jain. The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling,. Wiley-Interscience, New York, NY, USA, May 1991. Winner of "1991 Best Advanced How-To Book, Systems" award from the Computer Press Association.
35. Chris Kenyon and Giorgos Cheliotis. Architecture requirements for commercializing grid resources. In Proc. of the 11th Intl. Symposium on High-Performance Distributed Computing (HPDC), pages 215-224, 2002.
36. George Kola, Tevfik Kosar, and Miron Livny. Phoenix: Making data-intensive grid applications fault-tolerant. In Rajkumar Buyya, editor, GRID, pages 251-258. IEEE Computer Society, 2004.
37. Derrick Kondo, Michela Taufer, Charles L. Brooks III, Henri Casanova, and Andrew A. Chien. Characterizing and evaluating desktop grids: An empirical study. In Proc. of the 18th International Parallel and Distributed Processing Symposium (IPDPS), 2004.
38. Hui Li, David Groep, and Lex Wolters. Workload characteristics of a multi-cluster supercomputer. In Dror G. Feitelson, Larry Rudolph, and Uwe Schwiegelshohn, editors, Job Scheduling Strategies for Parallel Processing (JSSPP'04), pages 176-194. Springer-Verlag, June 2004.
39. Uri Lublin and Dror G. Feitelson. The workload on parallel supercomputers: Modeling the characteristics of rigid jobs. Journal of Parallel and Distributed Computing, 63(20): 1105-1122, 2003.
40. Raissa Medeiros, Walfredo Cirne, Francisco Vilar Brasileiro, and Jacques Philippe Sauvé. Faults in grids: Why are they so bad and what can be done about it?. In Heinz Stockinger, editor, GRID, pages 18-24. IEEE Computer Society, 2003.
41. Emmanuel Medernach. Workload analysis of a cluster in a grid environment. In Dror G. Feitelson, Eitan Frachtenberg, Larry Rudolph, and Uwe Schwiegelshohn, editors, Proc. of the 11th Int'l. Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP), volume 3834 of Lecture Notes in Computer Science, pages 36-61. Springer, 2005.
42. H.H. Mohamed and D.H.J. Epema. Experiences with the koala co-allocating scheduler in multiclusters. In Proc. of the 5th IEEE/ACM Int'l Symp. on Cluster Computing and the GRID (CCGrid), May 2005.
43. M. Pinedo. Scheduling: Theory, Algorithms, and Systems. Prentice-Hall, 2nd edition, 2002.
44. Wayne Schroeder, Richard Marciano, Joseph Lopez, and Michael K. Gleicher. Analysis of HPSS Performance Based on Per-file Transfer Logs. In Proc. of the 16th IEEE Mass Storage Systems Symposium, pages 103-115, San Diego, March 1999. IEEE Computer Society.
45. U. Schwiegelshohn and R. Yahyapour. Fairness in parallel job scheduling. Journal of Scheduling, 3(5):297-320, 2000.
46. Hongzhang Shan, Leonid Oliker, and Rupak Biswas. Job superscheduler architecture and performance in computational grid environments. In SC, pages 44-54. ACM, 2003.
47. Baiyi Song, Carsten Ernemann, and Ramin Yahyapour. Parallel Computer Workload Modeling with Markov Chains. In Dror G. Feitelson, Larry Rudolph, and Uwe Schwiegelshohn, editors, Proc. of the 10th Job Scheduling Strategies for Parallel Processing (JSSPP), volume 3277 of Lecture Notes in Computer Science, pages 47-62. Springer, October 2004.
48. Baiyi Song, Carsten Ernemann, and Ramin Yahyapour. User Group-based Work-load Analysis and Modeling. In Proc. of the 5th Int'l. Symp. on Cluster Computing and the Grid (CCGrid). IEEE Computer Society, 2005.
49. Douglas Thain, John Bent, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau, and Miron Livny. Pipeline and batch sharing in grid workloads. In Proc. of the 12th Intl. Symposium on High-Performance Distributed Computing (HPDC), pages 152-161, 2003.
50. Mitchell D. Theys, Howard Jay Siegel, Noah B. Beck, Min Ta, and Michael Jurczyk. A Mathematical Model, Heuristic and Simulation Study for a Basic Data Staging Problem in a Heterogenous Networking Environment. In Proc. of the 7th Heterogeneous Computing Workshop, pages 115-122, Orlando, March 1998. IEEE Computer Society.
51. G. Tsouloupas and M. D. Dikaiakos. GridBench: A workbench for grid benchmarking. In P. M. A. Sloot, A. G. Hoekstra, T. Priol, A. Reinefeld, and M. Bubak, editors, Proc. of the European Grid Conference (EGC), volume 3470 of Lecture Notes in Computer Science, pages 211-225. Springer, 2005.
52. Rich Wolski, Neil Spring, and Jim Hayes. The network weather service: A distributed resource performance forecasting service for metacomputing. Journal of Future Generation Computing Systems, 15(5-6) :757-768, October 1999.