Xen and the art of cluster scheduling

VTDC 2006 - 2nd International Workshop on Virtualization Technology in Distributed Computing; held in Conjunction with SC06

Volumn , Issue , 2006, Pages

  Fallenbeck, Niels ^a   Picht, Hans Joachim ^a   Smith, Matthew ^a   Freisleben, Bernd ^a  

^a PHILIPPS UNIVERSITY MARBURG   (Germany)

Author keywords

Backfilling; Cluster computing; Parallel serial jobs; Scheduling; Virtualization

Indexed keywords

DISTRIBUTED COMPUTER SYSTEMS; SCHEDULING; TECHNOLOGY;

BACKFILLING; CLUSTER COMPUTING; CLUSTER SCHEDULING; DISTRIBUTED COMPUTING; EASE-OF-USE; OVERALL PERFORMANCE; PARALLEL JOBS; PARALLEL/SERIAL JOBS; PROOF-OF-CONCEPT IMPLEMENTATION; RUN-TIME; SCHEDULING SYSTEMS; SUN GRID ENGINE; VIRTUALIZATION; VIRTUALIZATION TECHNOLOGY;

CHLORINE COMPOUNDS;

EID: 48249150789     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/VTDC.2006.18     Document Type: Conference Paper

References (31)

1. D. Wright, "Cheap Cycles from the Desktop to the Dedicated Cluster: Combining Opportunistic and Dedicated Scheduling with Condor," in Proceedings of the Linux Clusters: The HPC Revolution conference, Champaign - Urbana, IL, June 2001.
2. S. Srinivasan, R. Kettimuthu, V. Subramani, and P. Sadayappan, "Characterization of Backfilling Strategies for Parallel Job Scheduling," in ICPPW '02: Proceedings of the 2002 International Conference on Parallel Processing Workshops. Washington, DC, USA: IEEE Computer Society, 2002, pp. 514-522.
3. Sun Gridengine Developers, "Sun GridEngine Website," 2006, http://gridengine.sunsource.net.
4. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the Art of Virtualization," in SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles. New York, NY, USA: ACM Press, 2003, pp. 164-177.
5. T. Gebhardt, "Configuration of the MARC Cluster," 2006, http://www.uni-marburg.de/hrz/infrastruktur/zserv/cluster/config.
6. "Manpage of the qsub Program," 2006, http://gridengine. sunsource.net/nonav/source/browse/~checkout~/gridengine/doc/htmlman/htmlman1/ qsub.html.
7. D. A. Lifka, "The ANL/IBM SP Scheduling System." in Job Scheduling Strategies for Parallel Processing (JSSPP), 1995, pp. 295-303.
8. A. M. Weil and D. G. Feitelson, "Utilization, Predictability, Workloads, and User Runtime Estimates in Scheduling the IBM SP2 with Backfilling." IEEE Transactions on Parallel and Distributed Systems, vol. 12, no. 6, pp. 529-543, 2001.
9. B. G. Lawson and E. Smirni, "Multiple-Queue Backfilling Scheduling with Priorities and Reservations for Parallel Systems." in Job Scheduling Strategies for Parallel Processing (JSSPP), 2002, pp. 72-87.
10. D. Zotkin and P. J. Keleher, "Job-Length Estimation and Performance in Backfilling Schedulers," in HPDC '99: Proceedings of the The Eighth IEEE International Symposium on High Performance Distributed Computing. Washington, DC, USA: IEEE Computer Society, 1999, p. 39.
11. B. Lawson and E. Smirni, "Self-Adaptive Scheduler Parameterization via Online Simulation," in IPDPS '05: Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers. Washington, DC, USA: IEEE Computer Society, 2005, p. 29.1.
12. S.-H. Chiang and F. Chuyong, "Re-evaluating Reservation Policies for Backfill Scheduling on Parallel Systems," 16th IASTED Int'l Conf. on Parallel and Distributed Computing and Systems (PDCS), 2004.
13. P. J. Keleher, D. Zotkin, and D. Perkovic, "Attacking the Bottlenecks of Backfilling Schedulers," Cluster Computing, vol. 3, no. 4, pp. 245-254, 2000.
14. W Smith, I. T. Foster, and V. E. Taylor, "Predicting Application Run Times Using Historical Information," in IPPS/SPDP '98: Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing. London, UK: Springer-Verlag, 1998, pp. 122-142.
15. B. G. Lawson and E. Smirni, "Multiple-Queue Backfilling Scheduling with Priorities and Reservations for Parallel Systems," SIGMETRICS Performance Evaluation Review, vol. 29, no. 4, pp. 40-47, 2002.
16. D. Tsafrir, Y. Etsion, and D. G. Feitelson, "Backfilling Using Runtime Predictions Rather than User Estimates," School of Computer Science and Engineering, Hebrew University of Jerusalem, Tech. Rep. TR 2005-5, 2003.
17. A. Haas, "Specification of the Resource Reservation and Backfilling Grid Engine 6.0 scheduler enhancement," 2004, http://gridengine.sunsource. net/nonav/source/browse/~checkout~/gridengine/doc/devel/rfe/ resource_reservation.txt".
18. Thomas Gebhardt, "Description of the MARC Cluster Hadrware," 2006, http://www.uni-marburg.de/hrz/infrastruktur/zserv/cluster/hardware.
19. B. Clark, T. Deshane, E. Dow, S. Evanchik, M. Finlayson, J. Herne, and J. N. Matthews, "Xen and the Art of Repeated Research." in USENIX Annual Technical Conference, FREENIX Track, 2004, pp. 135-144.
20. L. Gilbert, J. Tseng, R. Newman, S. Iqbal, R. Pepper, O. Celebioglu, J. Hsieh, and M. Cobban, "Performance Implications of Virtualization and Hyper-Threading on High Energy Physics Applications in a Grid Environment," in IPDPS '05: Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) ?Papers. Washington, DC, USA: IEEE Computer Society, 2005, p. 32.1.
21. A. Menon, J. R. Santos, Y Turner, G. J. Janakiraman, and W Zwaenepoel, "Diagnosing Performance Overheads in the Xen Virtual Machine Environment," in VEE '05: Proceedings of the 1st ACM/USENIX international conference on Virtual execution environments. New York, NY, USA: ACM Press, 2005, pp. 13-23.
22. VMWare INC, "VMWare Homepage," 2006, http://www.vmware.com.
23. I. Foster, T. Freeman, K. Keahy, D. Scheftner, B. Sotomayer, and X. Zhang, "Virtual Clusters for Grid Communities," in CCGRID '06: Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06). Washington, DC, USA: IEEE Computer Society, 2006, pp. 513-520.
24. The Globus Project, "Virtual Workspaces," 2006, http://workspace.globus.org/.
25. N. Kiyanclar, G. A. Koenig, and W Yurcik, "Maestro-VC: A Paravirtualized Execution Environment for Secure On-Demand Cluster Computing," in CCGRID '06: Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06). Washington, DC, USA: IEEE Computer Society, 2006, p. 28.
26. I. Krsul, A. Ganguly, J. Zhang, J. A. B. Fortes, and R. J. Figueiredo, "VMPlants: Providing and Managing Virtual Machine Execution Environments for Grid Computing," in SC '04: Proceedings of the 2004 ACM/IEEE conference on Supercomputing. Washington, DC, USA: IEEE Computer Society, 2004, p. 7.
27. G. Valle, R. Lottiaux, D. Margery, C. Morin, and J.-Y. Berthou, "Ghost Process: a Sound Basis to Implement Process Duplication, Migration and Checkpoint/Restart in Linux Clusters," in The 4th International Symposium on Parallel and Distributed Computing, Lille, France, July 2005, pp. 97-104.
28. B. Lin and P. A. Dinda, "VSched: Mixing Batch And Interactive Virtual Machines Using Periodic Real-time Scheduling," in SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing. Washington, DC, USA: IEEE Computer Society, 2005, p. 8.
29. VMWare INC, "VMWare GSX Server," 2006, http://www.vmware.com/ products/server/.
30. Id Software, Inc., "Quake II Homepage," 2006, http://www.idsoftware.com/games/quake/quake2/.
31. M. Smith, T. Friese, M. Engel, and B. Freisleben, "Countering Security Threats in Service-Oriented On-Demand Grid Computing Using Sand-boxing and Trusted Computing Techniques," Journal of Parallel and Distributed Computing, vol. 66, no. 9, pp. 1189-1204, 2006.