Precise and realistic utility functions for user-centric performance analysis of schedulers

Proceedings of the 16th International Symposium on High Performance Distributed Computing 2007, HPDC'07

Volumn , Issue , 2007, Pages 107-116

  Lee, Cynthia B ^a   Snavely, Allan E ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Genetic algorithms; Scheduling; Utility functions

Indexed keywords

COMPUTER SIMULATION; FUNCTIONS; GENETIC ALGORITHMS; PROBLEM SOLVING;

JOB COMPLETION; UTILITY FUNCTIONS;

SCHEDULING;

EID: 34548092059     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1272366.1272381     Document Type: Conference Paper

References (26)

1. Au Young, Alvin, Laura Grit, Janet Wiener and John Wilkes. "Service contracts and aggregate utility functions." 15th IEEE International Symposium on High Performance Distributed Computing, Paris, France, June 2006.
2. Brevik, John, Daniel Nurmi and Rich Wolski. "Predicting Bounds on Queueing Delay in Space-Shared Computing Environments." IEEE International Symposium on Workload Characterization, October, 2006.
3. Chun, Brent. N. Market-based Cluster Resource Management. PhD thesis. University of California, Berkeley. November 2001.
4. Chun, Brent N., Philip Buonadonna, Alvin Au Young, Chaki Ng, David C. Parkes, Jeffrey Shneidman, Alex C. Snoeren, and Amin Vahdat. "Mirage: A Microeconomic Resource Allocation System for Sensornet Testbeds," 2nd IEEE Workshop on Embedded Networked Sensors, May 2005.
5. Chun, Brent. N. and David E. Culler. "User-centric performance analysis of market-based cluster batch schedulers." 2nd IEEE International Symposium on Cluster Computing and the Grid, May 2002.
6. Chapin, Steve J., Walfredo Cirne, Dror G. Feitelson, James Patton Jones, Scott T. Leutenegger, Uwe Schwiegeishohn, Warren Smith, and David Talby. "Benchmarks and Standards for the Evaluation of Parallel Job Schedulers." In Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph eds. 1999.
7. Earheart, Travis and Nancy Wilkins-Diehr of SDSC provided the original workload to the Parallel Workloads Archive [6, 8] of Dror Feitelson et al. The specific Parallel Workoads Archive file version we used is SDSC-BLUE-2000-2.1- cln.swf.
8. Feitelson, Dror, et al. Parallel Workloads Archive and Standard Workload Format, http://www.cs.huji.ac.il/labs/parallel/workload/.
9. Feitelson, Dror G. and Larry Rudolph. "Toward convergence in job schedulers in parallel supercomputers," Proc. of the 2nd Workshop on Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph, eds. April 1996.
10. Feitelson, Dror G., Larry Rudolph, Uwe Schwiegelsohn, Kenneth C. Sevcik and Parkson Wong. "Theory and Practice in Parallel Job Scheduling." Proceedings of the 3rd Workshop on Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph, eds. 1997.
11. Irwin, David E., Laura E. Grit, Jeffrey S. Chase. "Balancing Risk and Reward in a Market-Based Task Service," 13th IEEE International Symposium on High Performance Distributed Computing, June 2004.
12. Lai, K. B. A. Huberman and L. Fine. "Tycoon: A Distributed Market-based Resource Allocation System. Technical Report." cs.DC/0404013, April 2004. Available at http://arxiv.org/abs/cs.DC/0404013
13. Lee, Cynthia Bailey and Allan Snavely. "On the UserScheduler Dialogue: Studies of User-Provided Runtime Estimates and Utility Functions." International Journal of High Performance Computing Applications, 2006.
14. Lee, Cynthia Bailey, Yael Schwartzman, Jennifer Hardy and Allan Snavely "Are user runtime estimates inherently inaccurate?" In 10th Job Scheduling Strategie s for Parallel Processing, June 2004.
15. Mu'alem, Ahuva W. and Dror G. Feitelson. "Utilization, Predictability, Workloads, and User Runtime Estimates in Scheduling the IBM SP2 with Backfilling," IEEE Trans. Parallel & Distributed Systems, 12(6). June 2001.
16. Norvig, Peter. Python code, available at http://aima.cs.berkeley.edu/ python/readme.html. Used according to terms of license. ©1998 - 2002.
17. Pfeiffer, Wayne. Personal Interview. San Diego Supercomputer Center, at the University of California, San Diego. La Jolla, CA. April 9, 2004.
18. Russell, Stuart and Peter Norvig. Artificial Intelligence: A Modern Approach, Prentice Hall Series in Artificial Intelligence. Englewood Cliffs, New Jersey. 1995.
19. Stoica, Ion, Hussein Abdel-Wahab and Alex Pothen. "A Microeconomic Scheduler for Parallel Computers," Proc. of the 1st Workshop on Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph, eds. April 1995.
20. Talby, David, Dror G. Feitelson and A. Raveh. "Comparing logs and models of parallel workloads using the coplot method." Proceedings of the 5th Workshop on Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph (Eds.), 1999.
21. Tsafrir, Dan and Dror G. Feitelson. "Instability in parallel job scheduling simulation: the role of workload flurries." IEEE International Parallel and Distributed Processing Symposium. Rhodes Island, Greece, April 2006.
22. Tsafrir, Dan and Dror G. Feitelson. "The dynamics of backfilling: solving the mystery of why increased inaccuracy may holy." IEEE International Symposium on Workload Characterization. October 2006.
23. Waldspurger, C. A., T. Hogg, B. A. Huberman, J. O. Kephart and S. Stornetta. "Spawn: A Distributed Computational Economy." IEEE Transactions on Software Engineering, 18(2). February 1992.
24. Weinberg, Jon and Allan Snavely. "Symbiotic Space-Sharing on SDSCs DataStar System." Proceedings of the 12th Workshop on Job Scheduling Strategies for Parallel Processing, E. Frachtenberg and U. Schwiegelshohn, eds. 2006.
25. Wolski, Rich, James Plank, John Brevik and Todd Bryan. "Analyzing Market-based Resource Allocation Strategies for the Computational Grid." The International Journal of High Performance Computing Applications, Vol. 15: 3. 2001.
26. Zotkin, Dmitry and Peter J. Keleher. "Job-length estimation and performance in backfilling schedulers." 8th High Performance Distributed Computing Conference. IEEE. 1999.