Resource management for rapid application turnaround on enterprise desktop grids

IEEE/ACM SC2004 Conference, Proceedings

Volumn , Issue , 2004, Pages 499-512

  Kondo, Derrick ^a   Chien, Andrew A ^a   Casanova, Henri ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

GRID CONFIGURATIONS; RESOURCE MANAGEMENT; SCHEDULING HEURISTICS; TRACE-DRIVEN SIMULATIONS;

CLOCKS; COMPUTER SIMULATION; HEURISTIC METHODS; INTELLIGENT AGENTS; RESOURCE ALLOCATION; SCHEDULING; THROUGHPUT;

PERSONAL COMPUTERS;

EID: 23944497298     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (48)

1. A. Acharya, G. Edjlali, and J. Saltz. The Utility of Exploiting Idle Workstations for Parallel Computation. In Proceedings of the 1997 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, pages 225-234, 1997.
2. A. D. Alexandrov, M. Ibel, K. E. Schauser, and C.J. Scheiman. SuperWeb: Towards a Global Web-Based Parallel Computing Infrastructure. In Proc. of the 11th IEEE International Parallel Processing Symposium (IPPS), April 1997.
3. R.H. Arpaci, A.C. Dusseau, A.M. Vahdat, L.T. Liu, T.E. Anderson, and D.A." Patterson. The Interaction of Parallel and Sequential Workloads on a Network of Workstations. In Proceedings of SIGMETRICS'95, pages 267-278, May 1995.
4. A. Barak, S. Guday, and Wheeler R. The MOSIX Distributed Operating System, Load Balancing for UNIX, volume 672 of Lecture Notes in Computer Science. Springer-Verlag, 1993.
5. A. Baratloo, M. Karaul, Z. Kedem, and P. Wyckoff. Charlotte: Metacomputing on the Web. In Proc. of the 9th International Conference on Parallel and Distributed Computing Systems (PDCS-96), 1996.
6. A. Bestavros. Load Profiling In Distributed Real-Time Systems. In The 17th International Conference on Distributed Computer Systems, May 1997.
7. R. Bhagwan, S. Savage, and G. Voelker. Understanding Availability. In In Proceedings of IPTPS'03, 2003.
8. W. Bolosky, J. Douceur, D. Ely, and M. Theimer. Feasibility of a Serverless Distributed file System Deployed on an Existing Set of Desktop PCs. In Proceedings of SIGMETRICS, 2000.
9. N. Camiel, S. London, N. Nisan, and O. Regev. The PopCorn Project: Distributed Computation over the Internet in Java. In Proc. of the 6th International World Wide Web Conference, April 1997.
10. The Compute Against Cancer project, http:// www.computeagainstcancer.org/.
11. P. Cappello, B. Christiansen, M. Ionescu, M. Neary, K. Schauser, and D. Wu. Javelin: Internet-Based Parallel Computing Using Java. In Proceedings of the Sixth ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 1997.
12. H. Casanova, A. Legrand, D. Zagorodnov, and F. Berman. Heuristics for Scheduling Parameter Sweep Applications in Grid Environments. In Proceedings of the 9th Heterogeneous Computing Workshop (HCW'00), pages 349-363, May 2000.
13. A. Chien, B. Calder, S. Elbert, and K. Bhatia. Entropia: Architecture and Performance of an Enterprise Desktop Grid System. Journal of Parallel and Distributed Computing, 63:597-610, 2003.
14. J. Chu, K. Labonte, and B. Levine. Availability and locality measurements of peer-to-peer file systems. In Proceedings of ITCom: Scalability and Traffic Control in IP Networks, July 2003.
15. P. Dinda. The Statistical Properties of Host Load. Scientific Programming, 7(3-4), 1999.
16. P. Dinda. A Prediction-Based Real-Time Scheduling Advisor. In Proceedings of the International Parallel and Distributed Processing Symposium (IPDPS'02), April 2002.
17. P. Dinda. Online Prediction of the Running Time of Tasks. Cluster Computing, 5(3):225-236, July 2002.
18. Entropia, Inc. http://www.entropia.com.
19. G. Fedak, C. Germain, V. N'eri, and F. Cappello. XtremWeb: A Generic Global Computing System. In Proceedings of the IEEE International Symposium on Cluster Computing and the Grid (CCGRID'01), May 2001.
20. The Fight Aids At Home project, http://www. fightaidsathome.org/.
21. The Berkeley Open Infrastructure for Network Computing, http://boinc.berkeley.edu/.
22. James Frey, Todd Tannenbaum, Miron Livny, Ian Foster, and Steven Tuecke. Condor-g: A computation management agent for multi-institutional grids. Cluster Computing, 5(3):237-246, 2002.
23. D. Ghormley, D. Petrou, S. Rodrigues, A. Vahdat, and T. Anderson. GLUnix: a Global Layer Unix for a Network of Workstations. Software-Practice and Experience, 28(9), July 1998.
24. The great internet mersene prime search (gimps). http://www.mersenne.org/.
25. S.A. Hupp. The "Worm" Programs - Early Experience with Distributed Computation. Communications of the ACM, 3(25), 1982.
26. D. Kondo and H. Casanova. Computing the Optimal Makespan for Jobs with Identical and Independent Tasks Scheduled on Volatile Hosts. Technical Report CS2004-0796, Dept. of Computer Science and Engineering, University of California at San Diego, July 2004.
27. D. Kondo, M. Taufer, C. Brooks, H. Casanova, and A. Chien. Characterizing and Evaluating Desktop Grids: An Empirical Study. In Proceedings of the International Parallel and Distributed Processing Symposium (IPDPS'04), April 2004.
28. M. Litzkow, M. Livny, and M. Mutka. Condor - A Hunter of Idle Workstations. In Proceedings of the 8th International Conference of Distributed Computing Systems (ICDCS), 1988.
29. O. Lodygensky, G. Fedak, V. Neri, F. Cappello, D. Thain, and M. Livny. XtremWeb and Condor: Sharing Resources Between Internet Connected Condor Pool. In Proceedings of the IEEE International Symposium on Cluster Computing and the Grid (CCGRID'03) Workshop on Global Computing on Personal Devices, May 2003.
30. Maui Scheduler. http://www. supercluster.org/maui.
31. M. Mutka and M. Livny. The available capacity of a privately owned workstation environment. Performance Evaluation, 4(12), July 1991.
32. J. Nabrzyski, J. Schopf, and J. Weglarz, editors. Grid Resource Management, chapter 26. Kluwer Press, 2003.
33. Andy Oram, editor. Peer-To-Peer: Harnessing the Power of Disruptive Technologies. O'Reilly & Associates, Inc., Sebastopol, CA, USA, 2001.
34. The Portable Batch System Webpage. http:// www.openpbs.com.
35. J. Pedroso, L.M. Silva, and J.G. Silva. Web-based metacomputing with JET. In Proc. of the ACM PPoPP Workshop on Java for Science and Engineering Computation, June 1997.
36. Platform Computing Inc. http://www. platform.com/.
37. J. Pruyne and M. Livny. A Worldwide Flock of Condors : Load Sharing among Workstation Clusters. Journal on Future Generations of Computer Systems, 12, 1996.
38. L. Sarmenta and S. Hirano. Bayanihan: Building and Studying Web-Based Volunteer Computing Systems Using Java. Future Generation Computer Systems, 15(5-6):675-686, 1999.
39. S. Saroiu, P.K. Gummadi, and S.D. Gribble. A measurement study of peer-to-peer file sharing systems. In Proceeding of MMCN, January 2002.
40. The seti@home project. http://setiathome. ssl.berkeley.edu/.
41. M.R. Shirts and V.S. Pande. Screen Savers of the World, Unite! Science, 290:1903-1904, 2000.
42. S. Smallen, H. Casanova, and F. Berman. Tunable On-line Parallel Tomography. In Proceedings of SuperComputing'01, Denver, Colorado, Nov. 2001.
43. W. T. Sullivan, D. Werthimer, S. Bowyer, J. Cobb, G. Gedye, and D. Anderson. A new major SETI project based on Project Serendip data and 100,000 personal computers. In Proc. of the Fifth Intl. Conf. on Bioastronomy, 1997.
44. DataSynapse Inc. http://www. datasynapse.com/.
45. United Devices Inc. http://www.ud.com/.
46. Vijay Pande. Private communication, 2004.
47. R. Wolski, N. Spring, and J. Hayes. Predicting the CPU Availability of Time-shared Unix Systems. In Peoceedings of 8th IEEE High Performance Distributed Computing Conference (HPDC8), August 1999.
48. P. Wyckoff, T. Johnson, and K. Jeong. Finding Idle Periods on Networks of Workstations. Technical Report CS761, Dept of Computer Science, New York University, March 1998.