Decentralized scheduling and load balancing for parallel programs

Proceedings - 14th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2014

Volumn , Issue , 2014, Pages 324-333

  Jackson, Gary ^a   Keleher, Pete ^a   Sussman, Alan ^a  

^a University of Maryland   (United States)

Author keywords

decentralized; parallel computing; peer to peer; scheduling

Indexed keywords

GRID COMPUTING; PARALLEL ARCHITECTURES; PARALLEL PROCESSING SYSTEMS; SCHEDULING;

DECENTRALIZED; DECENTRALIZED ALGORITHMS; DECENTRALIZED SCHEDULING; DISTRIBUTED RESOURCES; PARALLEL COMPUTATION; PARALLEL JOB SCHEDULING; PEER TO PEER; PEER-TO-PEER ENVIRONMENTS;

CLUSTERING ALGORITHMS;

EID: 84904566439     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2014.44     Document Type: Conference Paper

References (21)

1. 2https://www.opensciencegrid.org
2. S. Ratnasamy, P. Francis, M. Handley, R. Karp, and S. Shenker, "A scalable content-addressable network," in SIGCOMM '01: Proceedings of the 2001 Conference on Applications, technologies, architectures, and protocols for computer communications. New York, NY, USA: ACM, 2001, pp. 161-172.
3. I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, and H. Bal-akrishnan, "Chord: A scalable peer-to-peer lookup service for Internet applications," in Proceedings of the ACM SIGCOMM '01 Conference, San Diego, California, August 2001.
4. A. I. T. Rowstron and P. Druschel, "Pastry: Scalable, decentralized object location, and routing for large-scale peer-to-peer systems," in Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms, ser. Middleware '01. London, UK: Springer-Verlag, 2001, pp. 329-350.
5. F. Dabek, R. Cox, F. Kaashoek, and R. Morris, "Vivaldi: a decentralized network coordinate system," in SIGCOMM '04: Proceedings of the 2004 Conference on Applications, technologies, architectures, and protocols for computer communications. New York, NY, USA: ACM, 2004, pp. 15-26.
6. S. Song, P. Keleher, B. Bhattacharjee, and A. Sussman, "Decentralized, accurate, and low-cost network bandwidth prediction," in Proceedings 2011 IEEE INFOCOM, April 2011, pp. 6-10.
7. J. Lee, P. Keleher, and A. Sussman, "Decentralized dynamic scheduling across heterogeneous multi-core desktop grids," in Proceedings of the 19th Internations Heterogeneity in Computing Workshop (HCW2010). IEEE Computer Society Press, Apr. 2010, appears with Workshop Proceedings of IPDPS 2010.
8. -, "Decentralized resource management for multi-core desktop grids," in Proceedings of the 24th International Parallel & Distributed Processing Symposium. IEEE Computer Society Press, Apr. 2010.
9. J.-S. Kim, B. Nam, P. Keleher, M. Marsh, B. Bhattacharjee, and A. Sussman, "Resource discovery techniques in distributed desktop grid environments," in GRID '06: Proceedings of the 7th IEEE/ACM International Conference on Grid Computing. Washington, DC, USA: IEEE Computer Society, 2006, pp. 9-16.
10. A. Weil, "Utilization and predictability in scheduling the ibm sp2 with backfilling," in Proceedings of the 12th. International Parallel Processing Symposium on International Parallel Processing Symposium, ser. IPPS '98. Washington, DC, USA: IEEE Computer Society, 1998, pp. 542-.
11. D. P. Anderson, "BOINC: A system for public-resource computing and storage," in GRID '04: Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing. Washington, DC, USA: IEEE Computer Society, 2004, pp. 4-10.
12. B. Bode, D. M. Halstead, R. Kendall, Z. Lei, and D. Jackson, "The Portable Batch Scheduler and the Maui scheduler on Linux clusters," in Proceedings of the 4th annual Linux Showcase & Conference-Volume 4. Berkeley, CA, USA: USENIX Association, 2000, pp. 27-27.
13. Adaptive Computing. Torque resource manager. [Online]. Available: http://www.clusterresources.com/products/torque-resource-manager.php
14. M. Litzkow, M. Livny, and M. Mutka, "Condor-a hunter of idle workstations," in Proceedings of the 8th International Conference on Distributed Computing Systems, June 1988.
15. J. Pruyne and M. Livny, "Providing resource management services to parallel applications," in Proceedings of the Second Workshop on Environments and Tools for Parallel Scientific Computing, Townsend, TN, May 1994.
16. J. Frey, T. Tannenbaum, M. Livny, I. Foster, and S. Tuecke, "Condor-G: A computation management agent for multi-institutional grids," in Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing, ser. HPDC '01. Washington, DC, USA: IEEE Computer Society, 2001, pp. 55-66.
17. J. Kolodziej and S. U. Khan, "Multi-level hierarchic genetic-based scheduling of independent jobs in dynamic heterogeneous grid environment," Inf. Sci., vol. 214, pp. 1-19, Dec. 2012.
18. Q. Wang, Y. Gao, and P. Liu, "Hill climbing-based decentralized job scheduling on computational grids," in Proceedings of the First International Multi-Symposiums on Computer and Computational Sciences-Volume 1 (IMSCCS'06)-Volume 01, ser. IMSCCS '06. Washington, DC, USA: IEEE Computer Society, 2006, pp. 705-708.
19. S. Fidanova and M. Durchova, "Ant algorithm for grid scheduling problem," in Proceedings of the 5th international conference on Large-Scale Scientific Computing, ser. LSSC'05. Berlin, Heidelberg: Springer-Verlag, 2006, pp. 405-412.
20. C. Fayad, J. Garibaldi, and D. Ouelhadj, "Fuzzy grid scheduling using tabu search," in IEEE International Fuzzy Systems Conference, 2007., July 2007, pp. 1-6.
21. H. Abbes, C. Cerin, and M. Jemni, "Bonjourgrid as a decentralised job scheduler," in Asia-Pacific Services Computing Conference, 2008. APSCC '08. IEEE, dec. 2008, pp. 89-94.