A self-organizing flock of Condors

Journal of Parallel and Distributed Computing

Volumn 66, Issue 1, 2006, Pages 145-161

  Butt, Ali R ^a,b,c   Zhang, Rongmei ^a   Hu, Y Charlie ^a,b  

^a PURDUE UNIVERSITY   (United States)

^b ACM   (United States)

^c IEEE   (United States)

Author keywords

Condor; Distributed resource discovery; Flocking; Peer to peer

Indexed keywords

CONDOR; DISTRIBUTED RESOURCE DISCOVERY; FLOCKING; PEER-TO-PEER;

COMPUTER NETWORKS; COMPUTER SIMULATION; COST EFFECTIVENESS; FAULT TOLERANT COMPUTER SYSTEMS; STRUCTURAL LOADS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 29244470241     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2005.06.022     Document Type: Article

References (54)

1. A. Bayucan, R.L. Henderson, C. Lesiak, B. Mann, T. Proett, D. Tweten, Portable batch system: external reference specification, Technical Report, MRJ Technology Solutions, 2672 Bayshore Parkway, Suite 810, Mountain View, CA 94043, 〈 http://pbs.mrj.com 〉 July 2005.
2. R. Butler, D. Engert, I. Foster, C. Kesselman, S. Tuecke, J. Volmer, and V. Welch A national-scale authentication infrastructure IEEE Comput. 33 12 2000 60 66
3. A.R. Butt, S. Adabala, N.H. Kapadia, R.J. Figueiredo, and J.A.B. Fortes Grid-computing portals and security issues J. Parallel Distrib. Comput.: Special issue Scalable Web Services Archit. 63 10 2003 1006 1014
4. A.R. Butt, R. Zhang, and Y.C. Hu A self-organizing flock of Condors Proceedings of the ACM/IEEE SC2003 Phoenix, AZ 2003
5. M. Castro, P. Druschel, Y.C. Hu, A. Rowstron, Exploiting network proximity in peer-to-peer overlay networks, Technical Report MSR-TR-2002-82, Microsoft Research, 2002.
6. M. Castro, P. Druschel, A.-M. Kermarrec, and A. Rowstron Scribe: a large-scale and decentralised application-level multicast infrastructure IEEE J. Selected Areas Commun. (JSAC) (Special issue Network Support Multicast Commun.) 20 8 2002 100 110
7. S. Chapin, D. Katramatos, J. Karpovish, and A. Grimshaw Resource management in legion Proceedings of the Fifth Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP'99) San Juan, Puerto Rico 1999
8. Condor Team, Condor Version 6.4.7 Manual, Technical Report, Computer Sciences Department, University of Wisconsin-Madison, Madison, WI, 2003.
9. Cray Research, NQE User's Guide, Technical Report 007-3794-001, Cray Research, 〈 http://www.cray.com/craydoc/20/manuals/2148_3.3/2148_3.3- manual.pdf 〉 July 2005.
10. F. Dabek, M.F. Kaashoek, D. Karger, R. Morris, and I. Stoica Wide-area cooperative storage with CFS Proceedings of the 18th ACM Symposium on Operating System Principles (SOSP'01) Chateau Lake Louise, Banff, Canada 2001 202 215
11. D.H.J. Epema, M. Livny, R. van Dantzig, X. Evers, and J. Pruyne A worldwide flock of Condors: load sharing among workstation clusters Future Generation Comput. Systems 12 1 1996 53 65
12. FIPS 180-1, Secure Hash Standard, Technical Report Publication 180-1, Federal Information Processing Standard (FIPS), NIST, US Department of Commerce, Washington DC, April 1995.
13. I. Foster, J. Geisler, B. Nickless, W. Smith, and S. Tuecke Software infrastructure for the I-WAY high-performance distributed computing experiment Proceedings of the Fifth IEEE Symposium on High Performance Distributed Computing (HPDC-5) Syracuse, NY 1996
14. I. Foster, N.T. Karonis, C. Kesselman, and S. Tuecke Managing security in high-performance distributed computations Cluster Comput.: J. Networks Software Tools Appl. 1 1 1998 95 107
15. I. Foster, and C. Kesselman Globus: a metacomputing infrastructure toolkit Internat. J. Supercomput. Appl. High Perform. Comput. 11 2 1997 115 128
16. I. Foster, C. Kesselman (Eds.), The GRID: Blueprint for a New Computing Infrastructure, Morgan Kaufmann Publishers, Los Altos, CA, 1999.
17. I. Foster, C. Kesselman, G. Tsudik, and S. Tuecke A security architecture for computational grids Proceedings of the Fifth ACM Conference on Computer and Communication Security (CCS 98) San Francisco, CA 1998 83 92
18. J. Frankel, T. Pepper, The Gnutella protocol specification v0.4 (2000), 〈 http://cs.ecs.baylor.edu/ ∼ donahoo/classes/4321/GNUTellaProtocolV0. 4Rev1.2.pdf 〉 July 2005.
19. Y. Fu, J. Chase, B. Chun, S. Schwab, A. Vahdat, SHARP: an architecture for secure resource peering, in: Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP'03), Bolton Landing, NY, 2003.
20. P. Ganesan, K. Gummadi, and H. Garcia-Molina Cannon in G major designing DHTs with hierarchical structure Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS'04) Tokyo, Japan 2004
21. Globus Team, The Globus Project, 〈 http://www.globus.org/ 〉 July 2005.
22. I. Goldberg, D. Wagner, R. Thomas, and E.A. Brewer A secure environment for untrusted helper applications confining the Wily Hacker Proceedings of the Sixth USENIX Security Symposium San Jose, CA 1996 1 13
23. L. Gong, M. Mueller, H. Prafullchandra, and R. Schemers Going beyond the sandbox: an overview of the new security architecture in the Java development kit 1.2 Proceedings of the USENIX Symposium on Internet Technologies and Systems (USITS'97) Monterey, CA 1997
24. Y.C. Hu, S.M. Das, and H. Pucha Exploiting the synergy between peer-to-peer and mobile ad hoc networks Proceedings of the Ninth Workshop on Hot Topics in Operating Systems (HotOS IX) Lihue, Hawaii 2003
25. A. Iamnitchi, I. Foster, D.C. Nurmi, A peer-to-peer approach to resource location in grid environments, in: Proceedings of the 11th Symposium on High Performance Distributed Computing, Avon Books, New York, 2002.
26. IBM Corporation, IBM Load Leveler: User's Guide, Technical Report SH26-7226_00, IBM Corporation, 1993.
27. S. Kenny, and B. Coghlan Towards a grid-wide intrusion detection system Proceedings of the European Grid Conference (EGC2005) Amsterdam, The Netherlands 2005
28. G.H. Kim, and E.H. Spafford The design and implementation of Tripwire a file system integrity checker Proceedings of the Second ACM Conference on Computer and Communications Security (CCS'94) Fairfax, VA 1994
29. M.J. Litzkow, M. Livny, and M.W. Mutka Condor - a hunter of idle workstations Proceedings of the Eighth International Conference on Distributed Computing Systems (ICDCS 1988) San Jose, CA 1988 104 111
30. M. Litzkow, and M. Solomon Supporting checkpointing and process migration outside the UNIX kernel USENIX Conference Proceedings San Francisco, CA 1992 283 290
31. M. Litzkow, T. Tannenbaum, J. Basney, M. Livny, Checkpoint and migration of UNIX processes in the condor distributed processing system, Technical Report 1346, Computer Sciences Department, University of Wisconsin, Madison, WI, 1997.
32. R. Mahajan, M. Castro, and A. Rowstron Controlling the cost of reliability in peer-to-peer overlays Proceedings of the Second International Workshop on Peer-to-Peer Systems (IPTPS'03) Berkeley, CA 2003
33. B.P. Miller, M. Christodorescu, R. Iverson, T. Kosar, A. Mirgorodskii, and F. Popovici Playing inside the black box: using dynamic instrumentation to create security holes Parallel Process. Lett. 11 2-3 2001 267 280
34. Napster, Napster file sharing tools, 〈 http://www.napster.com/ 〉 July 2005.
35. Pastry Project Team, FreePastry, 〈 http://freepastry.rice.edu/ FreePastry/ 〉 July 2005.
36. L. Peterson, T. Anderson, D. Culler, and T. Roscoe A blueprint for introducing disruptive technology into the internet Proceedings of the First ACM Workshop on Hot Topics in Networks (HotNets-I) Princeton, NJ 2002
37. R. Raman, M. Livny, and M. Solomon Matchmaking distributed resource management for high throughput computing Proceedings of the Seventh IEEE International Symposium on High Performance Distributed Computing (HPDC-7) Chicago, IL 1998 140 146
38. R. Raman, M. Livny, and M. Solomon Matchmaking: an extensible framework for distributed resource management Cluster Comput.: J. Networks Software Tools Appl. 2 2 1999 129 138
39. R. Raman, M. Livny, and M. Solomon Resource management through multilateral matchmaking Proceedings of the Ninth IEEE Symposium on High Performance Distributed Computing (HPDC-9) Pittsburgh, PA 2000 290 291
40. S. Ratnasamy, P. Francis, M. Handley, R. Karp, and S. Schenker A scalable content-addressable network Proceedings of the ACM SIGCOMM 2001 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM'01) San Diego, CA 2001 161 172
41. S. Rhea, D. Geels, T. Roscoe, and J. Kubiatowicz Handling churn in DHT Proceedings of the USENIX Annual Technical Conference (USENIX'04) Boston, MA 2004
42. M. Ripeanu, I. Foster, A decentralized, adaptive, replica location service, in: Proceedings of the 11th Symposium on High Performance Distributed Computing, 2002.
43. A. Rowstron, and P. Druschel Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility Proceedings of the 18th ACM Symposium on Operating System Principles (SOSP'01) Chateau Lake Louise, Banff, Canada 2001 188 201
44. A. Rowstron, and P. Druschel Pastry: scalable, decentralized object location, and routing for large-scale peer-to-peer systems Proceedings of the Middleware 2001 IFIP/ACM International Conference on Distributed Systems Platforms, Heidelberg, Germany 2001 329 350
45. Sharman Networks, Kazaa Media Desktop, 〈 http://www.kazaa.com/ 〉 July 2005.
46. D. Spence, and T. Harris XenoSearch distributed resource discovery in the XenoServer open platform Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing (HPDC'03) Seattle, WA 2003
47. I. Stoica, R. Morris, D. Karger, M.F. Kaashoek, and H. Balakrishnan Chord a scalable peer-to-peer lookup service for internet applications Proceedings of the ACM SIGCOMM 2001 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM'01) San Diego, CA 2001 149 160
48. V. Sunderam PVM: a framework for parallel distributed computing Concurrency: Practice Exp. 2 4 1990 315 339
49. J.B. Weissman Gallop: the benefits of wide-area computing for parallel processing J. Parallel Distrib. Comput. 54 2 1998 183 205
50. E. Zegura, K. Calvert, and S. Bhattacharjee How to model an internetwork Proceedings of the IEEE INFOCOM'96 - The Conference on Computer Communications San Francisco, CA 1996 594 602
51. R. Zhang, and Y.C. Hu Borg a hybrid protocol for scalable application-level multicast in peer-to-peer networks Proceedings of the 13th International Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV 2003) Monterey, CA 2003 172 179
52. B.Y. Zhao, J.D. Kubiatowicz, A.D. Joseph, Tapestry: an infrastructure for fault-resilient wide-area location and routing, Technical Report UCB//CSD-01-1141, University of California, Berkeley, CA, 2001.
53. S. Zhou LSF load sharing in large-scale heterogeneous distributed systems Proceedings of the Workshop on Cluster Computing Orlando, FL 1992
54. S.Q. Zhuang, B.Y. Zhao, A.D. Joseph, R.H. Katz, and J. Kubiatowicz Bayeux an architecture for scalable and fault-tolerant wide-area data dissemination Proceedings of the 11th International Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV 2001) Port Jefferson, NY 2001 11 20