Design and implementation trade-offs for wide-area resource discovery

ACM Transactions on Internet Technology

Volumn 8, Issue 4, 2008, Pages

  Albrecht, Jeannie ^a   Oppenheimer, David ^b   Vahdat, Amin ^c   Patterson, David A ^d  

^a WILLIAMS COLLEGE   (United States)

^b GOOGLE INC   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

PlanetLab; Resource discovery

Indexed keywords

CENTRALIZED ARCHITECTURE; DECENTRALIZED DESIGN; DISTRIBUTED RESOURCE DISCOVERY; GEOGRAPHICALLY DISTRIBUTED RESOURCES; HIGHLY AVAILABLE; METRIC VALUES; NETWORK CHARACTERISTICS; PLANETLAB; PLANETLAB NODES; QUERY LATENCY; RESOURCE DISCOVERY; SELF-HEALING PROPERTIES; SERVER CLUSTERS; VOLATILE ENVIRONMENTS; WIDE-AREA; WIDE-AREA DISTRIBUTED SYSTEMS;

APPLICATIONS; COMMERCE; DESIGN; NETWORK PROTOCOLS; SENSOR NETWORKS; SERVERS;

ARCHITECTURAL DESIGN;

EID: 53949109600     PISSN: 15335399     EISSN: 15576051     Source Type: Journal    
DOI: 10.1145/1391949.1391952     Document Type: Article

References (66)

1. ALBRECHT, J., TUTTLE, C., SNOEREN, A. C., AND VAHDAT, A. 2006. PlanetLab application management using Plush. SIGOPS Oper. Syst. Rev. 40, 1, 33-40.
2. ASPNES, J., KIRSCH, J., AND KRISHNAMURTHY, A. 2004. Load balancing and locality in range-queriable data structures. In Proceedings of the Annual ACM SIGOPS Symposium on Principles of Distributed Computing (PODC).
3. ASPNES, J. AND SHAH, G. 2003. Skip graphs. In Proceedings of the Annual ACM-SIAM Symposium on Discrete Algorithms (SODA).
4. AUYOUNG, A., CHUN, B. N., SNOEREN, A. C., AND VAHDAT, A. 2004. Resource allocation in federated distributed computing infrastructures. In Proceedings of the Symposium on Reliable Infrastructures for XML (OASIS).
5. AWERBUCH, B. AND SCHEIDLER, C. 2003. Peer-to-Peer systems for prefix search. In Proceedings of the Annual ACM SIGOPS Symposium on Principles of Distributed Computing (PODC).
6. BALAZINSKA, M., BALAKRISHNAN, H., AND KARGER, D. 2002. INS/Twine: A scalable peer-to-peer architecture for intentional resource discovery. In Proceedings of the IEEE International Conference on Program Comprehension (ICPC).
7. BAVIER, A., BOWMAN, M., CHUN, B., CULLER, D., KARLIN, S., MUIR, S., PETERSON, L., ROSCOE, T., SPALINK, T., AND WAWRZONIAK, M. 2004. Operating systems support for planetary-scale network services. In Proceedings of the ACM Symposium on Networked Systems Design and Implementation (NSDI).
8. BHARAMBE, A., AGRAWAL, M., AND SESHAN, S. 2004. Mercury: Supporting scalable multi-attribute range queries. In Proceedings of the ACM SIGCOMM Data Communications Conference.
9. HANG, H., GOVINDAN, R., JAMIN, S., SHENKER, S., AND WILLINGER, W. 2002. Towards capturing representative AS-level Internet topologies. In Proceedings of the ACM Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS).
10. HAWATHE, Y., RAMABHADRAN, S., RATNASAMY, S., LAMARCA, A., SHENKER, S., AND HELLERSTEIN, J. 2005. A case study in building layered DHT applications. In Proceedings of the ACM SIGCOMM Data Communications Conference.
11. HEN, Y., BINDEL, D., SONG, H., AND KATZ, R. 2004. An algebraic approach to practical and scalable overlay network monitoring. In Proceedings of the ACM SIGCOMM Data Communications Conference.
12. HUN, B. 2008. Slicestat. http://berkeley.intel-research.net/bnc/ slicestat/.
13. ONSIDINE, J., BYERS, J., AND MAYER-PATEL, K. 2003. A constraint satisfication approach to testbed embedding services, hi Proceedings of the Workshop on Hot Topics in Network (HotNets).
14. RAINICEANU, A., LINGA, P., GEHRKE, J., AND SHANMUGASUNDARAM, J. 2004. Querying peer-to-peer networks using P-trees. In Proceedings of the International Workshop on Web and Databases (WebDB).
15. ZAJKOWSKI, K., FITZGERALD, S., FOSTER, I., AND KESSELMAN, C. 2001. Grid information services for distributed resource sharing. In Proceedings of the IEEE International Symposium on High Performance Distributed Computing (HPDC).
16. ZAJKOWSKI, K., FOSTER, I., KESSELMAN, C., SANDER, V., AND TUECKE, S. 2002. SNAP: A protocol for negotiating service level agreements and coordinating resource management in distributed systems. In Proceedings of the 8th Workshop on Job Scheduling Strategies for Parallel Processing. Lecture Notes in Computer Science, vol. 2537. Springer, 153-183.
17. ABEK, F., COX, R., KAAHOEK, F., AND MORRIS, R. 2004. Vivaldi: A decentralized network coordinate system. In Proceedings of the ACM SIGCOMM Data Communications Conference.
18. ABEK, F., ZHAO, B., DRUSCHEL, P., KUBIATOWICZ, J., AND STOICA, I. 2003. Towards a common API for structured P2P overlays. In Proceedings of the International Workshop on Peer-to-Peer Systems (IPTPS).
19. DNS 1987. Domain names-implementation and specification, http://www.ietf.org/rfc/rfc1035.txt.
20. OUCEUR, J. R. 2002. The Sybil attack. In Proceedings of the International Workshop on Peer-to-Peer Systems (IPTPS).
21. FERGUSON, D., NIKOLAOU, C., SAIRAMESH, J., AND YEMINI, Y. 1996. Economic Models for Allocating Resources in Computer Systems. World Scientific (Scott Clearwater, Ed.).
22. FOSTER, I. AND KESSELMAN, C. 2003. The Grid 2. Morgan Kaufmann.
23. FOSTER, I., KESSELMAN, C., AND TUECKE, S. 2001. The anatomy of the grid: Enabling scalable virtual organizations. Int. J. High Perform. Comput. Appl. 15, 3, 200-222.
24. FU, Y., CHASE, J., CHUN, B., SCHWAB, S., AND VAHDAT, A. 2003. SHARP: An architecture for secure resource peering. In Proceedings of the SIGOPS Symposium on Operating Systems Principles (SOSP).
25. GUPTA, A., AGRAWAL, D., AND ABBAD, A. E. 2003. Approximate range selection queries in peer-to-peer systems. In Proceedings of the Conference on Innovative Data Systems Research (CIDR).
26. HUANG, A. AND STEENKISTE, P. 2003. Network-Sensitive service discovery. In Proceedings of the USENLX Symposium on Internet Technologies and Systems (USITS).
27. HUEBSCH, R. 2004. PlaneTlab application manager, http://appmanager.berkeley.mtel-research.net/.
28. HUEBSCH, R., HELLERSTEIN, J. M., BOON, N. L., LOO, T., SHENKER, S., AND STOICA, I. 2003. Querying the Internet with PIER. In Proceedings of the International Conference on Very Large Databases (VLDB).
29. BARAKI, T. AND KATOH, N. 1988. Resource Allocation Problems: Algorithmic Approaches. MIT Press, Cambridge, MA.
30. JAGADISH, H. V. 1990. Linear clustering of objects with multiple attributes. In Proceedings of the ACM SIGMOD International Conference on Management of Data. JINI. 1998. Jini homepage, http://java.sun.com/products/ jini.
31. KARGER, D. AND RUHL, M. 2004. Simple efficient load balancing algorithms for peer-to-peer systems. In Proceedings of the International Workshop on Peer-to-Peer Systems (IPTPS).
32. KAZAA. 2001. Kazaa homepage, http://www.kazaa.com/us/index.htm.
33. KEE, Y.-S., LOGOTHETIS, D., HUANG, R., CASANOVA, H., AND CHIEN, A. 2005. Efficient resource description and high quality selection for virtual grids. In Proceedings of the IEEE International Symposium on Cluster Computing and the Gird (CCGrid).
34. KRISHNAMURTHY, B. AND WANG, J. 2000. On network-aware clustering of Web clients. In Proceedings of the ACM SIGCOMM Data Communications Conference.
35. LDAP 1997. LDAP homepage, http://www.ietf.org/rfc/rfc2251.txt.
36. I, J., STRIBLING, J., MORRIS, R., KAASHOEK, M. F., AND GIL, T. M. 2005. A performance vs. cost framework for evaluating DHT design tradeoffs under churn. In Proceedings of the Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM).
37. INUX VSERVER. 2003. VServer homepage, http://linux-vserver.org/.
38. ITZKOW, M., LIVNY, M., AND MUTKA, M. 1988. Condor-A hunter of idle workstations. In Proceedings of the IEEE International Conference on Distributed Computing Systems (ICDCS).
39. IU, C. AND FOSTER, I. 2004. A constraint language approach to matchmaking. In Proceedings of the IEEE International Workshop on Research Issues in Data Engineering (RIDE).
40. IU, C., YANG, L., FOSTER, I., AND ANGULO, D. 2002. Design and evaluation of a resource selection framework. In Proceedings of the International Symposium on High Performance Distributed Computing (HPDC).
41. ASSIE, M., CHUN, B., AND CULLER, D. 2004. The Ganglia distributed monitoring system: Design, implementation, and experience. Parallel Comput. 30, 7 (Jul.).
42. NATH, S., KE, Y., GIBBONS, P. B., KARP, B., AND SESHAN, S. 2003. IrisNet: An architecture for enabling sensor-enriched Internet services. Tech. Rep. IRP-TR-03-04, Intel Research, Pittsburgh, Pennsylvania. June.
43. NG, T. S. E. AND ZHANG, H. 2002. Predicting Internet network distance with coordinates-based approaches. In Proceedings of the Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM).
44. NG, T. S. E. AND ZHANG, H. 2004. A network positioning system for the Internet. In Proceedings of the USENIX Annual Technical Conference (USENIX ATC).
45. OPPENHEIMER, D., CHUN, B., PATTERSON, D., SNOEREN, A. C., AND VAHDAT, A. 2006. Service placement in shared wide-area platforms. In Proceedings of the USENIX Annual. Technical. Conference (USENLX ATC).
46. PAI, V. 2008. CoTop: A slice-based top for PlanetLab. http://codeen.cs.princeton.edu/cotop/.
47. PAI, V S., WANG, L., PARK, K., PANG, R., AND PETERSON, L. 2003. The dark side of the Web: An open proxy's view. In Proceedings of the Workshop on Hot Topics in Networks (HotNets).
48. RAMABHADRAN, S., RATNASAMY, S., HELLERSTEIN, J. M., AND SHENKER, S. 2004. Prefix hash tree. In Proceedings of the Annual ACM SIGOPS Symposium, on Principles of Distributed Computing (PODC).
49. RAMAN, R., LIVNY, M., AND SOLOMON, M. 1998. Matchmaking: Distributed resource management for high throughput computing. In Proceedings of the IEEE International Symposium on High Performance Distributed Computing (HPDC).
50. RAMAN, R., LIVNY, M., AND SOLOMON, M. 2003. Policy driven heterogeneous resource co-allocation with gangmatching. In Proceedings of the IEEE International Symposium on High Performance Distributed Computing (HPDC).
51. RATNASAMY, S., FRANCIS, P., HANDLEY, M., KARP, R., AND SHENKER, S. 2001. A content addressable network. In Proceedings of the ACM SIGCOMM Data Communications Conference.
52. RED HERRING MAGAZINE. 2004. Distributed computing: We come in peace. Red Herring Mag. (Aug.).
53. REYNOLDS, P. AND VAHDAT, A. 2003. Efficient peer-to-peer keyword searching. In Proceedings of the ACM/IFIP/USENIX International Middleware Conference.
54. RHEA, S., CHUN, B.-G., KUBIATOWICZ, J., AND SHENKER, S. 2005. Fixing the embarrassing slowness of OpenDHT on PlanetLab. In Proceedings of the Conference on Real, Large Distributed Systems (WORLDS).
55. RHEA, S., GEELS, D., ROSCOE, T., AND KUBIATOWICZ, J. 2004. Handling churn in a DHT. In Proceedings of the USENIX Annual Technical Conference (USENIX ATC).
56. RHEA, S., GODFREY, B., KARP, B., KUBIATOWICZ, J., RATNASAMY, S., SHENKER, S., STOICA, I., AND YU, H. 2005. OpenDHT: A public DHT service and its uses. In Proceedings of the ACM SIGCOMM Data Communications Conference.
57. SLP. 1987. SLP. http://www.ietf.org/rfc/rfc2165.txt.
58. SPENCE, D. AND HARRIS, T. 2003. XenoSearch: Distributed resource discovery in the XenoServer open platform. In Proceedings of the IEEE International Symposium, on High Performance Distributed Computing (HPDC).
59. STOICA, I., MORRIS, R., KARGER, D., KAASHOEK, M. F., AND BALAKRISHNAN, H. 2001. Chord: A scalable peer-to-peer lookup service for Internet applications. In Proceedings of the ACM SIGCOMM Data Communications Conference.
60. TANG, C. AND DWARKADAS, S. 2004. Hybrid global-local indexing for efficient peer-to-peer information retrieval. In Proceedings of the ACM Symposium on Networked Systems Design and Implementation (NSDI).
61. TANG, C., XU, Z., AND MAHALINGAM, M. 2003. pSearch: Information retrieval in structured overlays. ACM SIGCOMM Comput. Commun. Rev. 33, 1, 89-94.
62. AHDAT, A., YOCUM, K., WALSH, K., MAHADEVAN, P., KOSTIĆ, D., CHASE, J., AND BECKER, D. 2002. Scalability and accuracy in a large-scale network emulator. In Proceedings of the ACM USENIX Symposium on Operating Systems Design and Implementation (OSDI).
63. AN RENESSE, R., BIRMAN, K., AND VOGELS, W. 2003. Astrolabe: A robust and scalable technology for distributed system monitoring, management, and data mining. ACM Trans. Comput. Syst. 21, 2, 164-206.
64. WAWRZONIAK, M., PETERSON, L., AND ROSCOE, T. 2003. Sophia: An information plane for networked systems. In Proceedings of the Workshop on Hot Topics in Networking (HotNets).
65. WHITE, B., LEPREAU, J., STOLLER, L., RICCI, R., GURUPRASAD, S., NEWBOLD, M., HIBLER, M., BARB, C., AND JOGLEKAR, A. 2002. An integrated experimental environment for distributed systems and networks. In Proceedings of the ACM USENIX Symposium on Operating Systems Design and Implementation (OSDI).
66. ZHANG, X. AND SCHOPF, J. 2004. Performance Analysis of the Globus toolkit monitoring and discovery service, MDS2. In Proceedings of the International Workshop on Middleware Performance (MP).