Volley: Automated data placement for geo-distributed cloud services

Proceedings of NSDI 2010: 7th USENIX Symposium on Networked Systems Design and Implementation

Volumn , Issue , 2010, Pages 17-32

  Agarwal, Sharad ^a   Dunagan, John ^a   Jain, Navendu ^a   Saroiu, Stefan ^a   Wolman, Alec ^a   Bhogan, Harbinder ^b  

^a MICROSOFT RESEARCH   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

DISTRIBUTED DATABASE SYSTEMS; ITERATIVE METHODS; MESH GENERATION; SYSTEMS ANALYSIS; WEB SERVICES;

APPLICATION DATA; BUSINESS CONSTRAINTS; CAPACITY LIMIT; DATA ACCESS PATTERNS; DISTRIBUTED CLOUDS; INTER-DEPENDENCIES; ITERATIVE OPTIMIZATION ALGORITHMS; STATE OF THE ART;

LOCATION BASED SERVICES;

EID: 85076778745     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (45)

1. A. Adya, J. Dunagan, and A. Wolman. Centrifuge: Integrating Lease Management and Partitioning for Cloud Services. In NSDI, 2010.
2. Amazon Web Services. http://aws.amazon.com.
3. K. Amiri, D. Petrou, G. Ganger, and G. Gibson. Dynamic Function Placement for Data-intensive Cluster Computing. In USENIX Annual Technical Conference, 2000.
4. S. Arora, S. Rao, and U. Vazirani. Expander Flows, Geometric Embeddings and Graph Partitioning. In STOC, 2004.
5. R. Chaiken, B. Jenkins, P. Larson, B. Ramsey, D. Shakib, S. Weaver, and J. Zhou. SCOPE: Easy and efficient parallel processing of massive data sets. In VLDB, 2008.
6. M. Charikar and S. Guha. Improved Combinatorial Algorithms for the Facility Location and k-Median Problems. In FOCS, 1999.
7. M. Chen, E. Kiciman, E. Fratkin, A. Fox, and E. Brewer. Pinpoint: Problem Determination in Large, Dynamic Systems. In DSN, 2002.
8. F. Chudak and D. Williamson. Improved approximation algorithms for capacitated facility location problems. Mathematical Programming, 102(2):207-222, 2005.
9. F. Dabek, R. Cox, F. Kaashoek, and R. Morris. Vivaldi: A Decentralized Network Coordinate System. In SIGCOMM, 2004.
10. Data Center Global Expansion Trend. http://www.datacenterknowledge.com/ archives/2008/03/27/google-data-center-faq/.
11. J. Dean and S. Ghemawat. MapReduce: simplified data processing on large clusters. OSDI, 2004.
12. Facebook. http://www.facebook.com.
13. J. Flinn, S. Park, and M. Satyanarayanan. Balancing Performance, Energy, and Quality in Pervasive Computing. In ICDCS, 2002.
14. R. Fonseca, G. Porter, R. Katz, S. Shenker, and I. Stoica. X-Trace: A Pervasive Network Tracing Framework. In NSDI, 2007.
15. Global Air travel Trends. http://www.zinnov.com/presentation/ Global Aviation-Markets-An Ananlysis.pdf.
16. Google Apps. http://apps.google.com.
17. G. Hamlin Jr and J. Foley. Configurable applications for graphics employing satellites (CAGES). ACM SIG-GRAPH Computer Graphics, 9(1):9-19, 1975.
18. G. Hunt and M. Scott. The Coign Automatic Distributed Partitioning System. In OSDI, 1999.
19. S. Jamin, C. Jin, A. Kurc, D. Raz, and Y. Shavitt. Constrained Mirror Placement on the Internet. In INFOCOM, 2001.
20. E. Jul, H. Levy, N. Hutchinson, and A. Black. Fine-grained mobility in the Emerald system. ACM Transactions on Computer Systems, 6(1):109-133, 1966.
21. M. Karlsson and M. Mahalingam. Do We Need Replica Placement Algorithms in Content Delivery Networks? In International Workshop on Web Content Caching and Distribution (WCW), 2002.
22. D. Kimelman, V. Rajan, T. Roth, M. Wegman, B. Lindsey, H. Lindsey, and S. Thomas. Dynamic Application Partitioning in VisualAge Generator Version 3.0. Lecture Notes In Computer Science; Vol. 1543, pages 547-548, 1998.
23. N. Kothari, R. Gummadi, T. Millstein, and R. Govindan. Reliable and Efficient Programming Abstractions for Wireless Sensor Networks. In PLDI, 2007.
24. J. Leskovec and E. Horvitz. Planetary-Scale Views on an Instant-Messaging Network. In WWW, 2008.
25. M. Lewis and A. Grimshaw. The core Legion object model. In HPDC, 1996.
26. LinkedIn. http://linkedin.com.
27. H. Liu, T. Roeder, K. Walsh, R. Barr, and E. Sirer. Design and Implementation of a Single System Image Operating System for Ad Hoc Networks. In MobiSys, 2005.
28. Live Mesh. http://www.mesh.com.
29. Live Messenger. http://messenger.live.com.
30. B. Livshits and E. Kiciman. Doloto: Code Splitting for Network-bound Web 2.0 Applications. In SIGSOFT FSE, 2008.
31. J. Michel and A. van Dam. Experience with distributed processing on a host/satellite graphics system. ACM SIG-GRAPH Computer Graphics, 10(2):190-195, 1976.
32. Microsoft Office Online. http://office.microsoft.com/enus/office live/default.aspx.
33. R. Newton, S. Toledo, L. Girod, H. Balakrishnan, and S. Madden. Wishbone: Profile-based Partitioning for Sensornet Applications. In NSDI, 2009.
34. Quova IP Geo-Location Database. http://www.quova.com.
35. Rapid Release Cycles. http://www.ereleases.com/pr/20070716009.html.
36. S. Agarwal and J. Lorch. Matchmaking for Online Games and Other Latency-Sensitive P2P Systems. In SIGCOMM, 2009.
37. M. Shapiro, Y. Gourhant, S. Habert, L. Mosseri, and M. Ruffin. SOS: An object-oriented operating system-assessment and perspectives. Computing Systems, 1989.
38. M. Steen, P. Homburg, and A. Tanenbaum. Globe: A wide-area distributed system. IEEE Concurrency, pages 70-78, 1999.
39. C. Stewart, K. Shen, S. Dwarkadas, M. Scott, and J. Yin. Profile-driven component placement for cluster-based online services. IEEE Distributed Systems Online, 5(10):1-1, 2004.
40. Y. Su and J. Flinn. Slingshot: Deploying Stateful Services in Wireless Hotspots. In MobiSys, 2005.
41. M. Tatsubori, T. Sasaki, S. Chiba, and K. Itano. A byte-code translator for distributed execution of”legacy” java software. In ECOOP, pages 236-255. Springer-Verlag, 2001.
42. E. Tilevich and Y. Smaragdakis. J-orchestra: Automatic java application partitioning. In ECOOP, pages 178-204. Springer-Verlag, 2002.
43. Twitter. http://www.twitter.com.
44. F. Yang, J. Shanmugasundaram, M. Riedewald, and J. Gehrke. Hilda: A High-Level Language for DataDrivenWeb Applications. ICDE, 2006.
45. Y. Zhao, Y. Xie, F. Yu, Q. Ke, Y. Yu, Y. Chen, and E. Gillum. Botgraph: Large Scale Spamming Botnet Detection. In NSDI, 2009.