Understanding and mitigating the impact of load imbalance in the memory caching tier

Proceedings of the 4th Annual Symposium on Cloud Computing, SoCC 2013

Volumn , Issue , 2013, Pages

  Hong, Yu Ju ^a   Thottethodi, Mithuna ^a  

^a PURDUE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLOUD COMPUTING;

BASIC MECHANISM; CONSISTENCY MODEL; DESIGN AND IMPLEMENTS; DISTRIBUTED MEMORY; LOAD IMBALANCE; MEMORY CACHING; PERFORMANCE IMPROVEMENTS; STORAGE LAYERS;

MEMORY ARCHITECTURE;

EID: 84893337055     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2523616.2525970     Document Type: Conference Paper

References (39)

1. S. V. Adve and K. Gharachorloo. Shared memory consistency models: A tutorial. Computer, 29(12): 66-76, Dec. 1996.
2. B. Atikoglu, Y. Xu, E. Frachtenberg, S. Jiang, and M. Paleczny. Workload analysis of a large-scale key-value store. In Proceedings of the 12th ACM SIGMETRICS/PERFORMANCE joint international conference on Measurement and Modeling of Computer Systems, pages 53-64, 2012.
3. G. Barish and K. Obraczka. World wide web caching: Trends and techniques. IEEE Communications Magazine, 38: 178-184, 2000.
4. M. Cha, H. Kwak, P. Rodriguez, Y.-Y. Ahn, and S. Moon. I tube, you tube, everybody tubes: analyzing the world's largest user generated content video system. In Proceedings of the 7th ACM SIGCOMM conference on Internet measurement, IMC'07, pages 1-14, New York, NY, USA, 2007. ACM.
5. B. F. Cooper, R. Ramakrishnan, U. Srivastava, A. Silberstein, P. Bohannon, H.-A. Jacobsen, N. Puz, D. Weaver, and R. Yerneni. PNUTS: Yahoo!'s hosted data serving platform. Proc. VLDB, 1(2): 1277-1288, Aug. 2008.
6. B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with ycsb. In Proceedings of the 1st ACM symposium on Cloud computing, pages 143-154, 2010.
7. J. C. Corbett, J. Dean, et al. Spanner: Google's globally-distributed database. In Proceedings of the 10th USENIX conference on Operating Systems Design and Implementation, OSDI'12, pages 251-264. USENIX Association, 2012.
8. Couchbase: a NoSQL database. http://www.couchbase.com.
9. F. Dabek, M. F. Kaashoek, D. Karger, R. Morris, and I. Stoica. Wide-area cooperative storage with cfs. In Proceedings of the eighteenth ACM symposium on Operating systems principles, SOSP'01, pages 202-215. ACM, 2001.
10. B. Debnath, S. Sengupta, and J. Li. SkimpyStash: RAM space skimpy key-value store on flash-based storage. In Proceedings of the 2011 ACM SIGMOD International Conference on Management of data, pages 25-36, 2011.
11. B. Fan, H. Lim, D. G. Andersen, and M. Kaminsky. Small cache, big effect: provable load balancing for randomly partitioned cluster services. In Proceedings of the 2nd ACM Symposium on Cloud Computing, pages 23:1-23:12, 2011.
12. Facebook's nsdi'13 presentation. https://www.usenix.org/conference/ nsdi13/scaling-memcache-facebook.
13. B. Fitzpatrick. Distributed caching with memcached. Linux Journal, (124), Aug. 2004.
14. S. Gilbert and N. Lynch. Brewer's conjecture and the feasibility of consistent, available, partition-tolerant web services. SIGACT News, 33(2): 51-59, June 2002.
15. Gumstix Overo Earth COM. http://www.gumstix.com/store/product-info.php? products-id=211.
16. Gumstix Stagecoach expansion board. https://www.gumstix.com/store/ product-info.php?products-id=247.
17. M. P. Herlihy and J. M. Wing. Linearizability: a correctness condition for concurrent objects. ACM Trans. Program. Lang. Syst., 12(3): 463-492, July 1990.
18. D. Karger, E. Lehman, T. Leighton, R. Panigrahy, M. Levine, and D. Lewin. Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the World Wide Web. In Proceedings of the twenty-ninth annual ACM symposium on Theory of computing, pages 654-663, 1997.
19. D. R. Karger and M. Ruhl. Diminished chord: a protocol for heterogeneous subgroup formation in peer-to-peer networks. In Proceedings of the Third international conference on Peer-to-Peer Systems, IPTPS'04, pages 288-297. Springer-Verlag, 2004.
20. libketama: a consistent hashing algorithm for Memcached clients. http://github.com/RJ/ketama.
21. S. Kumar. HPCA/PPoPP 2012 Keynote Talk. http://www.ece.lsu.edu/hpca-18/ files/HPCA2012-Facebook-Keynote.pdf.
22. L. Lamport. How to make a multiprocessor computer that correctly executes multiprocess programs. IEEE Trans. Comput., 28(9): 690-691, Sept. 1979.
23. C. Li, D. Porto, A. Clement, J. Gehrke, N. Preguiça, and R. Rodrigues. Making geo-replicated systems fast as possible, consistent when necessary. In Proceedings of the 10th USENIX conference on Operating Systems Design and Implementation, OSDI'12, pages 265-278. USENIX Association, 2012.
24. W. Lloyd, M. J. Freedman, M. Kaminsky, and D. G. Andersen. Don't settle for eventual: scalable causal consistency for wide-area storage with COPS. In Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles, SOSP'11, pages 401-416, 2011.
25. N. Megiddo and D. S. Modha. Arc: A self-tuning, low overhead replacement cache. In Proceedings of the 2nd USENIX Conference on File and Storage Technologies, FAST'03, pages 115-130. USENIX Association, 2003.
26. A version of YCSB which supports Memcached operations. https://github.com/mikewied/Memcached-Java-Load-Client.
27. libemcached: A C and C++ client library for Memcached. https://code.launchpad.net/libmemcached.
28. Memcached: distributed memory object caching system. http://memcached. org.
29. J. V. D. Merwe, S. Sen, and C. Kalmanek. Streaming video traffic: Characterization and network impact. In In Proc. of International Web Content Caching and Distribution Workshop, 2002.
30. S. Michel, K. Nguyen, A. Rosenstein, L. Zhang, S. Floyd, and V. Jacobson. Adaptive web caching: towards a new global caching architecture. Comput. Netw. ISDN Syst., 30(22-23): 2169-2177, Nov. 1998.
31. R. Nishtala, H. Fugal, et al. Scaling memcache at facebook. In Proceedings of the 10th USENIX conference on Networked Systems Design and Implementation, nsdi'13, pages 385-398. USENIX Association, 2013.
32. K. Petersen, M. J. Spreitzer, D. B. Terry, M. M. Theimer, and A. J. Demers. Flexible update propagation for weakly consistent replication. In Proceedings of the sixteenth ACM symposium on Operating systems principles, pages 288-301, 1997.
33. A. Rowstron and P. Druschel. Storage management and caching in past, a large-scale, persistent peer-to-peer storage utility. In Proceedings of the eighteenth ACM symposium on Operating systems principles, SOSP'01, pages 188-201. ACM, 2001.
34. N. Sharma, S. Barker, D. Irwin, and P. Shenoy. Blink: managing server clusters on intermittent power. In Proceedings of the sixteenth international conference on Architectural support for programming languages and operating systems, pages 185-198, 2011.
35. Spymemcached: A Java client for Memcached. http://code.google.com/p/ spymemcached.
36. I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, and H. Balakrishnan. Chord: A scalable peer-to-peer lookup service for internet applications. In Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, SIGCOMM'01, pages 149-160. ACM, 2001.
37. J. Terrace and M. J. Freedman. Object storage on CRAQ: high-throughput chain replication for read-mostly workloads. In Proceedings of the 2009 conference on USENIX Annual technical conference, pages 11-11, 2009.
38. G. Urdaneta, G. Pierre, and M. van Steen. Wikipedia workload analysis for decentralized hosting. Comput. Netw., 53(11): 1830-1845, July 2009.
39. J. Wang. A survey of web caching schemes for the internet. SIGCOMM Comput. Commun. Rev., 29(5): 36-46, Oct. 1999.