Characterizing load imbalance in real-world networked caches

Proceedings of the 13th ACM Workshop on Hot Topics in Networks, HotNets 2014

Volumn , Issue , 2014, Pages

  Huang, Qi ^a,b   Gudmundsdottir, Helga ^c,d   Vigfusson, Ymir ^c,d   Freedman, Daniel A ^e   Birman, Ken ^a   Van Renesse, Robbert ^a  

^a Department of Molecular Biology and Genetics   (United States)

^b FACEBOOK   (United States)

^c EMORY UNIVERSITY   (United States)

^d REYKJAVIK UNIVERSITY   (Iceland)

^e TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Caching; Load Balancing; Networking

Indexed keywords

DIGITAL STORAGE; RESOURCE ALLOCATION;

BACK-END SERVERS; CACHE SERVERS; CACHING; CONSISTENT HASHING; HASHING FUNCTIONS; LOAD IMBALANCE; NETWORKING; TEMPORAL EFFECTS;

WEB SERVICES;

EID: 84914696634     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2670518.2673882     Document Type: Conference Paper

References (15)

1. N. Bronson, Z. Amsden, G. Cabrera, P. Chakka, P. Dimov, H. Ding, J. Ferris, A. Giardullo, S. Kulkarni, H. Li, M. Marchukov, D. Petrov, L. Puzar, Y. J. Song, and V. Venkataramani. Tao: Facebook's Distributed Data Store for the Social Graph. In Proc. of the 2013 USENIX Annual Technical Conference (ATC '13), pages 49-60, San Jose, CA, USA, 2013.
2. G. Cormode and M. Hadjieleftheriou. Methods for Finding Frequent Items in Data Streams. The VLDB Journal, 19(1):3-20, February 2010.
3. F. Dabek, M. F. Kaashoek, D. Karger, R. Morris, and I. Stoica. Wide-area Cooperative Storage with CFS. In Proc. of the 18th ACM Symposium on Operating Systems Principles (SOSP '01), pages 202-215, Banff, Alberta, Canada, 2001.
4. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: Amazon's Highly Available Key-value Store. In Proc. of 21st ACM SIGOPS Symposium on Operating Systems Principles (SOSP '07), pages 205-220, Stevenson, WA, USA, 2007.
5. B. Fan, H. Lim, D. G. Andersen, and M. Kaminsky. Small Cache, Big Efiect: Provable Load Balancing for Randomly Partitioned Cluster Services. In Proc. of the 2nd ACM Symposium on Cloud Computing (SOCC '11), pages 23:1-23:12, Cascais, Portugal, 2011.
6. Y.-J. Hong and M. Thottethodi. Understanding and Mitigating the Impact of Load Imbalance in the Memory Caching Tier. In Proc. of the 4th ACM Symposium on Cloud Computing (SOCC '13), pages 13:1-13:17, Santa Clara, CA, USA, 2013.
7. Q. Huang, K. Birman, R. van Renesse, W. Lloyd, S. Kumar, and H. C. Li. An analysis of Facebook photo caching. In Proc. of the 24th ACM Symposium on Operating Systems Principles (SOSP '13), pages 167-181, Farminton, PA, USA, 2013.
8. J. Hwang and T. Wood. Adaptive Performance-Aware Distributed Memory Caching. In Proc. of the 10th International Conference on Autonomic Computing (ICAC '13), pages 33-43, San Jose, CA, USA, 2013.
9. R. James. libketama: a consistent hashing algo for memcache clients. http://github.com/RJ/ketama (accessed on 2014/07/15), April 2007.
10. D. Karger, E. Lehman, T. Leighton, R. Panigrahy, M. Levine, and D. Lewin. Consistent Hashing and Random Trees: Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web. In Proc. of the 29th Annual ACM Symposium on Theory of Computing (STOC '97), pages 654-663, El Paso, TX, USA, 1997.
11. D. Karger, A. Sherman, A. Berkheimer, B. Bogstad, R. Dhanidina, K. Iwamoto, B. Kim, L. Matkins, and Y. Yerushalmi. Web Caching with Consistent Hashing. In Proc. of the 8th International World Wide Web Conference (WWW '99), pages 1203-1213, Toronto, Ontario, Canada, 1999.
12. A. Likhtarov, R. Nishtala, R. McElroy, H. Fugal, A. Grynenko, and V. Venkataramani. Introducing mcrouter: A memcached protocol router for scaling memcached deployments. http://tinyurl.com/n5t338j, September 2014.
13. R. Nishtala, H. Fugal, S. Grimm, M. Kwiatkowski, H. Lee, H. C. Li, R. McElroy, M. Paleczny, D. Peek, P. Saab, D. Stafford, T. Tung, and V. Venkataramani. Scaling Memcache at Facebook. In Proc. of the 10th USENIX Conference on Networked Systems Design and Implementation (NSDI '13), pages 385-398, Lombard, IL, USA, 2013.
14. X. Wang and D. Loguinov. Load-balancing Performance of Consistent Hashing: Asymptotic Analysis of Random Node Join. IEEE/ACM Transactions on Networking, 15 (4):892-905, August 2007.
15. T. Zhu, A. Gandhi, M. Harchol-Balter, and M. A. Kozuch. Saving Cash by Using Less Cache. In Proc. of the 4th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud '12), Boston, MA, USA, 2012.