Workload analysis of a large-scale key-value store

Performance Evaluation Review

Volumn 40, Issue 1 SPEC. ISS., 2012, Pages 53-64

  Atikoglu, Berk ^a   Xu, Yuehai ^a   Frachtenberg, Eitan ^a   Jiang, Song ^b   Paleczny, Mike ^a  

^a FACEBOOK   (United States)

^b Facebook ^*  (United States)

Author keywords

key value store; memcached; workload analysis; workload modeling

Indexed keywords

FACEBOOK; HIT RATE; KEY-VALUE STORE; MEMCACHED; PERSISTENT STORAGE; RESEARCH COMMUNITIES; SOCIAL NETWORKS; SYNTHETIC WORKLOADS; TEMPORAL PATTERN; WORKLOAD ANALYSIS; WORKLOAD MODELING;

COMPUTER SYSTEMS; INDUSTRY; RETAIL STORES;

SOCIAL NETWORKING (ONLINE);

EID: 84864688266     PISSN: 01635999     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2254756.2254766     Document Type: Conference Paper

References (31)

1. http://voldemort-project.com.
2. AHMAD, I. Easy and efficient disk I/O workload characterization in VMware ESX server. In Proceedings of IEEE International Symposium on Workload Characterization (Sept. 2007).
3. ANAND, A., MUTHUKRISHNAN, C., KAPPES, S., AKELLA, A., AND NATH, S. Cheap and large CAMs for high performance data-intensive networked systems. In Proceedings of the 7th USENIX conference on Networked Systems Design and Implementation (Apr. 2010).
4. ANDERSEN, D. G., FRANKLIN, J., KAMINSKY, M., PHANISHAYEE, A., TAN, L., AND VASUDEVAN, V. FAWN: a fast array of wimpy nodes. In Proceedings of the 22nd ACM SIGOPS Symposium on Operating Systems Principles (SOSP) (Big Sky, Montana, 2009), ACM, pp. 1-14.
5. ARLITT, M., FRIEDRICH, R., AND JIN, T. Workload characterization of a web proxy in a cable modem environment. ACM SIGMETRICS - Performance Evaluation Review 27 (1999), 25-36.
6. ARLITT, M. F., AND WILLIAMSON, C. L. Internet web servers: Workload characterization and performance implications. IEEE/ACM Transactions on Networking 5 (October 1997), 631-645.
7. BARFORD, P., BESTAVROS, A., BRADLEY, A., AND CROVELLA, M. Changes in web client access patterns. In World Wide Web Journal, Special Issue on Characterization and Performance Evaluation (1999).
8. BEAVER, D., KUMAR, S., LI, H. C., SOBEL, J., AND VAJGEL, P. Finding a needle in haystack: Facebook's photo storage. In Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation (Oct. 2010).
9. BEREZECKI, M., FRACHTENBERG, E., PALECZNY, M., AND STEELE, K. Many-core key-value store. In Proceedings of the Second International Green Computing Conference (Orlando, FL, Aug. 2011).
10. BRESLAU, L., CAO, P., FAN, L., PHILLIPS, G., AND SHENKER, S. Web caching and zipf-like distributions: Evidence and implications. In Proceedings of the 18th Annual IEEE International Conference on Computer Communications (1999).
11. CARNS, P., LATHAM, R., ROSS, R., KAMIL ISKRA, S. L., AND RILEY, K. 24/7 characterization of petascale I/O workloads. In Proceedings of the 4th Workshop on Interfaces and Architectures for Scientific Data Storage (Nov. 2009).
12. CUNHA, C. R., BESTAVROS, A., AND CROVELLA, M. E. Characteristics of WWW client-based traces. In Technical Report TR-95-010, Boston University Department of Computer Science, (July 1995).
13. DEBNATH, B. K., SENGUPTA, S., AND LI, J. Flashstore: High throughput persistent key-value store. Proceedings of 36th International Conference on Very Large Data Bases (VLDB) 3, 2 (2010).
14. DEBNATH, B. K., SENGUPTA, S., AND LI, J. SkimpyStash: RAM space skimpy key-value store on flash-based storage. In Proceedings of the Annual ACM SIGMOD Conference (June 2010), pp. 25-36.
15. DECANDIA, G., HASTORUN, D., JAMPANI, M., KAKULAPATI, G., PILCHIN, A., SIVASUBRAMANIAN, S., VOSSHALL, P., AND VOGELS, W. Dynamo: Amazon's highly available key-value store. In Proceedings of the 21st ACM SIGOPS Symposium on Operating Systems Principles (SOSP) (Stevenson, WA, 2007), pp. 205-220.
16. DUSKA, B. M., MARWOOD, D., AND FEELEY, M. J. The measured access characteristics of world-wide web client proxy caches. In Proceedings of USENIX Symposium of Internet Technologies and Systems (Dec. 1997).
17. FEITELSON, D. G. Workload modeling for performance evaluation. In Performance Evaluation of Complex Systems: Techniques and Tools, M. C. Calzarossa and S. Tucci, Eds., vol. 2459 of Lecture Notes in Computer Science. Springer-Verlag, Sept. 2002, pp. 114-141. www.cs.huji.ac.il/~feit/papers/ WorkloadModel02chap.ps.gz.
18. FITZPATRICK, B. Distributed caching with memcached. Linux Journal, 124 (Aug. 2004), 72-78. www.linuxjournal.com/article/7451?page=0,0.
19. JIANG, S., AND ZHANG, X. LIRS: an efficient low inter-reference recency set replacement policy to improve buffer cache performance. In Proceedings of the 2002 ACM SIGMETRICS international conference on Measurement and modeling of computer systems (2002), SIGMETRICS'02, ACM, pp. 31-42.
20. KAVALANEKAR, S., WORTHINGTON, B., ZHANG, Q., AND SHARDA, V. Characterization of storage workload traces from production windows servers. In Proceedings of IEEE International Symposium on Workload Characterization (Sept. 2008).
21. KEETON, K., ALISTAIR VEITCH, D. O., AND WILKES, J. I/O characterization of commercial workloads. In Proceedings of the 3rd Workshop on Computer Architecture Evaluation using Commercial Workloads (Jan. 2000).
22. KIM, Y., GUNASEKARAN, R., SHIPMAN, G. M., DILLOW, D. A., ZHANG, Z., AND SETTLEMYER, B. W. Workload characterization of a leadership class storage cluster. In Proceedings of Petascale Data Storage Workshop (Nov. 2010).
23. LIM, H., FAN, B., ANDERSEN, D. G., AND KAMINSKY, M. Silt: A memory-eficient, high-performance key-value store. In Proceedings of the 23rd ACM Symposium on Operating Systems Principles (Oct. 2011).
24. LUBLIN, U., AND FEITELSON, D. G. The workload on parallel supercomputers: Modeling the characteristics of rigid jobs. Journal of Parallel and Distributed Computing 63, 11 (Nov. 2003), 1105-1122. www.cs.huji.ac.il/~feit/papers/ Rigid01TR.ps.gz.
25. MANLEY, S., AND SELTZER, M. Web facts and fantasy. In Proceedings of USENIX Symposium on Internet Technologies and Systems (Dec. 1997).
26. PETROVIC, J. Using Memcached for data distribution in industrial environment. In Proceedings of the Third International Conference on Systems (Washington, DC, 2008), IEEE Computer Society, pp. 368-372.
27. REDDI, V. J., LEE, B. C., CHILIMBI, T., AND VAID, K. Web search using mobile cores: Quantifying and mitigating the price of efficiency. In Proceedings of the 37th International Symposium on Computer Architecture (ISCA) (June 2010), ACM. portal.acm.org/citation.cfm?id=1815961.1816002.
28. ROSELLI, D., LORCH, J. R., AND ANDERSON, T. E. A comparison of file system workloads. In Proceedings of the 2000 USENIX Annual Technical Conference (June 2000).
29. VASUDEVAN, V. R. Energy-Efficient Data-intensive Computing with a Fast Array of Wimpy Nodes. PhD thesis, Carnegie Mellon University, Oct. 2011.
30. WANG, F., XIN, Q., HONG, B., MILLER, E. L., LONG, D. D. E., BRANDT, S. A., AND MCLARTY, T. T. File system workload analysis for large scientific computing applications. In Proceedings of 21st IEEE / 12th NASA Goddard Conference on Mass Storage Systems and Technologies (Apr. 2004).
31. ZHAO, H. HipHop for PHP: Move fast. https://developers.facebook.com/blog/ post/358/, Feb. 2010.