Performance evaluation of traditional caching policies on a large system with petabytes of data

Proceedings - 2012 IEEE 7th International Conference on Networking, Architecture and Storage, NAS 2012

Volumn , Issue , 2012, Pages 227-234

  Fares, Ribel ^a   Romoser, Brian ^a   Zong, Ziliang ^a   Nijim, Mais ^b   Qin, Xiao ^c  

^a TEXAS STATE UNIVERSITY   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

^c AUBURN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CACHE REPLACEMENT POLICY; CACHING PERFORMANCE; CACHING POLICY; DATA SETS; I/O PERFORMANCE; LARGE DATASETS; LARGE SYSTEM; LEAST FREQUENTLY USED; LEAST RECENTLY USED; PERFORMANCE EVALUATION; PERFORMANCE GAIN; PETABYTES; SATELLITE IMAGES; SCIENCE CENTERS; SMALL FILES; SPEED STORAGE; U.S. GEOLOGICAL SURVEYS;

BEHAVIORAL RESEARCH; SATELLITE IMAGERY;

DIGITAL STORAGE;

EID: 84868159274     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/NAS.2012.32     Document Type: Conference Paper

References (36)

1. Marissa Mayer, "Innovation at Google: the physics of data", PARC Forum, 2009, http://www.parc.com/event/936/innovation-at-google.html.
2. Giuseppe DeCandia, Deniz Hastorun, Madan Jampani, Gunavardhan Kakulapati, Avinash Lakshman, Alex Pilchin, Swami Sivasubramanian, Peter Vosshall and Werner Vogels, "Dynamo: Amazon's Highly Available Key-Value Store", in Proceedings of the 21st ACM Symposium on Operating Systems Principles, Stevenson, WA, October 2007.
3. Doug Beaver, Sanjeev Kumar, Harry C. Li, Jason Sobel, Peter Vajgel, "Finding a needle in Haystack: Facebooks photo store", in Proceedings of the 9th USENIX Symposium on Operating Systems Design and Implementation, Vancouver, Canada, October 2010.
4. http://earthexplorer.usgs.gov/.
5. http://glovis.usgs.gov/.
6. Alan Jay Smith, "Design of CPU Cache Memories", In Proceedings of IEEE TENCON, 1987.
7. Hong-Tai Chou and David J. Dewitt, "An Evaluation of Buffer Management Strategies for Relational Database Systems", in Proceedings of International Conference on Very Large Databases (VLDB), 1985.
8. Shaul Dar, Michael J. Franklin, B. Jonsson, Divesh Srivastava, and Michael Tan, "Semantic Data Caching and Replacement", in Proceedings of International Conference on Very Large Databases (VLDB), 1996.
9. Nimrod Megiddo and Dharmendra S. Modha, "ARC: A Self-Tuning, Low Overhead Replacement Cache", in Proceedings of USENIX Conference on File and Storage Technologies (FAST), pp. 115-130, 2003.
10. Yuanyuan Zhou, James Philbin, and Kai Li, "The Multi-Queue Replacement Algorithm for Second Level Buffer Caches", in Proceedings of USENIX Technical Conference, 2001.
11. The NASA Worldwide Reference System, http://landsat.gsfc.nasa.gov/about/ wrs.html.
12. P. Cao and S. Irani, "Cost-aware WWW proxy caching algorithms", in Proceedings of USENIX Conference, 1997.
13. J. Z. Teng and R. A. Gumaer, "Managing IBM database 2 buffers to maximize performance", IBM System Journal, vol. 23, no. 2, pp. 211- 218, 1984.
14. M. N. Nelson, B. B. Welch, and J. K. Ousterhout, "Caching in the Sprite network file system", ACM Transactions on Computer Systems, vol. 6, no. 1, pp. 134-154, 1988.
15. M. J. Bach, "The Design of the UNIX Operating System", Englewood Cliffs, 1986.
16. J. L. Bentley, D. D. Sleator, R. E. Tarjan, and V. K. Wei, "A locally adaptive data compression scheme", Comm. ACM, vol. 29, no. 4, pp. 320-330, 1986.
17. D. L. Willick, D. L. Eager, and R. B. Bunt, "Disk Cache Replacement Policies for Network File Servers", in Proceedings of the International Conference on Distributed Computing Systems (ICDCS), 1993.
18. P. J. Denning, "The Working Set Model for Program Behavior", Comm. ACM, 1968.
19. J. Robinson and M. Devarakonda, "Data Cache Management Using Frequency-Based Replacement", in Proceedings of the 1995 ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems, 1990.
20. E. J. O'Neil et. al., "The LRU-K Page Replacement Algorithm for Database Disk Buffering", in Proceedings of SIGMOD, 1993.
21. D. Lee et. al., "On the Existence of a Spectrum of Policies that Subsumes the Least Recently Used (LRU) and Least Frequently Used(LFU) Policies", in Proceedings of the 1995 ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems, 1999.
22. T. Johnson and D. Shasha., "2Q: A Low Overhead High Performance Buffer Management Replacement Algorithm", in Proceedings of International Conference on Very Large Databases (VLDB), 1994.
23. M. Baker, S. Asami, E. Deprit, J.K. Ousterhout, and M.I. Seltzer, "Non- Volatile Memory for Fast, Reliable File Systems", In Proceedings of ASPLOS, pp.10-22, 1992.
24. Butt, A.R., Gniady, C., Hu, Y.C., "The Performance Impact of Kernel Prefetching on Buffer Cache Replacement Algorithms", IEEE Transactions on Computers, vol. 56, no. 7., pp. 889-908, Jul. 2007.
25. Grimsrud, K.S., Archibald, J.K., Nelson, B.E., "Multiple Prefetch Adaptive Disk Caching, " IEEE Transactions on Knowledge and Data Engineering, vol. 5, no. 1, pp. 88-103, Feb.1993.
26. Jeon, H.S., "Practical Buffer Cache Management Scheme Based on Simple Prefetching", IEEE Transactions on Consumer Electronics, vol. 52, no. 3, Aug. 2006.
27. Jeon, J., Lee, G., Cho, H., Ahn, B., "A Prefetching Web Caching Method Using Adaptive Search Patterns", in Proceedings of the IEEE Pacific Rim Conference On Communications, Computers, And Signal Processing, vol. 1, pp. 37-40, Aug. 2003.
28. Cao, P., Felten, E.W., Karlin, A.R., Li, K., "A Study of Integrated Prefetching and Caching Strategies", in Proceedings of the 1995 ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems, vol. 23, no. 1, pp. 188-197, May 1995, .
29. Gonzalez, A., Aliagas, C., Valero, M., "A Data Cache with Multiple Caching Strategies Tuned to Different Types of Locality", in Proceedings of the Ninth International Conference on Supercomputing, pp. 338- 347, 1995.
30. Griffoen, J., Appleton, R., "Reducing File System Latency Using a Predictive Approach", in Proceedings of the Summer USENIX Technical Conference, vol. 1, pp. 13-13, 1995, .
31. Azevedo, D., Oliveira, J., "Application of Data Mining Techniques to the Storage Management and Online Distribution of Satellite Images", in Proceedings of the Seventh International Conference on Intelligent Systems Design and Applications, pp. 955-930, 2007.
32. Nanopoulos, A., Katsaros, D., Manolopoulos, Y. "A Data Mining Algorithm for Generalized Web Prefetching", IEEE Transactions on Knowledge and Data Engineering, vol. 15, no. 5, pp. 1155-1169, September 2003.
33. Lan, B., Bressan, S., Ooi, B., Tan, K., "Rule-Assisted Prefetching in Web-Server Caching", in Proceedings of the Ninth International Conference on Information and Knowledge Management, pp. 504-511, 2000.
34. Megiddo, N., Modha, D., "Outperforming LRU with an Adaptive Replacement Cache Algorithm", Computer, vol. 37 no. 4, pp. 58-65, April 2004.
35. Arlitt, M., Friedrich, R., Jin, T., "Performance Evaluation of Web Proxy Cache Replacement Policies", Performance Evaluation, vol. 39 no. 1-4, pp. 149-164, February 2000.
36. Rizzo, L., Vicisano, L., "Replacement Policies for a Proxy Cache", IEEE/ACM Transactions on Networking, vol. 8, no. 2, pp. 158-170, April 2000.