Dache: A data aware caching for big-data applications using the MapReduce framework

Tsinghua Science and Technology

Volumn 19, Issue 1, 2014, Pages 39-50

  Zhao, Yaxiong ^a,b   Wu, Jie ^b   Liu, Cong ^c  

^a GOOGLE INC   (United States)

^b TEMPLE UNIVERSITY   (United States)

^c SUN YAT SEN UNIVERSITY   (China)

Author keywords

Big data; Caching; Hadoop; Mapreduce

Indexed keywords

APPLICATION PROGRAMS; BIG DATA; MANAGERS; OPEN SOURCE SOFTWARE; OPEN SYSTEMS;

BIG DATA APPLICATIONS; CACHING; DISTRIBUTED DATA PROCESSING; HADOOP; LARGE AMOUNTS OF DATA; MAP-REDUCE; MAPREDUCE FRAMEWORKS; OPEN SOURCE IMPLEMENTATION;

DATA HANDLING;

EID: 84900642133     PISSN: 10070214     EISSN: None     Source Type: Journal    
DOI: 10.1109/tst.2014.6733207     Document Type: Article

References (28)

1. J. Dean and S. Ghemawat, Mapreduce: Simplified data processing on large clusters, Commun. Of ACM, vol. 51, no. 1, pp. 107-113, 2008.
2. Hadoop, http://hadoop.apache.org/, 2013.
3. Java programming language, http://www.java.com/, 2013.
4. P. Th. Eugster, P. A. Felber, R. Guerraoui, and A.-M. Kermarrec, The many faces of publish/subscribe, ACM Comput. Surv., vol. 35, no. 2, pp. 114-131, 2003.
5. Cache algorithms, http://en.wikipedia.org/wiki/Cache algorithms, 2013.
6. Amawon web services, http://aws.amazon.com/, 2013.
7. Google compute engine, http://cloud.google.com/ products/computeengine. html, 2013.
8. G. Ramalingam and T. Reps. A categorized bibliography on incremental computation, in Proc. Of POPL '93, New York, NY, USA, 1993.
9. F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: A distributed storage system for structured data, in Proc. Of OSDI'2006, Berkeley, CA, USA, 2006.
10. S. Ghemawat, H. Gobioff, and S.-T. Leung, The google file system, SIGOPS Oper. Syst. Rev., vol. 37, no. 5, pp. 29-43, 2003. (Pubitemid 40929686)
11. D. Peng and F. Dabek, Largescale incremental processing using distributed transactions and notifications, in Proc. Of OSDI' 2010, Berkeley, CA, USA, 2010.
12. J. Ousterhout, P. Agrawal, D. Erickson, C. Kozyrakis, J. Leverich, D. Mazi'eres, S. Mitra, A. Narayanan, D. Ongaro, G. Parulkar, M. Rosenblum, S. M. Rumble, E. Stratmann, and R. Stutsman, The case for ramcloud, Commun. Of ACM, vol. 54, no. 7, pp. 121-130, 2011.
13. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, Dryad: Distributed data-parallel programs from sequential building blocks, SIGOPS Oper. Syst. Rev., vol. 41, no. 3, pp. 59-72, 2007. (Pubitemid 47281575)
14. L. Popa, M. Budiu, Y. Yu, and M. Isard, Dryadinc: Reusing work in large-scale computations, in Proc. Of HotCloud'09, Berkeley, CA, USA, 2009.
15. C. Olston, G. Chiou, L. Chitnis, F. Liu, Y. Han, M. Larsson, A. Neumann, V. B. N. Rao, V. Sankarasubramanian, S. Seth, C. Tian, T. ZiCornell, and X. Wang, Nova: Continuous pig/hadoop workflows, in Proc. Of SIGMOD'2011, New York, NY, USA, 2011.
16. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins, Pig latin: A not-so-foreign language for data processing, in Proc. Of SIGMOD'2008, New York, NY, USA, 2008.
17. U. A. Acar, Self-adjusting computation: An Overview, in Proc. Of PEPM'09, New York, NY, USA, 2009.
18. T. Karagiannis, C. Gkantsidis, D. Narayanan, and A. Rowstron, Hermes: Clustering users in large-scale e-mail services, in Proc. Of SoCC '10, New York, NY, USA, 2010.
19. Memcached - A distributed memory object caching system, http://memcached.org/, 2013.
20. P. Scheuermann, G. Weikum, and P. Zabback, Data partitioning and load balancing in parallel disk systems, The VLDB Journal, vol. 7, no. 1, pp. 48-66, 1998. (Pubitemid 128382397)
21. M. Zaharia, A. Konwinski, A. D. Joseph, R. Katz, and I. Stoica, Improving mapreduce performance in heterogeneous environments, in Proc. Of OSDI'2008, Berkeley, CA, USA, 2008.
22. H. Herodotou, F. Dong, and S. Babu, No one (cluster) size fits all: Automatic cluster sizing for data-intensive analytics, in Proc. Of SOCC'2011, New York, NY, USA, 2011.
23. S. Wu, F. Li, S. Mehrotra, and B. C. Ooi, Query optimization for massively parallel data processing, in Proc. Of SOCC'2011, New York, NY, USA, 2011.
24. D. Logothetis, C. Olston, B. Reed, K. C. Webb, and K. Yocum, Stateful bulk processing for incremental analytics, in Proc. Of SOCC'2011, New York, NY, USA, 2010.
25. B. He, M. Yang, Z. Guo, R. Chen, B. Su, W. Lin, and L. Zhou, Comet: Batched stream processing for data intensive distributed computing, in Proc. Of SOCC'2011, New York, NY, USA, 2010.
26. D. Battr'e, S. Ewen, F. Hueske, O. Kao, V. Markl, and D. Warneke, Nephele/pacts: A programming model and execution framework for web-scale analytical processing, in Proc. Of SOCC'2010, New York, NY, USA, 2010.
27. P. Xiong, Y. Chi, S. Zhu, J. Tatemura, C. Pu, and H. Hacigümü Ş, Activesla: A profit-oriented admission control framework for database-as-a-service providers, in Proc. Of SOCC'2011, New York, NY, USA, 2011.
28. H. Gonzalez, A. Halevy, C. S. Jensen, A. Langen, J. Madhavan, R. Shapley, andW. Shen, Google fusion tables: Data management, integration and collaboration in the cloud, in Proc. Of SOCC'2010, New York, NY, USA, 2010.