Mastiff: A mapreduce-based system for time-based big data analytics

Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012

Volumn , Issue , 2012, Pages 72-80

  Guo, Sijie ^a   Xiong, Jin ^a   Wang, Weiping ^a   Lee, Rubao ^b  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^b Ohio State University   (United States)

Author keywords

MapReduce; time based data analytics

Indexed keywords

CLUSTER COMPUTING; COMPUTER ARCHITECTURE; SEARCH ENGINES;

BIG DATA ANALYTICS; DATA ANALYTICS; EXISTING SYSTEMS; LOADING SPEED; MAP-REDUCE; QUERY EXECUTION; QUERY PERFORMANCE; WAREHOUSING SYSTEMS;

BIG DATA;

EID: 84870674299     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTER.2012.10     Document Type: Conference Paper

References (30)

1. D. J. Abadi, D. Carney, U. Çetintemel, M. Cherniack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul, and S. B. Zdonik, "Aurora: a new model and architecture for data stream management," VLDB J., vol. 12, no. 2, pp. 120-139, 2003.
2. A. Arasu, B. Babcock, S. Babu, M. Datar, K. Ito, I. Nishizawa, J. Rosenstein, and J. Widom, "Stream: The stanford stream data manager," in SIGMOD, 2003.
3. A. Gates, O. Natkovich, S. Chopra, P. Kamath, S. Narayanam, C. Olston, B. Reed, S. Srinivasan, and U. Srivastava, "Building a highlevel dataflow system on top of mapreduce: The pig experience," PVLDB, 2009.
4. A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wyckoff, and R. Murthy, "Hive - a warehousing solution over a map-reduce framework," PVLDB, vol. 2, no. 2, pp. 1626-1629, 2009.
5. B. Chattopadhyay, L. Lin, W. Liu, S. Mittal, P. Aragonda, V. Lychagina, Y. Kwon, and M. Wong, "Tenzing a sql implementation on the mapreduce framework," PVLDB, 2011.
6. A. Abouzeid, K. Bajda-Pawlikowski, D. J. Abadi, A. Rasin, and A. Silberschatz, "Hadoopdb: An architectural hybrid of mapreduce and dbms technologies for analytical workloads," PVLDB, 2009.
7. S. Chen, "Cheetah: A high performance, custom data warehouse on top of mapreduce," PVLDB, 2010.
8. http://hadoop.apache.org.
9. http://sourceforge.net/projects/gridsql/.
10. Y. He, R. Lee, Y. Huai, Z. Shao, N. Jain, X. Zhang, and Z. Xu, "Rcfile: A fast and space-efficient data placement structure in mapreduce-based warehouse systems," in ICDE, 2011.
11. A. Pavlo, E. Paulson, A. Rasin, D. J. Abadi, D. J. DeWitt, S. Madden, and M. Stonebraker, "A comparison of approaches to large-scale data analysis," in SIGMOD, 2009.
12. D. J. Abadi, "Data management in the cloud: Limitations and opportunities," IEEE Data Eng. Bull., vol. 32, no. 1, pp. 3-12, 2009.
13. M. J. Franklin, S. Krishnamurthy, N. Conway, A. Li, A. Russakovsky, and N. Thombre, "Continuous analytics: Rethinking query processing in a network-effect world," in CIDR, 2009.
14. J. Dittrich, J.-A. Quiané-Ruiz, A. Jindal, Y. Kargin, V. Setty, and J. Schad, "Hadoop++: Making a yellow elephant run like a cheetah (without it even noticing)," PVLDB, 2010.
15. D. Jiang, B. C. Ooi, L. Shi, and S. Wu, "The performance of mapreduce: an in-depth study," in PVLDB, 2010.
16. A. Jindal, J.-A. Quiané-Ruiz, and J. Dittrich, "Trojan data layouts: right shoes for a running elephant," in SOCC, 2011.
17. Y. Lin, D. Agrawal, C. Chen, B. C. Ooi, and S. Wu, "Llama: leveraging columnar storage for scalable join processing in the mapreduce framework," in SIGMOD, 2011.
18. Y. Cao, C. Chen, F. Guo, D. Jiang, Y. Lin, B. C. Ooi, H. T. Vo, S. Wu, and Q. Xu, "Es2: A cloud data storage system for supporting both oltp and olap," in ICDE, 2011.
19. http://www.netezza.com/data-warehouse-appliance-products/dw-appliance. aspx.
20. http://www.oracle.com/technology/products/bi/db/exadata/pdf/ exadata-storage-technical-overview.pdf.
21. M. Stonebraker, D. J. Abadi, A. Batkin, X. Chen, M. Cherniack, M. Ferreira, E. Lau, A. Lin, S. Madden, E. J. O'Neil, P. E. O'Neil, A. Rasin, N. Tran, and S. B. Zdonik, "C-store: A column-oriented dbms," in VLDB, 2005.
22. http://hadoop.apache.org/pig/docs/r0.6.0/zebra-overview. html.
23. A. Floratou, J. M. Patel, E. J.Shekita, and S. Tata, "Column- oriented storage techniques for mapreduce," PVLDB, 2011.
24. A. Ailamaki, D. J. DeWitt, M. D. Hill, and M. Skounakis, "Weaving relations for cache performance," in VLDB, 2001.
25. R. A. Hankins and J. M. Patel, "Data morphing: an adaptive, cache-conscious storage technique," in VLDB, 2003.
26. A. L. Holloway and D. J. DeWitt, "Read-optimized databases, in depth," PVLDB, vol. 1, no. 1, pp. 502-513, 2008.
27. S. Harizopoulos, V. Liang, D. J. Abadi, and S. Madden, "Performance tradeoffs in read-optimized databases," in VLDB, 2006, pp. 487-498.
28. http://wiki.apache.org/hadoop/FAQ.
29. D. J. Abadi, D. S. Myers, D. J. DeWitt, and S. Madden, "Materialization strategies in a column-oriented dbms," in ICDE, 2007.
30. http://hadoop.apache.org/common/docs/stable/cluster setup.html.