EpiC: An extensible and scalable system for processing big data

Proceedings of the VLDB Endowment

Volumn 7, Issue 7, 2014, Pages 541-552

  Jiang, Dawei ^a   Chen, Gang ^b   Ooi, Beng Chin ^a   Tan, Kian Lee ^a   Wu, Sai ^b  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b ZHEJIANG UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

BIG DATA; COMPUTER PROGRAMMING; FAULT TOLERANCE; OPEN SOURCE SOFTWARE;

CONCURRENT PROGRAMMING; DATA PROCESSING MODELS; DESIGN AND IMPLEMENTATIONS; EFFECTIVENESS AND EFFICIENCIES; MACHINE COMMUNICATIONS; OPEN SOURCE IMPLEMENTATION; PROGRAMMING INTERFACE; SEMI STRUCTURED DATA;

DATA HANDLING;

EID: 84896835469     PISSN: None     EISSN: 21508097     Source Type: Journal    
DOI: 10.14778/2732286.2732291     Document Type: Conference Paper

References (31)

1. The hadoop offical website. http://hadoop.apache.org/.
2. The storm project offical website. http://storm-project.net/.
3. A. Abouzeid, K. Bajda-Pawlikowski, D. Abadi, A. Silberschatz, and A. Rasin. HadoopDB: an architectural hybrid of mapreduce and dbms technologies for analytical workloads. PVLDB, 2(1), Aug. 2009.
4. D. Battre, S. Ewen, F. Hueske, O. Kao, V. Markl, and D. Warneke. Nephele/pacts: a programming model and execution framework for web-scale analytical processing. In SoCC, 2010.
5. J. L. Bentley and R. Sedgewick. Fast algorithms for sorting and searching strings. In SODA, 1997.
6. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst. HaLoop: efficient iterative data processing on large clusters. VLDB, 3(1-2), Sept. 2010.
7. B. Chattopadhyay, L. Lin, W. Liu, S. Mittal, P. Aragonda, V. Lychagina, Y. Kwon, and M. Wong. Tenzing a SQL implementation on the MapReduce framework. In VLDB, 2011.
8. J. Dean and S. Ghemawat. MapReduce: simplified data processing on large clusters. Commun. ACM, 51(1), Jan. 2008.
9. D. J. DeWitt, R. H. Gerber, G. Graefe, M. L. Heytens, K. B. Kumar, and M. Muralikrishna. Gamma -a high performance dataflow database machine. In VLDB, 1986.
10. D. J. DeWitt and J. Gray. Parallel database systems: The future of high performance database systems. Commun. ACM, 35(6), 1992.
11. D. J. DeWitt, A. Halverson, R. Nehme, S. Shankar, J. Aguilar-Saborit, A. Avanes, M. Flasza, and J. Gramling. Split query processing in polybase. In SIGMOD, 2013.
12. S. Fushimi, M. Kitsuregawa, and H. Tanaka. An overview of the system software of a parallel relational database machine grace. In VLDB, 1986.
13. A. Ghazal, T. Rabl, M. Hu, F. Raab, M. Poess, A. Crolotte, and H.-A. Jacobsen. BigBench: Towards an industry standard benchmark for big data analytics. In SIGMOD, 2013.
14. C. Hewitt, P. Bishop, and R. Steiger. A universal modular actor formalism for artificial intelligence. In IJCAI, 1973.
15. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: distributed data-parallel programs from sequential building blocks. SIGOPS Oper. Syst. Rev., 41(3), Mar. 2007.
16. M. Isard and Y Yu. Distributed data-parallel computing using a high-level programming language. In SIGMOD, 2009.
17. D. Jiang, B. C. Ooi, L. Shi, and S. Wu. The performance of MapReduce: an in-depth study. PVLDB, 3(1-2), Sept. 2010.
18. D. Jiang, A. K. H. Tung, and G. Chen. MAP-JOIN-REDUCE: Toward scalable and efficient data analysis on large clusters. IEEE TKDE, 23(9), Sept. 2011.
19. F. Li, B. C. Ooi, M. T. Ozsu, and S. Wu. Distributed data management using MapReduce. ACM Comput. Surv. (to appear), 46(3), 2014.
20. G. Malewicz, M. H. Austern, A. J. C. Bik, J. C. Dehnert, I. Horn, N. Leiser, and G. Czajkowski. Pregel: a system for large-scale graph processing. In SIGMOD, 2010.
21. L. Neumeyer, B. Robbins, A. Nair, and A. Kesari. S4: Distributed stream computing platform. In ICDMW, 2010.
22. L. Page, S. Brin, R. Motwani, and T. Winograd. The pagerank citation ranking: Bringing order to the web. Technical report, Stanford InfoLab, November 1999.
23. A. Pavlo, E. Paulson, A. Rasin, D. J. Abadi, D. J. DeWitt, S. Madden, and M. Stonebraker. A comparison of approaches to large-scale data analysis. In SIGMOD, 2009.
24. S. Salihoglu and J. Widom. GPS: A graph processing system. In SSDBM(Technical Report), 2013.
25. R. Sinha and J. Zobel. Cache-conscious sorting of large sets of strings with dynamic tries. J. Exp. Algorithmics, 9, Dec. 2004.
26. M. Stonebraker, D. J. Abadi, A. Batkin, X. Chen, M. Cherniack, M. Ferreira, E. Lau, A. Lin, S. Madden, E. O'Neil, P. O'Neil, A. Rasin, N. Tran, and S. Zdonik. C-store: a column-oriented dbms. In VLDB, 2005.
27. X. Su and G. Swart. Oracle in-database Hadoop: when MapReduce meets RDBMS. In SIGMOD, 2012.
28. A. Thusoo, J. S. Sarma, N. Jain, Z. Shao, P. Chakka, S. Anthony, H. Liu, P. Wyckoff, and R. Murthy. Hive: a warehousing solution over a map-reduce framework. VLDB, 2(2), Aug. 2009.
29. S. Wu, F. Li, S. Mehrotra, and B. C. Ooi. Query optimization for massively parallel data processing. In SoCC, 2011.
30. H. Yang, A. Dasdan, R. Hsiao, and D. S. Parker. Map-Reduce-Merge: simplified relational data processing on large clusters. In SIGMOD, 2007.
31. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M. J. Franklin, S. Shenker, and I. Stoica. Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. InNSDI'12, 2012.