The family of mapreduce and large-scale data processing systems

ACM Computing Surveys

Volumn 46, Issue 1, 2013, Pages

  Sakr, Sherif ^a   Liu, Anna ^a   Fayoumi, Ayman G ^b  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

^b KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

Author keywords

Big data; Large scale data processing; MapReduce

Indexed keywords

BIG DATUM; COMPUTING ARCHITECTURE; DECLARATIVE PROGRAMMING; FUTURE RESEARCH DIRECTIONS; INDUSTRIAL COMMUNITIES; LARGE-SCALE DATA PROCESSING; MAP-REDUCE; PARALLEL APPLICATION;

DATA PROCESSING; INDUSTRIAL RESEARCH;

PARALLEL PROGRAMMING;

EID: 84887447695     PISSN: 03600300     EISSN: 15577341     Source Type: Journal    
DOI: 10.1145/2522968.2522979     Document Type: Article

References (134)

1. ABADI, D. J., MARCUS, A., MADDEN, S., AND HOLLENBACH, K. 2009. SW-store: A vertically partitioned dbms for semantic web data management. VLDB J. 18, 2, 385-406.
2. ABOUZEID, A., BAJDA-PAWLIKOWSKI, K., ABADI, D., RASIN, A., AND SILBERSCHATZ, A. 2009. HadoopDB: An architectural hybrid of mapreduce and dbms technologies for analytical workloads. Proc. VLDB Endow. 2, 1, 922-933.
3. ABOUZEID, A., BAJDA-PAWLIKOWSKI, K., HUANG, J., ABADI, D., AND SILBERSCHATZ, A. 2010. HadoopDB in action: Building real world applications. In Proceedings of the 36th ACM SIGMOD International Conference on Management of Data (SIGMOD10).
4. AFRATI, F. AND ULLMAN, J. 2010. Optimizing joins in a map-reduce environment. In Proceedings of the 13th International Conference on Extending Database Technology (EDBT10). 99-110.
5. AFRATI, F. N., SARMA, A. D., MENESTRINA, D., PARAMESWARAN, A. G., AND ULLMAN, J. D. 2012. Fuzzy joins using mapreduce. In Proceedings of the 28th IEEE International Conference on Data Engineering (ICDE12). 498-509.
6. AFRATI, F. N. AND ULLMAN, J. D. 2011. Optimizing multiway joins in a map-reduce environment. IEEE Trans. Knowl. Data Engin. 23, 9, 1282-1298.
7. ALEXANDROV, A., BATTRE, D., EWEN, S., HEIMEL, M., HUESKE, F., KAO, O., MARKL, V., NIJKAMP, E., AND WARNEKE, D. 2010. Massively parallel data analysis with pacts on nephele. Proc. VLDB Endow. 3, 2, 1625-1628.
8. ALVARO, P., CONDIE, T., CONWAY, N., ELMELEEGY, K., HELLERSTEIN, J. M., AND SEARS, R. 2010. Boom analytics: Exploring data-centric, declarative programming for the cloud. In Proceedings of the 5th European Conference on Computer Systems (EuroSys10). 223-236.
9. ARMBRUST, M., FOX, A., REAN, G., JOSEPH, A., KATZ, R., KONWINSKI, A., GUNHO, L., DAVID, P., RABKIN, A., STOICA, I., AND ZAHARIA, M. 2009. Above the clouds: A berkeley view of cloud Computing. http://www.cs.columbia. edu/roxana/teaching/COMS-E6998-7-Fall-2011/papers/armbrust-tr09.pdf.
10. BABU, S. 2010. Towards automatic optimization of mapreduce programs. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC10). 137-142.
11. BALMIN, A.,KALDEWEY, T., AND TATA, S. 2012. Clydesdale: Structured data processing on hadoop. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD12). 705-708.
12. BATTRE, D., EWEN, S., HUESKE, F., KAO, O., MARKL, V., AND WARNEKE, D. 2010. Nephele/PACTs: A programming model and execution framework for web-scale analytical processing. In Proceedings of the ACM Symposium on Cloud Computing (SoCC10). 119-130.
13. BEHM, A.,BORKAR, V. R.,CAREY, M. J.,GROVER, R.,LI, C.,ONOSE, N.,VERNICA, R.,DEUTSCH, A.,PAPAKONSTANTINOU, Y., AND TSOTRAS, V. J. 2011. ASTERIX: Towards a scalable, semistructured data platform for evolvingworld models. Distrib. Parallel Databases 29, 3, 185-216.
14. BELL, G., GRAY, J., AND SZALAY, A. S. 2006. Petascale computational systems. IEEE Comput. 39, 1, 110-112.
15. BEYER, K. S., ERCEGOVAC, V., GEMULLA, R., BALMIN, A., ELTABAKH, M. Y., KANNE, C.-C., OZCAN, F., AND SHEKITA, E. J. 2011. Jaql: A scripting language for large scale semistructured data analysis. Proc. VLDB Endow. 4, 12, 1272-1283.
16. BHATOTIA, P.,WIEDER, A.,RODRIGUES, R.,ACAR, U. A., AND PASQUINI, R. 2011. Incoop:MapReduce for Incremental computations. In Proceedings of the ACM Symposium on Cloud Computing (SoCC11).
17. BLANAS, S., PATEL, J., ERCEGOVAC, V., RAO, J., SHEKITA, E., AND TIAN, Y. 2010. A comparison of join algorithms for log processing in mapreduce. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD10). 975-986.
18. BOAG, S., CHAMBERLIN, D., FERNANDEZ, M. F., FLORESCU, D., ROBIE, J., AND SIMEON, J. 2010. XQuery 1.0: An xml query language. http://www.w3.org/TR/xquery.
19. BORKAR, V., ALSUBAIEE, S., ALTOWIM, Y., ALTWAIJRY, H., BEHM, A., BU, Y., CAREY, M., GROVER, R., HEILBRON, Z., KIM, Y.-S., LI, C., PIRZADEH, P., ONOSE, N., VERNICA, R., AND WEN, J. 2012a. ASTERIX: An open source system for big data management and analysis. Proc. VLDB Endow. 5, 2.
20. BORKAR, V. R., CAREY, M. J., GROVER, R., ONOSE, N., AND VERNICA, R. 2011. Hyracks: A flexible and extensible foundation for data-intensive Computing. In Proceedings of the 27th IEEE International Conference on Data Engineering (ICDE11). 1151-1162.
21. BORKAR, V. R., CAREY, M. J., AND LI, C. 2012b. Inside "big data management": Ogres, onions, or parfaits In Proceedings of the 15th International Conference on Extending Database Technology (EDBT12). 3-14.
22. BRAY, T., PAOLI, J., SPERBERG-MCQUEEN, C. M.,MALER, E., AND YERGEAU, F. 2008. Extensible markup language (xml) 1.0, 5th ed. http://www.w3.org/TR/REC- xml/.
23. BU, Y., HOWE, B., BALAZINSKA, M., AND ERNST, M. 2010. HaLoop: Efficient iterative data processing on large clusters. Proc. VLDB Endow. 3, 1, 285-296.
24. CAFARELLA, M. J. AND RE, C. 2010. Manimal: Relational optimization for data-intensive programs. In Proceedings of the 13th International Workshop on the Web and Databases (WebDB10).
25. CARY, A., SUN, Z., HRISTIDIS, V., AND RISHE, N. 2009. Experiences on processing spatial data with mapreduce. In Proceedings of the 21st International Conference on Scientific and Statistical Database Management (SSDBM09). 302-319.
26. CHAIKEN, R., JENKINS, B., LARSON, P., RAMSEY, B., SHAKIB, D.,WEAVER, S., AND ZHOU, J. 2008. SCOPE: Easy and efficient parallel processing of massive data sets. Proc. VLDB Endow. 1, 2, 1265-1276.
27. CHAMBERS, C., RANIWALA, A., PERRY, F., ADAMS, S., HENRY, R. R., BRADSHAW, R., AND WEIZENBAUM, N. 2010. FlumeJava: Easy efficient data-parallel pipelines. In Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI10). 363-375.
28. CHANG, F., DEAN, J., GHEMAWAT, S., HSIEH, W.,WALLACH, D., BURROWS, M., CHANDRA, T., FIKES, A., AND GRUBER, R. 2008. Bigtable: A distributed storage system for structured data. ACM Trans. Comput. Syst. 26, 2.
29. CHATTOPADHYAY, B., LIN, L., LIU, W., MITTAL, S., ARAGONDA, P., LYCHAGINA, V., KWON, Y., AND WONG, M. 2011. Tenzing a sql implementation on the mapreduce framework. Proc. VLDB Endow. 4, 12, 1318-1327.
30. CHEN, R., WENG, X., HE, B., AND YANG, M. 2010. Large graph processing in the cloud. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD10). 1123-1126.
31. CONDIE, T., CHU, D., HELLERSTEIN, J. M., AND MANIATIS, P. 2008. Evita raced: Metacompilation for declarative networks. Proc. VLDB Endow. 1, 1, 1153-1165.
32. CONDIE, T., CONWAY, N., ALVARO, P., HELLERSTEIN, J. M., ELMELEEGY, K., AND SEARS, R. 2010a. MapReduce online. In Proceedings of the 7th USENIX Conference on Networked Systems Design and Implementation (NSDI10). 313-328.
33. CONDIE, T.,CONWAY, N.,ALVARO, P.,HELLERSTEIN, J. M.,GERTH, J., TALBOT, J.,ELMELEEGY, K., AND SEARS, R. 2010b. Online aggregation and continuous query support in mapreduce. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD10). 1115-1118.
34. CORDEIRO, R. L. F., TRAINA, C., JR., TRAINA, A. J. M., LOPEZ, J., KANG, U., AND FALOUTSOS, C. 2011. Clustering very large multi-dimensional datasets with mapreduce. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD11). 690-698.
35. DAS, S., SISMANIS, Y., BEYER, K., GEMULLA, R., HAAS, P., AND MCPHERSON, J. 2010. Ricardo: Integrating r and hadoop. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD10). 987-998.
36. DEAN, J. AND GHEMAWAT, S. 2004. MapReduce: Simplified data processing on large clusters. In Proceedings of the 6th Symposium on Operating System Design and Implementation (OSDI04). 137-150.
37. DEAN, J. AND GHEMAWAT, S. 2008. MapReduce: Simplified data processing on large clusters. Comm. ACM 51, 1, 107-113.
38. DEAN, J. AND GHEMAWAT, S. 2010. MapReduce: A flexible data processing tool. Comm. ACM 53, 1, 72-77.
39. DEWITT, D. J. AND GRAY, J. 1992. Parallel database systems: The future of high performance database systems. Comm. ACM 35, 6, 85-98.
40. DITTRICH, J.,QUIANE-RUIZ, J., JINDAL, A.,KARGIN, Y., SETTY, V., AND SCHAD, J. 2010. Hadoop++: Making a yellow elephant run like a cheetah (without it even noticing). Proc. VLDB Endow. 3, 1, 518-529.
41. EKANAYAKE, J., LI, H., ZHANG, B., GUNARATHNE, T., BAE, S.-H., QIU, J., AND FOX, G. 2010. Twister: A runtime for iterative mapreduce. In Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing (HPDC10). 810-818.
42. ELGHANDOUR, I. AND ABOULNAGA, A. 2012a. ReStore: Reusing results of mapreduce jobs. Proc. VLDB Endow. 5, 6, 586-597.
43. ELGHANDOUR, I. AND ABOULNAGA, A. 2012b. ReStore: Reusing results of mapreduce jobs in pig. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD10). 701-704.
44. ELTABAKH, M. Y., TIAN, Y., OZCAN, F., GEMULLA, R., KRETTEK, A., AND MCPHERSON, J. 2011. CoHadoop: Flexible data placement and its exploitation in hadoop. Proc. VLDB Endow. 4, 9, 575-585.
45. ENE, A., IM, S., AND MOSELEY, B. 2011. Fast clustering using mapreduce. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD11). 681-689.
46. FEGARAS, L., LI, C. GUPTA, U., AND PHILIP, J. 2011. XML query optimization in map-reduce. In Proceedings of the International Workshop on the Web and Databases (WebDB).
47. FLORATOU, A., PATEL, J. M., SHEKITA, E. J., AND TATA, S. 2011. Column-oriented storage techniques for mapreduce. Proc. VLDB Endow. 4, 7, 419-429.
48. FRIEDMAN, E.,PAWLOWSKI, P., AND CIESLEWICZ, J. 2009. SQL/MapReduce: A practical approach to self-describing, polymorphic, and parallelizable user-defined functions. Proc. VLDB Endow. 2, 2, 1402-1413.
49. GATES, A. 2011. Programming Pig. OReilly Media.
50. GATES, A., NATKOVICH, O., CHOPRA, S., KAMATH, P., NARAYANAM, S., OLSTON, C., REED, B., SRINIVASAN, S., AND SRIVASTAVA, U. 2009. Building a highlevel dataflow system on top of mapreduce: The pig experience. Proc. VLDB Endow. 2, 2, 1414-1425.
51. GHEMAWAT, S., GOBIOFF, H., AND LEUNG, S. 2003. The google file system. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP03). 29-43.
52. GHOTING, A., KAMBADUR, P., PEDNAULT, E. P. D., AND KANNAN, R. 2011a. NIMBLE: A toolkit for the implementation of parallel data mining and machine learning algorithms on mapreduce. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD11). 334-342.
53. GHOTING, A., KRISHNAMURTHY, R., PEDNAULT, E. P. D., REINWALD, B., SINDHWANI, V., TATIKONDA, S., TIAN, Y., AND VAITHYANATHAN, S. 2011b. SystemML: Declarative machine learning on mapreduce. In Proceedings of the IEEE 27th International Conference on Data Engineering (ICDE11). 231-242.
54. HALEVY, A. Y. 2001. Answering queries using views: A survey. VLDB J. 10, 4, 270-294.
55. HE, Y., LEE, R., HUAI, Y., SHAO, Z., JAIN, N., ZHANG, X., AND XU, Z. 2011. RCFile: A fast and space-efficient data placement structure in mapreduce-based warehouse systems. In Proceedings of the IEEE 27th International Conference on Data Engineering (ICDE11). 1199-1208.
56. HERODOTOU, H. 2011. Hadoop performance models. CoRR abs/1106.0940. http://arxiv.org/abs/1106.0940.
57. HERODOTOU, H. AND BABU, S. 2011. Profiling, what-if analysis, and cost-based optimization of mapreduce programs. Proc. VLDB Endow. 4, 11, 1111-1122.
58. HERODOTOU, H.,DONG, F., AND BABU, S. 2011a. Mapreduce programming and cost-based optimization crossing this chasm with starfish. Proc. VLDB Endow. 4, 12, 1446-1449.
59. HERODOTOU, H., LIM, H., LUO, G., BORISOV, N.,DONG, L., CETIN, F. B., AND BABU, S. 2011b. Starfish: A self-tuning system for big data analytics. In Proceedings of the 5th Conference on Innovative Data Systems Research (CIDR11). 261-272.
60. HEY, T., TANSLEY, S., AND TOLLE, K., EDS. 2009. The fourth paradigm: Data-intensive scientific discovery. Microsoft Research. http://research. microsoft.com/en-us/collaboration/fourthparadigm/4th paradigm book complete lr.pdf.
61. HINDMAN, B., KONWINSKI, A., ZAHARIA, M., AND STOICA, I. 2009. A common substrate for cluster Computing. In HotCloud Workshop held in conjunction with the USENIX Annual Technical Conference. https://www.usenix.org/legacy/event/ hotcloud09/tech/full papers/hindman.pdf.
62. HUANG, J., ABADI, D. J., AND REN, K. 2011. Scalable sparql querying of large rdf graphs. Proc. VLDB Endow. 4, 11, 1123-1134.
63. HUSAIN, M. F.,MCGLOTHLIN, J. P.,MASUD, M. M.,KHAN, L. R., AND THURAISINGHAM, B. M. 2011. Heuristics-based query processing for large rdf graphs using cloud Computing. IEEE Trans. Knowl. Data Engin. 23, 9, 1312-1327.
64. ISARD, M., BUDIU, M., YU, Y., BIRRELL, A., AND FETTERLY, D. 2007. Dryad: Distributed data-parallel programs from sequential building blocks. In Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems (EuroSys07). 59-72.
65. JAHANI, E., CAFARELLA, M. J., AND RE, C. 2011. Automatic optimization for mapreduce programs. Proc. VLDB Endow. 4, 6, 385-396.
66. JIANG, D.,OOI, B. C., SHI, L., AND WU, S. 2010. The performance of mapreduce: An in-depth study. Proc. VLDB Endow. 3, 1, 472-483.
67. JIANG, D., TUNG, A. K. H., AND CHEN, G. 2011. MAP-JOIN-REDUCE: Toward scalable and efficient data analysis on large clusters. IEEE Trans. Knowl. Data Engin. 23, 9, 1299-1311.
68. JINDAL, A.,QUIANE-RUIZ, J.-A., AND DITTRICH, J. 2011. Trojan data layouts: Right shoes for a running elephant. In Proceedings of the 2nd ACM Symposium on Cloud Computing (SoCC11).
69. KALDEWEY, T., SHEKITA, E. J., AND TATA, S. 2012. Clydesdale: Structured data processing on mapreduce. In Proceedings of the 15th International Conference on Extending Database Technology (EDBT12). 15-25.
70. KANG, U., MEEDER, B., AND FALOUTSOS, C. 2011a. Spectral analysis for billion-scale graphs: Discoveries and implementation. In Proceedings of the 15th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining (PAKDD11). 13-25.
71. KANG, U., TONG, H., SUN, J., LIN, C.-Y., AND FALOUTSOS, C. 2011b. GBASE: A scalable and general graph management system. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD11). 1091-1099.
72. KANG, U., TSOURAKAKIS, C. E., AND FALOUTSOS, C. 2009. PEGASUS: A peta-scale graph mining system. In Proceedings of the 9th IEEE International Conference on Data Mining (ICDM09). 229-238.
73. KANG, U., TSOURAKAKIS, C. E., AND FALOUTSOS, C. 2011c. PEGASUS:Mining peta-scale graphs. Knowl. Inf. Syst. 27, 2, 303-325.
74. KHATCHADOURIAN, S., CONSENS, M. P., AND SIMEON, J. 2011. Having a chuql at xml on the cloud. In Proceedings of the 5th Alberto Mendelzon International Workshop on Foundations of Data Management (AMW11).
75. KIM, H., RAVINDRA, P., AND ANYANWU, K. 2011. From sparql to mapreduce: The journey using a nested triplegroup algebra. Proc. VLDB Endow. 4, 12, 1426-1429.
76. KOLB, L., THOR, A., AND RAHM, E. 2012a. Dedoop: Efficient deduplication with hadoop. Proc. VLDB Endow. 5, 12.
77. KOLB, L.,THOR, A., AND RAHM, E. 2012b. Load balancing formapreduce-based entity resolution. In Proceedings of the 28th International Conference on Data Engineering (ICDE12). 618-629.
78. KUMAR, V., ANDRADE, H., GEDIK, B., AND WU, K.-L. 2010. DEDUCE: At the intersection of mapreduce and stream processing. In Proceedings of the 13th International Conference on Extending Database Technology (EDBT10). 657-662.
79. LAMPORT, L. 1998. The part-time parliament. ACM Trans. Comput. Syst. 16, 2, 133-169.
80. LARGE SYNOPTIC SURVEY. 2013. http://www.lsst.org/.
81. LATTANZI, S.,MOSELEY, B., SURI, S., AND VASSILVITSKII, S. 2011. Filtering: Amethod for solving graph problems in mapreduce. In Proceedings of the 23rd ACM Symposium on Parallelism in Algorithms and Architectures (SPAA11). 85-94.
82. LIM, H., HERODOTOU, H., AND BABU, S. 2012. Stubby: A transformation-based optimizer for mapreduce workflows. Proc. VLDB Endow. 5, 12.
83. LIN, J. J. 2009. Brute force and indexed approaches to pairwise document similarity comparisons withmapreduce. In Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR09). 155-162.
84. LIN, Y.,AGRAWAL, D.,CHEN, C.,OOI, B. C., ANDWU, S. 2011. Llama: Leveraging columnar storage for scalable join processing in the mapreduce framework. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD11). 961-972.
85. LOGOTHE TIS, D. AND YOCUM, K. 2008. Ad-hoc data processing in the cloud. Proc. VLDB Endow. 1, 2, 1472-1475.
86. LOO, B. T.,CONDIE, T.,HELLERSTEIN, J.M.,MANIATIS, P.,ROSCOE, T., AND STOICA, I. 2005. Implementing declarative overlays. In Proceedings of the 20th ACMSymposium on Operating Systems Principles (SOSP05). 75-90.
87. LOW, Y., GONZALEZ, J., KYROLA, A., BICKSON, D., GUESTRIN, C., AND HELLERSTEIN, J. M. 2010. GraphLab: A new framework for parallel machine learning. In Proceedings of the 26th Conference on Uncertainty in Artificial Intelligence (UAI10). 340-349.
88. LOW, Y.,GONZALEZ, J.,KYROLA, A.,BICKSON, D.,GUESTRIN, C., AND HELLERSTEIN, J.M. 2012. Distributed graphlab: A framework for machine learning in the cloud. Proc. VLDB Endow. 5, 8, 716-727.
89. MALEWICZ, G., AUSTERN, M., BIK, A., DEHNERT, J., HORN, I., LEISER, N., AND CZAJKOWSKI, G. 2010. Pregel: A system for large-scale graph processing. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD10). 135-146.
90. MANOLA, F. ANDMILLER, E. 2004. RDF Primer, W3C Recommendation. http://www.w3.org/TR/REC-rdf-syntax/.
91. MELNIK, S., GUBAREV, A., LONG, J. J., ROMER, G., SHIVAKUMAR, S., TOLTON, M., AND VASSILAKIS, T. 2010. Dremel: Interactive analysis of web-scale datasets. Proc. VLDB Endow. 3, 1, 330-339.
92. METWALLY, A. AND FALOUTSOS, C. 2012. V-smart-join: A scalable mapreduce framework for all-pair similarity joins of multisets and vectors. Proc. VLDB Endow. 5, 8, 704-715.
93. MORALES, G. F., GIONIS, A., AND SOZIO, M. 2011. Social content matching in mapreduce. Proc. VLDB Endow. 4, 7, 460-469.
94. MORTON, K., BALAZINSKA, M., AND GROSSMAN, D. 2010a. ParaTimer: A progress indicator for mapreduce dags. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD10). 507-518.
95. MORTON, K., FRIESEN, A., BALAZINSKA, M., AND GROSSMAN, D. 2010b. Estimating the progress of mapreduce pipelines. In Proceedings of the 26th IEEE International Conference on Data Engineering (ICDE10). 681-684.
96. MYUNG, J., YEON, J., AND GOO LEE, S. 2010. SPARQL basic graph pattern processing with iterative mapreduce. In Proceedings of the Workshop on Massive Data Analytics on the Cloud (MDAC10).
97. NEUMANN, T. AND WEIKUM, G. 2008. RDF-3x: A risc-style engine for rdf. Proc. VLDB Endow. 1, 1.
98. NYKIEL, T., POTAMIAS, M., MISHRA, C., KOLLIOS, G., AND KOUDAS, N. 2010. MRShare: Sharing across multiple queries in mapreduce. Proc. VLDB Endow. 3, 1, 494-505.
99. ODERSKY, M., SPOON, L., AND VENNERS, B. 2011. Programming in Scala: A Comprehensive Step-by-Step Guide. Artima Inc.
100. OLSTON, C., REED, B., SRIVASTAVA, U., KUMAR, R., AND TOMKINS, A. 2008. Pig latin: A not-so-foreign language for data processing. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD08). 1099-1110.
101. PANDA, B., HERBACH, J., BASU, S., AND BAYARDO, R. J. 2009. PLANET: Massively parallel learning of tree ensembles with mapreduce. Proc. VLDB Endow, 2, 2, 1426-1437.
102. PAPADIMITRIOU, S. AND SUN, J. 2008. DisCo: Distributed co-clustering with map-reduce: A case study towards petabyte-scale end-to-end mining. In Proceedings of the 8th IEEE International Conference on Data Mining (ICDM08). 512-521.
103. PATTERSON, D. A. 2008. Technical perspective: The data center is the computer. Comm. ACM 51, 1, 105.
104. PAVLO, A., PAULSON, E.,RASIN, A.,ABADI, D.,DEWITT, D.,MADDEN, S., AND STONEBRAKER,M. 2009. A comparison of approaches to large-scale data analysis. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD09). 165-178.
105. PIKE, R., DORWARD, S., GRIESEMER, R., AND QUINLAN, S. 2005. Interpreting the data: Parallel analysis with sawzall. Sci. Program. 13, 4, 277-298.
106. PRUDHOMMEAUX, E. AND SEABORNE, A. 2008. SPARQL query language for rdf, w3c recommendation. http://www.w3.org/TR/rdf-sparql-query/.
107. QUIANE-RUIZ, J.-A., PINKEL, C., SCHAD, J., AND DITTRICH, J. 2011a. RAFT at work: Speeding-up mapreduce applications under task and node failures. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD11). 1225-1228.
108. QUIANE-RUIZ, J.-A., PINKEL, C., SCHAD, J., AND DITTRICH, J. 2011b. RAFTing mapreduce: Fast recovery on the raft. In Proceedings of the 27th IEEE International Conference on Data Engineering (ICDE11). 589-600.
109. RAVINDRA, P., KIM, H., AND ANYANWU, K. 2011. An intermediate algebra for optimizing rdf graph pattern matching on mapreduce. In Proceedings of the 8th Extended Semantic Web Conference on the Semanic Web: Research and Applications (ESWC11). 46-61.
110. SCHATZLE, A., PRZYJACIEL-ZABLOCKI, M., HORNUNG, T., AND LAUSEN, G. 2011. PigSPARQL: Mapping sparql to pig latin. In Proceedings of the International Workshop on Semantic Web Information Management (SWIM11). 65-84.
111. SELINGER, P. G.,ASTRAHAN,M.M.,CHAMBERLIN, D. D.,LORIE, R. A., AND PRICE, T. G. 1979. Access path selection in a relational databasemanagement system. In Proceedings of the ACMSIGMODInternational Conference on Management of Data (SIGMOD79). 23-34.
112. STONEBRAKER, M. 1986. The case for shared nothing. IEEE Datab. Engin. Bull. 9, 1, 4-9.
113. STONEBRAKER, M., ABADI, D., DEWITT, D., MADDEN, S., PAULSON, E., PAVLO, A., AND RASIN, A. 2010. MapReduce and parallel dbmss: Friends or foes Comm. ACM 53, 1, 64-71.
114. STUTZ, P., BERNSTEIN, A., AND COHEN, W. W. 2010. Signal/collect: Graph algorithms for the (semantic) Web. In Proceedings of the International Semantic Web Conference. 764-780.
115. THUSOO, A., SARMA, J., JAIN, N., SHAO, Z., CHAKKA, P., ANTHONY, S., LIU, H.,WYCKOFF, P., AND MURTHY, R. 2009. Hive-A warehousing solution over a map-reduce framework. Proc. VLDB Endow. 2, 2, 1626-1629.
116. THUSOO, A., SARMA, J., JAIN, N., SHAO, Z., CHAKKA, P., ZHANG, N., ANTHONY, S., LIU, H., AND MURTHY, R. 2010a. Hive-A petabyte scale data warehouse using hadoop. In Proceedings of the 26th IEEE International Conference on Data Engineering (ICDE10). 996-1005.
117. THUSOO, A., SHAO, Z., ANTHONY, S., BORTHAKUR, D., JAIN, N., SARMA, J. S.,MURTHY, R., AND LIU, H. 2010b. Data warehousing and analytics infrastructure at facebook. In Proceedings of the ACMSIGMOD International Conference on Management of Data (SIGMOD10). 1013-1020.
118. ULLMAN, J. D. 1990. Principles of Database and Knowledge Base Systems: Volume II: The New Technologies. W. H. Freeman and Co., New York.
119. VALIANT, L. G. 1990. A bridging model for parallel computation. Comm. ACM 33, 8, 103-111.
120. VERNICA, R.,CAREY,M., AND LI, C. 2010. Efficient parallel set-similarity joins using MapReduce. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD10). 495-506.
121. WANG, C., WANG, J., LIN, X., WANG, W., WANG, H., LI, H., TIAN, W., XU, J., AND LI, R. 2010. MapDupReducer: Detecting near duplicates over massive datasets. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD10). 1119-1122.
122. WANG, G., XIE, W., DEMERS, A., AND GEHRKE, J. 2013. Asynchronous large-scale graph processing made easy. In Proceedings of the 7th Conference on Innovative Data Systems Research (CIDR13).
123. WHITE, T. 2012. Hadoop: The Definitive Guide. OReilly Media.
124. XIAO, C.,WANG, W., LIN, X.,YU, J. X., ANDWANG, G. 2011. Efficient similarity joins for near-duplicate detection. ACM Trans. Datab. Syst. 36, 3, 15.
125. YANG, H.,DASDAN, A.,HSIAO, R., AND PARKER, D. 2007. Map-reduce-merge: simplified relational data processing on large clusters. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD07). 1029-1040.
126. YANG, H. AND PARKER, D. 2009. Traverse: Simplified indexing on large map-reduce-merge clusters. In Proceedings of the 14th International Conference on Database Systems for Advanced Applications (DASFAA09). 308-322.
127. YU, Y., ISARD,M.,FETTERLY, D.,BUDIU, M.,ERLINGSSON, U.,GUNDA, P., AND CURREY, J. 2008. DryadLINQ: A system for general-purpose distributed data-parallel computing using a high-level language. In Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation (OSDI08). 1-14.
128. ZAHARIA, M., BORTHAKUR, D., SARMA, J. S., ELMELEEGY, K., SHENKER, S., AND STOICA, I. 2010a. Delay scheduling: A simple technique for achieving locality and fairness in cluster scheduling. In Proceedings of the 5th European Conference on Computer Systems (EuroSys10). 265-278.
129. ZAHARIA, M., CHOWDHURY, M.,DAS, T.,DAVE, A.,MA, J.,MCCAULEY, M., FRANKLIN, M. J., SHENKER, S., AND STOICA, I. 2012. Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster Computing. In Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation (NSDI12).
130. ZAHARIA, M., CHOWDHURY, M., FRANKLIN, M. J., SHENKER, S., AND STOICA, I. 2010b. Spark: Cluster computing with working sets. In Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing (HotCloud10). 10.
131. ZAHARIA, M., KONWINSKI, A., JOSEPH, A., KATZ, R., AND STOICA, I. 2008. Improving mapreduce performance in heterogeneous environments. In Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation (OSDI08). 29-42.
132. ZHANG, Y., GAO, Q., GAO, L., AND WANG, C. 2012. IMapReduce: A Distributed Computing Framework for Iterative Computation. J. Grid Comput. 10, 1, 47-68.
133. ZHOU, J., LARSON, P., AND CHAIKEN, R. 2010. Incorporating partitioning and parallel plans into the SCOPE optimizer. In Proceedings of the 26th IEEE International Conference on Data Engineering (ICDE10). 1060-1071.
134. ZUKOWSKI, M., BONCZ, P. A., NES, N., AND HEMAN, S. 2005. MonetDB/X100-A dbms in the cpu cache. IEEE Data Engin. Bull. 28, 2, 17-22.