Big Data with Cloud Computing: An insight on the computing environment, MapReduce, and programming frameworks

Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery

Volumn 4, Issue 5, 2014, Pages 380-409

  Fernández, Alberto ^a   del Río, Sara ^b   López, Victoria ^b   Bawakid, Abdullah ^c   del Jesus, María J ^a   Benítez, José M ^b   Herrera, Francisco ^b,c  

^a UNIVERSITY OF JAÉN   (Spain)

^b UNIVERSITY OF GRANADA   (Spain)

^c KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

Author keywords

[No Author keywords available]

Indexed keywords

BIG DATA; CLOUD COMPUTING; DATA MINING; MESSAGE PASSING; OPEN SOURCE SOFTWARE; OPEN SYSTEMS; SCALABILITY;

CLASSICAL SOLUTIONS; COMPUTING ENVIRONMENTS; COMPUTING RESOURCE; DISTRIBUTED DATABASE; LARGE-SCALE ANALYTICS; MESSAGE PASSING INTERFACE; OPEN SOURCE IMPLEMENTATION; PROGRAMMING FRAMEWORK;

DISTRIBUTED DATABASE SYSTEMS;

EID: 84915782633     PISSN: 19424787     EISSN: 19424795     Source Type: Journal    
DOI: 10.1002/widm.1134     Document Type: Article

References (162)

1. Gupta R, Gupta H, Mohania M. Cloud computing and big data analytics: what is new from databases perspective? In: 1st International Conference on Big Data Analytics (BDA), New Delhi, India, 2012, 42-61.
2. Agrawal D, Das S, Abbadi AE. Big data and cloud computing: current state and future opportunities. In: 14th International Conference on Extending Database Technology (EDBT), Uppsala, Sweden, 2011, 530-533.
3. Madden S. From databases to big data. IEEE Internet Comput 2012, 16:4-6.
4. Kraska T. Finding the needle in the big data systems haystack. IEEE Internet Comput 2013, 17:84-86.
5. Alpaydin E. Introduction to Machine Learning. 2nd ed. Cambridge, MA: MIT Press; 2010.
6. Witten IH, Frank E, Hall MA. Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann Series in Data Management Systems. Amsterdam: Morgan Kaufmann; 2011.
7. March ST, Hevner AR. Integrated decision support systems: a data warehousing perspective. Decis Support Syst 2007, 43:1031-1043.
8. Watson HJ, Wixom BH. The current state of business intelligence. Computer 2007, 40:96-99.
9. Negash S, Gray P. Business intelligence. Commun Assoc Inf Sys 2004, 13:177-195.
10. O'Neil C, Schutt R. Doing Data Science. 1st ed. Sebastopol, CA: O'Reilly; 2013.
11. Provost F, Fawcett T. Data Science for Business. What You Need to Know about Data Mining and Data-Analytic Thinking. 1st ed. Sebastopol, CA: O'Reilly; 2013.
12. Han J, Haihong E, Le G, Du J. Survey on nosql database. In: 6th International Conference on Pervasive Computing and Applications, (ICPCA), Port Elizabeth, South Africa, 2011, 363-366.
13. Dean J, Ghemawat S. MapReduce: simplified data processing on large clusters. Commun ACM 2008, 51:107-113.
14. Lam C. Hadoop in Action. 1st ed. Greenwich, Connecticut (USA): Manning; 2011.
15. Buyya R, Broberg J, Goscinski A. Cloud Computing: Principles and Paradigms. Chichester: John Wiley & Sons; 2011.
16. Mell P, Grance T. The NIST definition of cloud computing (draft) recommendations of the national institute of standards and technology. NIST Spec Publ 2011, 145.
17. Plummer D, Bittman T, Austin T, Cearley D, Cloud DS. Defining and describing an emerging phenomenon. Technical Report, Gartner, 2008.
18. Hummer W, Satzger B, Dustdar S. Elastic stream processing in the cloud. WIREs Data Mining Knowl Discov 2013, 3:333-345.
19. Papazoglou M, Van Den Heuvel W-J. Service oriented architectures: approaches, technologies and research issues. VLDB J 2007, 16:389-415.
20. Ouf S, Nasr M, Amr M, Mosaad M, Kamal K, Mostafa F, Said R, Mohamed S. Business intelligence software as a service (SAAS). In: 2011 IEEE 3rd International Conference on Communication Software and Networks (ICCSN), Xian, China, 2011, 641-649.
21. Velte AT, Velte TJ, Elsenpeter R. Cloud Computing: A Practical Approach. New York City (USA): McGraw Hill; 2010.
22. Marx V. The big challenges of big data. Nature 2013, 498:255-260.
23. Wu X, Zhu X, Wu G-Q, Ding W. Data mining with big data. IEEE Trans Knowl Data Eng 2014, 26:97-107.
24. Schlieski T, Johnson BD. Entertainment in the age of big data. Proc IEEE 2012, 100:1404-1408.
25. Peltier TR, Peltier J, Blackley JA. Information Security Fundamentals. Boca Raton, FL: Auerbach Publications; 2005.
26. Xiao Z, Xiao Y. Achieving accountable mapreduce in cloud computing. Future Gener Comput Syst 2014, 30:1-13.
27. Zikopoulos PC, Eaton C, deRoos D, Deutsch T, Lapis G. Understanding Big Data-Analytics for Enterprise Class Hadoop and Streaming Data. 1st ed. New York City (USA): McGraw-Hill Osborne Media; 2011.
28. Labrinidis A, Jagadish HV. Challenges and opportunities with big data. PVLDB 2012, 5:2032-2033.
29. Peralta D, Triguero I, Sanchez-Reillo R, Herrera F, Benítez JM. Fast fingerprint identification for large databases. Pattern Recognit 2014, 47:588-602.
30. Peralta D, Galar M, Triguero I, Benítez JM, Miguel-Hurtado O, Herrera F. Minutiae filtering to improve both efficacy and efficiency of fingerprint matching algorithms. Eng Appl Artif Intel 2014, 32:37-53.
31. Waller MA, Fawcett SE. Data science, predictive analytics, and big data: a revolution that will transform supply chain design and management. J Bus Logistics 2013, 34:77-84.
32. Hey T, Trefethen AE. The UK E-science core programme and the grid. Future Gener Comput Syst 2002, 18:1017-1031.
33. Wang F-Y, Carley KM, Zeng D, Mao W. Social computing: from social informatics to social intelligence. IEEE Intell Syst 2007, 22:79-83.
34. Linden G, Smith B, York J. Amazon.com recommendations item-to-item collaborative filtering. IEEE Internet Comput 2003, 7:76-80.
35. Ngai EWT, Wat FKT. Literature review and classification of electronic commerce research. Inf Manage 2002, 39:415-429.
36. Mattmann CA. Computing: a vision for data science. Nature 2013, 493:473-475.
37. Provost F, Fawcett T. Data science and its relationship to big data and data-driven decision making. Big Data 2013, 1:51-59.
38. Cherkassky V, Mulier F. Learning from Data: Concepts, Theory, and Methods. Wiley Series in Adaptive and Learning Systems for Signal Processing, Communications and Control Series. New York, NY: John Wiley & Sons; 1998.
39. Tan P-N, Steinbach M, Kumar V. Introduction to Data Mining. London (U.K.): Pearson; 2006.
40. Chen CP, Zhang C-Y. Data-intensive applications, challenges, techniques and technologies: a survey on big data. Inf Sci 2014, 275:314-347.
41. Assent I. Clustering high dimensional data. WIREs Data Mining Knowl Discov 2012, 2:340-350.
42. Bacardit J, Llorà X. Large-scale data mining using genetics-based machine learning. WIREs Data Mining Knowl Discov 2013, 3:37-61.
43. Rothnie JBJ, Bernstein PA, Fox S, Goodman N, Hammer M, Landers TA, Reeve CL, Shipman DW, Wong E. Introduction to a system for distributed databases (sdd-1). ACM Trans Database Syst 1980, 5:1-17.
44. DeWitt DJ, Ghandeharizadeh S, Schneider DA, Bricker A, Hsiao H-I, Rasmussen R. The gamma database machine project. IEEE Trans Knowl Data Eng 1990, 2:44-62.
45. Chang F, Dean J, Ghemawat S, Hsieh WC, Wallach DA, Burrows M, Chandra T, Fikes A, Gruber RE. BigTable: a distributed storage system for structured data. ACM Trans Comput Syst 2008, 26:1-26.
46. Shafer J, Agrawal R, Mehta M. Sprint: a scalable parallel classifier for data mining. In: 22th International Conference on Very Large Data Bases (VLDB '96), Mumbai, 1996, 544-555.
47. Snir M, Otto S. MPI-The Complete Reference: The MPI Core. Cambridge, MA: MIT Press; 1998.
48. The Apache Software Foundation. Hadoop, an open source implementing of mapreduce and GFS, 2012
49. Creeger M. Cloud computing: an overview. ACM Queue 2009, 7:2.
50. Vaquero LM, Rodero-Merino L, Caceres J, Lindner M. A break in the clouds: towards a cloud definition. SIGCOMM Comput Commun Rev 2008, 39:50-55.
51. Shim K, Cha SK, Chen L, Han W-S, Srivastava D, Tanaka K, Yu H, Zhou X. Data management challenges and opportunities in cloud computing. In: 17th International Conference on Database Systems for Advanced Applications (DASFAA'2012). Berlin/Heidelberg: Springer; 2012, 323.
52. Kambatla K, Kollias G, Kumar V, Grama A. Trends in big data analytics. J Parallel Distrib 2014, 74:2561-2573.
53. White T. Hadoop: The Definitive Guide. 1st ed. Sebastopol, CA: O'Reilly; 2009.
54. Ghemawat S, Gobioff H, Leung S-T. The google file system. In: 19th Symposium on Operating Systems Principles, 2003, Bolton Landing, NY, 29-43.
55. Murty J. Programming Amazon Web Services-S3, EC2, SQS, FPS, and SimpleDB: Outsource Your Infrastructure. Ist ed. Sebastopol, CA: O'Reilly; 2008.
56. Chaiken R, Jenkins B, Larson P, Ramsey B, Shakib D, Weaver S, Zhou J. SCOPE: easy and efficient parallel processing of massive data sets. PVLDB 2008, 1:1265-1276.
57. Grossman RL, Gu Y. Data mining using high performance data clouds: experimental studies using sector and sphere. In: 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2008, Las Vegas, NV, 920-927.
58. Grossman RL, Gu Y, Sabala M, Zhang W. Compute and storage clouds using wide area high performance networks. Future Gener Comput Syst 2009, 25:179-183.
59. Härder T, Reuter A. Principles of transaction-oriented database recovery. ACM Comput Surv 1983, 15:287-317.
60. Kim Y, Shim K. Parallel top-k similarity join algorithms using mapreduce. In: 28th International Conference on Data Engineering (ICDE), Arlington, VA, 2012, 510-521.
61. Okcan A, Riedewald M. Processing theta-joins using mapreduce. In: Sellis TK, Miller RJ, Kementsietsidis A, Velegrakis Y, eds. SIGMOD Conference. New York, NY: ACM; 2011, 949-960.
62. DeCandia G, Hastorun D, Jampani M, Kakulapati G, Pilchin A, Sivasubramanian S, Vosshall P, Vogels W. Dynamo: Amazon's highly available key-value store. SIGOPS Oper Syst Rev 2007, 41:205-220.
63. Karger D, Lehman E, Leighton T, Panigrahy R, Levine M, Lewin D. Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the world wide web. In: 29th Annual ACM Symposium on Theory of Computing (STOC), New York, NY, 1997, 654-663.
64. Dimiduk N, Khurana A. HBase in Action. 1st ed. Greenwich, Connecticut (USA): Manning; 2012.
65. Lakshman A, Malik P. Cassandra: a decentralized structured storage system. Oper Syst Rev 2010, 44:35-40.
66. Russell J, Cohn R. Hypertable. 1st ed. Key Biscayne, FL, (USA): Bookvika publishing; 2012.
67. Chodorow K, Dirolf M. MongoDB: The Definitive Guide Powerful and Scalable Data Storage. 1st ed. Sebastopol, CA: O'Reilly; 2010.
68. Severance C. Discovering javascript object notation. IEEE Comput 2012, 45:6-8.
69. Anderson JC, Lehnardt J, Slater N. CouchDB: The Definitive Guide Time to Relax. 1st ed. Sebastopol, CA: O'Reilly; 2010.
70. Thusoo A, Sarma JS, Jain N, Shao Z, Chakka P, Anthony S, Liu H, Wyckoff P, Murthy R. Hive-a warehousing solution over a map-reduce framework. VLDB J 2009, 2:1626-1629.
71. Olston C, Reed B, Srivastava U, Kumar R, Tomkins A. Pig latin: a not-so-foreign language for data processing. In: 2008 ACM SIGMOD International Conference on Management of data (SIGMOD), Vancouver, Canada, 2008, 1099-1110.
72. Gates A, Natkovich O, Chopra S, Kamath P, Narayanam S, Olston C, Reed B, Srinivasan S, Srivastava U. Building a highlevel dataflow system on top of mapreduce: the pig experience. PVLDB 2009, 2:1414-1425.
73. Beyer KS, Ercegovac V, Gemulla R, Balmin A, Eltabakh MY, Kanne C-C, Özcan F, Shekita EJ. Jaql: a scripting language for large scale semistructured data analysis. VLDB J 2011, 4:1272-1283.
74. Melnik S, Gubarev A, Long J, Romer G, Shivakumar S, Tolton M, Vassilakis T. Dremel: interactive analysis of web-scale datasets. PVLDB 2010, 3:330-339.
75. Hausenblas M, Nadeau J. Apache drill: interactive ad-hoc analysis at scale. Big Data 2013, 1:100-104.
76. Zhou J, Bruno N, Wu M-C, Larson P-K, Chaiken R, Shakib D. SCOPE: parallel databases meet mapreduce. VLDB J 2012, 21:611-636.
77. Lin J, Dyer C. Data-Intensive Text Processing with MapReduce. Synthesis Lectures on Human Language Technologies. California (USA): Morgan and Claypool Publishers; 2010.
78. Shim K. Mapreduce algorithms for big data analysis. PVLDB 2012, 5:2016-2017.
79. Akyildiz I, Su W, Sankarasubramaniam Y, Cayirci E. A survey on sensor networks. IEEE Commun Mag 2002, 40:102-105.
80. Patcha A, Park J-M. An overview of anomaly detection techniques: existing solutions and latest technological trends. Comput Netw 2007, 51:3448-3470.
81. Elo L, Schwikowski B. Mining proteomic data for biomedical research. WIREs Data Mining Knowl Discov 2012, 2:1-13.
82. Glaab E, Bacardit J, Garibaldi JM, Krasnogor N. Using rule-based machine learning for candidate disease gene prioritization and sample classification of cancer gene expression data. PLoS One 2012, 7:e39932.
83. Swan AL, Mobasheri A, Allaway D, Liddell S, Bacardit J. Application of machine learning to proteomics data: classification and biomarker identification in postgenomics biology. Omics 2013, 17:595-610.
84. Cappello F, Geist A, Gropp B, Kalé LV, Kramer B, Snir M. Toward exascale resilience. Int J High Perform Comput Appl 2009, 23:374-388.
85. Jin H, Chen Y, Zhu H, Sun X-H. Optimizing hpc fault-tolerant environment: an analytical approach. In: 39th International Conference on Parallel Processing (ICPP), San Diego, CA, 2010, 525-534.
86. Jin H, Sun X-H. Performance comparison under failures of mpi and mapreduce: an analytical approach. Future Gener Comput Syst 2013, 29:1808-1815.
87. Tu T, Rendleman CA, Borhani DW, Dror RO, Gullingsrud J, Jensen M, Klepeis JL, Maragakis P, Miller PJ, Stafford KA, Shaw DE. A scalable parallel framework for analyzing terascale molecular dynamics simulation trajectories. In: ACM/IEEE Conference on Supercomputing (SC), Austin, TX, 2008, 1-12.
88. Plimpton SJ, Devine KD. Mapreduce in mpi for large-scale graph algorithms. Parallel Comput 2011, 37:610-632.
89. Srinivasan A, Faruquie TA, Joshi S. Data and task parallelism in ilp using mapreduce. Mach Learn 2012, 86:141-168.
90. Dean J, Ghemawat S. MapReduce: a flexible data processing tool. Commun ACM 2010, 53:72-77.
91. Pavlo A, Paulson E, Rasin A, Abadi DJ, DeWitt DJ, Madden S, Stonebraker M. A comparison of approaches to large-scale data analysis. In: 2009 ACM SIGMOD International Conference on Management of data, Providence, RI, 2009, 165-178.
92. Duda RO, Stork DG, Hart PE. Pattern Classification. New York, NY; Chichester: John Wiley & Sons; 2000.
93. Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning: Data Mining, Inference and Prediction. 2nd ed. New York, NY; Berlin/Heidelberg: Springer; 2009.
94. He Q, Du C, Wang Q, Zhuang F, Shi Z. A parallel incremental extreme SVM classifier. Neurocomputing 2011, 74:2532-2540.
95. López V, del Río S, Benítez JM, Herrera F. Cost-sensitive linguistic fuzzy rule based classification systems under the mapreduce framework for imbalanced big data. Fuzzy Set Syst in press. doi: 10.1016/j.fss.2014.01.015.
96. He Q, Wang H, Zhuang F, Shang T, Shi Z. Parallel sampling from big data with uncertainty distribution. Fuzzy Set Syst in press. doi: 10.1016/j.fss.2014.01.016:1-14.
97. Zhang J, Rui Li T, Ruan D, Gao Z, Zhao C. A parallel method for computing rough set approximations. Inf Sci 2012, 194:209-223.
98. Palit I, Reddy CK. Scalable and parallel boosting with mapreduce. IEEE Trans Knowl Data Eng 2012, 24:1904-1916.
99. Río S, López V, Benítez J, Herrera F. On the use of mapreduce for imbalanced big data using random forest. Inf Sci in press. doi: 10.1016/j.ins.2014.03.043.
100. Bahga A, Madisetti VK. Analyzing massive machine maintenance data in a computing cloud. IEEE Trans Parallel Distrib Syst 2012, 23:1831-1843.
101. Magoulès F, Zhao H-X, Elizondo D. Development of an rdp neural network for building energy consumption fault detection and diagnosis. Energy Build 2013, 62:133-138.
102. Wang P, Wang J, Chen Y, Ni G. Rapid processing of remote sensing images based on cloud computing. Future Gener Comput Syst 2013, 29:1963-1968.
103. Schatz MC. Cloudburst: highly sensitive read mapping with mapreduce. Bioinformatics 2009, 25:1363-1369.
104. Schönherr S, Forer L, Weißensteiner H, Kronenberg F, Specht G, Kloss-Brandstätter A. Cloudgene: a graphical execution platform for mapreduce programs on private and public clouds. BMC Bioinformatics 2012, 13:200.
105. Taylor RC. An overview of the hadoop/mapreduce/hbase framework and its current applications in bioinformatics. BMC Bioinformatics 2010, 11:S1.
106. Wang Y, Goh W, Wong L, Montana G. Random forests on hadoop for genome-wide association studies of multivariate neuroimaging phenotypes. BMC Bioinformatics 2013, 14:S6.
107. Han J, Cheng H, Xin D, Yan X. Frequent pattern mining: current status and future directions. Data Mining Knowl Discov 2007, 15:55-86.
108. Zhang C, Zhang S. Association Rule Mining: Models and Algorithms. Berlin/Heidelberg: Springer; 2002.
109. Woo J. Market basket analysis algorithms with mapreduce. WIREs Data Min Knowl Discov 2013, 3:445-452.
110. Qiao S, Li T, Peng J, Qiu J. Parallel sequential pattern mining of massive trajectory data. Int J Comput Intell Syst 2010, 3:343-356.
111. Jain AK. Data clustering: 50 years beyond k-means. Pattern Recognit Lett 2010, 31:651-666.
112. Xu R, Wunsch D. Clustering. 1st ed. Hoboken, New Jersey (USA): Wiley-IEEE Press; 2009.
113. Aljarah I, Ludwig SA. Parallel particle swarm optimization clustering algorithm based on mapreduce methodology. In: 4th World Congress Nature and Biologically Inspired Computing (NaBIC), Mexico City, Mexico, 2012, 104-111.
114. Kim Y, Shim K, Kim M-S, Sup Lee J. Dbcure-mr: an efficient density-based clustering algorithm for large data using mapreduce. Inf Syst 2014, 42:15-35.
115. Yang Y, Rutayisire T, Lin C, Li T, Teng F. An improved cop-kmeans clustering for solving constraint violation based on mapreduce framework. Fundam Inf 2013, 126:301-318.
116. Ricci F, Rokach L, Shapira B, Kantor PB, eds. Recommender Systems Handbook. Berlin/Heidelberg: Springer; 2011.
117. Schafer JB, Frankowski D, Herlocker J, Sen S. Collaborative filtering recommender systems. In: Brusilovsky P, Kobsa A, Nejdl W, eds. The Adaptive Web. Berlin/Heidelberg: Springer-Verlag; 2007, 291-324.
118. Kim Y, Shim K. Twilite: a recommendation system for twitter using a probabilistic model based on latent dirichlet allocation. Inf Syst 2013, 42:59-77.
119. Lai C-F, Chang J-H, Hu C-C, Huang Y-M, Chao H-C. Cprs: a cloud-based program recommendation system for digital TV platforms. Future Gener Comput Syst 2011, 27:823-835.
120. Zigkolis C, Karagiannidis S, Koumarelas I, Vakali A. Integrating similarity and dissimilarity notions in recommenders. Expert Syst Appl 2013, 40:5132-5147.
121. Owen S, Anil R, Dunning T, Friedman E. Mahout in Action. 1st ed. Manning; 2011.
122. Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I. Spark: cluster computing with working sets. In: HotCloud, Boston, MA 2010, 1-7.
123. Ericson K, Pallickara S. On the performance of high dimensional data clustering and classification algorithms. Future Gener Comput Syst 2013, 29:1024-1034.
124. Ghoting A, Kambadur P, Pednault EPD, Kannan R. Nimble: a toolkit for the implementation of parallel data mining and machine learning algorithms on mapreduce. In 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2011, San Diego, CA, 334-342.
125. Ghoting A, Krishnamurthy R, Pednault E, Reinwald B, Sindhwani V, Tatikonda S, Tian Y, Vaithyanathan S. Systemml: declarative machine learning on mapreduce. In: 27th International Conference on Data Engineering (ICDE), 2011, Washington, DC, 231-242.
126. Das S, Sismanis Y, Beyer KS, Gemulla R, Haas PJ, McPherson J. Ricardo: integrating R and Hadoop. In: 2010 International Conference on Management of data (SIGMOD), Indianapolis, IN, 2010, 987-998.
127. Guha S, Hafen R, Rounds J, Xia J, Li J, Xi B, Cleveland WS. Large complex data: divide and recombine (D&R) with RHIPE. Stat 2012, 1:53-67.
128. Guha S, Hafen RP, Kidwell P, Cleveland W. Visualization databases for the analysis of large complex datasets. J Mach Learn Res 2009, 5:193-200.
129. Wegener D, Mock M, Adranale D, Wrobel S. Toolkit-based high-performance data mining of large data on mapreduce clusters. In: IEEE International Conference on Data Mining Workshops, Miami, FL, 2009, 296-301.
130. Agneeswaran V. Big Data Analytics Beyond Hadoop: Real-Time Applications with Storm, Spark, and More Hadoop Alternatives. 1st ed. London (U.K.): Pearson; 2014.
131. Wise L. Using Open Source Platforms for Business Intelligence. Amsterdam: Morgan Kaufmann; 2012.
132. Amdahl GM. Validity of the single-processor approach to achieving large scale computing capabilities. In: Sprint Joint Computer Conference of the American Federation of Information Processing Societies, Atlantic City, NJ, 1967, 483-485.
133. Lin J. Mapreduce is good enough? Big Data 2013, 1:BD28-BD37.
134. Kajdanowicz T, Kazienko P, Indyk W. Parallel processing of large graphs. Future Gener Comput Syst 2014, 32:324-337.
135. Srirama SN, Jakovits P, Vainikko E. Adapting scientific computing problems to clouds using mapreduce. Future Gener Comput Syst 2012, 28:184-192.
136. Chen Y, Ferguson A, Martin B, Wang A, Wendell P. Big data and internships at cloudera. ACM Crossroads 2012, 19:35-37.
137. Zhang J, Wong J-S, Li T, Pan Y. A comparison of parallel large-scale knowledge acquisition using rough set theory on different mapreduce runtime systems. Int J Approx Reason 2014, 55:896-907.
138. Isard M, Budiu M, Yu Y, Birrell A, Fetterly D. Dryad: distributed data-parallel programs from sequential building blocks. In: 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems (EuroSys), New York, NY, 2007, 59-72.
139. Yu Y, Isard M, Fetterly D, Budiu M, Erlingsson L, Gunda PK, Currey J. Dryadlinq: a system for general-purpose distributed data-parallel computing using a high-level language. In: Operating Systems Design and Implementation, San Diego, CA, 2008, 1-14.
140. Bu Y, Howe B, Balazinska M, Ernst MD. The haloop approach to large-scale iterative data analysis. PVLDB 2012, 21:169-190.
141. Ekanayake J, Li H, Zhang B, Gunarathne T, Bae S-H, Qiu J, Fox G. Twister: a runtime for iterative mapreduce. In: ACM International Symposium on High Performance Distributed Computing (HPDC), 2010, New York, NY, 810-818.
142. Zaharia M, Chowdhury M, Das T, Dave A, Ma J, McCauley M, Franklin MJ, Shenker S, Stoica I. Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing. In: 9th USENIX Conference on Networked Systems Design and Implementation, San Jose, CA, 2012, 1-14.
143. Kraska T, Talwalkar A, Duchi J, Griffith R, Franklin M, Jordan M. Mlbase: a distributed machine learning system. In: Conference on Innovative Data Systems Research, Asilomar, CA, 2013, 1-7.
144. Valiant LG. A bridging model for parallel computation. Commun ACM 1990, 33:103-111.
145. Malewicz G, Austern MH, Bik AJ, Dehnert JC, Horn I, Leiser N, Czajkowski G. Pregel: a system for large-scale graph processing. In: 2010 ACM SIGMOD International Conference on Management of data, Indianapolis, IN, 2010, 135-146.
146. Martella C, Shaposhnik R, Logothetis D. Giraph in Action. 1st ed. Manning; 2014.
147. Xin RS, Gonzalez JE, Franklin MJ, Stoica I. Graphx: a resilient distributed graph system on spark. In: GRADES'13, New York, NY, 2013, 1-6.
148. Low Y, Kyrola A, Bickson D, Gonzalez J, Guestrin C, Hellerstein JM. Distributed graphlab: a framework for machine learning in the cloud. PVLDB 2012, 5:716-727.
149. Anderson Q. Storm Real-Time Processing Cookbook. 1st ed. Sebastopol, CA: O'Reilly; 2013.
150. Neumeyer L, Robbins B, Nair A, Kesari A. S4: distributed stream computing platform. In: 2010 IEEE Data Mining Workshops (ICDMW), Sydney, Australia, 2010, 170-177.
151. Zaharia M, Das T, Li H, Hunter T, Shenker S, Stoica I. Discretized streams: fault-tolerant streaming computation at scale. In: 24th ACM Symposium on Operating Systems Principles (SOSP), Farmington, PA, 2013, 423-438.
152. Ranger C, Raghuraman R, Penmetsa A, Bradski G, Kozyrakis C. Evaluating mapreduce for multi-core and multiprocessor systems. In: IEEE 13th International Symposium on High Performance Computer Architecture (HPCA), Phoenix, AZ, 2007, 1-6.
153. Fang W, He B, Luo Q, Govindaraju N. Mars: accelerating mapreduce with graphics processors. IEEE Trans Parallel Distrib Syst 2011, 22:608-620.
154. Chu C-T, Kim SK, Lin Y-A, Yu Y, Bradski GR, Ng AY, Olukotun K. Map-reduce for machine learning on multicore. In: Advances in Neural Information Processing Systems 19, Twentieth Annual Conference on Neural Information Processing Systems (NIPS), Vancouver, Canada, 2006, 281-288.
155. Ailamaki A, Govindaraju NK, Harizopoulos S, Manocha D. Query co-processing on commodity processors. In: 32nd International Conference on Very Large Data Bases (VLDB), Seoul, Korea, 2006, 1267-1267.
156. Stuart JA, Owens JD. Multi-gpu mapreduce on gpu clusters. In: 25th IEEE International Parallel and Distributed Processing Symposium (IPDPS), Anchorage, AK, 2011, 1068-1079.
157. Basaran C, Kang K-D. Grex: an efficient mapreduce framework for graphics processing units. J Parallel Distrib Comput 2013, 73:522-533.
158. Pan Y, Zhang J. Parallel programming on cloud computing platforms-challenges and solutions. J Convergence 2012, 3:23-28.
159. Schmidt K, Phillips C. Programming Elastic MapReduce. Ist ed. Sebastopol, CA: O'Reilly; 2013.
160. Nadipalli R. HDInsight Essentials. Ist ed. Birmingham: PACKT Publishing; 2013.
161. Jiang D, Ooi B, Shi L, Wu S. The performance of mapreduce: an in-depth study. PVLDB 2010, 3:472-483.
162. Stonebraker M, Abadi D, DeWitt D, Madden S, Paulson E, Pavlo A, Rasin A. Mapreduce and parallel dbmss: friends or foes? Commun ACM 2010, 53:64-71.