Scalable machine-learning algorithms for big data analytics: a comprehensive review

Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery

Volumn 6, Issue 6, 2016, Pages 194-214

  Gupta, Preeti ^a   Sharma, Arun ^a   Jindal, Rajni ^b  

^a INDIRA GANDHI DELHI TECHNICAL UNIVERSITY FOR WOMEN   (India)

^b DELHI TECHNOLOGICAL UNIVERSITY   (India)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DIGITAL STORAGE; LEARNING ALGORITHMS; LEARNING SYSTEMS;

COMPUTATIONAL FRAMEWORK; DATA ANALYTICS; EMERGING TECHNOLOGIES; HETEROGENEOUS DATA; LITERATURE SURVEY; PARALLEL DATA; SCALABLE ALGORITHMS; SCALABLE MACHINE LEARNING;

BIG DATA;

EID: 84987704255     PISSN: 19424787     EISSN: 19424795     Source Type: Journal    
DOI: 10.1002/widm.1194     Document Type: Review

References (63)

1. Owais SS, Hussein NS. Extract five categories CPIVW from the 9V characteristics of the big data. Int J Adv Comput Sci Appl 2016, 7:254–258.
2. Wu X, Zhu X, Wu GQ, Ding W. Data mining with big data. IEEE Trans Knowl Data Eng 2014, 26:97–107.
3. Chen H, Chiang RHL, Storey VC. Business intelligence and analytics: from big data to big impact. MIS Q 2012, 36:1165–1188.
4. Singh D, Reddy CK. A survey on platforms for big data analytics. J Big Data 2014, 2:1–20. doi:10.1186/s40537.014.0008.6.
5. Tsai C, Lai C, Chao H, Vasilakos AV. Big data analytics: a survey. J Big Data 2015, 2:1–32. doi:10.1186/s40537.015.0030.3.
6. Nathalie J, Stefanowski J. Big data analysis: new algorithms for a new society. In: A Machine Learning Perspective on Big Data Analysis. Springer International Publishing: Cham; 2016, 1–31.
7. Cohen J, Dolan B, Dunlap M, Hellerstein J, Welton C. Mad skills: new analysis practices for big data. Proc VLDB Endow 2009, 2:1481–1492. doi:10.14778/1687553.1687576.
8. Schmarzo B. Understanding the role of Hadoop in your bi environment. Available at: https://infocus.emc.com/williamschmarzo/understandingtheroleofhadoop-inyourbienvironment/. (Accessed February 6, 2016).
9. Borthakur D. HDFS architecture guide. Available at: https://hadoop.apache.org/docs/r1.2.1/hdfsdesign.pdf. (Accessed February 6, 2016).
10. Bakshi K. Considerations for big data: architecture and approach. In: Proceedings of the 2012 I.E. Aerospace Conference, Big Sky, Montana, US, Mar 3–10, 2012, 1–7. doi:10.1109/AERO.2012.6187357.
11. Kulkarni AP, Khandewal M. Survey on hadoop and introduction to YARN. Int J Emerging Technol Adv Eng 2014, 4:82–87.
12. Roman J. Hadoopecosystemtable. Available at: https://hadoopecosystemtable.github.io. (Accessed February 6, 2016).
13. Brewer E. CAP twelve years later: how the “rules” have changed. Computer 2012, 45:23–29. doi:10.1109/MC.2012.37.
14. Sharma S, Tim US, Gadia SK, Wong JS, Shandilya R, Peddoju SK. Classification and comparison of NoSQL big data models. Int J Big Data Intell 2015, 2:201–221.
15. Moniruzzaman ABM, Hossain SA. NoSQL database: new era of databases for big data analytics—classification, characteristics and comparison. Int J Database Theor Appl 2013, 6:1–14.
16. Moniruzzaman ABM. NewSQL: towards next-generation scalable RDBMS for online transaction processing (OLTP) for big data management. International Journal of Database Theory & Application 2014, 7:121–130.
17. Sundaresan B, Kandavel D. Big languages for big data: a study and comparison of current trend in data processing techniques for big data. In: Design and Implementation of Programming Languages Seminar, TU, Darmstadt, Germany, 2014. doi: 10.13140/2.1.5107.8402.
18. Lin J. Mapreduce is good enough? If all you have is a hammer, throw away everything that's not a nail! Big Data 2012, 1:28–37.
19. Doulkeridis C, Nørvåg K. A survey of large-scale analytical query processing in MapReduce. VLDB J 2013, 23:355–380. doi:10.1007/s00778.013.0319.9.
20. Landset S, Khoshgoftaar T, Richter A, Hasanin T. A survey of open source tools for machine learning with big data in the Hadoop ecosystem. J Big Data 2015, 2:1–36. doi:10.1186/s40537.015.0032.1.
21. Zaharia M, Chowdhury M, Das T, Dave A, Ma JM, McCauley M, Franklin MJ, Shenker S, Stoica I. Fast and interactive analytics over hadoop data with Spark. USENIX 2012, 37:45–51.
22. Shahrivari S, Jalili S. Beyond batch processing: towards real-time and streaming big data. Computers 2014, 3:117–129.
23. Marz N, Warren J. Big Data: Principles and Best Practices of Scalable Realtime Data Systems. Greenwich, CT: Manning Publications Co; 2015.
24. Vizard M. Cloudera aims to replace MapReduce with Spark as default hadoop framework. Available at: http://www.datacenterknowledge.com/archives/2015/09/09/cloudera-aims-to-replace-mapr. (Accessed February 6, 2016).
25. Zhao W, Ma H, He Q. Parallel K-means clustering based on MapReduce. In: Proceedings of First International Conference of Cloud Computing (CloudCom), Springer, Beijing, China, 2009, 674–679.
26. Thomas L, Annappa B. Application of parallel K-means clustering algorithm for prediction of optimal path in self aware mobile ad-hoc networks with link stability. In: Proceedings of First International Conference of Advances in Computing and Communications, Springer, Kochi, India, July 22–24, 2011, 396–405.
27. Arthur D, Vassilvitskii S. K-means++: the advantages of careful seeding. In: Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms (SODA '07), Society for Industrial and Applied Mathematics, Philadelphia, PA, USA, 2007, 1027–1035.
28. Bahmani B, Moseley B, Vattani A, Kumar R, Vassilvitskii S. Scalable k-means++. PVLDB 2012, 5:622–633.
29. He Y, Tan H, Luo W, Feng S, Fan J. MR-DBSCAN: a scalable MapReduce-based DBSCAN algorithm for heavily skewed data. Front Comput Sci 2014, 8:83–99. doi:10.1007/s11704.013.3158.3.
30. Yu Y, Zhao J, Wang X, Wang Q, Zhang Y. Cludoop: an efficient distributed density-based clustering for big data using Hadoop. Int J Distr Sensor Network 2015, 2015:1–13. doi:10.1155/2015/579391.
31. Jin C, Liu R, Chen Z, Hendrix W, Agrawal A, Choudhary A. A scalable hierarchical clustering algorithm using Spark. In: Proceedings of IEEE First International Conference on Big Data Computing Service and Applications (BigDataService), San Francisco Bay, CA, USA, 2015, 418–426. doi: 10.1109/BigDataService.2015.67.
32. Yan W, Brahmakshatriya U, Xue Y, Gilder M, Wise B. p-pic: parallel power iteration clustering for big data. J Parallel Distr Comput 2013, 73:352–359.
33. Jayalatchumy D, Thambidurai P. Implementation of p-pic algorithm in MapReduce to handle big data. Int J Res Eng Technol 2014, 3:113–118.
34. Zhu B, Mara A, Mozo A. CLUS: parallel subspace clustering algorithm on spark. In: Proceedings of New Trends in Databases and Information Systems, Poitiers, France, 2015, 175–185.
35. Cordeiro RLF, Traina JC, Traina AJM, Lo'pez J, Kang U, Faloutsos C. Clustering very large multi-dimensional datasets with MapReduce. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’11, ACM: New York, NY, USA, 2011, 690–698. doi: 10.1145/2020408.2020516.
36. Papadimitriou S, Sun J. Disco: distributed co-clustering with map-reduce: a case study towards petabyte-scale end-to-end mining. In: Proceedings of the Eighth IEEE International Conference on Data Mining, ICDM ’08, IEEE Computer Society: Washington, DC, USA, 2008, 512–521, doi: 10.1109/ICDM.2008.142.
37. Dai W, Ji W. A MapReduce implementation of C4. 5 decision tree algorithm. Int J Database Theor Appl 2014, 7:49–60.
38. Purdila V, Pentiuc S. MR-tree—a scalable MapReduce algorithm for building decision trees. J Appl Computer Sci Math 2014, 16:16–19.
39. Salperwyck C, Maby S, Cubillé J, Lagacherie M. CourboSpark: decision tree for time-series on Spark. In: Proceedings of the 1st International Workshop on Advanced Analytics and Learning on Temporal Data, Porto, Portugal, 2015.
40. Han J, Liu Y, Sun X. A scalable random forest algorithm based on MapReduce. In: Proceedings of the 4th IEEE International Conference on Software Engineering and Service Science (ICSESS), Beijing, China, May 23–25, 2013, 849–852. doi: 10.1109/ICSESS.2013.6615438.
41. Panda B, Herbach J, Basu S, Bayardo RJ. Planet: massively parallel learning of tree ensembles with MapReduce. PVLDB 2009, 2:1426–1437.
42. Wu G, Li H, Hu X, Bi Y, Zhang J, Wu X. MReC4.5: C4.5 ensemble classification with MapReduce. In: Proceedings of the Fourth ChinaGrid Annual Conference, Yantai, China, Aug 21–22, 2009, 249–255. doi: 10.1109/ChinaGrid.2009.39.
43. Singh K, Guntuku SC, Thakur A, Hota C. Big data analytics framework for peer-to-peer botnet detection using random forests. Inform Sci 2014, 278:488–497. doi:10.1016/j.ins.2014.03.066.
44. Río SD, López V, Benítez JM, Herrera F. A MapReduce approach to address big data classification problems based on the fusion of linguistic fuzzy rules. Int J Comput Intell Syst 2015, 8:422–437. doi:10.1080/18756891.2015.1017377.
45. Dai Y, Sun H. The naive Bayes text classification algorithm based on rough set in the cloud platform. J Chem Pharmaceut Res 2014, 6:1636–1643.
46. Liu B, Blasch E, Chen Y, Shen D, Chen G. Scalable sentiment classification for big data analysis using naive Bayes classifier. In: Proceedings of IEEE International Conference on Big Data, Silicon Valley, CA, USA, 2013, 99–104.
47. Sun ZQ, Fox GC. Study on parallel SVM based on MapReduce. In: International Conference on Parallel and Distributed Processing Techniques and Applications, Las Vegas, NV, USA, 2012, 495–561.
48. Xu K, Wen C, Yuan Q, He X, Tie J. A MapReduce based parallel SVM for email classification. J Network 2014, 9:1640–1647.
49. Khairnar J, Kinikar M. Sentiment analysis based mining and summarizing using SVM- Mapreduce. Int J Comput Sci Inform Tech 2014, 5:4081–4085.
50. Liu Y, Xu L, Li M. The parallelization of back propagation neural network in MapReduce and Spark. Int J Parallel Program 2016, 1–20. doi:10.1007/s10766.016.0401.1.
51. Zhang H, Xiao N. Parallel implementation of multi-layered neural networks based on MapReduce on cloud computing clusters. Soft Comput 2015, 20:1471–1483. doi:10.1007/s00500.015.1599.3.
52. Rehab MA, Boufarès F. Scalable massively parallel learning of multiple linear regression algorithm with MapReduce. In: IEEE International Conference Trustcom/BigDataSE/ISPA, Helsinki, Finland, Aug 20–22, 2015, 41–47. doi:10.1109/Trustcom.2015.560.
53. Hariharan C, Shivashankar S. Large scale multi-view learning on MapReduce. In: Proceedings of 19th International Conference on Advanced Computing and Communications, Chennai, India, 2013.
54. Zhao Q, Ye F, Wang S. A new back-propagation neural network algorithm for a big data environment based on punishing characterized active learning strategy. Int J Knowl Syst Sci 2013, 4:32–45. doi:10.4018/ijkss.2013100103.
55. Li Y, Schuurmans D. Mapreduce for parallel reinforcement learning. In: Proceedings of the 9th European Conference on Recent Advances in Reinforcement Learning, EWRL’11, Springer-Verlag: Berlin, Heidelberg, Germany, 2012, 309–320.
56. Barrett E, Duggan J, Howley E. A parallel framework for Bayesian reinforcement learning. Connection Sci 2014, 26:7–23. doi:10.1080/09540091.2014.885268.
57. Chen XW, Lin X. Big data deep learning: challenges and perspectives. IEEE Access 2014, 2:514–525. doi:10.1109/ACCESS.2014.2325029.
58. Zhang K, Chen XW. Large-scale deep belief nets with MapReduce. IEEE Access 2014, 2:395–403. doi:10.1109/ACCESS.2014.2319813.
59. Ibrahim S, Jin H, Lu L, He B, Antoniu G, Wu S. Handling partitioning skew in MapRe duce using LEEN. Peer-to-Peer Network Appl 2013, 6:409–424. doi:10.1007/s12083.013.0213.7.
60. Chen Q, Yao J, Xiao Z. Libra: lightweight data skew mitigation in MapReduce. IEEE Trans Parallel Distr Syst 2015, 26:2520–2533. doi:10.1109/TPDS.2014.2350972.
61. Desale D. Top 15 frameworks for machine learning experts. Available at: http://www.kdnuggets.com/2016/04/top-15-frameworks-machine-learning-experts.html. (Accessed June 30, 2016).
62. Xiaolong J, Benjamin WW, Xueqi C, Yuanzhuo W. Significance and challenges of big data research. Big Data Res 2015, 2:59–64. doi:10.1016/j.bdr.2015.01.006.
63. Riggins J. Apache spark for deep learning: two case studies. Available at: http://thenewstack.io/two-tales-big-data-framework-adoption-apache-spark/. (Accessed June 30, 2016).