Big Data technologies: A survey

Journal of King Saud University - Computer and Information Sciences

Volumn 30, Issue 4, 2018, Pages 431-448

  Oussous, Ahmed ^a   Benjelloun, Fatima Zahra ^a   Ait Lahcen, Ayoub ^a,b   Belfkih, Samir ^a  

^a IBN TOFAIL UNIVERSITY   (Morocco)

^b MOHAMMED V UNIVERSITY   (Morocco)

Author keywords

Big Data; Big Data analytics; Big Data distributions; Hadoop; Machine learning; NoSQL

Indexed keywords

EID: 85020839077     PISSN: 13191578     EISSN: 22131248     Source Type: Journal    
DOI: 10.1016/j.jksuci.2017.06.001     Document Type: Review

References (123)

1. Acharjya, D., Ahmed, K.P., A survey on big data analytics: challenges, open research issues and tools. Int. J. Adv. Comput. Sci. App. 7 (2016), 511–518.
2. Acharjya, D., Ahmed, K.P., A survey on big data analytics: challenges, open research issues and tools. Int. J. Adv. Comput. Sci. App. 7 (2016), 511–518.
3. Aher, S.B., Kulkarni, A.R., Hadoop mapreduce: a programming model for large scale data processing. Am. J. Comput. Sci. Eng. Surv. (AJCSES) 3 (2015), 01–10.
4. Ali, A., Qadir, J., urRasool, R., urRasool, R., Sathiaseelan, A., Zwitter, A., Crowcroft, J., Big data for development: applications and techniques. Big Data Anal., 1, 2016, 2.
5. Ames, A., Abbey, R., Thompson, W., 2013. Big Data Analytics Benchmarking SAS, R, and Mahout. SAS Technical Paper.
6. Azarmi, B., The big (data) problem. Scalable Big Data Architecture, 2016, Springer, 1–16.
7. Azarmi, B., Scalable Big Data Architecture. 2016, Springer.
8. Bansal, H., Mehrotra, S., Chauhan, S., Apache Hive Cookbook. 2016, Packt Publ.
9. Benjelloun, F.-Z., Ait Lahcen, A., Big data security: challenges, recommendations and solutions. Handbook of Research on Security Considerations in Cloud Computing, 2015, IGI Global, 301–313.
10. Benjelloun, F.-Z., Ait Lahcen, A., Belfkih, S., 2015. An overview of big data opportunities, applications and tools. In: Intelligent Systems and Computer Vision (ISCV), 2015 (pp. 1–6). IEEE.
11. Beyer, K.S., Ercegovac, V., Gemulla, R., Balmin, A., Eltabakh, M., Kanne, C.-C., Ozcan, F., Shekita, E.J., 2011. Jaql: a scripting language for large scale semistructured data analysis. In: Proceedings of VLDB Conference.
12. Bishop, C.M., Pattern recognition. Mach. Learn. 128 (2006), 1–58.
13. Botta, A., de Donato, W., Persico, V., Pescapé A., Integration of cloud computing and internet of things: a survey. Future Gener. Comput. Syst. 56 (2016), 684–700.
14. Brown, M.S., Data Discovery For Dummies, Teradata Special Edition. 2014, John Wiley & Sons Inc.
15. Chen, C.P., Zhang, C.-Y., Data-intensive applications, challenges, techniques and technologies: a survey on big data. Inf. Sci. 275 (2014), 314–347.
16. Chen, M., Mao, S., Liu, Y., Big data: a survey. Mobile Networks App. 19 (2014), 171–209.
17. Chen, M., Mao, S., Zhang, Y., Leung, V.C., Big Data: Related Technologies, Challenges and Future Prospects. 2014, Springer.
18. Chullipparambil, C.P., Big Data Analytics Using Hadoop Tools. (Ph.D. thesis), 2016, San Diego State University.
19. Coronel, C., Morris, S., Database Systems: Design, Implementation, & Management. 2016, Cengage Learning.
20. De carvalho, O.M., Roloff, E., Navaux, P.O., 2013. A Survey of the state-of-the-art in event processing. In: 11th Workshop on Parallel and Distributed Processing (WSPPD).
21. Di Martino, B., Aversa, R., Cretella, G., Esposito, A., Kołodziej, J., Big data (lost) in the cloud. Int. J. Big Data Intell. 1 (2014), 3–17.
22. Dijcks, J.P., 2012. Oracle: Big Data for the Enterprise. Oracle White Paper.
23. Dimiduk, N., Khurana, A., Ryan, M.H., Stack, M., 2013. HBase in Action. Manning Shelter Island.
24. Dinsmore, T.W., Streaming analytics. Disruptive Analytics, 2016, Springer, 117–144.
25. Emani, C.K., Cullot, N., Nicolle, C., Understandable big data: a survey. Comput. Sci. Rev. 17 (2015), 70–81.
26. Fang, H., Zhang, Z., Wang, C.J., Daneshmand, M., Wang, C., Wang, H., A survey of big data research. IEEE Network 29 (2015), 6–9.
27. Furht, B., Villanustre, F., Introduction to big data. Big Data Technol. App., 2016, Springer International Publishing, Cham, 3–11.
28. Gandomi, A., Haider, M., Beyond the hype: big data concepts, methods, and analytics. Int. J. Inf. Manage. 35 (2015), 137–144.
29. George, L., HBase: The Definitive Guide. 2011, O'Reilly Media Inc.
30. Gollapudi, S., Getting Started with Greenplum for Big Data Analytics. 2013, Packt Publishing Ltd.
31. Hoffman, S., Apache Flume: Distributed Log Collection for Hadoop. 2013, Packt Publishing Ltd.
32. Hoffman, S., Apache Flume: Distributed Log Collection for Hadoop. 2015, Packt Publishing Ltd.
33. Hsieh, M.-Y., Li, G.-L., Liao, M.-H., Chou, W.-K., Li, K.-C., Accurate analysis of a movie recommendation service with linked data on hadoop and mahout. Frontier Computing, 2016, Springer, 551–560.
34. Huang, Y., Li, T., Luo, C., Fujita, H., Horng, S.-J., Dynamic variable precision rough set approach for probabilistic set-valued information systems. Knowledge-Based Syst. 122 (2017), 131–147.
35. Huang, Y., Li, T., Luo, C., Fujita, H., Horng, S.-J., Matrix-based dynamic updating rough fuzzy approximations for data mining. Knowledge-Based Syst. 119 (2017), 273–283.
36. Hurwitz, J., Nugent, A., Halper, F., Kaufman, M., 2013. Big Data for Dummies. (1st ed.). For Dummies.
37. Islam, M.K., Srinivasan, A., Apache Oozie: The Workflow Scheduler for Hadoop. 2015, O'Reilly Media Inc.
38. Jadhav, A., Deshpande, L., A survey on approaches to efficient classification of data streams using concept drift. Int. J., 4, 2016.
39. Jain, A., Instant Apache Sqoop. 2013, Packt Publishing Ltd.
40. Junqueira, F., Reed, B., ZooKeeper: Distributed Process Coordination. 2013, O'Reilly Media Inc.
41. Kamrul Islam, M., Srinivasan, A., Apache Oozie The Workflow Scheduler for Hadoop. 2014, O'Reilly Media Inc.
42. Kankanhalli, A., Hahn, J., Tan, S., Gao, G., Big data and analytics in healthcare: introduction to the special section. Inf. Syst. Front. 18 (2016), 233–235.
43. Karau, H., Fast Data Processing with Spark. 2013, Packt Publishing Ltd.
44. Khan, N., Yaqoob, I., Hashem, I.A.T., Inayat, Z., Mahmoud Ali, W.K., Alam, M., Shiraz, M., Gani, A., Big data: survey, technologies, opportunities, and challenges. Sci. World J., 2016.
45. Kobielus, J.G., 2012. The forrester wave: Enterprise hadoop solutions, q1 2012. Forrester.
46. Krishnan, K., Data Warehousing in the Age of Big Data. 1st ed., 2013, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
47. Kune, R., Konugurthi, P.K., Agarwal, A., Chillarige, R.R., Buyya, R., The anatomy of big data computing. Software: Pract. Experience 46 (2016), 79–105.
48. Landset, S., Khoshgoftaar, T.M., Richter, A.N., Hasanin, T., A survey of open source tools for machine learning with big data in the hadoop ecosystem. J. Big Data, 2, 2015, 1.
49. Lee, I., Big data: dimensions, evolution, impacts, and challenges. Bus. Horizons, 2017.
50. Letouzé E., 2012. Big Data for Development: Challenges & Opportunities. UN Global Pulse.
51. Loganathan, A., Sinha, A., Muthuramakrishnan, V., Natarajan, S., A systematic approach to Big Data. Int. J. Comput. Sci. Inf. Technol. 4 (2014), 869–878.
52. Lovalekar, S., Big Data: an emerging trend in future. Int. J. Comput. Sci. Inf. Technol., 5, 2014.
53. Lublinsky, B., Smith, K.T., Yakubovich, A., Professional Hadoop Solutions. 2013, John Wiley & Sons.
54. Luo, C., Li, T., Chen, H., Fujita, H., Yi, Z., Efficient updating of probabilistic approximations with incremental objects. Knowledge-Based Syst. 109 (2016), 71–83.
55. Luo, J., Wu, M., Gopukumar, D., Zhao, Y., Big data application in biomedical research and health care: a literature review. Biomed. Inf. Insights, 8, 2016, 1.
56. Lydia, E.L., Swarup, M.B., Big data analysis using hadoop components like flume, mapreduce, pig and hive. Int. J. Sci. Eng. Comput. Technol., 5, 2015, 390.
57. Lyko, K., Nitzschke, M., Ngomo, A.-C.N., Big data acquisition. New Horizons for a Data-Driven Economy, 2016, Springer, 39–61.
58. Maeda, K., Comparative survey of object serialization techniques and the programming supports. J. Commun. Comput. 9 (2012), 920–928.
59. Maheswari, N., Sivagami, M., Large-scale data analytics tools: apache hive, pig, and hbase. Data Sci. Big Data Comput., 2016, Springer, 191–220.
60. Mall, N.N., Rana, S., et al. Overview of big data and hadoop. Imperial J. Interdiscip. Res., 2, 2016.
61. Manoochehri, M., Data Just Right: Introduction to Large-scale Data & Analytics. 2013, Addison-Wesley.
62. Mazumder, S., Big data tools and platforms. Big Data Concepts, Theories, and Applications, 2016, Springer, 29–128.
63. McAfee, A., Brynjolfsson, E., et al. Big Data: the management revolution. Harvard Bus. Rev. 90 (2012), 60–68.
64. Menon, R., Cloudera Administration Handbook. 2014, Packt Publishing Ltd.
65. Murthy, B., Goel, M., Lee, A., Granholm, D., Cheung, S., 2011. Oracle Exalytics in-Memory Machine: A brief Introduction.
66. Nadipalli, R., HDInsight Essentials. 2015, Packt Publishing Ltd.
67. Nahar, J., Imam, T., Tickle, K.S., Chen, Y.-P.P., Computational intelligence for heart disease diagnosis: a medical knowledge driven approach. Expert Syst. App. 40 (2013), 96–104.
68. Najafabadi, M.M., Villanustre, F., Khoshgoftaar, T.M., Seliya, N., Wald, R., Muharemagic, E., Deep learning applications and challenges in big data analytics. J. Big Data, 2, 2015, 1.
69. Najafabadi, M.M., Villanustre, F., Khoshgoftaar, T.M., Seliya, N., Wald, R., Muharemagic, E., Deep learning applications and challenges in big data analytics. J. Big Data, 2, 2015, 1.
70. Nambiar, R., Bhardwaj, R., Sethi, A., Vargheese, R., A look at challenges and opportunities of Big Data analytics in healthcare. In: 2013 IEEE International Conference on Big Data, 2013, IEEE, 17–22.
71. Nathan, P., Enterprise Data Workflows with Cascading., 2013, O'Reilly Media Inc.
72. Oussous, A., Benjelloun, F.-Z., AitLahcen, A., Belfkih, S., Comparison and classification of nosql databases for big data. Int. J. Big Data Intell. (In press).
73. Park, B.-J., Oh, S.-K., Pedrycz, W., The design of polynomial function-based neural network predictors for detection of software defects. Inf. Sci. 229 (2013), 40–57.
74. Prasad, B.R., Agarwal, S., Comparative study of big data computing and storage tools: a review. Int. J. Database Theory App. 9 (2016), 45–66.
75. Purcell, B.M., Big Data using cloud computing. Holy Family Univ. J. Technol. Res., 2013.
76. Qiu, J., Wu, Q., Ding, G., Xu, Y., Feng, S., A survey of machine learning for big data processing. EURASIP J. Adv. Signal Process. 2016 (2016), 1–16.
77. Rabkin, A., Katz, R.H., 2010. Chukwa: a system for reliable large-scale log collection. In: LISA. vol. 10. pp. 1–15.
78. Radha, K., Rao, B.T., A study on big data techniques and applications. Int. J. Adv. Appl. Sci. 5 (2016), 101–108.
79. Raghav, R., Pothula, S., Vengattaraman, T., Ponnurangam, D., Raghav, R., Pothula, S., Vengattaraman, T., Ponnurangam, D., A survey of data visualization tools for analyzing large volume of data in big data platform. International Conference on Communication and Electronics Systems (ICCES), 2016, IEEE, 1–6.
80. Raim, A.M., 2013. Introduction to Distributed Computing with pbdR at the UMBC High Performance Computing Facility. Technical Report HPCF-2013-2, UMBC High Performance Computing Facility, University of Maryland, Baltimore County.
81. Rajaraman, V., Big data analytics. Resonance 21 (2016), 695–716.
82. Razzak, M.I., Naz, S., Zaib, A., 2017. Deep learning for medical image processing: Overview, challenges and future. arXiv preprint arXiv: 1704.06825.
83. del Río, S., López, V., Benítez, J.M., Herrera, F., On the use of mapreduce for imbalanced big data using random forest. Inf. Sci. 285 (2014), 112–137.
84. Sakr, S., 2016. Big data 2.0 processing systems: a survey. Springer Briefs in Computer Science.
85. Sakr, S., General-purpose big data processing systems. Big Data 2.0 Processing Systems, 2016, Springer, 15–39.
86. Sakr, S., Introduction. Big Data 2.0 Processing Systems: A Survey, 2016, Springer International Publishing, Cham, 1–13.
87. Sakr, S., Large-scale stream processing systems. Big Data 2.0 Processing Systems, 2016, Springer, 75–89.
88. Salleh, K.A., Janczewski, L., Technological, organizational and environmental security and privacy issues of big data: A literature review. Procedia Comput. Sci. 100 (2016), 19–28.
89. Sammer, E., Hadoop Operations. 2012, O'Reilly Media Inc.
90. Sangeetha, J., Prakash, V.S.J., A survey on big data mining techniques. Int. J. Comput. Sci. Inf. Secur., 15, 2017, 482.
91. Sarkar, D., Introducing HDInsight. Pro Microsoft HDInsight, 2014, Springer, 1–12.
92. Schmarzo, B., Big Data: Understanding How Data Powers Big Business. 2013, John Wiley & Sons.
93. Segleau, D., Laker, K., Stackowiak, R., Mishra, G., Harding, D., Mohiuddin, K., Sun, H., Hornick, M., Nelson, B., Macdonald, B., Plunkett, T., Oracle Big Data Handbook. 2013, McGraw-Hill, Oracle Press.
94. Shapira, G., Seidman, J., Malaska, T., Grover, M., Hadoop Application Architectures. 2015, O'Reilly Media Inc.
95. Shaw, S., Vermeulen, A.F., Gupta, A., Kjerrumgaard, D., Hive architecture. Practical Hive, 2016, Springer, 37–48.
96. Shireesha, R., Bhutada, S., A study of tools, techniques, and trends for big data analytics. IJACTA 4 (2016), 152–158.
97. Siddiqa, A., Karim, A., Gani, A., Big data storage technologies: a survey. Frontiers, 1, 2016.
98. Skourletopoulos, G., Mavromoustakis, C.X., Mastorakis, G., Batalla, J.M., Dobre, C., Panagiotakis, S., Pallis, E., Big data and cloud computing: a survey of the state-of-the-art and research challenges. Advances in Mobile Cloud Computing and Big Data in the 5G Era, 2017, Springer, 23–41.
99. Skowron, A., Jankowski, A., Dutta, S., Interactive granular computing. Granular. Computing 1 (2016), 95–113.
100. Stimmel, C.L., Big Data Analytics Strategies for the Smart Grid. 2014, CRC Press.
101. Stoianov, N., Urueña, M., Niemiec, M., Machnik, P., Maestro, G., Integrated security infrastructures for law enforcement agencies. Multimedia Tools App., 2013, 1–16.
102. Sun, J., Fujita, H., Chen, P., Li, H., Dynamic financial distress prediction with concept drift based on time weighting combined with adaboost support vector machine ensemble. Knowledge-Based Syst. 120 (2017), 4–14.
103. Team, R.C., R Language Definition. 2000, R foundation for statistical computing, Austria.
104. Tsai, C.-W., Lai, C.-F., Chao, H.-C., Vasilakos, A.V., Big data analytics. Big Data Technologies and Applications, 2016, Springer, 13–52.
105. Usha, D., Aps, A.J., A survey of Big Data processing in perspective of hadoop and mapreduce. International Journal of Current Engineering and Technology, 2014.
106. Vohra, D., Using apache sqoop. Pro Docker, 2016, Springer, 151–183.
107. Wadkar, S., Siddalingaiah, M., Apache Ambari. Pro Apache Hadoop, 2014, Springer, 399–401.
108. Wadkar, S., Siddalingaiah, M., Hcatalog and hadoop in the enterprise. Pro Apache Hadoop, 2014, Springer, 271–282.
109. Wang, H., Xu, Z., Fujita, H., Liu, S., Towards felicitous decision making: an overview on challenges and trends of big data. Inf. Sci. 367 (2016), 747–765.
110. Wang, H., Xu, Z., Pedrycz, W., An overview on the roles of fuzzy set techniques in big data processing: trends, challenges and opportunities. Knowledge-Based Syst. 118 (2017), 15–30.
111. Wang, L., Machine learning in big data. Int. J. Adv. Appl. Sci. 4 (2016), 117–123.
112. Wang, S., Yao, X., Multiclass imbalance problems: analysis and potential solutions. IEEE Trans. Syst. Man Cybern. Part B (Cybern.) 42 (2012), 1119–1130.
113. Weiss, R., Zgorski, L., Obama Administration Unveils Big Data Initiative: Announces 200 Million in New R&D Investments. 2012, Office of Science and Technology Policy, Washington, DC.
114. White, T., Hadoop: The Definitive Guide. 2012, O'Reilly Media Inc.
115. Wu, X., Zhu, X., Wu, G.-Q., Ding, W., Data mining with big data. IEEE Trans. Knowl. Data Eng. 26 (2014), 97–107.
116. Yu, H., Ni, J., Zhao, J., Acosampling: An ant colony optimization-based undersampling method for classifying imbalanced dna microarray data. Neurocomputing 101 (2013), 309–318.
117. Zang, W., Zhang, P., Zhou, C., Guo, L., Comparative study between incremental and ensemble learning on data streams: case study. J. Big Data 1 (2014), 1–16.
118. Zhang, J., Li, T., Ruan, D., Liu, D., Rough sets based matrix approaches with dynamic attribute variation in set-valued information systems. Int. J. Approximate Reasoning 53 (2012), 620–635.
119. Zhou, L., Performance of corporate bankruptcy prediction models on imbalanced dataset: the effect of sampling methods. Knowledge-Based Syst. 41 (2013), 16–25.
120. Zhou, L., Fujita, H., Posterior probability based ensemble strategy using optimizing decision directed acyclic graph for multi-class classification. Inf. Sci. 400 (2017), 142–156.
121. Zhou, L., Wang, Q., Fujita, H., One versus one multi-class classification fusion using optimizing decision directed acyclic graph for predicting listing status of companies. Inf. Fusion 36 (2017), 80–89.
122. Zikopoulos, P., Eaton, C., et al. Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data. 2011, McGraw-Hill Osborne Media.
123. Zikopoulos, P., Parasuraman, K., Deutsch, T., Giles, J., Corrigan, D., et al. Harness the Power of Big Data The IBM Big Data Platform. 2012, McGraw Hill Professional.