Critical analysis of Big Data challenges and analytical methods

Journal of Business Research

Volumn 70, Issue , 2017, Pages 263-286

  Sivarajah, Uthayasankar ^a   Kamal, Muhammad Mustafa ^a   Irani, Zahir ^a   Weerakkody, Vishanth ^a  

^a BRUNEL UNIVERSITY   (United Kingdom)

Author keywords

Big Data; Big Data Analytics; Challenges; Methods; Systematic literature review

Indexed keywords

EID: 85027936282     PISSN: 01482963     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbusres.2016.08.001     Document Type: Article

References (111)

1. Abawajy, J., Comprehensive analysis of big data variety landscape. International Journal of Parallel, Emergent and Distributed Systems 30:1 (2015), 5–14.
2. Abawajy, J.H., Kelarev, A., Chowdhury, M., Large iterative multitier ensemble classifiers for security of big data. IEEE Transactions on Emerging Topics in Computing 2:3 (2014), 352–363.
3. Abdellatif, T.M., Capretz, L.F., Ho, D., Software analytics to software practice: a systematic literature review. Proceedings of the 1st International Workshop on BIG Data Software Engineering – IEEE Press, 2015, 30–36.
4. Agarwal, R., Dhar, V., Editorial – big data, data science, and analytics: the opportunity and challenge for is research. Information Systems Research 25:3 (2014), 443–448.
5. Akerkar, R., Big data computing. 2014, CRC Press, Taylor & Francis Group, Florida, USA.
6. Al Nuaimi, E., Al Neyadi, H., Mohamed, N., Al-Jaroodi, J., Applications of big data to smart cities. Journal of Internet Services and Applications 6:1 (2015), 1–15.
7. Assunção, M.D., Calheiros, R.N., Bianchi, S., Netto, M.A., Buyya, R., Big Data computing and clouds: trends and future directions. Journal of Parallel and Distributed Computing 79 (2015), 3–15.
8. Banerjee, A., Bandyopadhyay, T., Acharya, P., Data analytics: hyped up aspirations or true potential. Vikalpa. The Journal for Decision Makers 38:4 (2013), 1–11.
9. Barbierato, E., Gribaudo, M., Iacono, M., Performance evaluation of NoSQL big-data applications using multi-formalism models. Future Generation Computer Systems 37 (2014), 345–353.
10. Barnaghi, P., Sheth, A., Henson, C., From data to actionable knowledge: big data challenges in the web of things. IEEE Intelligent Systems 28:6 (2013), 6–11.
11. Berners-Lee, T., & Shadbolt, N. (2011). There's gold to be mined from all our data. The Times, London 1:1–2. Online Available at: http://www.thetimes.co.uk/tto/opinion/columnists/article3272618.ece [Accessed on 21st April 2016].
12. Bertot, J.C., Gorham, U., Jaeger, P.T., Sarin, L.C., Choi, H., Big Data, open government and e-government: issues, policies and recommendations. Information Polity 19:1, 2 (2014), 5–16.
13. Bhimani, A., Willcocks, L., Digitisation, Big Data and the transformation of accounting information. Accounting and Business Research 44:4 (2014), 469–490.
14. Bihani, P., Patil, S.T., A comparative study of data analysis techniques. International Journal of Emerging Trends & Technology in Computer Science 3:2 (2014), 95–101.
15. Boyd, D., Crawford, K., Critical questions for big data: Provocations for a cultural, technological, and scholarly phenomenon. Information, communication & society 15:5 (2012), 662–679.
16. Brown, B., Chui, M., Manyika, J., Are you ready for the era of Big Data?. The McKinsey Quarterly 4 (2011), 24–35.
17. Cárdenas, A.A., Manadhata, P.K., Rajan, S.P., Big Data analytics for security. IEEE Security and Privacy 6 (2013), 74–76.
18. Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka, E. Jr., Mitchell, T., Toward an architecture for never-ending language learning. Proceedings of the Conference on Association for the Advancement of Artificial Intelligence, 2010, 1306–1313.
19. Chen, C.L.P., Zhang, C.Y., Data-intensive applications, challenges, techniques and technologies: a survey on big data. Information Sciences 275 (2014), 314–347.
20. Chen, G., Chen, K., Jiang, D., Ooi, B.C., Shi, L., Vo, H.T., Wu, S., E3: an elastic execution engine for scalable data processing. Journal of Information Processing 20:1 (2012), 65–76.
21. Chen, H., Chiang, R.H., Storey, V.C., Business intelligence and analytics: From Big Data to big impact. MIS Quarterly 36:4 (2012), 1165–1188.
22. Chen, J., Chen, Y., Du, X., Li, C., Lu, J., Zhao, S., Zhou, X., Big data challenge: a data management perspective. Frontiers of Computer Science 7:2 (2013), 157–164.
23. Chen, M., Mao, S., Liu, Y., Big Data: a survey. Mobile Networks and Applications 19:2 (2014), 171–209.
24. Crawford, K., The hidden biases of big data. Harvard Business Review Blog. Available at: http://blogs.hbr.org/2013/04/the-hidden-biases-in-big-data/, 1 April, 2013 (accessed 5 January 2016).
25. Cukier, K., The economist, data, data everywhere: A special report on managing information., 2010 Online Available at http://www.economist.com/node/15557443 (Accessed on 20th April 2016).
26. Davenport, T.H., Dyché, J., Big data in big companies. International Institute for Analytics., 2013 Available Online at http://www.demonish.com/cracker/1431316877_1217a9641e/bigdata-bigcompanies-106461.pdf (Accessed 5th January 2016).
27. Davenport, T.H., Harris, J.G., Competing on analytics: The new science of winning. 2007, Harvard Business Press.
28. David, R.J., Han, S.K., A systematic assessment of the empirical support for transaction cost economics. Strategic Management Journal 25:1 (2004), 39–58.
29. Delbufalo, E., Outcomes of inter-organizational trust in supply chain relationships: a systematic literature review and a meta-analysis of the empirical evidence. Supply Chain Management: An International Journal 17:4 (2012), 377–402.
30. Demchenko, Y., Grosso, P., De Laat, C., Membrey, P., Addressing big data issues in scientific data infrastructure. IEEE international conference on collaboration technologies and systems (CTS), 2013, 48–55.
31. Dobre, C., Xhafa, F., Intelligent services for big data science. Future Generation Computer Systems 37 (2014), 267–281.
32. Dwivedi, Y.K., Mustafee, N., Profiling research published in the Journal of Enterprise Information Management. Journal of Enterprise Information Management 23:1 (2010), 8–26.
33. Dwivedi, Y.K., Kiang, M., Lal, B., Williams, M.D., Profiling research published in the Journal of Electronic Commerce Research. Journal of Electronic Commerce Research 9:2 (2008), 77–91.
34. Edwards, R., Fenwick, T., Digital analytics in professional work and learning. Studies in Continuing Education, 2015, 1–15.
35. Eembi, N.B.C., Ishak, I.B., Sidi, F., Affendey, L.S., Mamat, A., A systematic review on the profiling of digital news portal for Big Data veracity. Procedia Computer Science 72 (2015), 390–397.
36. Frehe, V., Kleinschmidt, T., Teuteberg, F., Big data in logistics-identifying potentials through literature, case study and expert interview analyzes. In GI-Jahrestagung, 2014, 173–186.
37. Gandomi, A., Haider, M., Beyond the hype: Big data concepts, methods, and analytics. International Journal of Information Management 35:2 (2015), 137–144.
38. Gantz, J., Reinsel, D., The Digital Universe in 2020: Big data, bigger digital shadows, and biggest growth in the Far East. IDC – EMC Corporation., 2012 Online Available at http://www.emc.com/collateral/analyst-reports/idc-the-digital-universe-in-2020.pdf (Accessed 16th January 2016).
39. George, G., Haas, M.R., Pentland, A., Big Data and management. Academy of Management Journal 57:2 (2014), 321–326.
40. Gu, L., Zeng, D., Li, P., Guo, S., Cost minimization for big data processing in geo-distributed data centers. In Cloud Networking for Big Data, 2015, Springer International Publishing, 59–78.
41. Halevy, A., Rajaraman, A., Ordille, J., Data integration: The teenage years. Proceedings of the 32nd International Conference on Very Large Data Bases, 2006, 9–16.
42. Hargittai, E., Is bigger always better?. Potential biases of big data derived from social network sites, The ANNALS of the American Academy of Political and Social Science 659:1 (2015), 63–76.
43. Hasan, S., Shamsuddin, S.M., Lopes, N., Machine learning big data framework and analytics for big data problems. International Journal of Advance Soft Computing Application 6:2 (2014), 1–14.
44. Hashem, I.A.T., Yaqoob, I., Anuar, N.B., Mokhtar, S., Gani, A., Khan, S.U., The rise of big data on cloud computing: Review and open research issues. Information Systems 47 (2015), 98–115.
45. Intel IT Center, Big Data Analytics: Intel's IT Manager Survey on How Organizations Are Using Big Data. Available at: http://www.intel.co.za/content/www/za/en/big-data/data-insights-peer-research-report.html, 2012 [Accessed 5 Jan. 2016].
46. Irani, Z., Investment evaluation within project management: an information systems perspective. Journal of the Operational Research Society 61:6 (2010), 917–928.
47. Irani, Z., Ghoneim, A., Love, P.E., Evaluating cost taxonomies for information systems management. European Journal of Operational Research 173:3 (2006), 1103–1122.
48. Irani, Z., Sharif, A., Kamal, M.M., Love, P.E., Visualising a knowledge mapping of information systems investment evaluation. Expert Systems with Applications 41:1 (2014), 105–125.
49. Jiang, H., Chen, Y., Qiao, Z., Weng, T.H., Li, K.C., Scaling up MapReduce-based big data processing on multi-GPU systems. Cluster Computing 18:1 (2015), 369–383.
50. Jin, X., Wah, B.W., Cheng, X., Wang, Y., Significance and challenges of big data research. Big Data Research 2:2 (2015), 59–64.
51. Joseph, R.C., Johnson, N.A., Big data and transformational government. IT Professional 15:6 (2013), 43–48.
52. Jukić, N., Sharma, A., Nestorov, S., Jukić, B., Augmenting data warehouses with Big Data. Information Systems Management 32:3 (2015), 200–209.
53. Kaisler, S., Armour, F., Espinosa, J.A., Money, W., Big data: Issues and challenges moving forward. 46th Hawaii International Conference on System Sciences (HICSS), 2013, 995–1004.
54. Kamal, M.M., Irani, Z., Analysing supply chain integration through systematic literature review: a normative perspective. Supply Chain Management: An International Journal 19:5/6 (2014), 523–557.
55. Karacapilidis, N., Tzagarakis, M., Christodoulou, S., On a meaningful exploitation of machine and human reasoning to tackle data-intensive decision making. Intelligent Decision Technologies 7:3 (2013), 225–236.
56. Khan, M.A., Uddin, M.F., Gupta, N., Seven Vs of Big Data understanding Big Data and extract value. Proceedings of 2014 Zone 1 Conference of the American Society for Engineering Education (ASEE Zone 1) – IEEE, 2014, 1–5.
57. Kim, G.H., Trimi, S., Chung, J.H., Big-data applications in the government sector. Communications of the ACM 57:3 (2014), 78–85.
58. Kitchenham, B., Charters, S., Guidelines for performing systematic review process research in software engineering., 2007 Online Available at http://www.citeulike.org/group/14013/article/7874938 (Accessed on 19th December 2015).
59. Krishnamurthy, R., Desouza, K.C., Big data analytics: the case of the social security administration. Information Polity 19:3/4 (2014), 165–178.
60. Kumar, A., Niu, F., Ré, C., Hazy: making it easier to build and maintain big-data analytics. Communications of the ACM 56:3 (2013), 40–49.
61. Kune, R., Konugurthi, P.K., Agarwal, A., Chillarige, R.R., Buyya, R., The anatomy of big data computing. Software: Practice and Experience 46:1 (2016), 79–105.
62. Labrinidis, A., Jagadish, H.V., Challenges and opportunities with big data. Proceedings of the VLDB Endowment 5:12 (2012), 2032–2033.
63. Lazer, D., Pentland, A., Adamic, L., Aral, S., Baraba´si, A., Brewer, D. Van Alstyne, M., ‘Computational social science’. Science vol. 323:no. 5915 (2009), 721–723.
64. Lebdaoui, I., Orhanou, G., Elhajji, S., An integration adaptation for real-time Datawarehousing. International Journal of Software Engineering and its Applications 8:11 (2014), 115–128.
65. Lettieri, E., Masella, C., Radaelli, G., Disaster management: findings from a systematic review. Disaster Prevention and Management: An International Journal 18:2 (2009), 117–136.
66. Liao, Z., Yin, Q., Huang, Y., Sheng, L., Management and application of mobile big data. International Journal of Embedded Systems 7:1 (2014), 63–70.
67. Lu, R., Zhu, H., Liu, X., Liu, J.K., Shao, J., Toward efficient and privacy-preserving computing in big data era. IEEE Network 28:4 (2014), 46–50.
68. Machanavajjhala, A., Reiter, J.P., Big privacy: protecting confidentiality in big data. XRDS: Crossroads. The ACM Magazine for Students 19:1 (2012), 20–23.
69. du Mars, R., Mission impossible? Data governance process takes on big data., 2012 Online Available at http://searchdatamanagement.techtarget.com/feature/Mission-impossible-Data-governance-process-takes-on-big-data (Accessed on 9th January 2016).
70. Mayer-Schönberger, V., Cukier, K., Big data: A revolution that will transform how we live, work, and think. 2013, Eamon Dolan/Houghton Mifflin Harcourt, Boston, MA.
71. Mishra, D., Gunasekaran, A., Papadopoulos, T., Childe, S.J., Big Data and supply chain management: a review and bibliometric analysis. Annals of Operations Research, 2016, 10.1007/s10479-016-2236-y.
72. MIT Technology Review, The Big Data Conundrum: How to define it?., 2013 Available Online at https://www.technologyreview.com/s/519851/the-big-data-conundrum-how-to-define-it/ (Accessed 19th May 2016).
73. Office of Science and Technology Policy (OSTP), Executive Office of the President, Big data press release final 2., 2012 Available http://www.whitehouse.gov/sites/default/files/microsites/ostp/big_data_press_release_final_2.pdf (Accessed on 7th October 2015).
74. Otto, B., Organizing data governance: findings from the telecommunications industry and consequences for large service providers. Communications of the Association for Information Systems 29:1 (2011), 45–66.
75. Paris, J., Donnal, J.S., Leeb, S.B., NilmDB: the non-intrusive load monitor database. Smart Grid, IEEE Transactions on 5:5 (2014), 2459–2467.
76. Phillips-Wren, G., Hoskisson, A., An analytical journey towards big data. Journal of Decision Systems 24:1 (2015), 87–102.
77. Pittaway, L., Robertson, M., Munir, K., Denyer, D., Neely, A., Networking and innovation: a systematic review of the evidence. International Journal of Management Reviews 5:3‐4 (2004), 137–168.
78. Polato, I., Ré, R., Goldman, A., Kon, F., A comprehensive view of Hadoop research – a systematic literature review. Journal of Network and Computer Applications 46 (2014), 1–25.
79. Raghavendra, R., Ranganathan, P., Talwar, V., Wang, Z., Zhu, X., No power struggles: coordinated multi-level power management for the data center. In ACM SIGARCH Computer Architecture News 36:1 (2008), 48–59.
80. Rehman, M.H., Chang, V., Batool, A., Teh, Y.W., Big data reduction framework for value creation in sustainable enterprises. International Journal of Information Management, 2016 (Accepted).
81. Russom, P., Managing Big Data. Available Online at: The Data Warehousing Institute., 2013 [Accessed 5th January 2016] https://tdwi.org/articles/2013/10/01/executive-summary-managing-big-data.aspx.
82. Sandhu, R., Sood, S.K., Scheduling of big data applications on distributed cloud based on QoS parameters. Cluster Computing 18 (2014), 1–12.
83. Savitz, E., Gartner: Top 10 strategic technology trends for 2013., 2012 Online Available at http://www.forbes.com/sites/ericsavitz/2012/10/23/gartner-top-10-strategic-technology-rends-for-2013/ (Accessed on 3rd March 2016).
84. Savitz, E., Gartner: 10 critical tech trends for the next five years., 2012 Online Available at http://www.forbes.com/sites/ericsavitz/2012/10/22/gartner-10-critical-tech-trends-for-the-next-five-years/ (Accessed on 3rd March 2016).
85. Shah, T., Rabhi, F., Ray, P., Investigating an ontology-based approach for Big Data analysis of inter-dependent medical and oral health conditions. Cluster Computing 18:1 (2015), 351–367.
86. Simonet, A., Fedak, G., Ripeanu, M., Active Data: A programming model to manage data life cycle across heterogeneous systems and infrastructures. Future Generation Computer Systems 53 (2015), 25–42.
87. Sivarajah, U., Irani, Z., Jones, S., Application of Web 2.0 technologies in E-Government: A United Kingdom case study. 2014 47th Hawaii International Conference on System Sciences, 2014, 2221–2230.
88. Sivarajah, U., Irani, Z., Weerakkody, V., Evaluating the use and impact of Web 2.0 technologies in local government. Government Information Quarterly 32:4 (2015), 473–487.
89. Spiess, J., T'Joens, Y., Dragnea, R., Spencer, P., Philippart, L., Using big data to improve customer experience and business performance. Bell Labs Technical Journal 18:4 (2014), 3–17.
90. Su, K., Li, J., Fu, H., Smart city and the applications. IEEE International Conference on Electronics, Communications and Control (ICECC), 2011, 1028–1031.
91. Sun, N., Morris, J.G., Xu, J., Zhu, X., Xie, M., iCARE: A framework for big data-based banking customer analytics. IBM Journal of Research and Development, 58(5/6), 2014, 4-1.
92. Szongott, C., Henne, B., von Voigt, G., Big data privacy issues in public social media. 6th IEEE international conference on digital ecosystems technologies (DEST), 2012, 1–6.
93. Taheri, J., Zomaya, A.Y., Siegel, H.J., Tari, Z., Pareto frontier for job execution and data transfer time in hybrid clouds. Future Generation Computer Systems 37 (2014), 321–334.
94. Ting, K.M., Washio, T., Wells, J.R., Liu, F.T., Aryal, S., DEMass: a new density estimator for big data. Knowledge and Information Systems 35:3 (2013), 493–524.
95. Tole, A.A., Big data challenges. Database Systems Journal 4:3 (2013), 31–40.
96. Tranfield, D., Denyer, D., Smart, P., Towards a methodology for developing evidence-informed management knowledge by means of systematic review. British Journal of Management 14:3 (2003), 207–222.
97. Van Dijck, J., Datafication, dataism and dataveillance: Big Data between scientific paradigm and ideology. Surveillance & Society 12:2 (2014), 197–208.
98. Vasarhelyi, M.A., Kogan, A., Tuttle, B.M., Big data in accounting: an overview. Accounting Horizons 29:2 (2015), 381–396.
99. Waller, M.A., Fawcett, S.E., Data science, predictive analytics, and big data: a revolution that will transform supply chain design and management. Journal of Business Logistics 34:2 (2013), 77–84.
100. Wang, G., Gunasekaran, A., Ngai, E.W., Papadopoulos, T., Big data analytics in logistics and supply chain management: certain investigations for research and applications. International Journal of Production Economics 176 (2016), 98–110.
101. Wang, Y., Wiebe, V.J., Big Data Analytics on the characteristic equilibrium of collective opinions in social networks. International Journal of Cognitive Informatics and Natural Intelligence (IJCINI) 8:3 (2014), 29–44.
102. Watson, H.J., Tutorial: big data analytics: Concepts, technologies, and applications. Communications of the Association for Information Systems 34:1 (2014), 1247–1268.
103. Web, G., SensorMap for wide-area sensor webs. Embedded computing., 2007 Online Available at http://www.fengzhao.com/pubs/embcomp.pdf (Accessed on 13th March 2016).
104. Weill, P., Ross, J.W., IT savvy: What top executives must know to go from pain to gain. 2009, Harvard Business Press.
105. Xu, J.S., Zhang, E., Huang, C.-H., Chen, L.H.L., Celik, N., Efficient multi-fidelity simulation optimization. Proceedings of 2014 winter simulation conference, 2014, Savanna, GA.
106. Yi, X., Liu, F., Liu, J., Jin, H., Building a network highway for big data: architecture and challenges. IEEE Network 28:4 (2014), 5–13.
107. Zaslavsky, A., Perera, C., Georgakopoulos, D., Sensing as a service and big data. International Conference on Advances in Cloud Computing (ACC-2012), Bangalore, India, 2012, 21–29.
108. Zhang, F., Liu, M., Gui, F., Shen, W., Shami, A., Ma, Y., A distributed frequent itemset mining algorithm using Spark for Big Data analytics. Cluster Computing 18:4 (2015), 1493–1501.
109. Zhang, X., Hu, Y., Xie, K., Zhang, W., Su, L., Liu, M., An evolutionary trend reversion model for stock trading rule discovery. Knowledge-Based Systems 79 (2015), 27–35.
110. Zhao, Z., Zhang, R., Cox, J., Duling, D., Sarle, W., Massively parallel feature selection: an approach based on variance preservation. Machine Learning 92:1 (2013), 195–220.
111. Zicari, R.V., Big Data: Challenges and Opportunities. (2014) Akerkar, R., (eds.) Big data computing, 2014, CRC Press, Taylor & Francis Group, Florida, USA, 103–128.