Big IoT Data Analytics: Architecture, Opportunities, and Open Research Challenges

IEEE Access

Volumn 5, Issue , 2017, Pages 5247-5261

  Marjani, Mohsen ^a   Nasaruddin, Fariza ^a   Gani, Abdullah ^a   Karim, Ahmad ^b   Hashem, Ibrahim Abaker Targio ^a   Siddiqa, Aisha ^a   Yaqoob, Ibrar ^a  

^a UNIVERSITY OF MALAYA   (Malaysia)

^b BAHAUDDIN ZAKARIYA UNIVERSITY   (Pakistan)

Author keywords

Big data; data analytics; distributed computing; Internet of Things; smart city

Indexed keywords

DATA MINING; DATA VISUALIZATION; DISTRIBUTED COMPUTER SYSTEMS; INTERNET OF THINGS; SMART CITY;

DATA ANALYTICS; FUTURE RESEARCH DIRECTIONS; INTERNET OF THINGS (IOT); LARGE DATA; RESEARCH CHALLENGES; STATE OF THE ART;

BIG DATA;

EID: 85028044013     PISSN: None     EISSN: 21693536     Source Type: Journal    
DOI: 10.1109/ACCESS.2017.2689040     Document Type: Article

References (99)

1. P. Tiainen, "New opportunities in electrical engineering as a result of the emergence of the Internet of Things, " Tech. Rep., AaltoDoc, Aalto Univ., 2016.
2. M. Beyer, "Gartner says solving Big Data challenge involves more than just managing volumes of data, " Tech. Rep., AaltoDoc, Aalto Univ., 2011.
3. J. Gantz and D. Reinsel, "Extracting value from chaos, " IDC Iview, vol. 1142, pp. 1-12, Jun. 2011.
4. R. Mital, J. Coughlin, and M. Canaday, "Using big data technologies and analytics to predict sensor anomalies, " in Proc. Adv. Maui Opt. Space Surveill. Technol. Conf., Sep. 2014, p. 84.
5. N. Golchha, "Big data-The information revolution, " Int. J. Adv. Res., vol. 1, no. 12, pp. 791-794, 2015.
6. P. Russom, Big Data Analytics. TDWI, 4th Quart., 2011.
7. C.-W. Tsai, "Big data analytics: A survey, " J. Big Data, vol. 2, no. 1, pp. 1-32, 2015.
8. M. Chen, Related Technologies in Big Data. Heidelberg, Germany: Springer, 2014, pp. 11-18.
9. Z. Khan, A. Anjum, and S. L. Kiani, "Cloud based big data analytics for smart future cities, " in Proc. IEEE/ACM 6th Int. Conf. Utility Cloud Comput. (UCC), Dec. 2013, pp. 381-386.
10. P. Russom, Big Data Analytics. TDWI, 4th Quart., 2011, pp. 1-35.
11. S. LaValle, E. Lesser, R. Shockley, M. S. Hopkins, and N. Kruschwitz, "Big data, analytics and the path from insights to value, " MIT Sloan Manag. Rev., vol. 52, no. 2, p. 21, 2011.
12. E. Al Nuaimi et al., "Applications of big data to smart cities, " J. Internet Services Appl., vol. 6, p. 25, Dec. 2015.
13. J. Gubbi, R. Buyya, S. Marusic, and M. Palaniswami, "Internet of Things (IoT): A vision, architectural elements, and future directions, " Future Generat. Comput. Syst., vol. 29, no. 7, pp. 1645-1660, 2013.
14. C. A. Ciufo. (2014). Industrial Equipment Talking on the IoT? Bet-Ter get a Gateway (Device). [Online]. Available: http://eecatalog. com/caciufo/2014/07/15/iot-gateway-Adlink/
15. L. Atzori, A. Iera, and G. Morabito, "The Internet of Things: A survey, " Comput. Netw., vol. 54, no. 15, pp. 2787-2805, 2010.
16. H.-C. Hsieh and C.-H. Lai, "Internet of Things architecture based on integrated PLC and 3G communication networks, " in Proc. IEEE 17th Int. Conf. Parallel Distrib. Syst. (ICPADS), Dec. 2011, pp. 853-856.
17. K. Kambatla, "Trends in big data analytics, " J. Parallel Distrib. Comput., vol. 74, no. 7, pp. 2561-2573, 2014.
18. J. Manyika, Big Data: The Next Frontier for Innovation, Competition, and Productivity. McKinsey Global Inst. Rep., 2011.
19. I. A. T. Hashem et al., "The rise of big data on cloud computing: Review and open research issues, " Inf. Syst., vol. 47, pp. 98-115, Jan. 2015.
20. W. B. Ali, "Big data-driven smart policing: big data-based patrol car dispatching, " J. Geotech. Transp. Eng., vol. 1, no. 2, pp. 1-16, 2016.
21. J. Gantz and D. Reinsel, "The digital universe in 2020: Big data, bigger digital shadows, and biggest growth in the far east, " IDC iView: IDC Analyze the Future, Tech. Rep., 2012.
22. V. Borkar, M. J. Carey, and C. Li, "Inside Big Data management: Ogres, onions, or parfaits? in Proc. 15th Int. Conf. Extending Database Technol., 2012, pp. 3-14.
23. A. Gani, "A survey on indexing techniques for big data: Taxonomy and performance evaluation, " Knowl. Inf. Syst., vol. 46, no. 2, pp. 241-284, 2016.
24. A. Paul, "Video search and indexing with reinforcement agent for interactive multimedia services, " ACM Trans. Embed. Comput. Syst., vol. 12, no. 2, pp. 1-16, 2013.
25. O. Kwon and N. B. L. Shin, "Data quality management, data usage experience and acquisition intention of big data analytics, " Int. J. Inf. Manage., vol. 34, no. 3, pp. 387-394, 2014.
26. S. Oswal and S. Koul, "Big data analytic and visualization on mobile devices, " in Proc. Nat. Conf. New Horizons IT-NCNHIT, 2013, p. 223.
27. L. Candela and D. P. C. Pagano, "Managing big data through hybrid data infrastructures, " ERCIM News, vol. 89, pp. 37-38, Jun. 2012.
28. M. D. Assuncao, R. N. Calheiros, S. Bianchi, M. A. S. Netto, and R. Buyya. (2013). Big data computing and clouds: Challenges, solutions, and future directions. [Online]. Available: https://arxiv. org/abs/1312.4722
29. D. Singh and C. K. Reddy, "A survey on platforms for big data analytics, " J. Big Data, vol. 2, no. 1, p. 1, 2014.
30. A. Siddiqa, "A survey of big data management: Taxonomy and state-ofthe-Art, " J. Netw. Comput. Appl., vol. 71, pp. 151-166, Aug. 2016.
31. C. A. Steed, "Big data visual analytics for exploratory earth system simulation analysis, " Comput. Geosci., vol. 61, pp. 71-82, Mar. 2013.
32. C. L. P. Chen and C.-Y. Zhang, "Data-intensive applications, challenges, techniques and technologies: A survey on big data, " Inf. Sci., vol. 275, pp. 314-347, Aug. 2014.
33. M. W. Pfaf-, "A new mathematical model for relative quanti-cation in real-Time RT-PCR, " Nucl. Acids Res., vol. 29, no. 9, p. e45, 2001.
34. F. M. Waas, "Beyond conventional data warehousing-massively parallel data processing with Greenplum database, " in International Workshop on Business Intelligence for the Real-Time Enterprise. Berlin, Germany: Springer, 2008.
35. F. Färber, S. K. Cha, J. Primsch, C. Bornhövd, S. Sigg, and W. Lehner, "SAP HANA database: Data management for modern business applications, " ACM SIGMOD Rec., vol. 40, no. 4, pp. 45-51, Dec. 2011.
36. M. Cheng, "Mu rhythm-based cursor control: An of-ine analysis, " Clin. Neurophys., vol. 115, no. 4, pp. 745-751, 2004.
37. M. Castro, P. Druschel, A. M. Kermarrec, and A. I. T. Rowstron, "Scribe: A large-scale and decentralized application-level multicast infrastructure, " IEEE J. Sel. Areas Commun., vol. 20, no. 8, pp. 1489-1499, Oct. 2002.
38. J. Kreps, N. Narkhede, and J. Rao, "KAFKA: A distributed messaging system for log processing, " in Proc. NetDB. 2011, pp. 1-7.
39. H. Notsu, Y. Okada, M. Akaishi, and K. Niijima, "Time-Tunnel: Visual analysis tool for time-series numerical data and its extension toward parallel coordinates, " in Proc. Int. Conf. Comput. Graph., Imag. Vis. (CGIV), Jul. 2005, pp. 167-172.
40. A. Rabkin and R. H. Katz, "Chukwa: A system for reliable large-scale log collection, " in Proc. LISA, Nov. 2010, pp. 1-15.
41. S. Hong and H. Kim, "An analytical model for a GPU architecture with memory-level and thread-level parallelism awareness, " ACM SIGARCH Comput. Archit., vol. 37, no. 3, pp. 152-163, Jun. 2009.
42. K. Chodorow, MongoDB: The De-nitive Guide. Newton, MA, USA: OReilly Media, Inc, 2014.
43. Z. Jourdan and R. K. T. E. Rainer Marshall, "Business intelligence: An analysis of the literature 1, " Inf. Syst. Manage., vol. 25, no. 2, pp. 121-131, 2008.
44. A. Bifet, G. Holmes, R. Kirkby, and B. Pfahringer, "MOA: Massive online analysis, " J. Mach. Learn. Res., vol. 11, pp. 1601-1604, May 2010.
45. A. Mukhopadhyay, U. Maulik, S. Bandyopadhyay, and C. A. C. Coello, "A survey of multiobjective evolutionary algorithms for data mining: Part I, " IEEE Trans. Evol. Comput., vol. 18, no. 1, pp. 4-19, Feb. 2014.
46. V. Estivill-Castro, "Why so many clustering algorithms: A position paper, " ACM SIGKDD Explorations Newslett., vol. 4, no. 1, pp. 65-75, 2002.
47. C. Bielza and P. Larrañaga, "Discrete Bayesian network classi-ers: A survey, " ACM Comput. Surveys, vol. 47, no. 1, p. 5, Jul. 2014.
48. F. Chen et al., "Data mining for the Internet of Things: Literature review and challenges, " Int. J. Distrib. Sensor Netw., vol. 12, Aug. 2015.
49. R. Luss and A. dAspremont, "Predicting abnormal returns from news using text classi-cation, " Quant. Finance, vol. 15, no. 6, pp. 999-1012, 2015.
50. P. Melin and O. Castillo, "A review on type-2 fuzzy logic applications in clustering, classi-cation and pattern recognition, " Appl. Soft comput., vol. 21, pp. 568-577, Aug. 2014.
51. A. Soualhi, K. Medjaher, and N. Zerhouni, "Bearing health monitoring based on Hilbert-Huang transform, support vector machine, and regression, " IEEE Trans. Instrum. Meas., vol. 64, no. 1, pp. 52-62, Jan. 2015.
52. D. T. Larose, K-Nearest Neighbor Algorithm. 2005, pp. 90-106.
53. M.-Y. Su, "Real-Time anomaly detection systems for Denial-of-Service attacks by weighted K-nearest-neighbor classi-ers, " Expert Syst. Appl., vol. 38, no. 4, pp. 3492-3498, 2011.
54. M. Muja and D. G. Lowe, "Scalable nearest neighbor algorithms for high dimensional data, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 11, pp. 2227-2240, Nov. 2014.
55. C. Hu, "Data-driven method based on particle swarm optimization and K-nearest neighbor regression for estimating capacity of lithium-ion battery, " Appl. Energy, vol. 129, pp. 49-55, Sep. 2014.
56. K. Srivastava, "Data mining using hierarchical agglomerative clustering algorithm in distributed cloud computing environment, " Int. J. Comput. Theory Eng., vol. 5, no. 3, p. 520, 2013.
57. P. Berkhin, A Survey of Clustering Data Mining Techniques, in Grouping Multidimensional Data. Berlin, Germany: Springer, 2006, pp. 25-71.
58. A. Gosain and M. Bhugra, "A comprehensive survey of association rules on quantitative data in data mining, " in Proc. IEEE Conf. Inf. Commun. Technol., Apr. 2013, pp. 1003-1008.
59. M. Fitzwater, "Ef-cient mining of maximal sequential patterns using multiple samples, " in Proc. SIAM Int. Conf. Data Mining, 2005, p. 1.
60. Z. Yang and M. Kitsuregawa, "LAPIN-SPAM: An improved algorithm for mining sequential pattern, " in Proc. 21st Int. Conf. Data Eng. Work-shops (ICDEW), Apr. 2005, p. 1222.
61. A. Gandomi and M. Haider, "Beyond the hype: Big data concepts, methods, and analytics, " Int. J. Inf. Manage., vol. 35, no. 2, pp. 137-144, 2015.
62. K. Kalpakis and D. V. Gada Puttagunta, "Distance measures for effective clustering of ARIMA time-series, " in Proc. IEEE Int. Conf. Data Min-ing (ICDM), Dec. 2001, pp. 273-280.
63. N. Kumar, Time-Series Bitmaps: A Practical Visualization Tool forWork-ing with Large Time Series Databases. Philadelphia, PA, USA: SIAM, 2005.
64. D. Ryan, High Performance Discovery in Time Series: Techniques and Case Studies. Berlin, Germany: Springer, 2013.
65. X. Wu and S. Zhang, "Synthesizing high-frequency rules from different data sources, " IEEE Trans. Knowl. Data Eng., vol. 15, no. 2, pp. 353-367, Mar. 2003.
66. R. Duan, X. Chen, and T. Xing, "A QoS architecture for IOT, " in Proc. Int. Conf. 4th Int. Conf. Cyber, Phys. Soc. Comput. (iThings/CPSCom), Oct. 2011, pp. 717-720.
67. Y. Zhang, ICN Based Architecture for IoT. IRTF Contribution, Oct. 2013.
68. S. Darby, "Smart metering: What potential for householder engagement? Building Res. Inf., vol. 38, no. 5, pp. 442-457, 2010.
69. T. A. Rahman and S. K. A. Rahim, "RFID vehicle plate number (e-plate) for tracking and management system in Proc. Int. Conf. Parallel Distrib. Syst. (ICPADS), Dec. 2013, pp. 611-616.
70. J. Sherly and D. Somasundareswari, "Internet of Things based smart transportation systems, " Int. Res. J. Eng. Technol., vol. 2, no. 7, 2015.
71. N. Tohamy, "What you need to know about the Internet of Things, MHD Supply Chain Solutions, vol. 45, no. 3, p. 32, 2015.
72. C. Pettey. (2015). Five Ways the Internet of Things Will Bene-T the Supply Chain. [Online]. Available: http://www.gartner. com/smarterwithgartner/-ve-ways-The-internet-of-Things-will-bene-Tthe-supply-chain-2/
73. Y. Yan, Y. Qian, H. Sharif, and D. Tipper, "A survey on smart grid communication infrastructures: Motivations, requirements and challenges, " IEEE Commun. Surveys Tuts., vol. 15, no. 1, pp. 5-20, Feb. 2013.
74. S. Bera, S. Misra, and J. J. P. C. Rodrigues, "Cloud computing applications for smart grid: A survey, " IEEE Trans. Parallel Distrib. Syst., vol. 26, no. 5, pp. 1477-1494, May 2015.
75. T. Dethlefs, Energy Service Description for Capabilities of Distributed Energy Resources. Berlin, Germany: Springer, 2015.
76. C. Neureiter, "A standards-based approach for domain speci-c modelling of smart grid system architectures, " in Proc. 11th Int. Conf. Syst. Syst. Eng. (SoSE), Kongsberg, Norway, Jun. 2016, pp. 1-6.
77. F. Bonomi, "Fog computing and its role in the Internet of Things, " in Proc. 1st Ed. MCC Workshop Mobile Cloud Comput., 2012, pp. 1-6.
78. K. Steinklauber. (2014). Data Protection in the Internet of Things. [Online]. Available: https://securityintelligence.com/data-protection-inthe-internet-of-Things
79. T. Hu, H. Chen, L. Huang, and X. Zhu, "A survey of mass data mining based on cloud-computing, " in Proc. Anti-Counterfeiting, Secur. Identi-cat., Aug. 2012, pp. 1-4.
80. Y. Sun, "Mining knowledge from interconnected data: A heterogeneous information network analysis approach, " Proc. VLDB Endowment, vol. 5, no. 12, pp. 2022-2023, 2012.
81. M. Chen, L. T. Yang, T. Kwon, L. Zhou, and M. Jo, "Itinerary planning for energy-ef-cient agent communications in wireless sensor networks, " IEEE Trans. Veh. Technol., vol. 60, no. 7, pp. 3290-3299, Sep. 2011.
82. D. Zhang, "A taxonomy of agent technologies for ubiquitous computing environments, " Trans. Internet Inf. Syst., vol. 6, no. 2, pp. 547-565, 2012.
83. M. Chen, V. C. M. Leung, and S. Mao, "Directional controlled fusion in wireless sensor networks, " Mobile Netw. Appl., vol. 14, no. 2, pp. 220-229, Apr. 2009.
84. X. Wu, X. Zhu, G.-Q. Wu, and W. Ding, "Data mining with big data, " IEEE Trans. Knowl. Data Eng., vol. 26, no. 1, pp. 97-107, Jan. 2014.
85. K. Su, "A logical framework for identifying quality knowledge from different data sources, " Decision Support Syst., vol. 42, no. 3, pp. 1673-1683, 2006.
86. L. Wang, G. Wang, and C. A. Alexander, "Big data and visualization: Methods, challenges and technology progress, " Digit. Technol., vol. 1, no. 1, pp. 33-38, 2015.
87. A. T. Azar and A. E. Hassanien, "Dimensionality reduction of medical big data using neural-fuzzy classi-er, " Soft Comput., vol. 19, no. 4, pp. 1115-1127, 2015.
88. V. L. Popov and M. He, Method of Dimensionality Reduction in Contact Mechanics and Friction. Springer, 2015.
89. C. Donalek et al., "Immersive and collaborative data visualization using virtual reality platforms, " in Proc. IEEE Int. Conf. Big Data (USA Big Data), Oct. 2014, pp. 609-614.
90. H. Childs et al., "Research challenges for visualization software, " Com-puter, vol. 46, no. 5, pp. 34-42, May 2013.
91. E. Y. Gorodov and V. V. Gubarev, "Analytical review of data visualization methods in application to big data, " J. Elect. Comput. Eng., vol. 2013, Oct. 2013, Art. no. 969458.
92. Center. (2013). Big Data Visualization: Turning Big Data Into Big Insights [While Paper]. [Online]. Available: https://future.transport.nsw. gov.au/wp-content/uploads/2016/02/big-data-visualization-Turning-bigdata-into-big-insights.pdf
93. (2013). Five Big Data Challenges and How to Overcome Them With Visual Analytics. [Online]. Available: https://www.sas. com/resources/asset/-ve-big-data-challenges-Article.pdf
94. P. Simon, The Visual Organization: Data Visualization, Big Data, and the Quest for Better Decisions. Hoboken, NJ, USA: Wiley, 2014.
95. B. B. Ahamed, T. Ramkumar, and S. Hariharan, "Data integration progression in large data source using mapping af-nity, " in Proc. 7th Int. Conf. Adv. Softw. Eng. Appl. (ASEA), Dec. 2014, pp. 16-21.
96. J. Liu and X. Zhang, "Data integration in fuzzy XML documents, " Inf. Sci., vol. 280, pp. 82-97, Mar. 2014.
97. A. Maayan et al., "Lean big data integration in systems biology and systems pharmacology, " Trends Pharmacol. Sci., vol. 35, no. 9, pp. 450-460, 2014.
98. P. B. D. Agrawal et al., "Challenges and opportunities with big data: A community white paper developed by leading researchers across the United States, " Computing Community Consortium, White paper, 2012.
99. R. Agrawal et al., "The claremont report on database research, " Commu-nications, vol. 52, no. 6, pp. 56-65, 2009.