Device data ingestion for industrial big data platforms with a case study

Sensors (Switzerland)

Volumn 16, Issue 3, 2016, Pages

  Ji, Cun ^a   Shao, Qingshi ^a   Sun, Jiao ^a   Liu, Shijun ^a   Pan, Li ^a   Wu, Lei ^a,b   Yang, Chenglei ^a  

^a SHANDONG UNIVERSITY   (China)

^b NORTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Big data; Device data ingestion; Industrial internet of things; Internet of things

Indexed keywords

INTERNET; INTERNET OF THINGS;

DATA PLATFORM; DATA SLICING; DATA SPLITTING; DATA SYNCHRONIZATION; DEVICE DATA; HETEROGENEOUS DEVICES; MULTIPLE SOURCE; SCENARIO ANALYSIS;

BIG DATA;

EID: 84975760200     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s16030279     Document Type: Article

References (34)

1. Rani, S.; Talwar, R.; Malhotra, J.; Ahmed, S.H.; Sarkar, M.; Song, H. A novel scheme for an energy efficient Internet of Things based on wireless sensor networks. Sensors 2015, 15, 28603-28626. [CrossRef] [PubMed]
2. Lin, Y.; Yang, J.; Lv, Z.; Wei, W.; Song, H. A self-assessment stereo capture model applicable to the Internet of Things. Sensors 2015, 15, 20925-20944. [CrossRef] [PubMed]
3. Fan, W.; Bifet, A. Mining big data: Current status, and forecast to the future. ACM SIGKDD Explor. Newsletter 2013, 14, 1-5. [CrossRef]
4. Ranjan, R. Streaming big data processing in datacenter clouds. IEEE Cloud Comp. 2014, 1, 78-83. [CrossRef]
5. Campbell, P. Community cleverness required. Nature 2008, 455. [CrossRef]
6. Mervis, J. Agencies rally to tackle big data. Science 2012, 336, 22. [CrossRef] [PubMed]
7. Labrinidis, A.; Jagadish, H.V. Challenges and opportunities with big data. In Proceedings of the VLDB Endowment, Istanbul, Turkey, 27-31 August 2012; Volume 5, pp. 2032-2033.
8. Gantz, J.; Reinsel, D. The digital universe in 2020: Big data, bigger digital shadows, and biggest growth in the far east. IDC iView: IDC Analyze the Future 2012, 2007, 1-16.
9. Ji, C.; Liu, S.; Yang, C.; Wu, L.; Pan, L. IBDP: An Industrial Big Data Ingestion and Analysis Platform and Case Studies. In Proceedings of the 2015 International Conference on Identification, Information and Knowledge in the Internet of Things (IIKI), Beijing, China, 22-23 October 2015. (in press).
10. Rajaraman, A.; Ullman, J.D. Mining of Massive Datasets; Cambridge University Press: Cambridge, UK, 2012.
11. Liu, X.; Iftikhar, N.; Xie, X. Survey of real-time processing systems for big data. In Proceedings of the 18th International Database Engineering & Applications Symposium, Porto, Portugal, 7-9 July 2014; pp. 356-361.
12. Llinas, J.; Hall, D.L. An introduction to multi-sensor data fusion. In Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (ISCAS'98), Monterey, CA, USA, 31 May-3 June 1998; pp. 537-540.
13. Lee, P.; Jayasumana, A.P.; Bandara, H.D.; Lim, S.; Chandrasekar, V. A peer-to-peer collaboration framework for multi-sensor data fusion. J. Netw. Comput. Appl. 2012, 35, 1052-1066. [CrossRef]
14. Dolui, K.; Mukherjee, S.; Datta, S.K. Smart device sensing architectures and applications. In Proceedings of the 2013 International Computer Science and Engineering Conference (ICSEC), Nakorn Pathom, Thailand, 4-6 September 2013; pp. 91-96.
15. Sawant, N.; Shah, H. Big Data Ingestion and Streaming Patterns. In Big Data Application Architecture Q & A; Apress: New York, NY, USA, 2013; pp. 29-42.
16. Qiao, L.; Li, Y.; Takiar, S.; Liu, Z.; Veeramreddy, N.; Tu, M.; Botev, C. Gobblin: Unifying data ingestion for Hadoop. In Proceedings of the 41st International Conference on Very Large Data Bases, Kohala Coast, HI, USA, 31 August-4 September 2015; Volume 8, pp. 1764-1769.
17. Keogh, E.; Chakrabarti, K.; Pazzani, M.; Mehrotra, S. Dimensionality reduction for fast similarity search in large time series databases. Knowl. Inf. Syst. 2001, 3, 263-286. [CrossRef]
18. Agrawal, R.; Faloutsos, C.; Swami, A. Efficient Similarity Search in Sequence Databases; Springer: Berlin, Heidelberg, 1993.
19. Chan, K.P.; Fu, A.W.C. Efficient time series matching by wavelets. In Proceedings of the 15th International Conference on Data Engineering, Sydney, Australia, 23-26 March 1999; pp. 126-133.
20. Keogh, E. Fast similarity search in the presence of longitudinal scaling in time series databases. In Proceedings of the Ninth IEEE International Conference on Tools with Artificial Intelligence, Newport Beach, CA, USA, 3-8 November 1997; pp. 578-584.
21. Zhou, D.Z.; Li, M.Q. Time series segmentation based on series importance point. Comp. Eng. 2008, 34, 14-16. (In Chinese).
22. Yang, K.; Shahabi, C. On the stationarity of multivariate time series for correlation-based data analysis. In Proceedings of the Fifth IEEE International Conference on Data Mining, Houston, TX, USA, 27-30 November 2005.
23. Playfair, W. The Commercial and Political Atlas and Statistical Breviary; Cambridge University Press: Cambridge, UK, 2005.
24. Havre, S.; Hetzler, B.; Nowell, L. ThemeRiver: Visualizing theme changes over time. In Proceedings of the IEEE Symposium on Information Visualization (InfoVis 2000), Salt Lake City, UT, USA, 9-10 October 2000; pp. 115-123.
25. Mueen, A.; Keogh, E.; Young, N. Logical-shapelets: An expressive primitive for time series classification. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Diego, CA, USA, 21-24 August 2011; pp. 1154-1162.
26. Rakthanmanon, T.; Keogh, E. Fast shapelets: A scalable algorithm for discovering time series shapelets. In Proceedings of the 13th SIAM Conference on Data Mining (SDM), Austin, TX, USA, 2-4 May 2013.
27. Xing, Z.; Pei, J.; Philip, S.Y. Early classification on time series. Knowl. Inf. Syst. 2012, 31, 105-127. [CrossRef]
28. Armbrust, M.; Fox, A.; Griffith, R.; Joseph, A.D.; Katz, R.; Konwinski, A.; Zaharia, M. A view of cloud computing. Comm. ACM 2010, 53, 50-58. [CrossRef]
29. Barroso, L.A.; Clidaras, J.; Hölzle, U. The datacenter as a computer: An introduction to the design of warehouse-scale machines. Syn. Lect. Comp. Archit. 2013, 8, 1-154. [CrossRef]
30. Wang, L.; Ranjan, R.; Chen, J.; Benatallah, B. Cloud Computing: Methodology, Systems, and Applications; CRC Press: Boca Raton, FL, USA, 2011.
31. Longda Foodstuff Group Co. Ltd. Available online: http://www.longda.com.cn (accessed on 15 December 2015).
32. Jinan District Heating Co. Ltd. Available online:http://www.jnreli.com (accessed on 15 December 2015).
33. Zhongtong Bus Holding Co. Ltd. Available online: http://www.zhongtong.com/en (accessed on 15 December 2015).
34. Jinan Theral Power Co. Ltd. Available online: http://www.jnrdyxgs.com (accessed on 15 December 2015).