A scalable data chunk similarity based compression approach for efficient big sensing data processing on cloud

IEEE Transactions on Knowledge and Data Engineering

Volumn 29, Issue 6, 2017, Pages 1144-1157

  Yang, Chi ^a   Chen, Jinjun ^b  

^a Unitec Institution of Technology   (New Zealand)

^b SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Big sensing data; cloud computing; data chunk; data compression; MapReduce; scalability; similarity model

Indexed keywords

CLOUD COMPUTING; DATA COMPRESSION; DIGITAL STORAGE; EFFICIENCY; RESTORATION; SCALABILITY;

ALGORITHM IMPLEMENTATION; CALCULATING SIMILARITIES; COMPRESSION EFFICIENCY; DATA CHUNKS; DATA COMPRESSION TECHNIQUES; MAP-REDUCE; SENSING DATA; SIMILARITY MODELS;

DATA HANDLING;

EID: 85018925383     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2016.2531684     Document Type: Article

References (46)

1. S. Tsuchiya, Y. Sakamoto, Y. Tsuchimoto, and V. Lee, "Big data processing in cloud environments, " FUJITSU Sci. Technol. J, vol. 48, no. 2, pp. 159-168, 2012.
2. "Big data: Science in the petabyte era: Community cleverness Required" Nature, vol. 455, no. 7209, p. 1, 2008.
3. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica, and M. Zaharia, "A view of cloud computing, " Commun. ACM, vol. 53, no. 4, pp. 50-58, 2010.
4. R. Buyya, C. S. Yeo, S. Venugopal, J. Broberg, and I. Brandic, "Cloud computing and emerging it platforms: Vision, hype, and reality for delivering computing as the 5th utility, " Future Gener. Comput. Syst, vol. 25, no. 6, pp. 599-616, 2009.
5. L. Wang, J. Zhan, W. Shi, and Y. Liang, "In cloud, can scientific communities benefit from the economies of scale?, " IEEE Trans. Parallel Distrib. Syst. vol. 23, no. 2, pp. 296-303, Feb. 2012.
6. S. Sakr, A. Liu, D. Batista, and M. Alomari, "A survey of large scale data management approaches in cloud environments, " IEEE Commun. Surveys Tuts, vol. 13, no. 3, pp. 311-336, Jul.-Sep. 2011.
7. B. Li, E. Mazur, Y. Diao, A. McGregor, and P. Shenoy, "A platform for scalable one-pass analytics using mapreduce, " in Proc. ACM SIGMOD Int. Conf. Manage. Data, 2011, pp. 985-996.
8. R. Kienzler, R. Bruggmann, A. Ranganathan, and N. Tatbul, "Stream as you go: The case for incremental data access and processing in the cloud, " in Proc. IEEE ICDE Int. Workshop Data Manage. Cloud, 2012, pp. 159-166.
9. C. Olston, G. Chiou, L. Chitnis, F. Liu, Y. Han, M. Larsson, A. Neumann, V. B. N. Rao, V. Sankarasubramanian, S. Seth, C. Tian, T. ZiCornell, and X. Wang, "Nova: Continuous pig/hadoop workflows, " in Proc. ACM SIGMOD Int. Conf. Manage. Data, 2011, pp. 1081-1090.
10. K. H. Lee, Y. J. Lee, H. Choi, Y. D. Chung, and B. Moon, "Parallel data processing with mapreduce: A survey, " ACM SIGMOD Rec, vol. 40, no. 4, pp. 11-20, 2012.
11. X. Zhang, C. Liu, S. Nepal, and J. Chen, "An efficient quasi-identifier index based approach for privacy preservation over incremental data sets on cloud, " J. Comput. Syst. Sci, vol. 79, no. 5, pp. 542-555, 2013.
12. X. Zhang, C. Liu, S. Nepal, S. Pandey, and J. Chen, "A privacy leakage upper-bound constraint based approach for cost-effective privacy preserving of intermediate datasets in cloud, " IEEE Trans. Parallel Distrib. Syst, vol. 24, no. 6, pp. 1192-1202, Jun. 2013.
13. X. Zhang, T. Yang, C. Liu, and J. Chen, "A scalable two-phase topdown specialization approach for data anonymization using systems, in mapreduce on cloud, " IEEE Trans. Parallel Distrib. Syst, vol. 25, no. 2, pp. 363-373, Feb. 2014.
14. W. Dou, X. Zhang, J. Liu, and J. Chen, "HireSome-II: Towards privacy-Aware cross-cloud service composition for big data applications, " IEEE Trans. Parallel Distrib. Syst, vol. 26, no. 2, pp. 455-466, Feb. 2015.
15. J. Conhen, "Graph twiddling in a mapreduce world, " IEEE Comput. Sci. Eng, vol. 11, no. 4, pp. 29-41, Jul./Aug. 2009.
16. K. Shim, "Mapreduce algorithms for big data analysis, " Proc. VLDB Endowment, vol. 5, no. 12, pp. 2016-2017, 2012.
17. N. Laptev, K. Zeng, and C. Zaniolo, "Very fast estimation for result and accuracy of big data analytics: The EARL system, " in Proc. 29th IEEE Int. Conf. Data Eng., 2013, pp. 1296-1299.
18. X. L. Dong, and D. Srivastava, "Big data integration, " in Proc. 29th IEEE Int. Conf. Data Eng., 2013, pp. 1245-1248.
19. P. Mineiro, N. Polyzotis, and M. Weimer, "Machine learning on big data, " in Proc. 29th IEEE Int. Conf. Data Eng., 2013, pp. 1242-1244.
20. A. Aboulnaga, and S. Babu, "Workload management for big data analytics, " in Proc. 29th IEEE Int. Conf. Data Eng., 2013, p. 1249.
21. M. Yuriyama, and T. Kushida, "Sensor cloud infrastructure, " in Proc. 13th Int. Conf. Netw.-Based Inf. Syst., 2010, pp. 1-8.
22. A. Alamri, W. S. Ansari, M. M. Hassan, M. S. Hossain, A. Alelaiwi, and M. A. Hossain, "A survey on sensor-cloud: Architecture, applications, and approaches, " Int. J. Distrib. Sens. Netw, vol. 2013, pp. 1-18, 2013.
23. C. Ji, Y. Li, W. Qiu, U. Awada, and K. Li, "Big data processing in cloud environemtns, " in Proc.12th Int. Symp. Pervasive Syst., Algorithms Netw., 2012, pp. 17-23.
24. L. Wang, G. Von Laszewski, A. Younge, X. He, M. Kunze, J. Tao, and C. Fu "Cloud computing: A perspective study, " New Gener. Comput, vol. 28, no. 2, pp. 137-146, 2010.
25. X. Yang, L. Wang, and G. Laszewski, "Recent research advances in e-science, " Cluster Comput, vol. 12, no. 4, pp. 353-356, 2009.
26. S. Sakr, A. Liu, D. Batista, and M. Alomari, "A survey of large scale data management approaches in cloud environments, " IEEE Commun. Surveys Tuts, vol. 13, no. 3, pp. 311-336, Jul.-Sep. 2011.
27. S. Lattanzi, B. Moseley, S. Suri, and S. Vassilvitskii, "Filtering: A method for solving graph problems in mapreduce, " in Proc. 23th ACM Symp. Parallelism Algorithms Archit., 2011, pp. 85-94.
28. K. Shim, "MapReduce Algorithms for Big Data Analysis, " Proc. VLDB Endowment, vol. 5, no. 12, pp. 2016-2017, 2012.
29. N. Sidiropoulos, and A. Kyrillidis, "Multi-way compressed sensing for sparse low-rank tenors, " IEEE Signal Process. Lett, vol. 19, no. 11, pp. 757-760, Nov. 2012.
30. C. Yang, X. Zhang, C. Liu, J. Pei, K. Ramamohanarao, and J. Chen, "A spatiotemporal compression based approach for efficient big data processing on cloud, " J. Comput. Syst. Sci, vol. 80, pp. 1563-1583, 2014.
31. L. Ramaswamy, V. Lawson, and S. V. Gogineni, "Towards a quality-centric big data architecture for federated sensor services, " IEEE Int. Congr. Big Data, 2013, pp. 86-93.
32. A. Cuzzocrea, G. Fortino, and O. Rana, "Managing data and processes in cloud-enabled large-scale sensor networks: State-of-Theart and future research directions, " in Proc. 13th IEEE/ACM Int. Symp. Cluster, Cloud Grid Comput., 2013, pp. 583-588.
33. Y. Fang, L. Chen, J. Wu, and B. Huang, "GPU implementation of orthogonal matching pursuit for compressive sensing, " in Proc. 17th IEEE Int. Conf. Parallel Distrib. Syst., 2011, pp. 1044-1047.
34. W. Wang, D. Lu, X. Zhou, B. Zhang, and J. Wu, "Statistical wavelet-based anomaly detection in big data with compressive sensing, " EURASIP J. Wireless Commun. Netw., 2013, Doi: 10.1186/1687-1499-2013-269.
35. J. Wang, S. Tang, B. Yin, and X. Li, "Data gathering in wireless sensor networks through intelligent compressive sensing, " in Proc. IEEE INFOCOM, Mar. 2012, pp. 603-611.
36. S. H. Yoon, and C. Shahabi, "An experimental study of the effectiveness of clustered aggregation (CAG) leveraging spatial and temporal correlations in wireless sensor networks, " ACM Trans. Sens. Netw, vol. 3, no. 1, Art. no. 3, 2007.
37. R. Qiu, and M. Wicks, "Cognitive networked sensing and big data, " ISBN 978-1-4614-4544-9, DOI 10.1007/978-1-4614-4544-9.
38. Real Time Big Data Processing with GridGain (2017, Feb. 16). [Online]. Available: http://www.gridgain.com/sitemap/
39. Managing and Mining Billion-Node Garphs (2017, Feb. 16). [Online]. Available: http://kdd2012.sigkdd.org/sites/images/summerschool/Haixun-Wang.pdf
40. Hadoop (2017, Feb. 16). [Online]. Available: http://hadoop. apache.org
41. Sensor Cloud (2017, Feb. 16). [Online]. Available: http://www. sensorcloud.com/
42. Big Data and Cloud Solutions in Amazon (2017, Feb. 16). [Online]. Available: http://aws.amazon.com/big-data/
43. Big Data Beyond MapReduce: Google?s Big Data Papers (2017, Feb. 16). [Online]. Available: http://architects.dzone.com/articles/big-data-beyond-mapreduce
44. NASA NEX (2017, Feb. 16). [Online]. Available: http://aws.amazon. com/nasa/nex/
45. Smart City with Internet of Things (Sensor Networks) and Big Data (2017, Feb. 16). [Online]. Available: http://www.academia. edu/5276488/Smartcity-with-Internetof-Things-Sensor
46. Balancing Opportunity and Risk in Big Data, A Survey of Enterprise Priorities and Strategies for Harnessing Big Data (2017, Feb. 16). [Online]. Available: http://www.citia.co.uk/content/files/50-135-263.pdf