A spatiotemporal compression based approach for efficient big data processing on Cloud

Journal of Computer and System Sciences

Volumn 80, Issue 8, 2014, Pages 1563-1583

  Yang, Chi ^a   Zhang, Xuyun ^a   Zhong, Changmin ^b   Liu, Chang ^a   Pei, Jian ^c   Ramamohanarao, Kotagiri ^d   Chen, Jinjun ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^b Joowing Australia Pty Ltd   (Australia)

^c SIMON FRASER UNIVERSITY   (Canada)

^d UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Big data; Cloud computing; Graph data; Scheduling; Spatiotemporal compression

Indexed keywords

BIG DATA; CLOUD COMPUTING; GRAPH STRUCTURES; SCHEDULING; TIME SERIES;

GRAPH DATA; MULTIPLE ITERATIONS; NOVEL TECHNIQUES; PARALLEL MEMORY; PERFORMANCE GAIN; SPATIO TEMPORAL FEATURES; SPATIO-TEMPORAL COMPRESSIONS; TEMPORAL CORRELATIONS;

DATA HANDLING;

EID: 84905086045     PISSN: 00220000     EISSN: 10902724     Source Type: Journal    
DOI: 10.1016/j.jcss.2014.04.022     Document Type: Article

References (32)

1. S. Tsuchiya, Y. Sakamoto, Y. Tsuchimoto, and V. Lee Big data processing in Cloud environments Fujitsu Sci. Tech. J. 48 2 2012 159 168
2. C. Ji, Y. Li, W. Qiu, U. Awada, and K. Li Big data processing in Cloud environments 2012 International Symposium on Pervasive Systems, Algorithms and Networks 2012 17 23
3. Big data: science in the petabyte era Nature 455 7209 2008 1
4. Balancing opportunity and risk in big data, a survey of enterprise priorities and strategies for harnessing big data http://www.informatica.com/ Images/1943-big-data-survey-wp-en-US.pdf accessed on March 01, 2013
5. M. Armbrust, A. Fox, R. Griffith, A.D. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica, and M. Zaharia A view of cloud computing Commun. ACM 53 4 2010 50 58
6. R. Buyya, C.S. Yeo, S. Venugopal, J. Broberg, and I. Brandic Cloud computing and emerging it platforms: vision, hype, and reality for delivering computing as the 5th utility Future Gener. Comput. Syst. 25 6 2009 599 616
7. L. Wang, G. Von Laszewski, A. Younge, X. He, M. Kunze, J. Tao, and C. Fu Cloud computing: a perspective study New Gener. Comput. 28 2 2010 137 146
8. L. Wang, J. Zhan, W. Shi, and Y. Liang In cloud, can scientific communities benefit from the economies of scale? IEEE Trans. Parallel Distrib. Syst. 23 2 2012 296 303
9. X. Yang, L. Wang, and G. Laszewski Recent research advances in e-science Clust. Comput. 12 4 2009 353 356
10. S. Sakr, A. Liu, D. Batista, and M. Alomari A survey of large scale data management approaches in cloud environments IEEE Commun. Surv. Tutor. 13 3 2011 311 336
11. B. Li, E. Mazur, Y. Diao, A. McGregor, and P. Shenoy A platform for scalable one-pass analytics using MapReduce Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'11) 2011 985 996
12. J. Dean, and S. Ghemawat MapReduce: simplified data processing on large clusters Commun. ACM 51 1 2008 107 113
13. K.H. Lee, Y.J. Lee, H. Choi, Y.D. Chung, and B. Moon Parallel data processing with MapReduce: a survey SIGMOD Rec. 40 4 2012 11 20
14. Hadoop http://hadoop.apache.org accessed on March 01, 2013
15. X. Zhang, C. Liu, S. Nepal, and J. Chen An efficient quasi-identifier index based approach for privacy preservation over incremental data sets on Cloud J. Comput. Syst. Sci. 79 5 2013 542 555
16. X. Zhang, C. Liu, S. Nepal, W. Dou, and J. Chen Privacy-preserving layer over MapReduce on Cloud The 2nd International Conference on Cloud and Green Computing (CGC 2012) Xiangtan, China 2012 304 310
17. X. Zhang, C. Liu, S. Nepal, S. Pandey, and J. Chen A privacy leakage upper-bound constraint based approach for cost-effective privacy preserving of intermediate datasets in Cloud IEEE Trans. Parallel Distrib. Syst. 24 6 2013 1192 1202
18. X. Zhang, T. Yang, C. Liu, and J. Chen A scalable two-phase top-down specialization approach for data anonymization using MapReduce on Cloud IEEE Trans. Parallel Distrib. Syst. 25 2 2013 363 373
19. C. Yang, Z. Yang, K. Ren, and C. Liu Transmission reduction based on order compression of compound aggregate data over wireless sensor networks Proc. 6th International Conference on Pervasive Computing and Applications (ICPCA'11) Port Elizabeth, South Africa 2011 335 342
20. S.H. Yoon, and C. Shahabi An experimental study of the effectiveness of clustered aggregation (CAG) leveraging spatial and temporal correlations in wireless sensor networks ACM Trans. Sens. Netw. 2008 1 36
21. P. Edara, A. Limaye, and K. Ramamritham Asynchronous in-network prediction: efficient aggregation in sensor networks ACM Trans. Sens. Netw. 4 4 2008 article 25
22. M.J. Handy, M. Haase, and D. Timmermann An low energy adaptive clustering hierarchy with deterministic cluster-head selection Proc. 4th International Workshop on Mobile and Wireless Communications Network (MWCN) 2002 368 372
23. A. Ail, A. Khelil, P. Szczytowski, and N. Suri An adaptive and composite spatio-temporal data compression approach for wireless sensor networks Proc. of ACM MSWiM'11 2011 67 76
24. R. Kienzler, R. Bruggmann, A. Ranganathan, and N. Tatbul Stream as you go: the case for incremental data access and processing in the cloud IEEE ICDE International Workshop on Data Management in the Cloud (DMC'12) 2012
25. P. Bhatotia, A. Wieder, R. Rodrigues, U.A. Acar, and R. Pasquin Incoop: MapReduce for incremental computations Proceedings of Proceedings of the 2nd ACM Symposium on Cloud Computing (SoCC'11) 2011 1 14
26. C. Olston, G. Chiou, L. Chitnis, F. Liu, Y. Han, M. Larsson, A. Neumann, V.B.N. Rao, V. Sankarasubramanian, S. Seth, C. Tian, T. ZiCornell, and X. Wang Nova: continuous Pig/Hadoop workflows Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'11) 2011 1081 1090
27. S. Lattanzi, B. Moseley, S. Suri, and S. Vassilvitskii Filtering: a method for solving graph problems in MapReduce Proc. 23rd ACM Symposium on Parallelism in Algorithms and Architectures (SPAA'11) San Jose, California, USA 2011
28. J. Conhen Graph twiddling in a MapReduce world Comput. Sci. Eng. 11 4 2009 29 41
29. K. Shim MapReduce algorithms for big data analysis Proc. VLDB Endow. 5 12 2012 2016 2017
30. Big data beyond MapReduce: Google's big data papers http://architects. dzone.com/articles/big-data-beyond-mapreduce accessed on March 01, 2013
31. Real time big data processing with GridGain http://www.gridgain.com/book/ book.html accessed on March 03, 2013
32. Managing and mining billion-node graphs http://kdd2012.sigkdd.org/sites/ images/summerschool/Haixun-Wang.pdf accessed on March 05, 2013