Privacy Preserving Deep Computation Model on Cloud for Big Data Feature Learning

IEEE Transactions on Computers

Volumn 65, Issue 5, 2016, Pages 1351-1362

  Zhang, Qingchen ^a   Yang, Laurence T ^b,c   Chen, Zhikui ^a  

^a DALIAN UNIVERSITY OF TECHNOLOGY   (China)

^b HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^c ST FRANCIS XAVIER UNIVERSITY   (Canada)

Author keywords

BGN encryption; BGV encryption; Big data; Cloud computing; Deep computation model; High order back propagation; Smart city

Indexed keywords

BACKPROPAGATION; BACKPROPAGATION ALGORITHMS; CLOUD COMPUTING; COMPUTATION THEORY; COMPUTATIONAL EFFICIENCY; CRYPTOGRAPHY; DATA PRIVACY; EFFICIENCY;

ACTIVATION FUNCTIONS; COMPUTATION MODEL; DECRYPTION OPERATIONS; ENCRYPTION OPERATIONS; POLYNOMIAL FUNCTIONS; PROPRIETARY INFORMATION; SMART CITIES; TRAINING EFFICIENCY;

BIG DATA;

EID: 84963853667     PISSN: 00189340     EISSN: None     Source Type: Journal    
DOI: 10.1109/TC.2015.2470255     Document Type: Article

References (56)

1. W. Rong, X. Zhang, C. Dave, L. Chao, and S. Hao, "Smart city architecture: A technology guide for implementation and design challenges," China Commun., vol. 11, no. 3, pp. 56-69, 2014.
2. J. Jin, J. Gubbi, S. Marusic, and M. Palaniswami, "An information framework for creating a smart city through Internet of Things," IEEE Internet Things J., vol. 1, no. 2, pp. 112-121, Apr. 2014.
3. A. Domingo, B. Bellalta, M. Palacin, M. Oliver, and E. Almirall, "Public open sensor data: Revolutionizing smart cities," IEEE Technol. Soc. Mag., vol. 32, no. 4, pp. 50-56, Dec. 2013.
4. G. Pan, G. Qi, W. Zhang, S. Li, Z. Wu, and L. T. Yang, "Trace analysis and mining for smart cities: Issues, methods, and applications," IEEE Commun. Mag., vol. 51, no. 6, pp. 120-126, Jun. 2013.
5. I. Vilajosana, J. Llosa, B. Martinez, M. Domingo-Prieto, A. Angles, and X. Vilajosana, "Bootstrapping smart cities through a selfsustainable model based on big data flows," IEEE Commun. Mag., vol. 51, no. 6, pp. 128-134, Jun. 2013.
6. X. -W. Chen and X. Lin, "Big data deep learning: Challenges and perspectives," IEEE Access, vol. 2, pp. 514-525, May 2014.
7. K. Slavakis, G. B. Giannakis, and G. Mateos, "Modeling and optimization for big data analytics: (Statistical) learning tools for our era of data deluge," IEEE Signal Process. Mag., vol. 31, no. 5, pp. 18-31, Sep. 2014.
8. T. Condie, P. Mineiro, N. Polyzotis, and M. Weimer, "Machine learning on big data," in Proc. IEEE Int. Conf. Data Eng., 2013, pp. 1242-1244.
9. X. Wu, X. Zhu, G. -Q. Wu, and W. Ding, "Data mining with big data," IEEE Trans. Knowl. Data Eng., vol. 26, no. 1, pp. 97-107, Jan. 2014.
10. H. H. Huang and H. Liu, "Big data machine learning and graph analytics: Current state and future challenges," in Proc. IEEE Int. Conf. Big Data, 2014, pp. 16-17.
11. C. Yang, C. Liu, X. Zhang, S. Nepal, and J. Chen, "A time efficient approach for detecting errors in big sensor data on cloud," IEEE Trans. Parallel Distrib. Syst., vol. 26, no. 2, pp. 329-339, Feb. 2015.
12. X. Zhu, X. Qin, and M. Qiu, "QoS-aware fault-tolerant scheduling for real-time tasks on heterogeneous clusters," IEEE Trans. Comput., vol. 60, no. 6, pp. 800-812, Jun. 2011.
13. A. S. Prasad and S. Rao, "A mechanism design approach to resource procurement in cloud computing," IEEE Trans. Comput., vol. 63, no. 1, pp. 17-30, Jan. 2014.
14. S. M. Kwang, "Agent-based cloud computing," IEEE Trans. Serv. Comput., vol. 5, no. 4, pp. 564-577, Oct.-Dec. 2012.
15. N. Jones, "Computer science: The learning machines," Nature, vol. 505, no. 7482, pp. 146-148, 2014.
16. A. Iosup, S. Ostermann, M. N. Yigitbasi, R. Prodan, T. Fahringer, and D. H. J. Epema, "Performance analysis of cloud computing services for many-tasks scientific computing," IEEE Trans. Parallel Distrib. Syst., vol. 22, no. 6, pp. 931-945, Jun. 2011.
17. X. Zhu, C. Chen, Laurence T. Yang, and Y. Xiang, "ANGEL: Agent-based scheduling for real-time tasks in virtualized clouds," IEEE Trans. Comput., [Online]. Available: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7054494, 2015.
18. Q. Zhang and Z. Chen, "A weighted kernel possibilistic C-means algorithm based on cloud computing for clustering big data," Int. J. Commun. Syst., vol. 27, no. 9, pp. 1378-1391, 2014.
19. A. Smola and S. Narayanamurthy, "An architecture for parallel topic models," Proc. VLDB Endowment, vol. 3, no. 1-2, pp. 703-710, 2010.
20. J. Lin and A. Kolcz, "Large-scale machine learning at Twitter," in Proc. ACM Conf. Manage. Data, 2012, pp. 793-804.
21. J. Yuan and S. Yu, "Privacy preserving back-propagation neural network learning made practical with cloud computing," IEEE Trans. Parallel Distrib. Syst., vol. 25, no. 1, pp. 212-221, Jan. 2014.
22. J. Bacon, D. Eyers, T. F. J. -M. Pasquier, J. Singh, J. I. Papagiannis, and P. Pietzuch, "Information flow control for secure cloud computing," IEEE Trans. Netw. Serv. Manage., vol. 11, no. 1, pp. 76-89, Apr. 2014.
23. E. Z. Tragos, V. Angelakis, A. Fragkiadakis, D. Gundlegard, C.-S. Nechifor, G. Oikonomou, H. C. Pohls, and A. Gavras, "Enabling reliable and secure IoT-based smart city applications," in Proc. Int. Conf. Pervasive Comput. Commun., 2014, pp. 111-116.
24. (2013). The health insurance portability and accountability act of privacy and security rules [Online]. Available: http://www.hhs.gov/ocr/privacy
25. Y. Lindelland B. Pinkas, "Privacy preserving data mining," J. Cryptol., vol. 15, no. 3, pp. 177-206, 2002.
26. W. Du and Z. Zhan, "Using randomized response techniques for privacy preserving data mining," in Proc. ACM Int. Conf. Knowl. Discovery Data Mining, 2003, pp. 505-510.
27. R. Wright and Z. Yang, "Privacy-preserving Bayesian network structure computation on distributed heterogeneous data," in Proc. ACM Int. Conf. Knowl. Discovery Data Mining, 2004, pp. 713-718.
28. J. Vaidya and C. Clifton, "Privacy preserving naive Bayes classifier for vertically partitioned data," in Proc. SIAM Int. Conf. Data Mining, 2004, pp. 522-526.
29. S. Laur, H. Lipmaa, and T. Mielikaihen, "Cryptographically private support vector machines," in Proc. ACM Int. Conf. Knowl. Discovery Data Mining, 2006, pp. 618-624.
30. J. Vaidya and C. Clifton, "Privacy-preserving K-means clustering over vertically partitioned data," in Proc. ACM Int. Conf. Knowl. Discovery Data Mining, 2003, pp. 206-215.
31. Z. Brakerski, C. Gentry, and V. Vaikuntanathan, "(Leveled) fully homomorphic encryption without bootstrapping," in Proc. ACM Innovations Theoretical Comput. Sci. Conf., 2012 pp. 309-325.
32. L. Kuang, F. Hao, L. T. Yang, M. Lin, C. Luo, and G. Min, "A tensor-based approach for big data representation and dimensionality reduction," IEEE Trans. Emerging Topics Comput., vol. 2, no. 3, pp. 280-291, Sep. 2014.
33. A. Cichocki, "Era of big data processing: A new approach via tensor networks and tensor decompositions," arXiv preprint arXiv:1403.2048, 2014.
34. Y. Bengio, A. Courville, and P. Vincent, "Representation learning: A review and new perspectives," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1798-1828, Aug. 2013.
35. Y. Liu, Y. Liu, and K. Chan, "Tensor distance based multilinear locality-preserved maximum information embedding," IEEE Trans. Neural Netw., vol. 21, no. 11, pp. 1848-1854, Nov. 2010.
36. R. L. Rivest, L. Adleman, and M. L. Dertouzos, "On data banks and privacy homomorphisms," Found. Secure Comput., vol. 4, no. 11, pp. 169-180, 1978.
37. R. L. Rivest, A. Shamir, and L. Adleman, "A method for obtaining digital signatures and public-key cryptosystems," Commun. ACM, vol. 21, no. 2, pp. 120-126, 1978.
38. D. Boneh, E. -J. Goh, and K. Nissim, "Evaluating 2-DNF formulas on ciphertexts," in Proc. Int. Conf. Theory Cryptography, 2005, pp. 325-341.
39. C. Gentry, "Fully homomorphic encryption using ideal lattices," in Proc. ACM Symp. Theory Comput., 2009, pp. 169-178.
40. T. Okamoto and S. Uchiyama, "A new public-key cryptosystem as secure as factoring," in Proc. Int. Conf. Theory Appl. Cryptol. Inf. Security, 1998, pp. 308-318.
41. P. Paillier, "Public-key cryptosystems based on composite degree residuosity classes," in Proc. Int. Conf. Theory Appl. Cryptographic Techn., 1999, pp. 223-238.
42. I. Damgard and M. Jurik, "A length-flexible threshold cryptosystem with applications," in Proc. Australasian Conf. Inf. Security Privacy, 2001, pp. 350-364.
43. T. El Gamal, "A public key cryptosystem and a signature scheme based on discrete logarithms," in Proc. Int. Conf. Theory Appl. Cryptographic Techn., 1985, pp. 10-18.
44. Z. Brakerski, "Fully homomorphic encryption without modulus switching from classical GapSVP," in Proc. 32nd Annu. Cryptol. Conf. Adv. Cryptol., 2012, pp. 868-886.
45. C. Gentry, A. Sahai, and B. Waters, "Homomorphic encryption from learning with errors: Conceptually-simpler, asymptoticallyfaster, attribute-based," in Proc. 33rd Annu. Cryptol. Conf. Adv. Cryptol., 2013, pp. 75-92.
46. A. Coates, A. Y. Ng, and H. Lee, "An analysis of single-layer networks in unsupervised feature learning," in Proc. Int. Conf. Artif. Intell. Statist., 2011, pp. 215-223.
47. T. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng, "NUSWIDE: A real-world web image database from National University of Singapore," in Proc. ACM Int. Conf. Image Video Retrieval, 2009, pp. 1-9.
48. W. Huang, G. Song, H. Hong, and K. Xie, "Deep architecture for traffic flow prediction: Deep belief networks with multitask learning," IEEE Trans. Intell. Transp. Syst., vol. 15, no. 5, pp. 2191-2201, Oct. 2014.
49. (2015). Performance Measurement System (PeMS) [Online]. Available: http://pems.dot.ca.gov
50. D. Agrawal and R. Srikant, "Privacy-preserving data mining," in Proc. ACM Conf. Manage. Data, 2000, pp. 439-450.
51. Y. Lindell and B. Pinkas, "Privacy preserving data mining," Lecture Notes Comput. Sci., vol. 1880, pp. 36-45, 2000.
52. N. Schlitter, "A protocol for privacy preserving neural network learning on horizontal partitioned data," in Proc. Privacy Statist. Databases, 2008, pp. 298-315.
53. T. Chen and S. Zhong, "Privacy-preserving backpropagation neural network learning," IEEE Trans. Neural Netw., vol. 20, no. 10, pp. 1554-1564, Oct. 2009.
54. A. Bansal, T. Chen, and S. Zhong, "Privacy preserving backpropagation neural network learning over arbitrarily partitioned data," Neural Comput. Appl., vol. 20, no. 1, pp. 143-150, Feb. 2011.
55. M. Dong, H. Li, K. Ota, and H. Zhu, "HVSTO: Efficient privacy preserving hybrid storage in cloud data center," in Proc. IEEE Conf. Comput. Commun. INFOCOM Workshop Security Privacy Big Data, 2014, pp. 529-534.
56. M. Barni, C. Orlandi, and A. Piva, "A privacy-preserving protocol for neural-network-based computation," in Proc. 8th Workshop Multimedia Security, 2006, pp. 146-151.