Privacy-preserving back-propagation and extreme learning machine algorithms

Data and Knowledge Engineering

Volumn 79-80, Issue , 2012, Pages 40-61

  Samet, Saeed ^a   Miri, Ali ^b  

^a MEMORIAL UNIVERSITY OF NEWFOUNDLAND   (Canada)

^b RYERSON UNIVERSITY   (Canada)

Author keywords

Back propagation; Distributed data structures; Extreme learning machine; Machine learning; Neural networks; Privacy preserving data mining

Indexed keywords

ACTIVATION FUNCTIONS; BATCH LEARNING; BP ALGORITHM; COMPLEX DATA; CONTINUOUS DATA; DISTRIBUTED DATA STRUCTURES; EXTREME LEARNING MACHINE; INPUT DATAS; LEARNING MODELS; LEARNING PHASE; LEARNING TECHNIQUES; MULTILAYER MODELS; NEURAL NETWORK LEARNING; NEURAL NETWORK SYSTEMS; NEW PROTOCOL; PRIVACY PRESERVING; PRIVACY PRESERVING DATA MINING; PRIVACY-PRESERVING PROTOCOLS; SENSITIVE DATAS; SINGLE LAYER; SINGLE-LAYER MODELS;

DATA PRIVACY; DATA STRUCTURES; LEARNING SYSTEMS; NEURAL NETWORKS;

BACKPROPAGATION ALGORITHMS;

EID: 84865103996     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2012.06.001     Document Type: Article

References (62)

1. F. Bonchi, B. Malin, and Y. Saygin Recent advances in preserving privacy when mining data Data & Knowledge Engineering 65 1 2008 1 4
2. Y. Lindell, and B. Pinkas Privacy preserving data mining Proceedings of the 20th Annual International Cryptology Conference (CRYPTO), Santa Barbara, CA, USA 2000 36 54
3. R. Agrawal, and R. Srikant Privacy-preserving data mining Proceedings of the ACM Special Interest Group on Management of Data Conference (SIGMOD), Dallas, TX, USA 2000 439 450
4. J. Vaidya, and C. Clifton Privacy-preserving decision trees over vertically partitioned data Proceedings of the 19th Annual IFIP WG 11.3 Working Conference on Data and Applications Security (DBSec), Storrs, CT, USA 2005 139 152
5. C. Clifton, M. Kantarcioglu, and J. Vaidya Defining privacy for data mining Proceedings of the National Science Foundation Workshop on Next Generation Data Mining (NGDM), Baltimore, MD, USA 2002 126 133
6. M. Kantarcioglu, and C. Clifton Privacy-preserving distributed mining of association rules on horizontally partitioned data IEEE Transactions on Knowledge and Data Engineering 16 9 2004 1026 1037
7. J.Z. Zhan, S. Matwin, and L. Chang Privacy-preserving collaborative association rule mining Proceedings of the 19th Annual IFIP WG 11.3 Working Conference on Data and Applications Security (DBSec), Storrs, CT, USA 2005 153 165
8. J.-L. Wang, C.-F. Xu, and Y.-H. Pan An incremental algorithm for mining privacy-preserving frequent itemsets Proceeding of the International Conference on Machine Learning and Cybernetics (ICMLC), Dalian, China 2006 1132 1137
9. W. Yang, and S. Huang Data privacy protection in multi-party clustering Data & Knowledge Engineering 67 1 2008 185 199
10. A. Inan, S.V. Kaya, Y. Saygin, E. Savas, A.A. Hintoglu, and A. Levi Privacy preserving clustering on horizontally partitioned data Data & Knowledge Engineering 63 3 2008 646 666
11. B.C. Fung, K. Wang, L. Wang, and P.C. Hung Privacy-preserving data publishing for cluster analysis Data & Knowledge Engineering 68 6 2009 552 575
12. S. Samet, A. Miri, and L. Orozco-Barbosa Privacy preserving k-means clustering in multi-party environment Proceedings of the International Conference on Security and Cryptography (SECRYPT), Barcelona, Spain 2007 381 385
13. M.C. Doganay, T.B. Pedersen, Y. Saygin, E. Savaş, and A. Levi Distributed privacy preserving k-means clustering with additive secret sharing Proceedings of the 2008 international workshop on Privacy and anonymity in information society, PAIS '08 2008 ACM New York, NY, USA 3 11
14. M. Kantarcioglu, A. Inan, W. Jiang, and B. Malin Formal anonymity models for efficient privacy-preserving joins Data & Knowledge Engineering 68 11 2009 1206 1223
15. W. Jiang, and C. Clifton A secure distributed framework for achieving k-anonymity The International Journal on Very Large Data Bases 15 4 2006 316 333
16. E. Magkosa, M. Maragoudakisb, V. Chrissikopoulosa, and S. Gritzalis Accurate and large-scale privacy-preserving data mining using the election paradigm Data & Knowledge Engineering 68 11 2009 1224 1236
17. H. Yu, X. Jiang, and J. Vaidya Privacy-preserving SVM using nonlinear kernels on horizontally partitioned data Proceedings of the 13th Annual Workshop on Selected Areas in Cryptography (SAC), Montreal, Quebec, Canada 2006 603 610
18. S. Laur, H. Lipmaa, and T. Mielikäinen Cryptographically private support vector machines Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Philadelphia, FL, USA 2006 618 624
19. L. Liu, M. Kantarcioglu, and B. Thuraisingham The applicability of the perturbation based privacy preserving data mining for real-world data Data & Knowledge Engineering 65 1 2008 5 21
20. J.J. Kim, and W.E. Winkler Multiplicative noise for masking continuous data Research Report Series (Statistics #2003-01) April 2003 Statistical Research Division, U.S. Bureau of the Census Washington DC, USA
21. A. Teoh, and C.T. Yuang Cancelable biometrics realization with multispace random projections IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics 37 5 2007 1096 1106
22. C.C. Aggarwal, and P.S. Yu On static and dynamic methods for condensation-based privacy-preserving data mining ACM Transactions on Database Systems (TODS) 33 1 2008 2:1 2:39
23. G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew Extreme learning machine: theory and applications Neurocomputing 70 1-3 2006 489 501 (selected Papers from the 7th Brazilian Symposium on Neural Networks (SBRN04))
24. C. Clifton, M. Kantarcioglu, J. Vaidya, X. Lin, and M.Y. Zhu Tools for privacy preserving distributed data mining ACM Special Interest Group on Knowledge Discovery and Data Mining (SIGKDD) 4 (2) 2003 28 34
25. J. Sakuma, and S. Kobayashi Large-scale k-means clustering with user-centric privacy preservation Proceedings of the 2008 Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), Osaka, Japan 2008 320 332
26. B. Goethals, S. Laur, H. Lipmaa, and T. Mielikäinen On private scalar product computation for privacy-preserving data mining Proceedings of the 7th International Conference on Information Security and Cryptology (ICISC), Seoul, Korea 2004 104 120
27. M. Kantarcioglu, and O. Kardes Privacy-preserving data mining in the malicious model International Journal of Information and Computer Security 2 4 2009 353 375
28. M. Barni, C. Orlandi, and A. Piva A privacy-preserving protocol for neural-network-based computation Proceeding of the 8th Workshop on Multimedia and Security, Geneva, Switzerland 2006 146 151
29. A.C. Yao Protocols for secure computations Proceedings of the 23rd Annual Symposium on Foundations of Computer Science (SFCS) 1982 IEEE Computer Society Washington, DC, USA 160 164
30. M. Naor, and B. Pinkas Oblivious transfer and polynomial evaluation Proceedings of the Thirty-First Annual ACM Symposium on Theory of Computing (STOC), New York, NY, USA 1999 245 254
31. C. Orlandi, A. Piva, and M. Barni Oblivious neural network computing via homomorphic encryption EURASIP Journal on Information Security 2007 1 11
32. P. Paillier Public-key cryptosystems based on composite degree residuosity classes Proceedings of the International Conference on the Theory and Application of Cryptographic Techniques (EUROCRYPT), Prague, Czech Republic 1999 223 238
33. J. Secretan, M. Georgiopoulos, and J. Castro A privacy preserving probabilistic neural network for horizontally partitioned databases Proceedings of the International Joint Conference on Neural Networks (IJCNN), Orlando, FL, USA 2007 1554 1559
34. H. Yu, and J. Vaidya Secure Matrix Addition, Technical Report UIOWA-CS-04-04 2004 University of Iowa http://hwanjoyu.org/paper/techreport04- 04.pdf
35. S. Samet, and A. Miri Privacy-preserving protocols for perceptron learning algorithm in neural networks Proceeding of the 4th IEEE International Conference on Intelligent Systems (IS), Varna, Bulgaria 2008 10-65 10-70
36. L. Guang, W. Ya-Dong, and S. Xiao-Hong A privacy preserving neural network learning algorithm for horizontally partitioned databases Information Technology Journal 9 1 2009 1 10
37. N. Schlitter A protocol for privacy preserving neural network learning on horizontal partitioned data Privacy Statistics in Databases (PSD), Istanbul, Turkey 2008
38. L. Wan, W.K. Ng, S. Han, and V.C.S. Lee Privacy-preservation for gradient descent methods Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '07 2007 ACM New York, NY, USA 775 783
39. T. Chen, and S. Zhong Privacy-preserving back propagation neural network learning IEEE Transactions on Neural Networks 20 10 2009 1554 1564
40. T. ElGamal A public key cryptosystem and a signature scheme based on discrete logarithms Proceedings of CRYPTO 84 on Advances in cryptology 1985 Springer-Verlag New York, Inc. New York, NY, USA 10 18
41. A. Bansal, T. Chen, and S. Zhong Privacy preserving back-propagation neural network learning over arbitrarily partitioned data Neural Computing and Applications 20 2011 143 150
42. Y.-C. Chang, and C.-J. Lu Oblivious polynomial evaluation and oblivious neural learning Theoretical Computer Science 341 2005 39 54
43. S.I. Gallant Neural Network Learning and Expert Systems 1993 MIT Press Cambridge, MA, USA
44. F. Rosenblatt Two theorems of statistical separability in the perceptron Proceedings of a Symposium on Mechanization of Thought Processes, London, England 1959 421 456
45. C. Rao, and S. Mitra Generalized Inverse of Matrices and its Applications 1971 Wiley New York
46. D. Serre Matrices: Theory and Applications 2002 Springer New York
47. J. Ortega Matrix Theory 1987 Plenum Press New York, London
48. M.M. Islam, M.A. Sattar, M.F. Amin, X. Yao, and K. Murase A new constructive algorithm for architectural and functional adaptation of artificial neural networks IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics 39 6 2009 1590 1605
49. S. Samet, and A. Miri Privacy preserving ID3 using Gini Index over horizontally partitioned data Proceeding of the 6th ACS/IEEE International Conference on Computer Systems and Applications (AICCSA), Doha, Qatar 2008 645 651
50. O. Goldreich Foundations of cryptography Basic Applications vol. 2 2004 Cambridge University Press New York, NY, USA
51. S. Goldwasser, S. Micali, and C. Rackoff The knowledge complexity of interactive proof systems SIAM Journal on Computing 18 1 1989 186 208
52. R. Canetti Security and composition of multiparty cryptographic protocols Journal of Cryptology 13 1 2000 143 202
53. S. Han, W.K. Ng, and P.S. Yu Privacy-preserving singular value decomposition Proceedings of the 2009 IEEE International Conference on Data Engineering (ICDE) 2009 IEEE Computer Society Washington, DC, USA 1267 1270
54. I. Isa, Z. Saad, S. Omar, M. Osman, K. Ahmad, and H. Sakim Suitable MLP network activation functions for breast cancer and thyroid disease detection Computational Intelligence, Modelling and Simulation (CIMSiM), 2010 Second International Conference on 2010 39 44
55. W.H. Beyer CRC Standard Mathematical Tables 28th ed. 1987 CRC Press Boca Raton, FL 299 300
56. S.L. Lauritzen, and D.J. Spiegelhalter Local computations with probabilities on graphical structures and their application to expert systems Journal of the Royal Statistical Society B 50 1988 157 194
57. R. Kohavi Scaling up the accuracy of naive-Bayes classifiers: a decision-tree hybrid Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD) 1996 202 207
58. I.A. Beinlich, H.J. Suermondt, R.M. Chavez, and G.F. Cooper The alarm monitoring system: a case study with two probabilistic inference techniques for belief networks Proceeding of the Second European Conf. on Artificial Intelligence in Medicine, vol. 38 1989 247 256
59. J. Hawkins, and M. Boden The applicability of recurrent neural networks for biological sequence analysis IEEE/ACM Transactions on Computational Biology and Bioinformatics 2 3 2005 243 253
60. S. Gallant Perceptron-based learning algorithms IEEE Transactions on Neural Networks 1 2 1990 179 191
61. S.E. Fahlman, and C. Lebiere The cascade-correlation learning architecture D.S. Touretzky, Advances in Neural Information Processing Systems vol. 2 1990 Morgan Kaufmann San Mateo, Denver 524 532 1989
62. M. Mezard, and J.-P. Nadal Learning in feedforward layered networks: the tiling algorithm Journal of Physics A Mathematical and General 22 1989 2191 2203