Robust feature learning by stacked autoencoder with maximum correntropy criterion

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2014, Pages 6716-6720

  Qi, Yu ^a,b   Wang, Yueming ^a,b   Zheng, Xiaoxiang ^a,b   Wu, Zhaohui ^b  

^a ZHEJIANG UNIVERSITY   (China)

^b ZHEJIANG UNIVERSITY   (China)

Author keywords

correntropy; deep learning; stacked autoencoder; Unsupervised feature learning

Indexed keywords

LEARNING SYSTEMS; MEAN SQUARE ERROR; SIGNAL PROCESSING; STATISTICS;

ANTI-NOISE ABILITY; AUTO ENCODERS; BENCHMARK DATASETS; CLASSIFICATION ACCURACY; CORRENTROPY; DEEP LEARNING; RECONSTRUCTION ERROR; UNSUPERVISED FEATURE LEARNING;

GAUSSIAN NOISE (ELECTRONIC);

EID: 84905284235     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2014.6854900     Document Type: Conference Paper

References (15)

1. G. Hinton, S. Osindero, and Y. Teh, "A fast learning algorithm for deep belief nets," Neural computation, vol. 18, no. 7, pp. 1527-1554, 2006.
2. R. Hinton, G. and Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, 2006.
3. Y. Boureau and Y. Cun, "Sparse feature learning for deep belief networks," in Advances in neural information processing systems, 2007, pp. 1185-1192.
4. Y. Bengio, "Learning deep architectures for ai," Foundations and Trends in Machine Learning, vol. 2, no. 1, pp. 1-127, 2009.
5. P. Vincent, H. Larochelle, Y. Bengio, and P. Manzagol, "Extracting and composing robust features with denoising autoencoders," in Proceedings of the 25th international conference on Machine learning. ACM, 2008, pp. 1096-1103.
6. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P. Manzagol, "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion," J. Mach. Learn. Res., vol. 11, pp. 3371-3408, Dec. 2010.
7. J. Xie, L. Xu, and E. Chen, "Image denoising and inpainting with deep neural networks," in Advances in Neural Information Processing Systems 25, pp. 350-358. 2012.
8. A. Martinez, "Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 24, no. 6, pp. 748-763, 2002.
9. S. Fidler, D. Skocaj, and A. Leonardis, "Combining reconstructive and discriminative subspace methods for robust classification and regression by subsampling," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 28, no. 3, pp. 337-350, 2006.
10. W. Liu, P. Pokharel, and J. Principe, "Correntropy: A localized similarity measure," in Neural Networks, 2006. IJCNN '06. International Joint Conference on, 2006, pp. 4919-4924.
11. W. Liu, P. Pokharel, and J. Principe, "Correntropy: Properties and applications in non-gaussian signal processing," Signal Processing, IEEE Transactions on, vol. 55, no. 11, pp. 5286-5298, 2007.
12. R. He, W. Zheng, B. Hu, and X. Kong, "A regularized correntropy framework for robust pattern recognition.," Neural Computation, vol. 23, no. 8, pp. 2074-2100, 2011.
13. K. Jeong, W. Liu, S. Han, E. Hasanbelliu, and J. Principe, "The correntropy mace filter," Pattern Recognition, vol. 42, no. 5, pp. 871-885, 2009.
14. R. He, B. Hu,W. Zheng, and X. Kong, "Robust principal component analysis based on maximum correntropy criterion," Image Processing, IEEE Transactions on, vol. 20, no. 6, pp. 1485-1494, 2011.
15. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, November 1998.