HSAE: A Hessian regularized sparse auto-encoders

Neurocomputing

Volumn 187, Issue , 2016, Pages 59-65

  Liu, Weifeng ^a   Ma, Tengzhou ^a   Tao, Dapeng ^b   You, Jane ^c  

^a CHINA UNIVERSITY OF PETROLEUM   (China)

^b YUNNAN UNIVERSITY   (China)

^c HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Auto encoder; Hessian regularization; Manifold; Sparse representation

Indexed keywords

ALGORITHMS;

AUTO ENCODERS; DEEP ARCHITECTURES; HESSIAN REGULARIZATION; HIDDEN STRUCTURES; LEARNING PARADIGMS; MANIFOLD; SPARSE REPRESENTATION; SPARSITY CONSTRAINTS;

LEARNING SYSTEMS;

ARTICLE; CONTROLLED STUDY; GEOMETRY; HESSIAN REGULARIZED SPARSE AUTO ENCODER; INTERMETHOD COMPARISON; LEARNING ALGORITHM; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; PRIORITY JOURNAL;

EID: 84949266924     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.07.119     Document Type: Article

References (33)

1. Yu J., Rui Y., Tao D. Click prediction for web image reranking using multimodal sparse coding. IEEE Trans. Image Process. (Tip.) 2014, 23(5):2019-2032.
2. Yu J., Tao D., Yong R. Learning to rank using user clicks and visual features for image retrieval. IEEE Trans. Cybern. 2015, 45(4):767-779.
3. Tao D., Li X., Wu X., Maybank S.J. General tensor discriminant analysis and gabor features for gait recognition. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29(10):1700-1715.
4. Tao D., Tang X., Li X., Wu X. Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. (T-PAMI) 2006, 28(7):1088-1099.
5. Yu J., Rui Y., Tang Y., Tao D. High-order distance based multiview stochastic learning in image classification. IEEE Trans. Cybern. 2014, 44(12):2431-2442.
6. Tao D., Jin L., Wang Y., Yuan Y., Li X. Person re-identification by regularized smoothing KISS metric learning. IEEE Trans. Circuits Syst. Video Technol. 2013, 23(10):1675-1685.
7. Yu J., Rui Y., Chen B. Exploiting click constraints and multiviewfeatures for image reranking. IEEE Trans. Multimed. 2014, 16(1):159-168.
8. Tao D., Lin X., Jin L., Li X. Principal component 2-dimensional long short-term memory for font recognition on single Chinese characters. IEEE Trans. Cybern. 2015, 2414920. 10.1109/TCYB.
9. Bengio Y., Courville A., Vincent P. Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 2013, 35:1798-1828.
10. Yang X., Zhang T., Xu C. Cross-domain feature learning in multimedia. IEEE Trans. Multimed. 2015, 17:64-78.
11. M. Chen, Z. Xu, K.Q. Weinberger, F. Sha, Marginalized denoising autoencoders for domain adaptation, in: Proceedings of the International Conference on Machine Learning, 2012.
12. M.Á. Carreira-Perpiñán, R. Raziperchikolaei, Hashing with binary autoencoders, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015.
13. Zhang J., Shan S., Kan M., Chen X. Coarse-to-fine auto-encoder networks (cfan) for real-time face alignment. Computer Vision-ECCV 2014 2014, 1-16. Springer.
14. Li S.-Z., Yu B., Wu W., Su S.-Z., Ji R.-R. Feature learning based on SAE-PCA network for human gesture recognition in RGBD images. Neurocomputing 2015, 151(Part 2):565-573.
15. Deng L., Seltzer M.L., Yu D., Acero A., Mohamed A.-R., Hinton G.E. Binary coding of speech spectrograms using a deep auto-encoder. Interspeech 2010, 1692-1695.
16. Liou C.-Y., Cheng W.-C., Liou J.-W., Liou D.-R. Autoencoder for words. Neurocomputing 2014, 139:84-96.
17. G.E. Hinton, R.S. Zemel, Autoencoders, Minimum Description Length and Helmholtz Free Energy, Advances in Neural Information Processing Systems, 1994.
18. Ranzato M.A., Poultney C., Chopra S., LeCun Y. Efficient learning of sparse representations with an energy-based model. Adv. neural Inf. Process. Syst. 2006, 1137-1144.
19. Lee H., Ekanadham C., Ng A.Y. Sparse deep belief net model for visual area V2. Adv. Neural Inf. Process. Syst. 2008, 873-880.
20. Ranzato M.A., Boureau Y.-L., LeCun Y. Sparse feature learning for deep belief networks. Adv. Neural Inf. Process. Syst. 2008, 1185-1192.
21. Vincent P., Larochelle H., Lajoie I., Bengio Y., Manzagol P.-A. Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 2010, 11:3371-3408.
22. Vincent P. A connection between score matching and denoising autoencoders. Neural Comput. 2011, 23:1661-1674.
23. K. Swersky, D. Buchman, N.D. Freitas, B.M. Marlin, On autoencoders and score matching for energy based models, in: Proceedings of the 28th International Conference on Machine Learning (ICML-11), 2011, pp. 1201-1208.
24. S. Rifai, P. Vincent, X. Muller, X. Glorot, Y. Bengio, Contractive auto-encoders: explicit invariance during feature extraction, in: Proceedings of the 28th International Conference on Machine Learning (ICML-11), 2011, pp. 833-840.
25. Rifai S., Mesnil G., Vincent P., Muller X., Bengio Y., Dauphin Y., Glorot X. Higher order contractive auto-encoder. Machine Learning and Knowledge Discovery in Databases 2011, 645-660. Springer.
26. Jia K., Sun L., Gao S., Song Z., Shi B.E. Laplacian auto-encoders: an explicit learning of nonlinear data manifold. Neurocomputing 2015, 160:250-260.
27. Liu W., Tao D. Multiview Hessian regularization for image annotation. IEEE Trans. Image Process. 2013, 22:2676-2687.
28. Liu W., Tao D., Cheng J., Tang Y. Multiview Hessian discriminative sparse coding for image annotation. Comput. Vis. Image Underst. 2014, 118:50-60.
29. Tao D., Jin L., Liu W., Li.X. Hessian regularized support vector machines for mobile image annotation on the cloud. IEEE Trans. Multimed. 2013, 15(4):833-844.
30. C. Gravelines, Deep Learning via Stacked Sparse Autoencoders for Automated Voxel-Wise Brain Parcellation Based on Functional Connectivity, 2014.
31. LeCun Y., Bottou L., Bengio Y., Haffner P. Gradient-based learning applied to document recognition. Proc. IEEE 1998, 86(11):2278-2324.
32. A. Krizhevsky G. Hinton, Learning multiple layers of features from tiny images, Technical Report 1, Computer Science Department, University of Toronto, 2009, p. 7.
33. Torralba A., Fergus R., Freeman W.T. 80 million tiny images: a large data set for nonparametric object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30:1958-1970.