Discriminative feature extraction with deep neural networks

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2010, Pages

  Stuhlsatz, André ^a,b   Lippel, Jens ^a   Zielke, Thomas ^a  

^a UNIVERSITY OF APPLIED SCIENCES   (Germany)

^b OTTO VON GUERICKE UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

PATTERN RECOGNITION;

COMPLEX PATTERN; DISCRIMINATIVE FEATURE EXTRACTION; DISCRIMINATIVE FEATURES; HIGH-DIMENSIONAL; HIGHER-DIMENSIONAL; LOW DIMENSIONAL;

DEEP NEURAL NETWORKS;

EID: 79959487511     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2010.5596329     Document Type: Conference Paper

References (18)

1. K. Fukunaga and R. D. Short, "A class of feature extraction criteria and its relation to the bayes risk estimate," IEEE Trans. Inf. Theory, vol. 26, pp. 59-65, 1980.
2. H. Asoh and N. Otsu, "Nonlinear data analysis and multilayer perceptrons," in Proceedings of International Joint Conference on Neural Networks, vol. 2, 1989, pp. 411-415.
3. A. R. Webb and D. Lowe, "The optimised internal representation of multilayer classifier networks performs nonlinear discriminant analysis," Neural Networks, vol. 3, pp. 367-375, 1990.
4. D. Lowe and A. R. Webb, "Optimized feature extraction and the bayes decision in feed-forward classifier networks," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, pp. 355-364, 1991.
5. P. Gallinari, S. Thiria, F. Badran, and F. Fogelman-Soulie, "On the relations between discriminant analysis and multilayer perceptrons," Neural Networks, vol. 4, pp. 349-360, 1991.
6. H. Osman and M. M. Fahmy, "On the discriminatory power of adaptive feed-forward layered networks," IEEE Trans. Pattern Anal. Mach. Intell., vol. 16, pp. 837-842, 1994.
7. J. Mao and A. K. Jain, "Artificial neural networks for feature extraction and multivariate data projection," IEEE Trans. Neural Netw., vol. 6, pp. 296-317, 1995.
8. J.-H. Jiang, J.-H. Wang, X. Chu, and R.-Q. Yu, "Non-linear discriminant feature extraction using generalized back-propackagtion network," Journal of Chemometrics, vol. 10, pp. 281-294, 1996.
9. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," SCIENCE, vol. 313, pp. 504-507, 2006.
10. D. H. Ackley, G. E. Hinton, and T. J. Sejnowski, "A learning algorithm for boltzmann machines," Cognitive Science, vol. 9, pp. 147-169, 1985.
11. G. Hinton, S. Osindero, and Y. W. Teh, "A fast learning algortihm for deep belief nets," Neural Computation, vol. 18(7), pp. 1527-1554, 2006.
12. R. M. Neal and G. E. Hinton, "A new view of EM algorithm that justifies incremental, sparse and other variants." in Learning in Graphical Models, M. I Jordan, Ed. Kulwer Academic Publishers, 1998, pp. 355-368.
13. J. S. Liu, Monte Carlo Strategies in Scientific Computing. Springer Verlag, 2001.
14. G. E. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Computation, vol. 14(8), pp. 1771-1800, 2002.
15. M. Welling, M. Rosen-Zvi, and G. Hinton, "Exponential family harmoniums with an application to information retrieval," NIPS, vol. 17, pp. 1481-1488, 2005.
16. Y. LeCun and C. Cortes, THE MNIST DATABASE of handwritten digits, Std. [Online]. Available: http://yann.lecun.com/exdb/mnist
17. A. Asuncion and D. J. Newman, "UCI machine learning repository," 2007. [Online]. Available: http://www.ics.uci.edu/simmlearn/ MLRepository.html
18. H. Larochelle, Y. Bengio, J. Loradour, and P. Lamblin, "Exploring strategies for training deep neural networks," Journal of Machine Learning Research, vol. 1, pp. 1-40, 2009.