Some relationships between minimum bayes error and information theoretical feature extraction

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 5807, Issue , 2005, Pages 284-295

  Vasconcelos, Manuela ^a   Vasconcelos, Nuno ^b  

^a HARVARD UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

ATR; Classification; Feature extraction; Feature selection; Infomax; Maximum mutual information; Minimum Bayes error; Recognition; Statistical learning

Indexed keywords

ATR; CLASSIFICATION; FEATURE SELECTION; INFOMAX; MAXIMUM BAYES ERROR; MAXIMUM MUTUAL INFORMATION; RECOGNITION; STATISTICAL LEARNING;

AUTOMATIC TARGET RECOGNITION; CLASSIFICATION (OF INFORMATION); ERRORS; INFORMATION TECHNOLOGY; LEARNING SYSTEMS; PROBABILITY DISTRIBUTIONS; STATISTICAL METHODS;

FEATURE EXTRACTION;

EID: 27544455403     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.604289     Document Type: Conference Paper

References (19)

1. H. Yang and J. Moody, "Data Visualization and Feature Selection: New Algorithms for Nongaussian Data," in Proc. Neural Information Proc. Systems, Denver, USA, 2000.
2. B. Bonnlander and A. Weigand, "Selecting Input Variables using Mutual Information and Nonparametric Density Estimation," in Proc. IEEE International ICSC Symposium on Artificial Neural Networks, Tainan,Taiwan,1994.
3. J. Principe, D. Xu, and J. Fisher, "Information-Theoretic Learning," in Unsupervised Adaptive Filtering, Volume 1: Blind-Source Separation, S. Haykin, ed., Wiley, 2000.
4. K. Torkolla and W. Campbell, "Mutual Information in Learning Feature Transforms," in Proc. International Conference on Machine Learning, Stanford, USA, 2000.
5. S. Basu, C. Micchelli, and P. Olsen, "Maximum Entropy and Maximum Likelihood Criteria for Feature Selection from Multivariate Data," in Proc. IEEE International Symposium on Circuits and Systems, Geneva, Switzerland,2000.
6. S. Ullman, M. Vidal-Naquet, and E. Sali, "Visual features of intermediate complexity and their use in classification," Nature Neuroscience 5(7), pp. 1-6, 2002.
7. R. Linsker, "Self-Organization in a Perceptual Network," IEEE Computer 21, pp. 105-117, March 1988.
8. A. Bell and T. Sejnowski, "An Information Maximisation Approach to Blind Separation and Blind Deconvolution," Neural Computation 7(6), pp. 1129-1159, 1995.
9. D. Erdogmus and J. Principe, "Information Transfer Through Classifiers and its Relation to Probability of Error," in Proc. of the International Joint Conference on Neural Networks, Washington, 2001.
10. G. Saon and M. Padmanabhan, "Minimum Bayes Error Feature Selection for Continuous Speech Recognition," in Proc. Neural Information Proc. Systems, Denver, USA, 2000.
11. G. Carneiro and N. Vasconcelos, "Minimum Bayes Error Features for Visual Recognition by Sequential Feature Selection and Extraction," in Canadian Conference on Computer and Robot Vision, Vancouver, 2005.
12. L. Devroye, L. Gyorfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition, Springer-Verlag, 1996.
13. K. Fukunaga, Introduction to Statistical Pattern Recognition, Academic Press, 1990.
14. R. Duda, P. Hart, and D. Stork, Pattern Classification, John Wiley and Sons, 2001.
15. T. Cover and J. V. Campenhout, "On the Possible Orderings in the Measuremet Selection Problem," IEEE Trans. on Systems, Man, and Cybernetics 7, September 1977.
16. A. Jain and D. Zongker, "Feature Selection: Evaluation, Application, and Small Sample Performance," IEEE Trans. on Pattern Analysis and Machine Intelligence 19, pp. 153-158, February 1997.
17. S. Kullback, Information Theory and Statistics, Dover Publications, New York, 1968.
18. R. Blahut, Principles and Practice of Information Theory, Addison Wesley, 1991.
19. T. Cover and J. Thomas, Elements of Information Theory, John Wiley, 1991.