Correcting the Kullback-Leibler distance for feature selection

Pattern Recognition Letters

Volumn 26, Issue 11, 2005, Pages 1675-1683

  Coetzee, Frans M ^a,b  

^a GenuOne Inc   (United States)

^b GenuOne   (United States)

Author keywords

Classification error; Feature selection; Kullback Leibler distance; Neyman Pearson classification; Receiver operating curve (ROC)

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA REDUCTION; ERROR ANALYSIS; FUNCTIONS; PROBABILITY; SET THEORY; STATISTICAL METHODS;

CLASSIFICATION ERROR; FEATURE SELECTION; KULLBACK-LEIBLER DISTANCE; NEYMAN-PEARSON CLASSIFICATION; RECEIVER OPERATING CURVE (ROC);

PATTERN RECOGNITION;

EID: 19844363671     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2005.01.014     Document Type: Article

References (18)

1. Baker, L.D., McCallum, A.K., 1998. Distributional clustering of words for text classification. In: Proceedings of SIGIR-98, 21st ACM International Conference on Research and Development in Information Retrieval, Melbourne, AU, pp. 96-103
2. Blake, C., Merz, C., 1998. UCI repository of machine learning databases. URL http://www.ics.uci.edu/~mlearn/MLRepository.html
3. A. Blum, and P. Langley Selection of relevant features and examples in machine learning Artif. Intell. 97 1-2 1997 245 271
4. D.E. Boekee, and J.C.A. Van Der Lubbe Some aspects of error bounds in feature selection Pattern Recognit. 11 1979 353 360
5. Coetzee, F., Glover, E., Lawrence, S., Giles, C.L., 2001. Feature selection in web applications using roc inflections and power set pruning. In: Symposium on Applications and the Internet-SAINT 2001, San Diego, CA
6. Cover, and Thomas Principles of information theory 1993 Wiley and Sons
7. I. Csiszar The method of types IEEE Trans. Inf. Theory 44 6 1998 2502 2523
8. Duch, W., Adamczak, R., Gra̧bczewski, K., Ishikawa, M., Ueda, H., 1997. Extraction of crisp logical rules using constrained backpropagation networks-comparison of two new approaches. In: Proceedings of the European Symposium on Artificial Neural Networks (ESANN'97), pp. 109-114
9. W. Feller An introduction to probability theory and its applications third ed. Probability and mathematical statistics vol. 1 1950 John Wiley and Sons ISBN 0-471-25708-7
10. N.L. Johnson, and S. Kotz Discrete distributions. Probability and mathematical statistics 1969 John Wiley and Sons 0-471-44360-3
11. L.N. Kanal Patterns in pattern recognition IEEE Trans. Inf. Theory 20 1974 697 722
12. Kang, D., Silvescu, A., Zhang, J., Honavar, V., 2004. Generation of attribute value taxonomies from data for data-driven construction of accurate and compact classifiers. In: Proceedings of the Fourth IEEE International Conference on Data Mining (ICDM '04), Brighton, UK, in print
13. Koller, D., Sahami, M., 1996. Toward optimal feature selection. In: Proceedings of the 13th International Conference on Machine Learning, Morgan Kaufmann, pp. 284-292
14. J.R. Munkres Topology: a first course 1975 Prentice-Hall 0-13-925495-1
15. J. Novovicova, P. Pudil, and J. Kittler Divergence based feature selection for multimodal class densities IEEE Trans. Pattern Anal. Mach. Intell. 18 2 1996 218 223
16. P. Pudil, J. Novovicova, and J. Kittler Floating search methods in feature-selection Pattern Recognit. Lett. 15 11 1994 1119 1125
17. P. Pudil, J. Novovicova, and J. Kittler Simultaneous learning of decision rules and important attributes for classification problems in image analysis Image Vis. Comput. 12 3 1994 193 198
18. H.L. Van Trees Detection estimation and modulation theory vols. 1-3 1971 Wiley and Sons