Bayesian network classifiers versus selective k-NN classifier

Pattern Recognition

Volumn 38, Issue 1, 2005, Pages 1-10

  Pernkopf, Franz ^a,b  

^a GRAZ UNIVERSITY OF TECHNOLOGY   (Austria)

^b University of Washington   (United States)

Author keywords

Bayesian network classifiers; Feature selection; K NN classifier

Indexed keywords

ALGORITHMS; FEATURE EXTRACTION; PROBABILITY DISTRIBUTIONS; SET THEORY; STATISTICAL METHODS; TOPOLOGY;

BAYESIAN NETWORKS; ESTIMATION ERRORS; FEATURE SELECTION;

PATTERN RECOGNITION;

EID: 4644329616     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2004.05.012     Document Type: Article

References (35)

1. A.K. Jain, D. Zongker, Feature selection: evaluation, application, and small sample performance, IEEE Trans. Pattern Anal. Mach. Intell. 19 (2) (1997) 153-158.
2. M. Dash, H. Liu, Feature selection for classification, Intell. Data Anal. 1 (3) (1997) 131-156.
3. R. Kohavi, G.H. John, Wrappers for feature subset selection, Artif. Intell. 97 (1997) 273-324.
4. F. Pernkopf, P. O'Leary, Visual inspection of machined metallic high-precision surfaces, Eurasip J. Appl. Signal Process. Special Issue on Applied Visual Inspection 2002 (7) (2002) 667-678.
5. A.K. Jain, B. Chandrasekaran, Dimensionality and sample size considerations in pattern recognition in practice, Handbook of Statistics, vol. 2, North-Holland, Amsterdam, 1982.
6. D. Zongker, A. Jain, Algorithms for feature selection: an evaluation, International Conference on Pattern Recognition, ICPR 96, 1996, pp. 18-22.
7. F.J. Fern, P. Pudil, M. Hatef, J. Kittler, Comparative study of techniques for large-scale feature selection, E.S. Gelsema, L.N. Kamal (Eds.), Pattern Recognition in Practice, vol. IV, Elsevier Science B.V., Amsterdam, 1994, pp. 403-413.
8. R. Kohavi, D. Sommerfiled, Feature subset selection using the wrapper model: overfitting and dynamic search space topology, Proceedings of the First International Conference on Knowledge Discovery and Data Mining, 1995, pp. 192-197.
9. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann, Los Alios, CA, 1988.
10. N. Friedman, D. Geiger, M. Goldszmidt, Bayesian network classifiers, Mach. Learn. 29 (1997) 131-163.
11. M. Singh, G.M. Provan, Efficient learning of selective Bayesian network classifiers, International Conference of Machine Learning, 1996, pp. 453-461.
12. F. Pernkopf, Detection of surface defects on milled steel blocks using Bayesian network classifiers, Technical Report, Graz University of Technology, 2003.
13. C. Merz, P. Murphy, D. Aha, UCI repository of machine learning databases, Department of Information and Computer Science, University of California, Irvine, URL: http://www.ics.uci.edu/mlearn/MLRepository.html, 1997.
14. F.V. Jensen, An Introduction to Bayesian Networks, UCL Press Limited, London, 1996.
15. R.G. Cowell, A.P. Dawid, S.L. Lauritzen, D.J. Spiegelhalter, Probabilistic Networks and Expert Systems, Springer, Berlin, 1999.
16. D. Heckerman, A tutorial on learning Bayesian networks, Technical Report MSR-TR-95-06, Microsoft Research, 1995.
17. R.O. Duda, P.E. Hart, D.G. Stork, Pattern Classification, Wiley, New York, 2000.
18. E.J. Keogh, M.J. Pazzani, Learning augmented Bayesian classifiers: a comparison of distribution-based and classification-based approaches, Proceedings of Seventh International Workshop on Artificial Intelligence and Statistics, 1999, pp. 225-230.
19. P. Pudil, J. Novovičová, J. Kittler, Floating search methods in feature selection, Pattern Recognition Lett. 15 (1994) 1119-1125.
20. F. Pernkopf, P. O'Leary, Floating search algorithm for structure learning of Bayesian network classifiers, Pattern Recognition Lett. 24 (2003) 2839-2848.
21. J. Kittler, Feature set search algorithms, in: C.H. Chen (Ed.), Pattern Recognition and Signal Processing, Sijthoff and Noordhoff, Alphen a/d Rijn, 1978, pp. 41-60.
22. G.H. John. R. Kohavi, K. Pfleger, Irrelevant features and the subset selection problem, Proceedings of 11th International Conference on Machine Learning, 1994, pp. 121-129.
23. A.L. Blum, P. Langley, Selection of relevant features and examples in machine learning, Artif. Intell. 97 (1-2) (1997) 245-271.
24. P.A. Devijver, J. Kittler, Pattern Recognition: A Statistical Approach, Prentice-Hall International, Englewood Cliffs, NJ, 1982.
25. K. Fukunaga, Introduction to Statistical Pattern Recognition, Academic Press, New York, 1990.
26. D.E. Goldberg, Genetic Algorithms in Search Optimization and Machine Learning, Addison-Wesley, Reading, MA, 1989.
27. Bäck, Evolutionary Algorithms in Theory and Practice, Oxford University Press, Oxford, 1996.
28. Z. Michalewicz, D.B. Fogel, How to Solve it: Modern Heuristics, Springer, Berlin, 2000.
29. W. Siedlecki, J. Sklansky, A note on genetic algorithms for large-scale feature selection, Pattern Recognition Lett. 10 (1989) 335-347.
30. M.L. Raymer, W.F. Punch, E.D. Goodman, L.A. Kuhn, A.K. Jain, Dimensionality reduction using Genetic algorithms, IEEE Trans. Evol. Comput. 4 (2) (2000) 164-171.
31. F. Pernkopf, P. O'leary, Feature selection for classification using genetic algorithms with a novel encoding, International Conference on Computer Analysis of Images and Patterns, CAIP 2001, 2001, pp. 161-168.
32. H. Handels, T. Roß, J. Kreusch, H.H. Wolff, S.J. Pöppl, Feature selection for optimized skin tumor recognition using genetic algorithms, Artif. Intel. Med. 16 (1999) 283-297.
33. P. Somol, P. Pudil, J. Novovičová, P. Paclik, Adaptive floating search methods in feature selection, Pattern Recognition Lett. 20 (1999) 1157-1163.
34. U.M. Fayyad, K.B. Irani, Multi interval discretization of continuous valued attributes for classification learning, in: Proceedings of 13th International Joint Conference on Artificial mtelligence, 1993, pp. 1022-1027.
35. L. Kaufman, P.J. Rousseeuw, Finding Groups in Data: An Introduction to Cluster Analysis, Wiley, New York, 1990.