Experimental study on prototype optimisation algorithms for prototype-based classification in vector spaces

Pattern Recognition

Volumn 39, Issue 10, 2006, Pages 1827-1838

  Lozano, M ^a   Sotoca, J M ^a   Sanchez J S ^a   Pla, F ^a   Pekalska, E ^b,c   Duin, R P W ^b  

^a UNIVERSITAT JAUME I   (Spain)

^b Delft University of Technology ^*  (Netherlands)

^c UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

Adaptive condensing; Dissimilarity representation; EM algorithm; Nearest neighbour rule; Normal density based classifier; Prototype selection

Indexed keywords

ADAPTIVE ALGORITHMS; CLASSIFICATION (OF INFORMATION); COMPUTATIONAL COMPLEXITY; OPTIMIZATION; SOFTWARE PROTOTYPING; VECTORS;

ADAPTIVE CONDENSING; DISSIMILARITY REPRESENTATION; EM ALGORITHMS; NEAREST NEIGHBOUR RULE; NORMAL DENSITY BASED CLASSIFIERS; PROTOTYPE SELECTION;

ALGORITHMS;

EID: 33745421067     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2006.04.005     Document Type: Article

References (35)

1. Wilson D.L. Asymptotic properties of nearest neighbor rules using edited data sets. IEEE Trans. Syst. Man Cybern. 2 (1972) 408-421
2. Aha D.W., Kibler D., and Albert M.K. Instance-based learning algorithms. Mach. Learn. 6 1 (1991) 37-66
3. Dasarathy B.V. Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques (1990), IEEE Computer Society Press, Los Alamitos, CA
4. Devijver P.A., and Kittler J. Pattern Recognition: A Statistical Approach (1982), Prentice-Hall, Englewood Cliffs, NJ
5. Wilson D.R., and Martinez T.R. Reduction techniques for instance-based learning algorithms. Mach. Learn. 38 3 (2000) 257-286
6. Dasarathy B.V. Minimal consistent subset (MCS) identification for optimal nearest neighbor decision systems design. IEEE Trans. Syst. Man Cybern. 24 (1994) 511-517
7. Hart P.E. The condensed nearest neighbor rule. IEEE Trans. Inform. Theory 14 5 (1968) 505-516
8. Tomek I. Two modifications of CNN. IEEE Trans. Syst. Man Cybern. 6 (1976) 769-772
9. Toussaint G.T., Bhattacharya B.K., and Poulsen R.S. The application of voronoi diagrams to nonparametric decision rules. In: Billard L. (Ed). Computer Science and Statistics: The Interface (1985), Elsevier Science, Amsterdam
10. M.C. Ainslie, J.S. Sánchez, Space partitioning for instance reduction in lazy learning algorithms, Second Workshop on Integration and Collaboration Aspects of Data Mining, Decision Support and Meta-Learning, 2002, pp. 13-18.
11. Chang C.L. Finding prototypes for nearest neighbor classifiers. IEEE Trans. Comput. 23 (1974) 1179-1184
12. Chen C.H., and Józwik A. A sample set condensation algorithm for the class sensitive artificial neural network. Pattern Recognition Lett. 17 (1996) 819-823
13. Kohonen T. Self-Organizing Maps (1995), Springer, Berlin
14. M. Lozano, J.S., Sánchez, F. Pla, Using the geometrical distribution of prototypes for training set condensing, in: R. Conejo, M. Urretavizcaya, J.L. Pérez de la Cruz (Eds.), Current Topics in Artificial Intelligence, Lecture Notes in Artificial Intelligence, vol. 3040, Springer, Berlin, 2004, 618-627.
15. M. Lozano, J.M. Sotoca, J.S. Sánchez, F. Pla, An adaptive condensing algorithm based on mixtures of Gaussians, in: J. Vitrià et al. (Eds.), Setè Congrés Català d'Intel.ligencia Artificial, Barcelona (Spain), Frontiers in Artificial Intelligence and Applications, vol. 113, IOS Press, Amsterdam, 2004, pp. 225-232.
16. Pe{combining ogonek}kalska E., Duin R.P.W., and Paclík P. Prototype selection for dissimilarity-based classifiers. Pattern Recognition 39 2 (2006) 189-208
17. Pe{combining ogonek}kalska E., and Duin R.P.W. The Dissimilarity Representation for Pattern Recognition. Foundations and Applications (2005), World Scientific, Singapore
18. P. Paclík, R.P.W. Duin, Classifying spectral data using relational representation, Spectral Imaging Workshop, Graz, Austria, 2003.
19. Paclík P., and Duin R.P.W. Dissimilarity-based classification of spectra: computational issues. Real Time Imaging 9 4 (2003) 237-244
20. Pe{combining ogonek}kalska E., and Duin R.P.W. Dissimilarity representations allow for building good classifiers. Pattern Recognition Lett. 23 8 (2002) 943-956
21. Pe{combining ogonek}kalska E., Paclík P., and Duin R.P.W. A generalized kernel approach to dissimilarity based classification. J. Mach. Learn. Res. 2 2 (2002) 175-211
22. Cover T.M., and Hart P.E. Nearest neighbor pattern classification. IEEE Trans. Inform. Theory 13 1 (1967) 21-27
23. Sánchez J.S., Pla F., and Ferri F.J. On the use of neighbourhood-based non-parametric classifiers. Pattern Recognition Lett. 18 (1997) 1179-1186
24. T. Kohonen, J. Hynninen, J. Kangas, J. Laarksonen, K. Torkkola, LVQ_PAK: the learning vector quantization program package, Helsinki University of Technology, 1996 〈http://www.cis.hut.fi/research/som-research/nnrc-programs.shtml〉.
25. Chaudhuri B.B. A new definition of neighbourhood of a point in multi-dimensional space. Pattern Recognition Lett. 17 (1996) 11-17
26. Novovičová J., Pudil P., and Kittler J. Divergence based feature selection for multimodal class densities. IEEE Trans. Pattern Anal. Mach. Intell. 18 (1996) 218-223
27. McLachlan G., and Basford K. Mixture Models: Inference and Application to Clustering (1988), Marcel Dekker, New York
28. McLachlan G., and Krishnan T. The EM Algorithm and Extensions (1997), Wiley, New York
29. Dempster A.P., Laird N.M., and Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. J. R. Statist. Soc. B 39 (1977) 1-38
30. Figueiredo M.A.T., and Jain A.K. Unsupervised learning of finite mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 24 (2002) 381-396
31. E. Pe{combining ogonek}kalska, R.P.W. Duin, S. Günter, H. Bunke, On not making dissimilarities euclidean, Structural Syntactic and Statistical Pattern Recognition, Lecture Notes in Computer Science, vol. 3138, Springer, Berlin, 2004, pp. 1145-1154.
32. Cristianini N., and Shawe-Taylor J. An Introduction to Support Vector Machines (2000), Cambridge University Press, Cambridge
33. R.P.W. Duin, P. Juszczak, D. de Ridder, P. Paclík, E. Pe{combining ogonek}kalska, D.M.J. Tax, PR-tools, a Matlab toolbox for pattern recognition, 2004 〈http://www.prtools.org〉.
34. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. second ed. (2001), Wiley, New York
35. C.J. Merz, P.M. Murphy, UCI Repository of Machine Learning DB, Department of Information and Computer Science, University of California, 1998 〈http://www.ics.uci.edu/∼mlearn〉.