Adaptive prototype learning algorithms: Theoretical and experimental studies

Journal of Machine Learning Research

Volumn 7, Issue , 2006, Pages 2125-2148

  Chang, Fu ^a   Lin, Chin Chin ^b   Lu, Chi Jen ^a  

^a INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

^b NATIONAL TAIPEI UNIVERSITY OF TECHNOLOGY   (Taiwan)

Author keywords

Adaptive prototype learning; Cluster based prototypes; Consistency; Instance based prototype; Pattern classification

Indexed keywords

BENCHMARKING; CLASSIFIERS; ERROR ANALYSIS; PATTERN RECOGNITION; SOFTWARE PROTOTYPING; VECTORS;

ADAPTIVE PROTOTYPE LEARNING; CLUSTER-BASED PROTOTYPES; CONSISTENCY; INSTANCE-BASED PROTOTYPE;

LEARNING ALGORITHMS;

EID: 33750052899     PISSN: 15337928     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (39)

1. P. Bartlett and J. Shaw-Taylor. Generalization performance of support vector machines and other pattern classifiers. In B. Schölkopf, C. Burges, and A. J. Smola, editors, Advances in Kernel Methods: Support Vector Learning. MIT Press, 1999.
2. J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum, New York, 1981.
3. L. Bottou, C. Cortes, J. Denker, H. Drucker, I. Guyon, L. Jackel, Y. LeCun, U. Muller, E. Sackinger, P. Simard, and V. Vapnik. Comparison of classifier methods: A case study in handwriting digit recognition. In Proc. Int. Conf. Pattern Recognition, pages 77-87, 1994.
4. H. Brighton and C. Mellish. Advances in instance selection for instance-based learning algorithms. In Data Mining and Knowledge Discovery, 6:153-172, 2002.
5. C. Cortes and V. Vapnik. Support vector machines. In. Machine Learning, 20:1-25, 1995.
6. T. Cover and P. Hart. Nearest neighbor pattern classification. In IEEE Trans. Information Theory, 13:21-27, 1967.
7. N. Cristianini and J. Shawe-Taylor. An introduction to Support Vector Machines and other kernel-based learning methods. Cambridge University Press, 2000.
8. F. Devi and M. Murty. An incremental prototype set building technique. In Pattern Recognition, 35:505-513, 2002.
9. L. Devroye and L. Györfi. Nonparametric Density Estimation: The LI View. John Wiley, New York, 1985.
10. L. Devroye, L. Györfi, A. Krzyżak, and G. Lugosi. On the strong consistency of nearest neighbor regression function estimates. In Annals of Statistics, 22:1371-1385, 1994.
11. L. Devroye, L Györfi, and G. Lugosi. A Probabilistic Theory of Pattern Recognition. Springer, New York, 1996.
12. E. Fix and J. L. Hodges. Discriminatory analysis. Nonparametric discrimination: Consistency properties. Technical Report 4, Project Number 21-49-004, USAF School of Aviation Medicine. Randolph Field, Texas, 1951.
13. E. Fix and J. L. Hodges. Discriminatory analysis: small sample performance. Technical Report 11, Project Number 21-49-004, USAF School of Aviation Medicine. Randolph Field, Texas, 1952.
14. E. Fix and J. L. Hodges. Discriminatory analysis. Nonparametric discrimination: Consistency properties. In B. Dasarathy, editor, Nearest Neighbor Pattern Classification Techniques, pages 32-39, IEEE Computer Society Press, Los Alamitos, 1991.
15. E. Fix and J. L. Hodges. Discriminatory analysis: small sample performance. In B. Dasarathy, editor, Nearest Neighbor Pattern Classification Techniques, pages 40-56, IEEE Computer Society Press, Los Alamitos, 1991.
16. F. Girosi. An equivalence between sparse approximation and support vector machines. In Neural Computation, 10(6): 1455-1481, 1998.
17. P. Hart. The condensed nearest neighbor rule. In IEEE Trans. Information Theory, 14:515-516, 1968.
18. F. Höppner, F. Klawonn, R. Kruse, and T. Runkler. In Fuzzy Cluster Analysis: Methods for Classification, Data Analysis and Image Recognition. John Wiley & Sons, New York, 1999.
19. C.-W. Hsu and C.-J. Lin. A comparison of methods for multiclass support vector machines. In IEEE Transactions on Neural Networks, 13(2):415-425, 2002.
20. D.-W. Kim, K.Y. Lee, D. Lee, K. H. Lee. Evaluation of the performance of clustering algorithms in kernel-induced feature space. In Pattern Recognition, 38:607-611, 2005.
21. S. Knerr, L. Personnaz, and G. Dreyfus. Single-layer learning revisited: A stepwise procedure for building and training a neural network. In J. Fogelman, editor, Neurocomputing: Algorithms, Architectures and Applications, Springer-Verlag, New York, 1990.
22. T. Kohonen. Self-Organization and Associated Memory. Springer-Verlag, Berlin, 1988.
23. T. Kohonen. Statistical pattern recognition revisited. In R. Eckmiller, editor, Advanced Neural Computers, North-Holland, Amsterdam, pages 137-144, 1990.
24. Y. Linde, A. Buzo, and R. Gray. An algorithm for vector quantizer design. In Pattern Recognition, 19:84-95, 1980.
25. S. Lloyd. Least squares quantization in PCM. In IEEE Trans. Information Theory, 28:129-137, 1982.
26. J. Max. Quantizing for minimum distortion. In IEEE Trans. Information Theory, 6:7-12, 1960.
27. T. Mercer. Functions of positive and negative type and their connection with the theory of integral equations. In Philosophical Transactions of the Royal Society of London, Series A, 209:415-446, 1909.
28. D. J. Newman, S. Hettich, C. L. Blake, and C. J. Merz. UCI Repository of machine learning databases, Irvine, CA: University of California, Department of Information and Computer Science, 1998. [http://www.ics.uci.edu/~mlearn/ MLRepository.html].
29. J. C. Platt, N. Cristianini, and J. Shawe-Taylor. Large margin DAG's for multiclass classification. In Advances in Neural Information Processing Systems, 12:547-553, MIT Press, Cambridge, 2000.
30. S. Salzberg. A nearest hyperrectangle learning method. In Machine Learning, 6:251-276, 1991.
31. B. Schölkopf, C. J. C. Burges, and A. J. Smola. In Advances in Kernel Methods - Support Vector Learning. MIT Press, Cambridge, MA, 1999.
32. C. Stone. Consistent nonparametric regression. In Annals of Statistics, 5:595-645, 1977.
33. V. Vapnik and A. Chervonenkis. On the uniform convergence of relative frequencies of events to their probabilities. In Theory of Probability and Its Applications, 16:264-280, 1971.
34. V. Vapnik and A. Chervonenkis. Ordered risk minimization I. In Automation and Remote Control, 35:1226-1235, 1974.
35. V. Vapnik and A. Chervonenkis. Ordered risk minimization II. In Automation and Remote Control, 35:1403-1412, 1974.
36. V. Vapnik. The Nature of Statistical Learning Theory. Springer Verlag, New York, 1995.
37. D. R. Wilson and T. R. Martinez. Reduction techniques with instance-based learning algorithms. In Machine Learning, 38:257-286, 2000.
38. Z.-D. Wu, W.-X. Xie and J.-P. Yu. Fuzzy c-means clustering algorithm based on kernel method. In Fifth Intern. Conf. Computational Intelligence and Multimedia Applications, pages 1-6, 2003.
39. L. Zhao. Exponential bounds of mean error for the nearest neighbor estimates of regression functions. In Journal of Multivariate Analysis, 21:168-178, 1987.