Similarity-based methods: A general framework for classification, approximation and association

Control and Cybernetics

Volumn 29, Issue 4, 2000, Pages 937-967

  Duch, Włodzisław ^a  

^a NICOLAUS COPERNICUS UNIVERSITY   (Poland)

Author keywords

Approximation; Associative memory; Classification; Feature selection; kNN; Optimization; Similarity based methods

Indexed keywords

EID: 0034562759     PISSN: 03248569     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (53)

1. AHA, D.W. (1998) Feature weighting for lazy learning algorithms. In: Feature Extraction, Construction and Selection: A Data Mining Perspective, Liu, H. and Motoda, H., eds., Kluwer, Norwell, MA.
2. AHA, D., KIBLER, D. and ALBERT, M. (1991) Instance-based learning algorithms. Machine Learning, 6, 37-66.
3. ATKENSON, C.G., MOOR, A.W. and SCHAAL, S. (1997) Locally weighted learning. Artificial Intelligence Review, 11, 75-113.
4. BEZDEK J.C., CHUAH, S.K. and LEEP, D. (1986) Generalized k-nearest neighbor rule. Fuzzy Sets and Systems, 18, 237-256.
5. BISHOP, C.M. (1995) Neural Networks for Pattern Recognition. Oxford University Press.
6. BREIMAN, L. (1998) Bias-Variance, regularization, instability and stabilization. In: Neural Networks and Machine Learning, Bishop, C., ed., Springer.
7. CHIU, D.K.Y. and KAVANAUGH, F.E. (1997) The ck-nearest neighbor distance network: a network using class boundary feature distances. ICONIP'97, New Zealand, pp. 535-538.
8. DASARATHY, B.V., ed. (1990) Nearest neighbor norms: NN Pattern Classification Techniques. IEEE Computer Society Press, Los Alamitos, California.
9. DUCH, W. (1998) A framework for similarity-based classification methods. Intelligent Information Systems VII, Malbork, Poland, pp. 288-291.
10. DUCH, W., ADAMCZAK, R. and DIERCKSEN, G.H.F. (2000) Neural Networks and Similarity-Based Methods. Applied Mathematics and Computer Science, 10, 101-120.
11. DUCH, W., ADAMCZAK, R. and GRA̧BCZEWSKI, K. (1997) Extraction of crisp logical rules using constrained backpropagation networks. Proc. of International Joint Conference on Neural Networks (IJCNN'97), Houston, Texas, pp. 2384-2389.
12. DUCH, W., ADAMCZAK, R., GRA̧BCZEWSKI, K., ŻAL, G. and HAYASHI, Y. (1999) Fuzzy and crisp logical rule extraction methods in application to medical data. In: Fuzzy systems in Medicine, Szczepaniak, P.S., Lisboa, P.J.G. and Kacprzyk, J., eds., Physica-Verlag, Springer, 2000, pp. 593-616.
13. DUCH, W. and DIERCKSEN, G.H.F. (1995) Feature Space Mapping as a universal adaptive system. Computer Physics Communication, 87, 341-371.
14. DUCH, W. and GRUDZIŃSKI, K. (1998) A framework for similarity-based methods. 2nd Polish Conference on Theory and Applications of Artificial Intelligence, Łódź, pp. 33-60.
15. DUCH, W. and GRUDZIŃSKI, K. (1998a) A framework for similarity-based methods. 2nd Polish Conference on Theory and Applications of Artificial Intelligence, Łódź, pp. 33-60;
16. DUCH, W. and GRUDZIŃSKI, K. (1999) The weighted k-NN method with selection of features and its neural realization. 4th Conference on Neural Networks and Their Applications, Zakopane, pp. 191-196.
17. DUCH, W. and GRUDZIŃSKI, K. (1999a) Search and global minimization in similarity-based methods. International Joint Conference on Neural Networks (IJCNN'1999), Washington, paper no. 742.
18. DUCH, W. and GRUDZIŃSKI, K. (1999b) Weighting and selection of features in Similarity-Based Methods. Intelligent Information Systems VIII, Ustroń, Poland, pp. 32-36.
19. DUCH. W., GRUDZIŃSKI, K. and DIERCKSEN, G.H.F. (1998) Neural minimal distance methods. World Congress of Computational Intelligence, May 1998, Anchorage, Alaska, IJCNN'98 Proceedings, pp. 1299-1304.
20. DUCH, W. and JANKOWSKI, N. (1999) New neural transfer functions. Neural Computing Surveys, 2, 639-658.
21. FLOREEN, P. (1991) The convergence of Hamming memory networks. IEEE Transactions Neural Networks 2, 449-457.
22. FRIEDMAN, J.H. (1994) Flexible metric nearest neighbor classification. Technical Report, Dept. of Statistics, Stanford University.
23. FUCHS, M. (1996) Optimized nearest-neighbor classifiers using generated instances. LSA-96-02E Technical Report, Learning Systems & Applications Group, University of Kaiserslautern, Germany.
24. GRA̧BCZEWSKI, K. and DUCH, W. (1999) A general purpose separability criterion for classification systems. 4th Conf. on Neural Networks and Their Applications, Zakopane, pp. 203-208.
25. GRUDZIŃSKI, K. and DUCH, W. (2000) SBL-PM: A Simple Algorithm for Selection of Reference Instances for Similarity-Based Methods, Intelligent Information Systems IIS'2000, Physica-Verlag (Springer), pp. 99-108.
26. HASTIE, T. and TIBSHIRANI, R. (1996) Discriminant adaptive nearest neighbor classification. IEEE PAMI, 18, 607-616.
27. HAYKIN, S. (1994) Neural Networks. A Comprehensive Foundation. MacMillian, New York.
28. KOHONEN, T. (1995) Self-organizing maps. Springer-Verlag, Berlin.
29. KRISHNAIAH, P.R. and KANAL, L.N., eds. (1982) Handbook of statistics 2: classification, pattern recognition and reduction of dimensionality. North-Holland, Amsterdam.
30. KUNCHEVA, L.I. and BEZDEK, J.C. (1997) A fuzzy generalized nearest prototype classifier. In: Proc. 7th IFSA World Congress, Prague, Czech Republic, vol. III, pp. 217-222.
31. KUNCHEVA, L.I. and BEZDEK, J.C. (1999) Presupervised and Postsupervised Prototype Classifier Design. IEEE Transactions on Neural Networks, 10, 1142-1152.
32. LAAKSONEN, J. and OJA, E. (1996) Classification with Learning k-Nearest Neighbors. In: Proc. of ICNN'96, WASHINGTON, D.C., pp. 1480-1483.
33. LIPPMANN, R.P. (1987) An introduction to computing with neural nets. IEEE Magazine on Acoustics, Signal and Speech Processing, 4, 4-22.
34. LOWE, D.G. (1995) Similarity metric learning for variable-kernel classifier. Neural Computation, 7, 72-85.
35. MERTZ, C.J. and MURPHY, P.M. (1999) UCI repository, http://www.ics.uci.edu/pub/machine-learning-databases.
36. MICHALSKI, R. (1999) AQ-PM: A System for Partial Memory Learning. Intelligent Information Systems VII, Ustroń, Poland, 14-18 June 1999, pp. 70-79.
37. MICHIE, D., SPIEGELHALTER, D.J. and TAYLOR, C.C. (1994) Machine learning, neural and statistical classification. Elis Horwood, London.
38. MITCHELL, T.M. (1997) Machine Learning. McGraw-Hill.
39. REILLY, D.L., COOPER, L.N. and ELBAUM, C. (1982) A neural model for category learning. Biological Cybernetics, 45, 35-41.
40. RIPLEY, B. (1996) Pattern Recognition and Neural Networks. Cambridge University Press.
41. ROHWER, R. and MORCINIEC, M. (1996) A Theoretical and Experimental Account of n-tuple Classifier Performance. Neural Computation, 8, 657-670.
42. RUBIN, D.B. (1996) Multiple imputation after 18+ years. J. of the American Statistical Association, 91, 473-489.
43. SCHÖLKOPF, B., BURGES, C. and SMOLA, A. (1998) Advances in Kernel Methods: Support Vector Machines, MIT Press, Cambridge, MA.
44. SILVERMAN, B.W. (1986) Density estimation for statistics and data analysis. Chapman and Hall, London.
45. SIMARD, P., LECUN, Y. and DENKER, J. (1993) Efficient pattern recognition using a new transformation distance. Advances in Neural Information Processing Systems 5 (NIPS'5), San Mateo, CA, pp. 50-58.
46. STANFILL, C. and WALTZ, D. (1986) Toward memory-based reasoning. Communications of ACM, 29, 1213-1228.
47. WALTZ, D.L. (1995) Memory-based reasoning. In: The Handbook of Brain Theory and Neural Networks, Arbib, M.A., ed., MIT Press, pp. 568-570.
48. WASSERMAN, P.D. (1993) Advanced methods in neural networks. Van Nostrand Reinhold.
49. WETTSCHERECK, D. and AHA, D.W. (1995) Weighting Features. In: 1st Int. conf. on Case-based Reasoning (ICCBR-95), Lisbon, Portugal, Springer-Verlag.
50. WETTSCHERECK, D., AHA, D.W. and MOHRI, T. (1997) A Review and Empirical Evaluation of Feature Weighting Methods for a Class of Lazy Learning Algorithms. Artificial Intelligence Review, 11, 273-314.
51. WETTSCHERECK, D. and DIETTERICH. T.G. (1997a) Locally adaptive nearest neighbor algorithms. Advances in Neural Information Processing Systems 6 (NIPS'6), San Mateo, CA, pp. 184-191.
52. WILSON, D.R. and MARTINEZ, T.R. (1997) Improved heterogeneous distance functions. Journal of Artificial Intelligence Research, 6, 1-34.
53. YANG, J. PAREKH, R. and HONAVAR, V. (1998) DistAI: an inter-pattern distance-based constructive learning algorithm. World Congress on Computational Intelligence, Anchorage, Alaska, pp. 2208-2213.