A kernel autoassociator approach to pattern classification

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 35, Issue 3, 2005, Pages 593-606

  Zhang, Haihong ^a,b   Huang, Weimin ^a   Huang, Zhiyong ^b   Zhang, Bailing ^c  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c VICTORIA UNIVERSITY   (Australia)

Author keywords

Kernel machine; Nonlinear associative memory; Pattern recognition

Indexed keywords

APPROXIMATION THEORY; COMPUTER SIMULATION; EIGENVALUES AND EIGENFUNCTIONS; FUNCTIONS; IMAGE RECONSTRUCTION; MATHEMATICAL MODELS; NEURAL NETWORKS; OPTIMIZATION; POLYNOMIALS; PROBABILITY; SONAR; VECTORS;

KERNEL AUTOASSOCIATOR; KERNEL MACHINE; NONLINEAR ASSOCIATIVE MEMORY; SONAR TARGET RECOGNITION;

PATTERN RECOGNITION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; CLUSTER ANALYSIS; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; COMPUTER SIMULATION; EVALUATION; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; MATHEMATICAL COMPUTING; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; COMPUTER GRAPHICS; COMPUTER SIMULATION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; MODELS, BIOLOGICAL; MODELS, STATISTICAL; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 20444415598     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2005.843980     Document Type: Article

References (53)

1. D. L. Medin and J. D. Coley, Perception and Cognition at Certury's End, 2nd ed. San Diego, CA: Academic, 1998, pp. 403-440.
2. W. Y. Zhao, R. Chellappa, A. Rosenfeld, and P. J. Phillips, "Face recognition: A literature survey," UMD CfAR Tech. Rep. CAR-TR-948, 2000.
3. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cog. Neurosci., vol. 3, pp. 71-86, 1991.
4. S. Haykin, An Introduction to Neural Networks - A Comprehensive Foundation, 2nd ed. Upper Saddle River, NJ: Prentice-Hall, 1999.
5. P. McLeod, K. Plunkett, and E. T. Rolls, An Introduction to Connectionist Modeling of Cognitive Processes. New York: Oxford Univ. Press, 1998.
6. T. Kohonen, Content-Addressable Memories. Berlin, Germany: Springer, 1980.
7. W. J. Daunicht, "Autoassociation and novelty detection by neuromechanics," Science, vol. 253, no. 5025, pp. 1289-1291, 1991.
8. M. Markou and S. Singh, "Novelty detection: A review - Part 1: Statistical approaches," Signal Process., pp. 2481-2497, 2003.
9. M. Markou and S. Singh, "Novelty detection: a review part 2: neural network based approaches," Signal Process., pp. 2499-2521, 2003.
10. R. Féraud, O. J. Bernier, J. E. Viallet, and M. Collobert, "A fast and accurate face detector based on neural networks," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 1, pp. 42-53, Feb. 2001.
11. T. Petsche, A. Marcantonio, C. Darken, S. J. Hanson, G. M. Kuhn, and I. Santoso, "A neural network autoassociator for inductionmotor failure prediction," in Adv. Neural Inf. Process. Syst., 1996, vol. 8, pp. 924-930.
12. D. Y. Yeung and C. Chow, "Parzen window network intrusion detectors," in Int. Conf. Pattern Recognit., 2002, pp. 385-388.
13. S. J. Hanson and J. Kegl, "Parsnip: a connectionist network that learns natural language grammar from exposure to natural language sentences," in Proc. 9th Annu. Conf. Cognitive Science, 1987, pp. 106-119.
14. H. Schwenk and M. Milgram, "Transformation invariant autoassociation with application to handwritten character recognition," in Adv. Neural Inf. Process. Syst., 1995, pp. 991-998.
15. B. Zhang and Y. Guo, "Face recognition by auto-associative radial basis function network," in 3rd Int. Conf. Audio-and Video-Based Biometric Person Authentication (AVBPA), 2001, pp. 52-58.
16. B. Zhang, H. H. Zhang, and S. Ge, "Face recognition by applying wavelet subband representation and kernel associative memory," IEEE Trans. Neural Netw., vol. 15, no. 2, pp. 166-177, Apr. 2004.
17. P. Baldi and K. Hornik, "Neural networks and principal component analysis: learning from examples without local minima," Neural Netw., vol. 2, pp. 53-58, 1989.
18. D. E. Rumerlhart, G. E. Hinton, and R. J. Williams, "Learning internal representations by back-propatation errors," Nature, vol. 323, pp. 533-536, 1986.
19. N. Japkowicz, S. J. Hanson, and M. A. Gluck, "Nonlinear autoassociation is not equivalent to pca," Neural Comput., vol. 12, pp. 531-545, 2000.
20. G. W. Cottrell, P. Munro, and D. Zipser, "Learning internal representations of gray scale images: an example of extensional programming," in Proc. 9th Annu. Cog. Sci. Soc. Conf., 1987, pp. 462-473.
21. D. Valentin, H. Abdi, A. J. O'Toole, and G. W. Cotterell, "Connectionist models of face processing: a survey," Pattern Recognit., vol. 27, pp. 120-1230, 1994.
22. J. Hertz, A. Krogh, and R. G. Palmer, Introduction to the Theory of Neural Computation. Redwood City, CA: Addison-Wesley, 1991.
23. K. A. Kramer, "Nonlinear principal component analysis using autoassociative neural networks," J. AIChE, vol. 37, pp. 233-243, 1991.
24. D. DeMers and G. W. Cottrel, "Nonlinear dimensionality reduction," in Adv. Neural Inf. Process. Syst., 1993, pp. 580-587.
25. S. Usui, S. Nakauchi, and M. Nakano, "Internal color representation acquired by a five-layer neural network," in Artificial Neural Networks, T. Kohonen, O. Simula, and J. Kangas, Eds. New York: Elsevier, 1991, pp. 867-872.
26. B. Moghaddam, "Principal manifolds and bayesian subspaces for visual recognition," in Proc. IEEE Int. Conf. Computer Vision, 1999, pp. 1131-1136.
27. P. Comon, "Independent component analysis - a new concept?," Signal Process., vol. 36, pp. 287-314, 1994.
28. E. C. Malthouse, "Limitations of nonlinear pca as performed with generic neural networks," IEEE Trans. Neural Netw., vol. 9, no. 1, pp. 165-173, Feb. 1998.
29. B. Scholkopf and A. Smola, Learning With Kernels. Cambridge, MA: MIT Press, 2002.
30. S. Saitoh, Theory of Reproducing Kerels and Its Applications. Harlow, U.K.: Longman, 1988.
31. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
32. G. Baudat and F. Anouar, "Generalized discriminant analysis using a kernel approach," Neural Comput., vol. 12, no. 10, pp. 2385-2404, 2000.
33. B. Scholkopf, A. Smola, and K. R. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput., vol. 10, pp. 1299-1319, 1998.
34. B. Scholkopf, S. Mika, and C. J. C. Burges, "Input space versus feature space in kernel-based methods," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1000-1017, Oct. 1999.
35. G. Wahba, "Soft and hard classification by reproducing kernel hilbert space method," Proc. Nat. Acad. Sci., vol. 99, pp. 16524-16530, 2002.
36. N. Aronszajn, "Theory of reproducing kernels," Trans. Amer. Math. Soc., vol. 686, pp. 337-404, 1950.
37. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
38. T. M. Cover, "Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition," IEEE Trans. Electron. Comput., vol. EC-14, pp. 326-334, Jun. 1965.
39. V. A. Morozov, Method for Solving Incorrectly Posed Problems. New York: Springer, 1984.
40. D. W. Scott, Multivariate Density Estimation. New York: Wiley, 1992.
41. A. Ypma and R. P. W. Duin, "Novelty detection using self-organizing maps," in Progr. Connectionist Based Information Systems 2, 1998, pp. 1322-1325.
42. B. Scholkopf, J. C. Platt, J. Shawe-Taylor, A. J. Smola, and R. C. Williamson, "Estimating the support of a high-dimensional distribution," Neural Comput., vol. 13, no. 7, pp. 1443-1471, 2001.
43. M. Markou and S. Singh, "An approach to novelty detection applied to the classification of image regions," IEEE Trans. Knowl. Data Eng., vol. 16, no. Apr., pp. 396-407, 2004.
44. S. Aeberhard, D. Coomans, and O. de Vel, "Comparison of classifiers in high dimensional settings," Dept. Comput. Sci. Dept. Math. Stat., James Cook Univ., North Queensland, Australia, Tech. Rep. 92-02, 1992.
45. L. Juwei, K. N. Plataniotis, and A. N. Venetsanopoulos, "Face recognition using kernel direct discriminant analysis algorithms," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 117-126, Feb. 2003.
46. B. Scholkopf, Support Vector Learning. Munich, Germany: Oldenbourg Verlag, 1997.
47. D. Keysers, J. Dahmen, T. Theiner, and H. Ney, "Experiments with an extended tangent distance," in Proc. Int. Conf. Pattern Recognition, vol. 2, 2000, pp. 38-42.
48. Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. J. Jackel, "Backproparation applied to handwritten zip code recognition," Neural Comput., vol. 1, pp. 541-551, 1999.
49. B. Scholkopf, C. J. C. Burges, and V. N. Vapnik, "Extracting support data for a given task," in Int. Conf. Knowledge Discovery and Data Mining, 1995, pp. 252-257.
50. P. Simard, Y. LeCun, J. Denker, and B. Victorri, "Transformation invariance in pattern recognition - tangent distance and tangent propagation," in Neural Networks: Tricks of the Trade, Lecture Notes Comput. Sci., G. Orr and K. R. Muller, Eds. Heidelberg, Germany: Springer, 1998, pp. 239-274.
51. D. B. Graham and N. M. Allinson, "Characterizing virtual eigensignatures for general purpose face recognition," in Face Recognition: From Theory to Applications. New York: Springer-Verlag, 1998, pp. 446-456.
52. S. Lawrence, C. L. Giles. A. Tsoi, and A. Back, "Face recognition: a convolutional neural network approach," IEEE Trans. Neural Netw., vol. 8, no. 1, pp. 98-113, Feb. 1997.
53. N. Japkowicz, C. Mayers, and M. A. Gluck, "A novelty detection approach to classification," in Proc. 14th Joint Conf Artificial Intelligence, 1995, pp. 518-523.