Matrix-pattern-oriented Ho-Kashyap classifier with regularization learning

Pattern Recognition

Volumn 40, Issue 5, 2007, Pages 1533-1543

  Chen, Songcan ^a   Wang, Zhe ^a   Tian, Yongjun ^a  

^a NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

Author keywords

Linear classifier; Matrix pattern; Modified Ho Kashyap with squared approximation of the misclassification errors (MHKS); Pattern recognition; Regularization; Vector pattern

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); IMAGE PROCESSING; LEARNING SYSTEMS; PARAMETER ESTIMATION; VECTORS;

LINEAR CLASSIFIER; MATRIX PATTERN; MODIFIED HO-KASHYAP WITH SQUARED APPROXIMATION OF THE MISCLASSIFICATION ERRORS (MHKS); VECTOR PATTERN;

PATTERN RECOGNITION;

EID: 33846334396     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2006.09.001     Document Type: Article

References (25)

1. Bousquet O., Boucheron S., and Lugosi G. Introduction to statistical learning theory. Advanced Lectures on Machine Learning, Lecture Notes in Artificial Intelligence vol. 3176 (2004), Springer, Berlin 169-207
2. Duda R.O., Hart P.E., and Stock D.G. Pattern Classification. second ed. (2001), Wiley, New York
3. Muller K.-R., Mika S., Ratsch G., Tsuda K., and Scholkopf B. An introduction to kernel-based learning algorithms. IEEE Trans. Neural Networks 12 2 (2001) 181-202
4. Highleyman W.H. Linear decision functions. with application to pattern recognition, Proc. IRE 50 (1962) 1501-1514
5. R. Maree, P. Geurts, J. Piater, L. Wehenkel, Random subwindows for robust image classification, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR05), 2005.
6. H. Wang, N. Ahuja, Rank-R approximation of tensors: using image-as-matrix representation, IEEE Conference on Computer Vision and Pattern Recognition, 2005.
7. D. Xu, S. Yan, L. Zhang, H.J. Zhang, Z. Liu, H.Y. Shum, Concurrent subspace analysis, IEEE Conference on Computer Vision and Pattern Recognition, 2005.
8. H. Kong, L. Wang, E.K. Teoh, J.G. Wang, R. Venkateswarlu, A framework of 2D Fisher discriminant analysis: application to face recognition with small number of training samples, IEEE Conference on Computer Vision and Pattern Recognition, 2005.
9. S.C. Yan, D. Xu, L. Zhang, B.Y. Zhang, H.J. Zhang, Coupled kernel-based subspace learning, IEEE Conference on Computer Vision and Pattern Recognition, 2005.
10. Yang J., Zhang D., Frangi A.F., and Yang J.Y. Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans. PAMI 26 1 (2004) 131-137
11. J. Ye, R. Janardan, Q. Li, Two-dimensional linear discriminant analysis, University of Minnesota, NIPS2004.
12. M. Li, B. Yuan, 2D-LDA: a statistical linear discriminant analysis for image matrix, Pattern Recognition Lett., 2005.
13. Chen S., Zhu Y., Zhang D., and Yang J.-Y. Feature extraction approaches based on matrix pattern: MatPCA and MatFLDA. Pattern Recognition Lett. 26 8 (2005) 1157-1167
14. Smith F.W. Design of multicategory pattern classifiers with two-category classifier design procedures. IEEE Trans. Comput. C-18 6 (1969) 548-551
15. Chen L.F., Liao H.Y.M., Ko M.T., Lin J.C., and Yu G.J. A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recognition 33 10 (2000) 1713-1726
16. Hagiwara K. Regularization learning, early stopping and biased estimator. Neurocomputing 48 1-4 (2002) 937-955
17. Vapnik V. Statistical Learning Theory (1998), Wiley, New York
18. Leski J. Ho-Kashyap classifier with generalization control. Pattern Recognition Lett. 24 14 (2003) 2281-2290
19. C.L. Blake, C.J. Merz, UCI repository of machine learning databases, Available from: 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉, 1998.
20. K. Namwoon, H.J. Kyung, Assessing the integrity of cross-validation: a case for small sample-based research, in: Marketing Working Paper Series, Series No.: MKTG 97.096, Hong Kong: The Hong Kong University of Science & Technology UST Marketing Department, 1997.
21. Sugiyama M., and Qgawa H. Option design of regularization term and regularization parameter by subspace information criterion. Neural Networks 15 (2002) 349-361
22. Leung C.-T., and Chow T.W.S. Adaptive regularization parameter selection method for enhancing generalization capability of neural networks. Artif. Intell. 107 (1999) 347-356
23. Ye J. Generalized low rank approximation of matrices. Mach. Learning 61 1-3 (2005) 167-191
24. Leski J. Kernel Ho-Kashyap classifier with generalization control. Int. J. Appl. Math. Comput. Sci. 14 1 (2004) 53-61
25. Scholkopf B., Smola A., and Muller K.-R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10 (1998) 1299-1319