Minimum class variance support vector machines

IEEE Transactions on Image Processing

Volumn 16, Issue 10, 2007, Pages 2551-2564

  Zafeiriou, Stefanos ^a   Tefas, Anastasios ^a   Pitas, Ioannis ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Facial images; Fisher's discriminant analysis; Kernel methods; Principal component analysis (PCA); Support vector machines (SVMs)

Indexed keywords

DISCRIMINANT ANALYSIS; FACE RECOGNITION; HILBERT SPACES; OPTIMIZATION; PRINCIPAL COMPONENT ANALYSIS; SUPPORT VECTOR MACHINES;

DIMENSIONALITY REDUCTION; IMAGE CHARACTERIZATION; KERNEL METHOD;

IMAGE CLASSIFICATION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; COMPUTER ASSISTED DIAGNOSIS; DISCRIMINANT ANALYSIS; EVALUATION; FACE; HISTOLOGY; HUMAN; IMAGE ENHANCEMENT; METHODOLOGY; PRINCIPAL COMPONENT ANALYSIS; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRY; DISCRIMINANT ANALYSIS; FACE; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; PRINCIPAL COMPONENT ANALYSIS; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 34648814107     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2007.904408     Document Type: Article

References (52)

1. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
2. M. Pontil and A. Verri, "Support vector machines for 3D object recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 6, pp. 637-646, Jun. 1998.
3. A. Ganapathiraju, J. E. Hamaker, and J. Picone, "Applications of support vector machines to speech recognition," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2348-2355, Aug. 2004.
4. B. Moghaddam and Y. Ming-Hsuan, "Learning gender with support faces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 707-711, May 2002.
5. E. Osuna, R. Freund, and F. Girosi, "Training support vector machines: An application to face detection," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, San Juan, PR, 1997, pp. 130-136.
6. A. Tefas, C. Kotropoulos, and I. Pitas, "Using support vector machines to enhance the performance of elastic graph matching for frontal face authentication," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 7, pp. 735-746, Jul. 2001.
7. H. Drucker, W. Donghm, and V. N. Vapnik, "Support vector machines for spam categorization," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1048-1054, Sep. 1999.
8. B. Scholkopf and A. Smola, Learning With Kernels. Cambridge, MA: MIT Press, 2002.
9. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines. Cambridge, U.K.: Cambridge Univ. Press, 2000.
10. V. N. Vapnik and A. J. Chervonenkis, "On the uniform convergence of relative frequencies of events to their probabilities," Theory Probab. Appl., vol. 16, pp. 264-280, 1971.
11. S. Saitoh, Theory of Reproducing Kernels and its Applications. Harlow, U.K.: Longman Scientific & Technical, 1988.
12. R. C. Williamson, A. J. Smola, and B. Scholkopf, "Generalization performance of regularization networks and support vector machines via entropy numbers of compact operators," IEEE Trans. Inf. Theory, vol. 47, no. 6, pp. 2516-2532, Sep. 2001.
13. B. Scholkopf, S. Mika, C. J. C. Burges, P. Knirsch, K.-R. Muller, G. Ratsch, and A. J. Smola, "Input space vs. feature space in Kernel-based methods," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1000-1017, Sep. 1999.
14. K. I. Diamantaras and S. Y. Kung, Principal Component Neural Networks New York: Wiley, 1996.
15. A. Scholkopf, B. Smola, and K. R. Muller, "Nonlinear component analysis as a Kernel eigenvalue problem," Neural Comput., vol. 10, pp. 1299-1319, 1998.
16. D. L. Swets and J. Weng, "Using discrimmant eigenfeatures for image retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 8, pp. 831-836, Aug. 1996.
17. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
18. S. Mika, G. Ratsch, J. Weston, B. Scholkopf, A. Smola, and K.-R. Muller, "Constructing descriptive and diseriminative nonlinear features: Ayleigh coefficients in Kernel feature spaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 5, pp. 623-628, May 2003.
19. L. Juwei, K. N. Plataniotis, and A. N. Venetsanopoulos, "Face recognition using Kernel direct discrimmant analysis algorithms," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 117-126, Jan. 2003.
20. J. Yang, A. F. Frangi, J. Yang, D. Zhang, and Z. Jin, "KPCA plus LDA: A complete kernel Fisher discrimmant framework for feature extraction and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 2, pp. 230-244, Feb. 2005.
21. A. Hyvarinen, J. Karhunen, and E. Oja. Independent Component Analysis New York: Wiley, 2001.
22. F. R. Bachand M. I. Jordan, "Kernel independent component analysis," J. Mach. Learn. Res., vol. 3, pp. 1-48, 2002.
23. K.-R. Muller, S. Mika, G. Ratsch, K. Tsuda, and B. Scholkopf, "An introduction to Kernel-based learning algorithms," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 181-201, Mar. 2001.
24. K. Fukunaga, Statistical Pattern Recognition. San Diego, CA: Academic, 1990.
25. J. Yang and J.-Y. Yang, "Why can LDA be performed in PCA transformed space?," Pattern Recognit., vol. 36, no. 2, pp. 563-566, 2003.
26. H. Cevikalp, M. Neamtu, M. Wilkes, and A. Barkana, "Discriminative common vectors for face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 1, pp. 4-13, Jan. 2005.
27. M. Turk and A. P. Pentland, "Eigenfaces for recootion," J. Cogn. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.
28. M. K. Sirovich, "Application of the Karhunen-Loeve procedure for the characterization of human faces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 1, pp. 103-108, Jan. 1990.
29. K. I. Kim, K. Jung, and H. J. Kim, "Face recognition using Kernel principal component analysis," IEEE Signal Process. Lett., vol. 9, no. 1, pp. 40-42, Jan. 2002.
30. L. Chengjun, "Gabor-based Kernel PCA with fractional power polynomial models for face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 5, pp. 572-581, May 2004.
31. W. Karush, "Minima of functions of several variables with inequalities as side constraints," M.Sc., Dept. Math., Univ. Chicago, Chicago, IL, 1939.
32. H. W. Kuhn and A. W. Tucker, "Nonlinear programming," in Proc. 2nd Berkeley Symp., Berkeley, CA, 1951, pp. 481-492.
33. C. J. C. Burges, "A tutorial on support vector machines for pattern recognition," Data Minining Knowl. Discovery, vol. 2, pp. 121-167, 1998.
34. R. Fletcher, Practical Methods of Optimization, 2nd ed. New York: Wiley, 1987.
35. V. S. P. Hutson J, Applications of Functional Analysis and Operator Theory. London, U.K.: Academic, 1980.
36. E. Kreyszig, Introductory Functional Analysis With Applications. New York: Wiley, 1978.
37. K. Messer, J. Matas, J. V. Kittler, J. Luettin, and G. Maitre, "XM2VTSDB: The extended M2VTS database," in Proc. 2nd Inf. Conf. AVBPA, Washington, DC, Mar. 22-23, 1999, pp. 72-77.
38. K. Jonsson, J. Matas, and Kittler, "Learning salient features for realtime face verification," in Proc. 2nd Inf. Conf. AVBPA, Washington, DC, Mar. 22-23, 1999, pp. 60-65.
39. C. Kotropoulos, A. Tefas, and I. Pitas, "Morphological elastic graph matching applied to frontal face authentication under well-controlled and real conditions," Pattern Recognit., vol. 33, no. 12, pp. 31-43, Oct. 2000.
40. C. Wu, C. Liu, H.-Y. Strum, Y.-Q. Xy, and Z. Zhang, "Automatic eyeglasses removal from face images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 3, pp. 322-336, Mar. 2004.
41. Y. Tian and R. M. Bulle, "Automatic detecting neutral face for face authentication," in Proc. Spring Symp. Intelligent Multimedia Knowledge Management, Aug. 20-23, 2003, pp. 24-26.
42. T. Kanade, J. Cohn, and Y. Tian, "Comprehensive databases for facial expression analysis," in Proc. IEEE Int. Conf. Face and Gesture Recognition, Grenoble, France, Mar. 2000, pp. 46-53.
43. J. Devore and R. Peck Statistics: The Exploration and Analysis of Data, 3rd ed. Pacific Grove, CA: Brooks Cole, 1997.
44. I. McNemar, "Note on the sampling error of the difference between correlated proportions or percentages," Psychometrika, vol. 12, pp. 153-157, 1947.
45. B. A. Draper, K. Back, M. S. Bartlett, and J. R. Beveridge, "Recognizing faces with PCA and ICA," Comput. Vis. Image Understand., vol. 91, no. 1-2, pp. 115-137, 2003.
46. H. Cevikalp, M. Neamtu, and M. Wilkes, "Discriminative common vector method with Kernels," IEEE Trans. Neural Netiv., vol. 17, no. 6, pp. 1550-1565, Nov. 1996.
47. F. Girosi, "An equivalence between sparse approximation and support vector machines," Neural Comput., vol. 10, pp. 1455-1480, 1998.
48. G. Seber, Multivariate Observations. New York: Wiley, 1986.
49. I. Pitas and A. N. Venetsanopoulos, Nonlinear Digital Filters: Principles and Applications. Norwell, MA: Kluwer, 1990.
50. A. G. Bors and I. Pitas, "Median radial basis function neural network," IEEE Trans. Neural Netw., vol. 7, no. 6, pp. 1351-1364, Nov 1996.
51. J. Shawe-Taylor, C. K. I. Williams, N. Cristianini, and J. Kandola, "On the eigenspectrum of the gram matrix and the generalization error of Kernel-PCA," IEEE Trans. Inf. Theory, vol. 5 1, no. 7, pp. 2510-2522, Jul. 2005.
52. J. Shawe-Taylor and N. Cristianini, "On the generalization of soft margin algorithms," IEEE Trans. Inf. Theory, vol. 48, no. 10, pp. 2721-2735, Oct. 2002.