Bilinear analysis for Kernel selection and nonlinear feature extraction

IEEE Transactions on Neural Networks

Volumn 18, Issue 5, 2007, Pages 1442-1452

  Yang, Shu ^a   Yan, Shuicheng ^b   Zhang, Chao ^c   Tang, Xiaoou ^d,e  

^a Boston University   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c PEKING UNIVERSITY   (China)

^d MICROSOFT RESEARCH ASIA   (China)

^e CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Bilinear analysis; Discriminant analysis; Face recognition; Feature extraction; Fisher criterion; Kernel selection

Indexed keywords

ALGORITHMS; DISCRIMINANT ANALYSIS; FACE RECOGNITION; FISHER INFORMATION MATRIX; OPTIMIZATION;

BILINEAR ANALYSIS; FISHER CRITERION; KERNEL SELECTION;

FEATURE EXTRACTION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; FACE; HISTOLOGY; HUMAN; IMAGE ENHANCEMENT; METHODOLOGY; NONLINEAR SYSTEM; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; FACE; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; NONLINEAR DYNAMICS; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 34548626233     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2007.894042     Document Type: Article

References (44)

1. G. Baudat and F. Anouar, "Generalized discrimmant analysis using a kernel approach," Neural Comput., vol. 12, no. 10, pp. 2385-2404, 2000.
2. G. Casella and C. Robert, Monte Carlo Statistical Methods. New York: Springer-Verlag, 1999.
3. K. Crammer, J. Keshet, and Y. Singer, "Kernel design using boosting," in Advances in Neural Information Processing Systems, ser. 15. Cambridge, MA: MIT Press.
4. N. Cristianini, J. Kandola, A. Elisseeff, and J. Shawe-Taylor, "On kernel-target alignment," in Proc. Neural Inf. Process. Syst., Dec. 2001, pp. 367-373.
5. T. Evgeniou, M. Pontil, and A. Elisseeff, "Leave one out error, stability, and generalization of voting combinations of classifiers," Mach. Learn., vol. 55, no. 1, pp. 71-97, Apr. 2004.
6. G. Fung, M. Dundar, J. Bi, and B. Rao, "A fast iterative algorithm for Fisher discriminant using Heterogeneous kernels," in Proc. 21st Int. Conf. Mach. Learn., Banff, Canada, 2004, pp. 313-320.
7. T. Gestel, J. Suyken, G. Lanckriet, A. Lambrechts, B. De Moor, and J. Vanderwalle, "Bayesian framework for least squares support vector machine classifiers, Gaussian process and kernel Fisher discriminant analysis," Neural Comput., vol. 15, no. 5, pp. 1115-1148, May 2002.
8. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning. New York: Springer-Verlag, 2001.
9. T. Hastie and R. Tibshirani, "Discriminant analysis by Gaussian mixture," J. Roy. Statist. Soc., Jan. 1996.
10. H. Jiang, C. Pong, W. Chen, and J. Lai, "Kernel subspace LDA with optimized kernel parameters on face recognition," in Proc. 6th IEEE Int. Conf. Autom. Face Gesture Recognit., 2004, pp. 327-332.
11. R. Kondor and T. Jebara, "A kernel between sets of vectors," in Proc. 20th Int. Conf. Mach. Learn., Washington, DC, 2003, pp. 361-368.
12. S. Kim, A. Magnani, and S. Boyd, "Optimal kernel selection in kernel Fisher discriminant analysis," in Proc. Int. Conf. Mach. Learn., Pittsburgh, PA, 2006, pp. 465-472.
13. M. Kirby and L. Sirovih, "Application of the Karhunen-Loeve procedure for the characterization of human faces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 1, pp. 103-108, Jan. 1990.
14. W. J. Krzanowski, P. Jonathan, W. V. McCarthy, and M. R. Thomas, "Discriminant analysis with singular covariance matrices: Methods and applications to spectroscopic data," Appl. Statist., no. 44, pp. 887-894, 2004.
15. G. Lanckriet, N. Cristianini, L. Ghaoui, P. Bartlett, and M. Jordan, "Learning the kernel matrix with semi-definite programming," J. Mach. Learn. Res., vol. 5, pp. 27-72, 2004.
16. Z. Liang, D. Zhang, and P. Shi, "Robust kernel discriminant analysis and its application to feature extraction and recognition," Neurocomput., vol. 69, no. 7-9, pp. 928-933, 2006.
17. Q. Liu, H. Lu, and S. Ma, "Improving kernel Fisher discriminant analysis for face recognition," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 1, pp. 42-49, Jan. 2004.
18. Q. Liu, X. Tang, H. Lu, and S. Ma, "Face recognition using kernel scatter-difference-based discriminant analysis," IEEE Trans. Neural Netw., vol. 17, no. 4, pp. 1081-1085, Jul. 2006.
19. J. Lu, K. Plataniotis, and N. Venetsanopoulos, "Face recognition using kernel direct discriminant analysis algorithms," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 117-126, Jan. 2003.
20. S. Mika, G. Ratsch, J. Weston, B. Scholkopf, and K. R. Muller, "Fisher discriminant analysis with kernels," in Proc. IEEE Int. Workshop Neural Netw. Signal Process. IX, Aug. 1999, pp. 41-48.
21. S. Mika, G. Ratsch, B. Scholkopf, A. Smola, J. Weston, and K. R. Muller, "Invariant feature extraction and classification in kernel spaces," in Advances in Neural Information Processing Systems, ser. 12. Cambridge, MA: MIT Press, 1999.
22. S. Mika, G. Ratsch, J. Weston, B. Scholkopf, A. Smola, and K. R. Muller, "Constructing descriptive and discriminative nonlinear features: Rayleigh coefficients in kernel feature space," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 5, pp. 623-628, May 2003.
23. S. Mika, G. Ratsch, and K. R. Muller, "A mathematical programming approach to the kernel Fisher algorithm," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2001, vol. 13, pp. 591-597.
24. K. R. Muller, S. Mika, G. Ratsch, K. Tsuda, and B. Scholkof, "An introduce to kernel based learning algorithm," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 181-201, Mar. 2001.
25. Olivetti and Oracle Research Laboratory, "The Olivetti and Oracle Research Laboratory face database of faces," Cambridge, U.K. [Online]. Available: http://www.cam-orl.co.uk/facedatabase.html
26. J. Peltonen and S. Kaski, "Discriminative components of data," IEEE Trans. Neural Netw., vol. 16, no. 1, pp. 68-83, Jan. 2005.
27. P. J. Philips, H. Wechsler, J. Huang, and P. Rauss, "The FERET database and evaluation procedure for face recognition algorithms," Image Vis. Comput., vol. 16, pp. 295-306, 1998.
28. V. Roth and V. Steinhage, "Nonlinear discriminant analysis using kernel functions," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2000, vol. 12, pp. 568-574.
29. B. Scholkopf and A. Smola, Learning With Kernels. Cambridge,MA: MIT Press, 2002.
30. T. Sim, S. Baker, and M. Bsat, "The CMU pose, illumination, and expression (PIE) database," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., May 2002, pp. 53-58.
31. J. Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge, U.K.: Cambridge Univ. Press, 2004.
32. A. N. Tikhonov and V. Y. Arsenin, Solution of Ill-Posed Problems. New York: Wiley, 1997.
33. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
34. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
35. X. Wang and X. Tang, "A unified framework for subspace face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1222-1228, Sep. 2004.
36. X. Wang and X. Tang, "Random sampling for subspace face recognition," Int. J. Comput. Vis., vol. 70, no. 1, pp. 91-104, Oct. 2006.
37. A. R. Webb, Statistical Pattern Recognition, 2nd ed. New York: Wiley, 2004.
38. H. Xiong, M. N. S. Swamy, and M. O. Ahmad, "Optimizing the kernel in the empirical feature space," IEEE Trans. Neural Netw., vol. 16, no. 2, pp. 460-474, Mar. 2005.
39. M. H. Yang, "Kernel eigenfaces vs. kernel Fisherfaces: Face recognition using kernel methods," in Proc. 5th Int. Conf. Autom. Face Gesture Recognit., Washington, D.C., May 2002, pp. 215-220.
40. J. Yang, A. F. Frangi, J. Yang, D. Zhang, and Z. Jin, "KPCA plus LDA: A complete kernel Fisher discriminant framework for feature extraction and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 2, pp. 230-244, Feb. 2005.
41. J. Ye, R. Jananrdan, C. H. Park, and H. Park, "An optimization criterion for generalized discriminant analysis on undersampled problems," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 8, pp. 982-994, Aug. 2004.
42. J. Ye, R. Janardan, and Q. Li, "Two-dimensional linear discriminant analysis," in Proc. Neural Information Processing Systems, 2005, pp. 1596-1576.
43. W. Zhao, R. Chellappa, and P. J. Phillips, "Subspace linear discriminant analysis for face recognition," Ctr. Autom. Res., Univ. Maryland, College Park, MD, Tech. Rep., 1999.
44. W. Zheng, L. Zhao, and C. Zou, "Foley-Sammon optimal discriminant vectors using kernel approach," IEEE Trans. Neural Netw., vol. 16, no. 1, pp. 1-9, Jan. 2005.