Generalized discriminant analysis: A matrix exponential approach

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 40, Issue 1, 2010, Pages 186-197

  Zhang, Taiping ^a   Fang, Bin ^a   Tang, Yuan Yan ^a   Shang, Zhaowei ^a   Xu, Bin ^a  

^a CHONGQING UNIVERSITY   (China)

Author keywords

Distance diffusing; Exponential discriminant analysis (EDA); High order moment; Linear discriminant analysis (LDA); Matrix exponential

Indexed keywords

CLASSIFICATION ACCURACY; DATA SETS; GENERALIZED DISCRIMINANT ANALYSIS; GENERALIZED SINGULAR VALUE DECOMPOSITION; HIGH DIMENSIONAL DATA; HIGH-ORDER; LINEAR DISCRIMINANT ANALYSIS; LINEAR DISCRIMINANT ANALYSIS (LDA); MATRIX EXPONENTIALS; NULL SPACE; Q R DECOMPOSITION; REGULARIZED LDA; SMALL TRAINING; UNDERSAMPLED PROBLEMS; WITHIN-CLASS SCATTER MATRIX;

DISCRIMINANT ANALYSIS; METADATA; NATURAL LANGUAGE PROCESSING SYSTEMS; SINGULAR VALUE DECOMPOSITION;

PRINCIPAL COMPONENT ANALYSIS;

EID: 77955091618     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2009.2024759     Document Type: Article

References (57)

1. R. A. Fisher, "The statistical utilization of multiple measurements", Ann. Eugenics, vol. 8, pp. 376-386, 1938.
2. C. R. Rao, "The utilization of multiple measurements in problems of biological classification", J. R. Stat. Soc. B, vol. 10, pp. 159-203, 1948.
3. R. Duda, P. Hart, and D. Stork, Pattern Classification, 2nd ed. New York: Wiley, 2000.
4. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd ed. New York: Academic, 1990.
5. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class-specific linear projection", IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
6. J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Face recognition using LDA-based algorithms", IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 195-200, Jan. 2003.
7. H. Yu and H. Yang, "A direct LDA algorithm for high-dimensional data: With application to face recognition", Pattern Recognit., vol. 34, no. 10, pp. 2067-2070, Oct. 2001.
8. Z. Cui, B. Xu, W. Zhang, D. Jiang, and J. Xu, "CLDA: Feature selection for text categorization based on constrained LDA", in Proc. Int. Conf. Semantic Comput., 2007, pp. 702-712.
9. K. Torkkola, "Linear discriminant analysis in document classification", in Proc. IEEE ICDM Workshop Text Mining, 2001, pp. 401-404.
10. D. Tao, X. Tang, X. Li, and X. Wu, "Asymmetric bagging and random subspace for support-vector-machines-based relevance feedback in image retrieval", IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 7, pp. 1088-1099, Jul. 2006.
11. S. Raudys and R. P. W. Duin, "Expected classification error of the Fisher linear classifier with pseudoinverse covariance matrix", Pattern Recognit. Lett., vol. 19, no. 5/6, pp. 385-392, Apr. 1998.
12. J. H. Friedman, "Regularized discriminant analysis", J. Amer. Stat. Assoc., vol. 84, no. 405, pp. 165-175, 1989.
13. T. Hastie, A. Buja, and R. Tibshirani, "Penalized discriminant analysis", Ann. Stat., vol. 23, no. 1, pp. 73-102, 1995.
14. T. Hastie, R. Tibshirani, and A. Buja, "Flexible discriminant analysis by optimal scoring", J. Amer. Stat. Assoc., vol. 89, no. 428, pp. 1255-1270, 1994.
15. D.-Q. Dai and P. C. Yuen, "Face recognition by regularized discriminant analysis", IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 4, pp. 1080-1085, Aug. 2007.
16. K. Liu, Y.-Q. Cheng, and J.-Y. Yang, "A generalized optimal set of discriminant vectors", Pattern Recognit., vol. 25, no. 7, pp. 731-739, Jul. 1992.
17. L.-F. Chen, H.-Y. M. Liao, M.-T. Ko, J.-C. Lin, and G.-J. Yu, "A new LDA-based face recognition system which can solve the small-sample-size problem", Pattern Recognit., vol. 33, no. 10, pp. 1713-1726, Oct. 2000.
18. R. Huang, Q. Liu, H. Lu, and S. Ma, "Solving the small-sample-size problem of LDA", in Proc. 16th Int. Conf. Pattern Recog., 2002, vol. 3, pp. 29-32.
19. X. Jiang, B. Mandal, and A. Kot, "Eigenfeature regularization and extraction in face recognition", IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 3, pp. 383-394, Mar. 2008.
20. A. K. Qin, P. N. Suganthan, and M. Loog, "Generalized null-space uncor-related Fisher discriminant analysis for linear dimensionality reduction", Pattern Recognit., vol. 39, no. 9, pp. 1805-1808, Sep. 2006.
21. M. Loog, R. P. W. Duin, and R. Haeb-Umbach, "Multiclass linear dimension reduction by weighted pairwise Fisher criteria", IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 7, pp. 762-766, Jul. 2001.
22. J. Ye and Q. Li, "A two-stage linear discriminant analysis via QR decomposition", IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 6, pp. 929-941, Jun. 2005.
23. P. Howland and H. Park, "Generalizing discriminant analysis using the generalized singular value decomposition", IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 8, pp. 995-1006, Aug. 2004.
24. G. H. Golub and C. F. V. Loan, Matrix Computation. Baltimore, MD: The Johns Hopkins Univ. Press, 1983.
25. J. Ye, R. Janardan, C. H. Park, and H. S. Park, "An optimization criterion for generalized discriminant analysis on undersampled problems", IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 8, pp. 982-994, Aug. 2004.
26. S. Zhang and T. Sim, "When Fisher meets Fukunaga-Koontz: A new look at linear discriminants", in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., Jun. 17-22, 2006, vol. 1, pp. 323-329.
27. J. Ye, R. Janardan, and Q. Li, "Two-dimensional linear discriminant analysis", in Proc. Neural Inform. Process. Syst., 2005, pp. 1569-1576.
28. D. Tao, X. Li, X. Wu, and S. J. Maybank, "General tensor discriminant analysis and Gabor features for gait recognition", IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 10, pp. 1700-1715, Oct. 2007.
29. S. Yan, D. Xu, Q. Yang, L. Zhang, X. Tang, and H.-J. Zhang, "Multilinear discriminant analysis for face recognition", IEEE Trans. Image Process., vol. 16, no. 1, pp. 212-220, Jan. 2007.
30. X. Li, S. Lin, S. Yan, and D. Xu, "Discriminant locally linear embedding with high-order tensor data", IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 38, no. 2, pp. 342-352, Apr. 2008.
31. T. Tao, X. Li, X. Wu, and S. J. Maybank, "Tensor rank-one discriminant analysis: A convergent method for discriminative multilinear subspace selection", Neurocomputing, vol. 71, no. 10-12, pp. 1866-1882, Jun. 2008.
32. Y. Pang, Y. Yuan, and X. Li, "Gabor-based region covariance matrices for face recognition", IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 7, pp. 989-993, Jul. 2008.
33. D. Tao, X. Li, X. Wu, and S. J. Maybank, "Geometric mean for subspace selection", IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 260-274, Feb. 2009.
34. D. Tao, X. Li, X. Wu, and S. J. Maybank, "General averaged divergence analysis", in Proc. IEEE Int. Conf. Data Mining, 2007, pp. 302-311.
35. W. Bian and D. Tao, "Harmonic mean for subspace selection", in Proc. 19th ICPR, 2008, pp. 1-4.
36. T. Hastie and R. Tibshirani, "Discriminant analysis by Gaussian mixtures", J. R. Stat. Soc. B, vol. 58, pp. 155-176, 1996.
37. J. Duchene and S. Leclercq, "An optimal transformation for discriminant and principal component analysis", IEEE Trans. Pattern Anal. Mach. Intell., vol. 10, no. 6, pp. 978-983, Nov. 1988.
38. M. Zhu and A. M. Martinez, "Subclass discriminant analysis", IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 8, pp. 1274-1286, Aug. 2006.
39. M. Loog and R. Duin, "Linear dimensionality reduction via a heteroscedastic extension of LDA: The Chernoff criterion", IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 6, pp. 732-739, Jun. 2004.
40. D. Tao and X. Tang, "Nonparametric discriminant analysis in relevance feedback for content-based image retrieval", in Proc. 17th ICPR, Aug. 2004, vol. 2, pp. 1013-1016.
41. S. Mika, G. Rätsch, J. Weston, and B. S. K.-R. Müller, "Fisher discriminant analysis with kernels", in Proc. IEEE Neural Netw. Signal Process. IX, Y.-H. Hu, J. Larsen, E. Wilson, and S. Douglas, Eds., 1999, pp. 41-48.
42. T. Zhang, D. Tao, and J. Yang, "Discriminative locality alignment", in Proc. 10th ECCV, 2008, pp. 725-738.
43. W. Liu, D. Tao, and J. Liu, "Transductive component analysis", in Proc. 8th IEEE ICDM, Dec. 2008, pp. 433-442.
44. T. Zhang, D. Tao, X. Li, and T. Yang, "A unifying framework for spectral-analysis-based dimensionality reduction", in Proc. IEEE IJCNN, Jun. 2008, pp. 1670-1677.
45. J. Cardoso, "Source separation using higher order moments", in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., 1989, pp. 2109-2112.
46. H. Farid and E. H. Adelson, "Separating reflections from images using independent components analysis", J. Opt. Soc. Amer., vol. 16, no. 9, pp. 2136-2145, 1999.
47. X. Shao, W. Wang, Z. Hou, and W. Cai, "A new regression method based on independent component analysis", Talanta, vol. 69, no. 3, pp. 676-680, May 2006.
48. M. Welling and M. Weber, "A constrained EM algorithm for independent component analysis", Neural Comput., vol. 13, no. 3, pp. 677-689, Mar. 2001.
49. H. Araujo, J. Dias, and A. T. Almeida, "Parallel texture analysis using high-order statistics and neural networks", in Proc. Speech, Image Process. Neural Netw., 1994, pp. 401-404.
50. M. Tsatsanis and G. Giannakis, "Object and texture classification using higher order statistics", IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 7, pp. 733-750, Jul. 1992.
51. H.-W. Cheng and S.-T. Yau, "More explicit formulas for the matrix exponential", Linear Algebra Appl., vol. 262, pp. 131-163, Sep. 1, 1997.
52. D. S. Bernstein and W. So, "Some explicit formulas for the matrix exponential", IEEE Trans. Autom. Control, vol. 38, no. 8, pp. 1228-1232, Aug. 1993.
53. K. Z. Mao, "Fast orthogonal forward selection algorithm for feature subset selection", IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1218-1224, Sep. 2002.
54. B. Schökopf, A. Smola, and K. Muller, "Nonlinear component analysis as a kernel eigenvalue problem", Neural Comput., vol. 10, no. 5, pp. 1299-1319, Jul. 1998.
55. S. Zhang and T. Sim, "Discriminant subspace analysis: A Fukunaga-Koontz approach", IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 10, pp. 1732-1745, Oct. 2007.
56. Y. Face Database. [Online]. Available: http://cvc.yale.edu/projects/ yalefaces/yalefaces.html
57. T. Sim, S. Baker, and M. Bsat, "The CMU pose, illumination, and expression database", IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1615-1618, Dec. 2003.