Beyond trace ratio: Weighted harmonic mean of trace ratios for multiclass discriminant analysis

IEEE Transactions on Knowledge and Data Engineering

Volumn 29, Issue 10, 2017, Pages 2100-2110

  Li, Zhihui ^a   Nie, Feiping ^b   Chang, Xiaojun ^c   Yang, Yi ^d  

^a Beijing Success Technology Co Ltd   (China)

^b NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^c Carnegie Mellon University ^*  (United States)

^d UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Multiclass discriminant analysis; Trace ratio; Weighted harmonic mean

Indexed keywords

DISCRIMINANT ANALYSIS; EIGENVALUES AND EIGENFUNCTIONS; ELECTRONIC MAIL; FACE RECOGNITION; GESTURE RECOGNITION; HARMONIC ANALYSIS; ITERATIVE METHODS; LINEAR TRANSFORMATIONS; MATHEMATICAL TRANSFORMATIONS; MATRIX ALGEBRA; MOTION ESTIMATION; OPTIMIZATION;

CONVERGENCE; DIMENSIONAL REDUCTION TECHNIQUES; HIGH-DIMENSIONAL FEATURE SPACE; LINEAR DISCRIMINANT ANALYSIS; LOW-DIMENSIONAL REPRESENTATION; TRACE RATIO; WEIGHTED HARMONIC MEANS; WITHIN-CLASS SCATTER MATRIX;

TRACE ANALYSIS;

EID: 85028916868     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2017.2728531     Document Type: Article

References (55)

1. Y. Han, F. Wu, Q. Tian, and Y. Zhuang, "Image annotation by input-output structural grouping sparsity, " IEEE Trans. Image Process., vol. 21, no. 6, pp. 3066-3079, Jun. 2012.
2. E. Elhamifar and R. Vidal, "Sparse subspace clustering: Algorithm, theory, and applications, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 11, pp. 2765-2781, Nov. 2013.
3. S. Wang, X. Chang, X. Li, G. Long, L. Yao, and Q. Z. Sheng, "Diagnosis code assignment using sparsity-based disease correlation embedding, " IEEE Trans. Knowl. Data Eng., vol. 28, no. 12, pp. 3191-3202, Dec. 2016.
4. M. Wang, W. Fu, S. Hao, H. Liu, and X.Wu, "Learning on big graph: Label inference and regularization with anchor hierarchy, " IEEE Trans. Knowl. Data Eng., vol. 29, no. 5, pp. 1101-1114, May 2017.
5. M. Wang, W. Fu, S. Hao, D. Tao, and X. Wu, "Scalable semi-supervised learning by efficient anchor graph regularization, " IEEE Trans. Knowl. Data Eng., vol. 28, no. 7, pp. 1864-1877, Jul. 2016.
6. M. Wang, X. Liu, and X. Wu, "Visual classification by l1-hypergraph modeling, " IEEE Trans. Knowl. Data Eng., vol. 27, no. 9, pp. 2564-2574, Sep. 2015. [Online]. Available: http://dx.doi.org/10.1109/TKDE.2015.2415497
7. L. Zhang, M. Song, Y. Yang, Q. Zhao, C. Zhao, and N. Sebe, "Weakly supervised photo cropping, " IEEE Trans. Multimedia, vol. 16, no. 1, pp. 94-107, Jan. 2014.
8. Y. Yang, Z. Ma, A. G. Hauptmann, and N. Sebe, "Feature selection for multimedia analysis by sharing information among multiple tasks, " IEEE Trans. Multimedia, vol. 15, no. 3, pp. 661-669, Apr. 2013.
9. Y. Yang, Z. Ma, F. Nie, X. Chang, and A. G. Hauptmann, "Multiclass active learning by uncertainty sampling with diversity maximization, " Int. J. Comput. Vis., vol. 113, no. 2, pp. 113-127, 2015.
10. Y. Yan, F. Nie, W. Li, C. Gao, Y. Yang, and D. Xu, "Image classification by cross-media active learning with privileged information, " IEEE Trans. Multimedia, vol. 18, no. 12, pp. 2494-2502, Dec. 2016.
11. Y. Han, Y. Yang, Y. Yan, Z. Ma, N. Sebe, and X. Zhou, "Semisupervised feature selection via spline regression for video semantic recognition, " IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 2, pp. 252-264, Feb. 2015.
12. X. Chang, F. Nie, Y. Yang, and H. Huang, "A convex formulation for semi-supervised multi-label feature selection, " in Proc. 28th AAAI Conf. Artif. Intell., 2014, pp. 1171-1177.
13. F. Nie, W. Zhu, and X. Li, "Unsupervised feature selection with structured graph optimization, " in Proc. 30th AAAI Conf. Artif. Intell., 2016, pp. 1302-1308.
14. R. A. Fisher, "The use of multiple measurements in taxonomic problems, " Ann. Eugenics, vol. 7, no. 2, pp. 179-188, 1936.
15. C. R. Rao, "The utilization of multiple measurements in problems of biological classification, " J. Roy. Statist. Soc. B: Methodological, vol. 10, no. 2, pp. 159-203, 1948.
16. K. Fukunaga, Introduction to Statistical Pattern Recognition. 2nd ed. New York, NY, USA: Academic Press, 1990.
17. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. Hoboken, NJ, USA: Wiley, 2012.
18. S. Yuan, X. Mao, and L. Chen, "Multilinear spatial discriminant analysis for dimensionality reduction, " IEEE Trans. Image Process., vol. 26, no. 6, pp. 2669-2681, Jun. 2017.
19. Y. Zhou and S. Sun, "Manifold partition discriminant analysis, " IEEE Trans. Cybern., vol. 47, no. 4, pp. 830-840, Apr. 2017.
20. M. Kan, S. Shan, H. Zhang, S. Lao, and X. Chen, "Multi-view discriminant analysis, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 1, pp. 188-194, Jan. 2016.
21. R. Lotlikar and R. Kothari, "Fractional-step dimensionality reduction, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 6, pp. 623-627, Jun. 2000.
22. M. Loog, R. Duin, and R. Haeb-Umbach, "Multiclass linear dimension reduction by weighted pairwise Fisher criteria, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 7, pp. 762-766, Jul. 2001.
23. J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Face recognition using LDA-based algorithms, " IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 195-200, Jan. 2003.
24. G. McLachlan, Discriminant Analysis and Statistical Pattern Recognition. Hoboken, NJ, USA: Wiley, 2004.
25. D. Tao, X. Li, X. Wu, and S. J. Maybank, "Geometric mean for subspace selection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 260-274, Feb. 2009.
26. Y. Zhao and S. Zhang, "Generalized dimension-reduction framework for recent-biased time series analysis, " IEEE Trans. Knowl. Data Eng., vol. 18, no. 2, pp. 231-244, Feb. 2006.
27. T. Zhang, D. Tao, X. Li, and J. Yang, "Patch alignment for dimensionality reduction, " IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1299-1313, Sep. 2009.
28. W. Bian and D. Tao, "Harmonic mean for subspace selection, " in Proc. 19th Int. Conf. Pattern Recognit., 2008, pp. 1-4.
29. Y. Han, Y. Yang, F. Wu, and R. Hong, "Compact and discriminative descriptor inference using multi-cues, " IEEE Trans. Image Process., vol. 24, no. 12, pp. 5114-5126, Dec. 2015.
30. P. Wang, C. Shen, H. Zheng, and Z. Ren, "A variant of the trace quotient formulation for dimensionality reduction, " in Proc. Asian Conf. Comput. Vis., 2009, pp. 277-286.
31. W. Bian and D. Tao, "Max-min distance analysis by using sequential SDP relaxation for dimension reduction, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 1037-1050, May 2011.
32. Y. Yang, F. Nie, D. Xu, J. Luo, Y. Zhuang, and Y. Pan, "A multimedia retrieval framework based on semi-supervised ranking and relevance feedback, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 723-742, Apr. 2012.
33. Z. Zha, M. Wang, Y. Zheng, Y. Yang, R. Hong, and T. Chua, "Interactive video indexing with statistical active learning, " IEEE Trans. Multimedia, vol. 14, no. 1, pp. 17-27, Feb. 2012.
34. Y. Zhang and D.-Y. Yeung, "Worst-case linear discriminant analysis, " in Proc. Advances Neural Inf. Process. Syst., 2010, pp. 2568-2576.
35. H. Wang, S. Yan, D. Xu, X. Tang, and T. Huang, "Trace ratio versus ratio trace for dimensionality reduction, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
36. Y. Jia, F. Nie, and C. Zhang, "Trace ratio problem revisited, " IEEE Trans. Neural Netw., vol. 20, no. 4, pp. 729-735, Apr. 2009.
37. M. Zhao, R. H. Chan, P. Tang, T. W. Chow, and S. W. Wong, "Trace ratio linear discriminant analysis for medical diagnosis: A case study of dementia, " IEEE Signal Process. Lett., vol. 20, no. 5, pp. 431-434, May 2013.
38. L.-H. Zhang, "Uncorrelated trace ratio linear discriminant analysis for undersampled problems, " Pattern Recognit. Lett., vol. 32, no. 3, pp. 476-484, 2011.
39. H. Wang, S. Yan, D. Xu, X. Tang, and T. S. Huang, "Trace ratio versus ratio trace for dimensionality reduction, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
40. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
41. M. Loog, R. Duin, and R. Haeb-Umbach, "Multiclass linear dimension reduction by weighted pairwise Fisher criteria, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 7, pp. 762-766, Jul. 2001.
42. D. Tao, X. Li, X. Wu, and S. J. Maybank, "Geometric mean for subspace selection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 260-274, Feb. 2009.
43. P. Wang, C. Shen, H. Zheng, and Z. Ren, "A variant of the trace quotient formulation for dimensionality reduction, " in Proc. Asian Conf. Comput. Vis., 2009, pp. 277-286.
44. M. L. Overton and R. S. Womersley, "Optimality conditions and duality theory for minimizing sums of the largest eigenvalues of symmetric matrices, " Math. Program., vol. 62, no. 1-3, pp. 321-357, 1993.
45. Y. Zhang and D.-Y. Yeung, "Worst-case linear discriminant analysis, " in Proc. 23rd Int. Conf. Neural Inf. Process. Syst., 2010, pp. 2568-2576.
46. Y. Jia, F. Nie, and C. Zhang, "Trace ratio problem revisited, " IEEE Trans. Neural Netw., vol. 20, no. 4, pp. 729-735, Apr. 2009.
47. W. Bian and D. Tao, "Max-min distance analysis by using sequential SDP relaxation for dimension reduction, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 1037-1050, May 2011.
48. O. C. Hamsici and A. M. Martínez, "Bayes optimality in linear discriminant analysis, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 4, pp. 647-657, Apr. 2008.
49. S. A. Nene, S. K. Nayar, and H. Murase, "Columbia object image library (COIL-20), " Tech. Rep. CUCS-005-96, Feb. 1996.
50. T. J. Millar, P. R. A. Farquhar, and K. Willacy, "The UMIST database for astrochemistry 1995, " Astronomy and Astrophysics Supplement Series, vol. 121, no. 1, pp. 139-185, 1997.
51. M. J. Lyons, S. Akamatsu, M. Kamachi, and J. Gyoba, "Coding facial expressions with Gabor wavelets, " in Proc. 3rd Int. Conf. Face Gesture Recognit., 1998, pp. 200-205.
52. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.
53. F. Samaria and A. Harter, "Parameterisation of a stochastic model for human face identification, " in Proc. 2nd IEEE Workshop Appl. Comput. Vis., 1994, pp. 138-142.
54. T. Sim, S. Baker, and M. Bsat, "The CMU pose, illumination, and expression database, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1615-1618, Dec. 2003.
55. P. J. Phillips, H. Wechsler, J. Huang, and P. J. Rauss, "The FERET database and evaluation procedure for face-recognition algorithms, " Image Vis. Comput., vol. 16, no. 5, pp. 295-306, 1998.