Low-Rank Discriminant Embedding for Multiview Learning

IEEE Transactions on Cybernetics

Volumn 47, Issue 11, 2017, Pages 3516-3529

  Li, Jingjing ^a   Wu, Yue ^a   Zhao, Jidong ^a   Lu, Ke ^a  

^a UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

Graph embedding; low rank representation (LRR); multiview learning; subspace learning

Indexed keywords

DIFFERENT DISTRIBUTIONS; DISCRIMINANT EMBEDDING; EMPIRICAL LIKELIHOOD; GEOMETRIC INFORMATION; GEOMETRIC STRUCTURE; LOW-RANK REPRESENTATIONS; MULTI-VIEW LEARNING; SPECIFIC PROBLEMS;

PROBABILITY DISTRIBUTIONS;

EID: 84971408206     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2016.2565898     Document Type: Article

References (63)

1. X. Huang, Z. Lei, M. Fan, X. Wang, S. Z. Li, "Regularized discriminative spectral regression method for heterogeneous face matching, " IEEE Trans. Image Process., vol. 22, no. 1, pp. 353-362, Jan. 2013.
2. H. Hotelling, "Relations between two sets of variates, " Biometrika, vol. 28, nos. 3-4, pp. 321-377, 1936.
3. M. Kan, S. Shan, H. Zhang, S. Lao, X. Chen, "Multi-view discriminant analysis, " in Proc. 12th ECCV, Florence, Italy, 2012, pp. 808-821.
4. X. Cai, C. Wang, B. Xiao, X. Chen, J. Zhou, "Regularized latent least square regression for cross pose face recognition, " in Proc. IJCAI, Beijing, China, 2013, pp. 1247-1253.
5. Z. Ding, Y. Fu, "Low-rank common subspace for multi-view learning, " in Proc. ICDM, Shenzhen, China, 2014, pp. 110-119.
6. Y. Jiang, et al., "Collaborative fuzzy clustering from multiple weighted views, " IEEE Trans. Cybern., vol. 45, no. 4, pp. 688-701, Apr. 2015.
7. J. Yu, Y. Rui, Y. Y. Tang, D. Tao, "High-order distance-based multiview stochastic learning in image classification, " IEEE Trans. Cybern., vol. 44, no. 12, pp. 2431-2442, Dec. 2014.
8. M. Long, J. Wang, G. Ding, J. Sun, P. S. Yu, "Transfer feature learning with joint distribution adaptation, " in Proc. ICCV, Sydney, NSW, Australia, 2013, pp. 2200-2207.
9. M. Shao, D. Kit, Y. Fu, "Generalized transfer subspace learning through low-rank constraint, " Int. J. Comput. Vis., vol. 109, nos. 1-2, pp. 74-93, 2014.
10. C. Xu, D. Tao, C. Xu, "A survey on multi-view learning, " arXiv preprint arXiv:1304.5634, 2013.
11. A. Blum, T. Mitchell, "Combining labeled, unlabeled data with co-training, " in Proc. 11th Annu. Conf. Comput. Learn. Theory, Madison, WI, USA, 1998, pp. 92-100.
12. M. Gönen, E. Alpaydn, "Multiple kernel learning algorithms, " J. Mach. Learn. Res., vol. 12, pp. 2211-2268, Jul. 2011.
13. D. Zhai, H. Chang, S. Shan, X. Chen, W. Gao, "Multiview metric learning with global consistency, local smoothness, " ACM Trans. Intell. Syst. Technol., vol. 3, no. 3, 2012, Art. no. 53.
14. M. Long, J. Wang, G. Ding, D. Shen, Q. Yang, "Transfer learning with graph co-regularization, " IEEE Trans. Knowl. Data Eng., vol. 26, no. 7, pp. 1805-1818, Jul. 2014.
15. G. Liu, et al., "Robust recovery of subspace structures by low-rank representation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 171-184, Jan. 2013.
16. Q. Gu, J. Zhou, "Co-clustering on manifolds, " in Proc. ACM SIGKDD, Paris, France, 2009, pp. 359-368.
17. S. Yan, et al., "Graph embedding, extensions: A general framework for dimensionality reduction, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1, pp. 40-51, Jan. 2007.
18. M. Turk, A. Pentland, "Eigenfaces for recognition, " J. Cogn. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.
19. P. N. Belhumeur, J. P. Hespanha, D. J. Kriegman, "Eigenfaces vs. fisherfaces: Recognition using class specific linear projection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
20. X. He, P. Niyogi, "Locality preserving projections, " in Proc. NIPS, 2004, pp. 153-160.
21. F. R. K. Chung, Spectral Graph Theory, vol. 92. Providence, RI, USA: Amer. Math. Soc., 1997.
22. H.-T. Chen, H.-W. Chang, T.-L. Liu, "Local discriminant embedding, its variants, " in Proc. CVPR, vol. 2. San Diego, CA, USA, 2005, pp. 846-853.
23. F. Dornaika, A. Bosaghzadeh, "Exponential local discriminant embedding, its application to face recognition, " IEEE Trans. Cybern., vol. 43, no. 3, pp. 921-934, Jun. 2013.
24. M. Sugiyama, "Local Fisher discriminant analysis for supervised dimensionality reduction, " in Proc. ICML, Pittsburgh, PA, USA, 2006, pp. 905-912.
25. K. Lu, Z. Ding, S. Ge, "Sparse-representation-based graph embedding for traffic sign recognition, " IEEE Trans. Intell. Transp. Syst., vol. 13, no. 4, pp. 1515-1524, Dec. 2012.
26. Y. Zhang, Z. Jiang, L. S. Davis, "Learning structured low-rank representations for image classification, " in Proc. CVPR, Portland, OR, USA, 2013, pp. 676-683.
27. S. Li, Y. Fu, "Robust subspace discovery through supervised lowrank constraints, " in Proc. SIAM SDM, 2014, pp. 163-171.
28. Z. Ding, S. Suh, J.-J. Han, C. Choi, Y. Fu, "Discriminative lowrank metric learning for face recognition, " in Proc. IEEE FG, Ljubljana, Slovenia, 2015, pp. 1-6.
29. J. Chen, J. Yang, "Robust subspace segmentation via low-rank representation, " IEEE Trans. Cybern., vol. 44, no. 8, pp. 1432-1445, Aug. 2014.
30. Z. Ding, S. Ming, Y. Fu, "Latent low-rank transfer subspace learning for missing modality recognition, " in Proc. AAAI, 2014, pp. 1192-1198.
31. E. J. Candès, X. Li, Y. Ma, J. Wright, "Robust principal component analysis" J. ACM, vol. 58, no. 3, 2011, Art. no. 11.
32. S. Akaho, "A kernel method for canonical correlation analysis, " arXiv preprint cs/0609071, 2006.
33. J. Rupnik, J. Shawe-Taylor, "Multi-view canonical correlation analysis, " in Proc. SiKDD, 2010, pp. 1-4.
34. W. Zhang, X. Wang, X. Tang, "Coupled information-theoretic encoding for face photo-sketch recognition, " in Proc. CVPR, Providence, RI, USA, 2011, pp. 513-520.
35. Y. Ma, S. Lao, E. Takikawa, M. Kawade, "Discriminant analysis in correlation similarity measure space, " in Proc. ICML, vol. 227. Corvallis, OR, USA, 2007, pp. 577-584.
36. T. Sun, S. Chen, J.-Y. Yang, P. Shi, "A novel method of combined feature extraction for recognition, " in Proc. ICDM, Pisa, Italy, 2008, pp. 1043-1048.
37. T. Diethe, D. R. Hardoon, J. Shawe-Taylor, "Constructing nonlinear discriminants from multiple data views, " in Machine Learning, Knowledge Discovery in Databases. Heidelberg, Germany: Springer, 2010, pp. 328-343.
38. Z. Deng, K.-S. Choi, Y. Jiang, S. Wang, "Generalized hiddenmapping ridge regression, knowledge-leveraged inductive transfer learning for neural networks, fuzzy systems, kernel methods, " IEEE Trans. Cybern., vol. 44, no. 12, pp. 2585-2599, Dec. 2014.
39. N. Wang, D. Tao, X. Gao, X. Li, J. Li, "Transductive face sketchphoto synthesis, " IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 9, pp. 1364-1376, Sep. 2013.
40. Y. Luo, T. Liu, D. Tao, C. Xu, "Multiview matrix completion for multilabel image classification, " IEEE Trans. Image Process., vol. 24, no. 8, pp. 2355-2368, Aug. 2015.
41. W. Liu, D. Tao, J. Cheng, Y. Tang, "Multiview hessian discriminative sparse coding for image annotation, " Comput. Vis. Image Understand., vol. 118, pp. 50-60, Jan. 2014.
42. Y. Luo, Y. Wen, D. Tao, J. Gui, C. Xu, "Large margin multi-modal multi-task feature extraction for image classification, " IEEE Trans. Image Process., vol. 25, no. 1, pp. 414-427, Jan. 2016.
43. M. Yin, J. Gao, Z. Lin, Q. Shi, Y. Guo, "Dual graph regularized latent low-rank representation for subspace clustering, " IEEE Trans. Image Process., vol. 24, no. 12, pp. 4918-4933, Dec. 2015.
44. D. Cai, X. He, K. Zhou, J. Han, H. Bao, "Locality sensitive discriminant analysis, " in Proc. IJCAI, Hyderabad, India, 2007, pp. 708-713.
45. F. Nie, S. Xiang, C. Zhang, "Neighborhood minmax projections, " in Proc. IJCAI, Hyderabad, India, 2007, pp. 993-998.
46. Y. Wang, D. Zhang, W. Kinsner, Advances in Cognitive Informatics, Cognitive Computing, vol. 323. Heidelberg, Germany: Springer, 2010.
47. H.-J. K. Chiang, S.-H. Wang, J. Y.-J. Hsu, "Efficiently retrieving images that we perceived as similar, " in Proc. Workshops AAAI, 2014, pp. 2-5.
48. M. J. Powell, "A method for nonlinear constraints in minimization problems, " in Optimization. London, U.K.: Academic Press, 1969, pp. 283-298.
49. D. Gabay, B. Mercier, "A dual algorithm for the solution of nonlinear variational problems via finite element approximation, " Comput. Math. Appl., vol. 2, no. 1, pp. 17-40, 1976.
50. J.-F. Cai, E. J. Candès, Z. Shen, "A singular value thresholding algorithm for matrix completion, " SIAM J. Optim., vol. 20, no. 4, pp. 1956-1982, 2010.
51. J. Yang, W. Yin, Y. Zhang, Y. Wang, "A fast algorithm for edgepreserving variational multichannel image restoration, " SIAM J. Imag. Sci., vol. 2, no. 2, pp. 569-592, 2009.
52. D. Coppersmith, S. Winograd, "Matrix multiplication via arithmetic progressions, " in Proc. ACM Symp. Theory Comput., 1987, pp. 1-6.
53. R. Gopalan, R. Li, R. Chellappa, "Domain adaptation for object recognition: An unsupervised approach, " in Proc. ICCV, Barcelona, Spain, 2011, pp. 999-1006.
54. B. Gong, Y. Shi, F. Sha, K. Grauman, "Geodesic flow kernel for unsupervised domain adaptation, " in Proc. CVPR, Providence, RI, USA, 2012, pp. 2066-2073.
55. X.-Y. Jing, et al., "Uncorrelated multi-view discrimination dictionary learning for recognition, " in Proc. AAAI, 2014, pp. 2787-2795.
56. B. Tan, E. Zhong, E. W. Xiang, Q. Yang, "Multi-transfer: Transfer learning with multiple views, multiple sources, " Stat. Anal. Data Min. ASA Data Sci. J., vol. 7, no. 4, pp. 282-293, 2014.
57. M. Turk, A. Pentland, "Eigenfaces for recognition, " J. Cogn. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.
58. P. N. Belhumeur, J. P. Hespanha, D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
59. K.-C. Lee, J. Ho, D. J. Kriegman, "Acquiring linear subspaces for face recognition under variable lighting, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5, pp. 684-698, May 2005.
60. D. Cai, X. He, J. Han, "Spectral regression for efficient regularized subspace learning, " in Proc. ICCV, 2007, pp. 1-8.
61. T. Sim, S. Baker, M. Bsat, "The CMU pose, illumination, expression (PIE) database, " in Proc. FG, Washington, DC, USA, 2002, pp. 46-51.
62. S. Si, D. Tao, B. Geng, "Bregman divergence-based regularization for transfer subspace learning, " IEEE Trans. Knowl. Data Eng., vol. 22, no. 7, pp. 929-942, Jul. 2010.
63. Z. Ding, Y. Fu, "Robust multi-view subspace learning through dual low-rank decompositions, " in Proc. AAAI, Phoenix, AZ, USA, 2016, pp. 1181-1187.