Semisupervised feature analysis by mining correlations among multiple tasks

IEEE Transactions on Neural Networks and Learning Systems

Volumn 28, Issue 10, 2016, Pages 2294-2305

  Chang, Xiaojun ^a   Yang, Yi ^a  

^a UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

3 D motion data analysis; Gene pattern recognition; Image annotation; Multitask feature selection; Semisupervised learning.

Indexed keywords

ALGORITHMS;

COMMON STRUCTURES; FAST CONVERGENCE; FEATURE SELECTION ALGORITHM; FEATURE SPACE ANALYSIS; MANIFOLD LEARNING; MULTIMEDIA APPLICATIONS; OBJECTIVE FUNCTIONS; SELECTION FRAMEWORK;

FEATURE EXTRACTION;

EID: 84978974837     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2016.2582746     Document Type: Article

References (55)

1. L. Yu and H. Liu, "Feature selection for high-dimensional data: A fast correlation-based filter solution," in Proc. ICML, 2003, pp. 1-8.
2. L. Talavera, "An evaluation of filter and wrapper methods for feature selection in categorical clustering," in Proc. IDA, 2005, pp. 440-451.
3. S. HongYang and B.-G. Hu, "Discriminative feature selection by nonparametric Bayes error minimization," IEEE Trans. Knowl. Data Eng., vol. 24, no. 8, pp. 1422-1434, Aug. 2012.
4. X. Chang, F. Nie, S.Wang, Y. Yang, X. Zhou, and C. Zhang, "Compound rank-k projections for bilinear analysis," IEEE Trans. Neural Netw. Learn. Syst., vol. 27, no. 7, pp. 1502-1513, Jul. 2015.
5. Z. Ma, F. Nie, Y. Yang, J. R. R. Uijlings, and N. Sebe, "Web image annotation via subspace-sparsity collaborated feature selection," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1021-1030, Aug. 2012.
6. Z. Ma, F. Nie, Y. Yang, J. R. R. Uijlings, N. Sebe, and A. G. Hauptmann, "Discriminating joint feature analysis for multimedia data understanding," IEEE Trans. Multimedia, vol. 14, no. 6, pp. 1662-1672, Dec. 2012.
7. Y. Yang, Z. Ma, A. G. Hauptmann, and N. Sebe, "Feature selection for multimedia analysis by sharing information among multiple tasks," IEEE Trans. Multimedia, vol. 15, no. 3, pp. 661-669, Apr. 2013.
8. H. Liu and L. Yu, "Toward integrating feature selection algorithms for classification and clustering," IEEE Trans. Knowl. Data Eng., vol. 17, no. 4, pp. 491-502, Apr. 2005.
9. J.-B. Yang and C.-J. Ong, "An effective feature selection method via mutual information estimation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 6, pp. 1550-1559, Dec. 2012.
10. Z. Ma, Y. Yang, F. Nie, N. Sebe, S. Yan, and A. G. Hauptmann, "Harnessing lab knowledge for real-world action recognition," Int. J. Comput. Vis., vol. 109, nos. 1-2, pp. 60-73, 2014.
11. J. Gui, Z. Sun, S. Ji, D. Tao, and T. Tan, "Feature selection based on structured sparsity: A comprehensive study," IEEE Trans. Neural Netw. Learn. Syst., to be published.
12. X. Zhu, X. Li, S. Zhang, C. Ju, and X. Wu, "Robust joint graph sparse coding for unsupervised spectral feature selection," IEEE Trans. Neural Netw. Learn. Syst., to be published.
13. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. New York, NY, USA: Wiley, 2012.
14. F. Nie, H. Huang, X. Cai, and C. H. Ding, "Efficient and robust feature selection via joint 2,1-norms minimization," in Proc. NIPS, 2010, pp. 1-9.
15. R. Caruana, "Multitask learning," Mach. Learn., vol. 28, no. 1, pp. 41-75, 1997.
16. A. Argyriou, T. Evgeniou, and M. Pontil, "Convex multi-task feature learning," Mach. Learn., vol. 73, no. 3, pp. 243-272, 2008.
17. A. Argyriou and T. Evgeniou, "Multi-task feature learning," in Proc. NIPS, 2007, pp. 1-8.
18. S. Wang, X. Chang, X. Li, Q. Z. Shen, and W. Chen, "Multi-task support vector machines for feature selection with shared knowledge discovery," Signal Process., vol. 120, pp. 746-753, Mar. 2016.
19. Z. Zhao, L. Wang, and H. Liu, "Efficient spectral feature selection with minimum redundancy," in Proc. AAAI, 2010, pp. 673-678.
20. S. Xiang, F. Nie, G. Meng, C. Pan, and C. Zhang, "Discriminative least squares regression for multiclass classification and feature selection," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 11, pp. 1738-1754, Nov. 2012.
21. F. Nie, D. Xu, I. W. Tsang, and C. Zhang, "Flexible manifold embedding: A framework for semi-supervised and unsupervised dimension reduction," IEEE Trans. Image Process., vol. 19, no. 7, pp. 1921-1932, Jul. 2010.
22. Y. Yang, H. T. Shen, Z. Ma, Z. Huang, and X. Zhou, " 2,1-norm regularized discriminative feature selection for unsupervised learning," in Proc. IJCAI, 2011, pp. 1589-1594.
23. Z. Zheng and H. Liu, "Spectral feature selection for supervised and unsupervised learning," in Proc. ICML, 2007, pp. 1151-1157.
24. X. Zhu, "Semi-supervised learning literature survey," Dept. Comput. Sci., Univ. Wisconsin-Madison, Madison, WI, USA, Tech. Rep. TR 1530, 2006.
25. R. G. F. Soares, H. Chen, and X. Yao, "Semisupervised classification with cluster regularization," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 11, pp. 1779-1792, Nov. 2012.
26. F. Wang, "Semisupervised metric learning by maximizing constraint margin," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 4, pp. 931-939, Aug. 2011.
27. I. Cohen, F. G. Cozman, N. Sebe, M. C. Cirelo, and T. S. Huang, "Semisupervised learning of classifiers: Theory, algorithms, and their application to human-computer interaction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 12, pp. 1553-1566, Dec. 2004.
28. M. Guillaumin, J. Verbeek, and C. Schmid, "Multimodal semisupervised learning for image classification," in Proc. CVPR, 2010, pp. 902-909.
29. X. Chang, F. Nie, Y. Yang, and H. Huang, "A convex formulation for semi-supervised multi-label feature selection," in Proc. AAAI, 2014, pp. 1171-1177.
30. F. Nie, D. Xu, X. Li, and S. Xiang, "Semisupervised dimensionality reduction and classification through virtual label regression," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 3, pp. 675-685, Jun. 2011.
31. Y. Yang, D. Xu, F. Nie, J. Luo, and Y. Zhuang, "Ranking with local regression and global alignment for cross media retrieval," in Proc. ACM Multimedia, 2009, pp. 175-184.
32. Y. Liu, F. Nie, J. Wu, and L. Chen, "Efficient semi-supervised feature selection with noise insensitive trace ratio criterion," Neurocomputing, vol. 105, pp. 12-18, Apr. 2012.
33. X. Chang, H. Shen, S. Wang, J. Liu, and X. Li, "Semi-supervised feature analysis for multimedia annotation by mining label correlation," in Proc. PAKDD, 2014, pp. 74-85.
34. T. Jebara, J.Wang, and S.-F. Chang, "Graph construction and b-matching for semi-supervised learning," in Proc. ICML, 2009, pp. 441-448.
35. F. Nie, S. Xiang, Y. Jia, and C. Zhang, "Semi-supervised orthogonal discriminant analysis via label propagation," Pattern Recognit., vol. 42, no. 11, pp. 2615-2627, 2009.
36. Y. Yang, Z. Ma, F. Nie, X. Chang, and A. G. Hauptmann, "Multi-class active learning by uncertainty sampling with diversity maximization," Int. J. Comput. Vis., vol. 113, no. 2, pp. 113-127, 2014.
37. Y. Yang, D. Xu, F. Nie, S. Yan, and Y. Zhuang, "Image clustering using local discriminant models and global integration," IEEE Trans. Image Process., vol. 19, no. 10, pp. 2761-2773, Oct. 2010.
38. J. Chen, J. Zhou, and J. Ye, "Integrating low-rank and group-sparse structures for robust multi-task learning," in Proc. ACM SIGKDD, 2011, pp. 42-50.
39. F. Wu, Y. Han, Q. Tian, and Y. Zhuang, "Multi-label boosting for image annotation by structural grouping sparsity," in Proc. ACM MM, 2010, pp. 15-24.
40. G. Obozinski, B. Taskar, and M. I. Jordan, "Joint covariate selection and joint subspace selection for multiple classification problems," Statist. Comput., vol. 20, no. 2, pp. 231-252, Apr. 2010.
41. Y. Yang, Y.-T. Zhuang, F. Wu, and Y.-H. Pan, "Harmonizing hierarchical manifolds for multimedia document semantics understanding and crossmedia retrieval," IEEE Trans. Multimedia, vol. 10, no. 3, pp. 437-446, Apr. 2008.
42. Y.-Y. Lin, T.-L. Liu, and H.-T. Chen, "Semantic manifold learning for image retrieval," in Proc. ACM Multimedia, 2005, pp. 249-258.
43. Y.-G. Jiang, G. Ye, S.-F. Chang, D. Ellis, and A. C. Loui, "Consumer video understanding: A benchmark database and an evaluation of human and machine performance," in Proc. ICMR, 2011, Art. no. 29.
44. T.-S. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y.-T. Zheng, "NUS-WIDE: A real-world Web image database from National University of Singapore," in Proc. ACM Conf. Image Video Retr. (CIVR), Santorini, Greece, Jul. 2009, Art. no. 48.
45. H. Kuehne, H. Jhuang, E. Garrote, T. Poggio, and T. Serre, "HMDB: A large video database for human motion recognition," in Proc. ICCV, 2011, pp. 2556-2563.
46. S. Leonid and M. J. Black, "HumanEva: Synchronized video and motion capture dataset for evaluation of articulated human motion," Dept. Comput. Sci., Brown Univ., Providence, RI, USA, Tech. Rep. CS-06-08, 2006.
47. T. R. Golub et al., "Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring," Science, vol. 286, no. 5439, pp. 531-537, 1999.
48. M. A. Shipp et al., "Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning," Nature Med., vol. 8, no. 1, pp. 68-74, 2002.
49. S. Ramaswamy et al., "Multiclass cancer diagnosis using tumor gene expression signatures," Proc. Nat. Acad. Sci., vol. 98, no. 26, pp. 15149-15154, 2001.
50. J. Zhao, K. Lu, and X. He, "Locality sensitive semi-supervised feature selection," Neurocomputing, vol. 71, nos. 10-12, pp. 1842-1849, Jun. 2008.
51. Z. Xu, I. King, M. R.-T. Lyu, and R. Jin, "Discriminative semisupervised feature selection via manifold regularization," IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1033-1047, Jul. 2010.
52. Y. Han, Y. Yang, Y. Yan, Z. Ma, N. Sebe, and X. Zhou, "Semisupervised feature selection via spline regression for video semantic recognition," IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 2, pp. 252-264, Feb. 2015.
53. H. Wang, A. Kläser, C. Schmid, and C. L. Liu, "Action recognition by dense trajectories," in Proc. CVPR, 2011, pp. 3169-3176.
54. H. Wang and C. Schmid, "Action recognition with improved trajectories," in Proc. ICCV, 2013, pp. 3551-3558.
55. H. Ning, W. Xu, Y. Gong, and T. Huang, "Discriminative learning of visual words for 3D human pose estimation," in Proc. CVPR, 2008, pp. 1-8.