Sparse unsupervised dimensionality reduction for multiple view data

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 22, Issue 10, 2012, Pages 1485-1496

  Han, Yahong ^a   Wu, Fei ^b   Tao, Dacheng ^c   Shao, Jian ^b   Zhuang, Yueting ^b   Jiang, Jianmin ^a  

^a TIANJIN UNIVERSITY   (China)

^b ZHEJIANG UNIVERSITY   (China)

^c UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Multiple view data; structured sparsity; video and image classification

Indexed keywords

BASE MATRIX; DIMENSIONALITY REDUCTION; DISCRIMINATIVE FEATURES; HETEROGENEOUS FEATURES; HIGH-DIMENSIONAL; IMAGE DATA; LEARNED PATTERNS; MULTI-VIEW LEARNING; MULTI-VIEWS; MULTIPLE VIEWS; ORTHOGONAL CONSTRAINTS; SHARED INFORMATION; SHARING INFORMATION; SINGLE IMAGES; STATISTICAL PROPERTIES; STRUCTURED INFORMATION; STRUCTURED SPARSITY; VISUAL FEATURE; WEB IMAGES;

ALGORITHMS; IMAGE CLASSIFICATION; MATRIX ALGEBRA; OPTIMIZATION;

LOADING;

EID: 84867068830     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2012.2202075     Document Type: Article

References (38)

1. F. Korn, B. Pagel, and C. Faloutsos, "On the dimensionality curse and the self-similarity blessing," IEEE Trans. Know. Data Eng., vol. 13, no. 1, pp. 96-111, Jan.-Feb. 2001.
2. I. Jolliffe, "Principal component analysis," in Encyclopedia of Statistics in Behavioral Science. New York: Springer, 2002.
3. W. Dou, G. Dai, C. Xu, and Z. Zhang, "Sparse unsupervised dimensionality reduction algorithms," in Proc. Eur. Conf. Mach. Learn. Know. Discovery Databases, 2010, pp. 361-376.
4. S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, 2000. (Pubitemid 32041578)
5. J. Tenenbaum, V. Silva, and J. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, p. 2319, 2000.
6. L. Cao, J. Luo, F. Liang, and T. Huang, "Heterogeneous feature machines for visual recognition," in Proc. IEEE Int. Conf. Comput. Vision, Sep.-Oct. 2009, pp. 1095-1102.
7. F. Wu, Y. Han, Q. Tian, and Y. Zhuang, "Multi-label boosting for image annotation by structural grouping sparsity," in Proc. Int. Conf. Multimedia (ACM MM), 2010, pp. 15-24.
8. F. Wu, Y. Liu, and Y. Zhuang, "Tensor-based transductive learning for multimodality video semantic concept detection," IEEE Trans. Multimedia, vol. 11, no. 5, pp. 868-878, Aug. 2009.
9. Y. Han, J. Shao, F. Wu, and B. Wei, "Multiple hypergraph ranking for video concept detection," J. Zhejiang Univ.-Sci. C, vol. 11, no. 7, pp. 525-537, 2010.
10. H. Hotelling, "Relations between two sets of variates," Biometrika, vol. 28, nos. 3-4, p. 321, 1936.
11. S. Bickel and T. Scheffer, "Multi-view clustering," in Proc. IEEE Int. Conf. Data Mining, Nov. 2004, pp. 19-26. (Pubitemid 40731009)
12. B. Long, P. Yu, and Z. Zhang, "A general model for multiple view unsupervised learning," in Proc. 8th SIAM Int. Conf. Data Mining (SDM), 2008, pp. 822-833.
13. D. Zhou and C. Burges, "Spectral clustering and transductive learning with multiple views," in Proc. 24th Int. Conf. Mach. Learn. (ICML), 2007, pp. 1159-1166.
14. T. Diethe, D. Hardoon, and J. Shawe-Taylor, "Multiview Fisher discriminant analysis," in Proc. NIPS Workshop Learn. Multiple Sources Applicat. Robot., 2008, pp. 1-8.
15. N. Chen, J. Zhu, and E. Xing, "Predictive subspace learning for multiview data: A large margin approach," in Proc. Adv. Neural Inform. Process. Syst., vol. 23. 2010, pp. 361-369.
16. V. Sindhwani, P. Niyogi, and M. Belkin, "A co-regularization approach to semi-supervised learning with multiple views," in Proc. Workshop Learn. Multiple Views ICML, 2005, pp. 74-79.
17. T. Xia, D. Tao, T. Mei, and Y. Zhang, "Multiview spectral embedding," IEEE Trans. Syst., Man, Cybern., Part B, Cybern., vol. 40, no. 6, pp. 1438-1446, Dec. 2010.
18. Y. Jia, M. Salzmann, and T. Darrell, "Factorized latent spaces with structured sparsity," in Proc. Adv. Neural Inform. Process. Syst., vol. 23. 2010, pp. 982-990.
19. M. Yuan and Y. Lin, "Model selection and estimation in regression with grouped variables," J. Royal Statist. Soc., Series B (Statist. Methodol.), vol. 68, no. 1, pp. 49-67, 2006. (Pubitemid 43415335)
20. R. Jenatton, J. Audibert, and F. Bach, "Structured variable selection with sparsity-inducing norms," J. Mach. Learn. Res., vol. 12, pp. 2777-2824, Oct. 2011.
21. R. Jenatton, G. Obozinski, and F. Bach, "Structured sparse principal component analysis," in Proc. 12th Int. Conf. Artif. Intell. Statist. (AISTATS), 2009, pp. 57-64.
22. R. Jenatton, J. Mairal, G. Obozinski, and F. Bach, "Proximal methods for sparse hierarchical dictionary learning," in Proc. Int. Conf. Mach. Learn. (ICML), 2010, pp. 487-494.
23. H. Lee, A. Battle, R. Raina, and A. Ng, "Efficient sparse coding algorithms," in Proc. Adv. Neural Inform. Process. Syst., vol. 19. 2007, pp. 801-808.
24. P. Hoyer, "Non-negative matrix factorization with sparseness constraints," J. Mach. Learn. Res., vol. 5, pp. 1457-1469, Dec. 2004.
25. I. Jolliffe, N. Trendafilov, and M. Uddin, "A modified principal component technique based on the lasso," J. Computat. Graphic. Statist., vol. 12, no. 3, pp. 531-547, 2003. (Pubitemid 37239916)
26. H. Zou, T. Hastie, and R. Tibshirani, "Sparse principal component analysis," J. Computat. Graphic. Statist., vol. 15, no. 2, pp. 265-286, 2006. (Pubitemid 43935978)
27. Y. Yuan, X. Li, Y. Pang, X. Lu, and D. Tao, "Binary sparse nonnegative matrix factorization," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 5, pp. 772-777, May 2009.
28. Y. Yang, H. Shen, Z. Ma, Z. Huang, and X. Zhou, "L21-norm regularized discriminative feature selection for unsupervised learning," in Proc. 22nd Int. Joint Conf. Artif. Intell. (IJCAI), 2011, pp. 1589-1594.
29. S. Kim and E. Xing, "Tree-guided group lasso for multi-task regression with structured sparsity," in Proc. 27th Int. Conf. Mach. Learn. (ICML), 2010, pp. 543-550.
30. R. Tibshirani, "Regression shrinkage and selection via the lasso," J. Royal Statist. Soc. Series B (Methodol.), vol. 58, no. 1, pp. 267-288, 1996.
31. G. Golub and C. Van Loan, Matrix Computations. Baltimore, MD: Johns Hopkins Univ. Press, 1996.
32. T. Chua, J. Tang, R. Hong, H. Li, Z. Luo, and Y. Zheng, "NUS-WIDE: A real-world web image database from National University of Singapore," in Proc. ACM Int. Conf. Image Video Retriev., 2009, pp. 1-9.
33. S. Saponara, K. Denolf, G. Lafruit, C. Blanch, and J. Bormans, "Performance and complexity co-evaluation of the advanced video coding standard for cost-effective multimedia communications," EURASIP J. Appl. Signal Process., vol. 2004, pp. 220-235, Jan. 2004.
34. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
35. Z. Zhou and M. Zhang, "Multi-instance multi-label learning with application to scene classification," in Proc. Adv. Neural Inform. Process. Syst., vol. 19. 2007, p. 1609.
36. M. Wang, L. Yang, and X. Hua, "MSRA-MM: Bridging research and industrial societies for multimedia information retrieval," Microsoft Research Asia, Beijing, China, Tech. Rep. MSR-TR-2009-30, Mar. 2009.
37. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vision, vol. 60, no. 2, pp. 91-110, 2004.
38. T. Fawcett, "An introduction to ROC analysis," Patt. Recog. Lett., vol. 27, no. 8, pp. 861-874, 2006.