Multiview hessian regularization for image annotation

IEEE Transactions on Image Processing

Volumn 22, Issue 7, 2013, Pages 2676-2687

  Liu, Weifeng ^a   Tao, Dacheng ^b  

^a CHINA UNIVERSITY OF PETROLEUM   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Hessian; image annotation; manifold learning; multiview learning; semisupervised learning (SSL)

Indexed keywords

HESSIAN; IMAGE ANNOTATION; MANIFOLD LEARNING; MULTI-VIEW LEARNING; SEMI-SUPERVISED LEARNING (SSL);

LAPLACE TRANSFORMS; LEARNING ALGORITHMS; SUPERVISED LEARNING;

IMAGE ANALYSIS;

EID: 84877887638     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2013.2255302     Document Type: Article

References (52)

1. R. B. Francis, R. L. Gert, and I. J. Michael, "Multiple kernel learning, conic duality, and the SMO algorithm," in Proc. 21st Int. Conf. Mach. Learn., 2004, pp. 41-48.
2. M. Belkin and P. Niyogi, "Laplacian eigenmaps and spectral techniques for embedding and clustering," in Proc. Adv. Neural Inf. Process. Syst., 2001, pp. 585-591.
3. M. Belkin, P. Niyogi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from labeled and unlabeled examples," J. Mach. Learn. Res., vol. 7, no. 11, pp. 2399-2434, Nov. 2006. (Pubitemid 44708005)
4. C. B. James and R. J. Hathaway, "Convergence of alternating optimization," Neural, Parallel Sci. Comput., vol. 11, no. 4, pp. 351-368, 2003. (Pubitemid 37506735)
5. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training," in Proc. 11th Annu. Conf. Comput. Learn. Theory, 1998, pp. 92-100.
6. U. Brefeld and T. Scheffer, "Semi-supervised learning for structured output variables," in Proc. 23rd Int. Conf. Mach. Learn., 2006, pp. 145-152.
7. L. Cao, Z. Liu, and T. S. Huang, "Cross-dataset action recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 1998-2005.
8. L. Cao, J. Luo, H. Kautz, and T. S. Huang, "Image annotation within the context of personal photo collections using hierarchical event and scene models," IEEE Trans. Multimedia, vol. 11, no. 2, pp. 208-219, Feb. 2009.
9. O. Chapelle and A. Zien, "Semi-supervised classification by low density separation," in Proc. Int. Conf. Artif. Intell. Stat., 2005, pp. 57-64.
10. R. Collobert, F. Sinz, J. Weston, and L. Bottou, "Large scale transductive SVMs," J. Mach. Learn. Res., vol. 7, pp. 1687-1712, Jun. 2006. (Pubitemid 44223088)
11. S. Dasgupta, M. L. Littman, and D. McAllester, "PAC generalization bounds for co-training," in Proc. Adv. Neural Inf. Process. Syst., Dec. 2001, pp. 375-382.
12. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Royal Stat. Soc. Ser. B, Methdol., vol. 39, no. 1, pp. 1-38, 1977.
13. D. L. Donoho and C. Grimes, "Hessian eigenmaps: New locally linear embedding techniques for high-dimensional data," Proc. Nat. Acad. Sci. United States Amer., vol. 100, no. 10, pp. 5591-5596, May 2003. (Pubitemid 36576852)
14. J. Eells and L. Lemaire, Selected Topics in Harmonic Maps. Providence, RI, USA: American Mathematical Society, 1983.
15. A. Elmoataz, O. Lezoray, and S. Bougleux, "Nonlocal discrete regularization on weighted graphs: A framework for image and manifold processing," IEEE Trans. Image Process., vol. 17, no. 7, pp. 1047-1060, Jul. 2008.
16. M. Everingham, L. V. Gool, C. Williams, J. Winn, and A. Zisserman, "The PASCAL visual object classes (VOC) challenge," Int. J. Comput. Vis., vol. 88, no. 2, pp. 303-338, 2007.
17. M. Everingham, L. Van Gool, C. Williams, J. Winn, and A. Zisserman, "The PASCAL visual object classes challenge," in Proc. 2th PASCAL Challenge Workshop, 2009, pp. 1-17.
18. J. D. R. Farquhar, D. R. Hardoon, H. Meng, S. Szedmak, and J. S. Taylor, "Two view learning: SVM-2K, theory and practice," in Proc. Adv. Neural Inf. Process. Syst., 2006, pp. 355-362.
19. A. Fujino, N. Ueda, and K. Saito, "A hybrid generative/ discriminative approach to semi-supervised classifier design," in Proc. Nat. Conf. Artif. Intell., 2005, pp. 764-769. (Pubitemid 43006701)
20. B. Geng, D. Tao, C. Xu, L. Yang, and X.-S. Hua, "Ensemble manifold regularization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 6, pp. 1227-1233, Jun. 2012.
21. M. Gönen and E. Alpaydm, "Multiple kernel learning algorithms," J. Mach. Learn. Res., vol. 12, pp. 2211-2268, Jul. 2011.
22. N. Guan, D. Tao, Z. Luo, and B. Yuan, "Non-negative patch alignment framework," IEEE Trans. Neural Netw., vol. 22, no. 8, pp. 1218-1230, Aug. 2011.
23. N. Guan, D. Tao, Z. Luo, and B. Yuan, "NeNMF: An optimal gradient method for nonnegative matrix factorization," IEEE Trans. Signal Process., vol. 60, no. 6, pp. 2882-2898, Jun. 2012.
24. N. Guan, D. Tao, Z. Luo, and B. Yuan, "Online nonnegative matrix factorization with robust stochastic approximation," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 7, pp. 1087-1099, May 2012.
25. N. Guan, D. Tao, Z. Luo, and J. Shawe-Taylor, "MahNMF: Manhattan non-negative matrix factorization," arXiv:1207.3438v1
26. M. Guillaumin, J. Verbeek, and C. Schmid, "Multimodal semisupervised learning for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jul. 2010, pp. 902-909.
27. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, MA, USA: Cambridge University Press, 1990.
28. R. Jones, Learning to Extract Entities from Labeled and Unlabeled Text. Pittsburgh, PA, USA: Carnegie Mellon Univ., 2005.
29. K. I. Kim, F. Steinke, and M. Hein, "Semi-supervised regression using Hessian energy with an application to semi-supervised dimensionality reduction," in Proc. Adv. Neural Inf. Process. Syst., 2009, pp. 979-987.
30. G. R. G. Lanckriet, N. Cristianini, P. Bartlett, E. G. Laurent, and I. J. Michael, "Learning the kernel matrix with semidefinite programming," J. Mach. Learn. Res., vol. 5, pp. 27-72, Jul. 2004.
31. Y. Luo, D. Tao, B. Geng, C. Xu, and S. J. Maybank, "Manifold regularized multitask learning for semi-supervised multilabel image classification," IEEE Trans. Image Process., vol. 22, no. 2, pp. 523-536, Feb. 2013.
32. B. McFee, C. Galleguillos, and G. Lanckriet, "Contextual object localization with multiple kernel nearest neighbor," IEEE Trans. Image Process., vol. 20, no. 2, pp. 570-585, Feb. 2011.
33. D. J. Miller and H. S. Uyar, "A mixture of experts classifier with learning based on both labelled and unlabelled data," Adv. Neural Inf. Process. Syst., Dec. 1996, pp. 571-577.
34. Y. Nesterov, "Smooth minimization of non-smooth functions," Math. Program., vol. 103, no. 1, pp. 127-152, May 2005. (Pubitemid 40537674)
35. K. Nigam and R. Ghani, "Analyzing the effectiveness and applicability of co-training," in Proc. 9th Int. Conf. Inf. Knowl. Manage., 2000, pp. 86-93.
36. K. Nigam, A. K. Maccallum, S. Thrun, and T. Mitchell, "Text classification from labeled and unlabeled documents using EM," Mach. Learn., vol. 39, no. 2, pp. 103-134, May-Jun. 2000. (Pubitemid 30594822)
37. S. Nilufar, N. Ray, and H. Zhang, "Object detection with DoG scalespace: A multiple kernel learning approach," IEEE Trans. Image Process., vol. 21, no. 8, pp. 3744-3756, Apr. 2012.
38. S. Sonnenburg, G. Rätsch, C. Schäfer, and B. Schölkopf, "Large scale multiple kernel learning," J. Mach. Learn. Res., vol. 7, pp. 1531-1565, Jul. 2006. (Pubitemid 44373694)
39. F. Steinke and M. Hein, "Non-parametric regression between manifolds," in Proc. Adv. Neural Inf. Process. Syst., Dec. 2008, pp. 1561-1568.
40. D. Tao, X. Tang, X. Li, and X. Wu, "Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 7, pp. 1088-1099, Sep. 2006.
41. D. Tao, X. Li, X. Wu, W. Hu, and S. J. Maybank, "Supervised tensor learning," Knowl. Inf. Syst., vol. 13, no. 1, pp. 1-42, 2007.
42. D. Tao, X. Li, X. Wu, and S. J. Maybank, "General tensor discriminant analysis and gabor features for gait recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 10, pp. 1700-1715, Oct. 2007.
43. D. Tao, X. Li, X. Wu, and S. J. Maybank, "Geometric mean for subspace selection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 260-274, Feb. 2009.
44. X. Tian, L. Yang, J. Wang, X. Wu, and X.-S. Hua, "Bayesian visual reranking," IEEE Trans. Multimedia, vol. 13, no. 4, pp. 639-652, Aug. 2011.
45. X. Tian, D. Tao, X.-S. Hua, and X. Wu, "Active reranking for web image search," IEEE Trans. Image Process., vol. 19, no. 3, pp. 805-820, Mar. 2010.
46. X. Tian, D. Tao, and Y. Rui, "Sparse transfer learning for interactive video search reranking," ACM Trans. Multimedia Comput. Commun. Appl., vol. 8, no. 3, pp. 26-28, Jul. 2012.
47. V. N. Vapnic, Statistical Learning Theory. New York, NY, USA: John Wiley, 1998.
48. M. Wang, X.-S. Hua, R. Hong, J. Tang, G.-J. Qi, and Y. Song, "Unified video annotation via multigraph learning," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 5, pp. 733-346, May 2009.
49. M. Wang, K. Yang, X.-S. Hua, and H.-J. Zhang, "Towards relevant and diverse search of social images," IEEE Trans. Multimedia, vol. 12, no. 8, pp. 829-842, Dec. 2010.
50. T. Xia, D. Tao, T. Mei, and Y. Zhang, "Multiview spectral embedding," IEEE Trans. Syst. Man, Cybern. Part B, Cybern., vol. 40, no. 6, pp. 1438-1446, Feb. 2010.
51. B. Xie, Y. Mu, D. Tao, and K. Huang, "M-SNE: Multiview stochastic neighbor embedding," IEEE Trans. Syst. Man, and Cybern. Part B, Cybern., vol. 41, no. 4, pp. 1088-1096, Feb. 2011.
52. X. Zhu, "Semi-supervised learning literature survey contents," Dept. Comput. Sci., Madison, WI, USA Univ., Tech. Rep. 1530, 2005.