Multi-task rank learning for visual saliency estimation

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 5, 2011, Pages 623-636

  Li, Jia ^a,b   Tian, Yonghong ^c   Huang, Tiejun ^c   Gao, Wen ^c  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^b UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^c Peking University   (China)

Author keywords

Generalization ability; multi task learning; pair wise rank learning; visual saliency

Indexed keywords

DATA SETS; GENERALIZATION ABILITY; INTELLIGENT VIDEO; MULTITASK LEARNING; PAIR-WISE RANK LEARNING; POOR PERFORMANCE; RANK LEARNING; STATE-OF-THE-ART METHODS; UNIFIED MODEL; VIDEO APPLICATIONS; VIDEO RETARGETING; VISUAL FEATURE; VISUAL SALIENCY; VISUAL SALIENCY MODEL;

ESTIMATION; LEARNING ALGORITHMS;

VISUALIZATION;

EID: 79955597004     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2129430     Document Type: Article

References (41)

1. A. M. Treisman and G. Gelade, "A feature-integration theory of attention," Cognitive Psychol., vol. 12, no. 1, pp. 97-136, 1980.
2. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
3. L. Itti and C. Koch, "Computational modeling of visual attention," Nature Rev. Neurosci., vol. 2, no. 3, pp. 194-203, 2001.
4. L. Itti and P. Baldi, "A principled approach to detecting surprising events in video," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2005, pp. 631-637. (Pubitemid 43897253)
5. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2007, pp. 1-8.
6. C. Guo, Q. Ma, and L. Zhang, "Spatio-temporal saliency detection using phase spectrum of quaternion Fourier transform," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2008, pp. 1-8.
7. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Advances in Neural Information Processing Systems, vol. 19. Cambridge, MA: MIT Press, 2007, pp. 545-552.
8. Y. Zhai and M. Shah, "Visual attention detection in video sequences using spatiotemporal cues," in Proc. ACM Int. Conf. Multimedia, 2006, pp. 815-824. (Pubitemid 47113641)
9. W. Kienzle, F. A. Wichmann, B. Scholkopf, and M. O. Franz, "A nonparametric approach to bottom-up visual saliency," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2007, pp. 689-696.
10. V. Navalpakkam and L. Itti, "Search goal tunes visual features optimally," Neuron, vol. 53, no. 4, pp. 605-617, Feb. 2007. (Pubitemid 46216750)
11. R. J. Peters and L. Itti, "Beyond bottom-up: Incorporating task-dependent influences into a computational model of spatial attention," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2007, pp. 1-8.
12. L. Jacob, F. Bach, and J.-P. Vert, "Clustered multi-task learning: A convex formulation," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2008, pp. 745-752.
13. A. Argyriou, T. Evgeniou, and M. Pontil, "Multi-task feature learning," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2007, pp. 41-48.
14. L. Itti, "Crcns data sharing: Eye movements during free-viewing of natural videos," in Proc. Collaborative Res. Comput. Neurosci. Annu. Meeting, Jun. 2008, pp. 1-4.
15. Y. Freund, R. Iyer, R. E. Schapire, Y. Singer, and G. Dietterich, "An efficient boosting algorithm for combining preferences," J. Mach. Learning Res., vol. 4, pp. 170-178, Dec. 2004.
16. T. Joachims, "Training linear SVMS in linear time," in Proc. ACM Conf. Knowl. Discovery Data Mining, 2006, pp. 217-226. (Pubitemid 44535518)
17. L. Itti, G. Rees, and J. Tsotsos, Neurobiology of Attention. San Diego, CA: Elsevier, 2005.
18. C. Frith, "The top in top-down attention," in Neurobiological Attention, L. Itti, G. Rees, and J. K. Tsotsos, Eds., 1st ed. Amsterdam, The Netherlands: Elsevier Press, 2005, pp. 105-108.
19. D. Walther and C. Koch, "Modeling attention to salient proto-objects," Neural Netw., vol. 19, no. 9, pp. 1395-1407, 2006. (Pubitemid 44708603)
20. S. Marat, T. H. Phuoc, L. Granjon, N. Guyader, D. Pellerin, and A. Guerin-Dugue, "Modeling spatio-temporal saliency to predict gaze direction for short videos," Int. J. Comput. Vision, vol. 82, no. 3, pp. 231-243, 2009.
21. Y. Hu, D. Rajan, and L.-T. Chia, "Robust subspace analysis for detecting visual attention regions in images," in Proc. ACM Int. Conf. Multimedia, 2005, pp. 716-724.
22. H. Liu, S. Jiang, Q. Huang, C. Xu, and W. Gao, "Region-based visual attention analysis with its application in image browsing on small displays," in Proc. ACM Int. Conf. Multimedia, 2007, pp. 305-308.
23. M. Cerf, J. Harel, W. Einhauser, and C. Koch, "Predicting human gaze using low-level saliency combined with face detection," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2008, pp. 241-248.
24. G. Abdollahian, Z. Pizlo, and E. J. Delp, "A study on the effect of camera motion on human visual attention," in Proc. IEEE Int. Conf. Image Process., Oct. 2008, pp. 693-696.
25. Y.-F. Ma, X.-S. Hua, L. Lu, and H.-J. Zhang, "A generic framework of user attention model and its application in video summarization," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 907-919, Oct. 2005. (Pubitemid 41452519)
26. M. M. Chun, "Contextual guidance of visual attention," in Neurobi-ological Attention, L. Itti, G. Rees, and J. K. Tsotsos, Eds., 1st ed. Amsterdam, The Netherlands: Elsevier Press, pp. 246-250, 2005.
27. W. Kienzle, B. Scholkopf, F. A. Wichmann, and M. O. Franz, "How to find interesting locations in video: A spatiotemporal interest point detector learned from human eye movements," in Proc. 29th DAGM Symp., 2007, pp. 405-414.
28. D. Pang, A. Kimura, T. Takeuchi, J. Yamato, and K. Kashino, "A stochastic model of selective visual attention with a dynamic Bayesian network," in Proc. IEEE Int. Conf. Multimedia and Expo, Jun. 2008, pp. 1073-1076.
29. T. Liu, J. Sun, N.-N. Zheng, X. Tang, and H.-Y. Shum, "Learning to detect a salient object," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2007, pp. 1-8.
30. T. Liu, N. Zheng, W. Ding, and Z. Yua, "Video attention: Learning to detect a salient object sequence," in Proc. IEEE Int. Conf. Pattern Recognit., Dec. 2008, pp. 1-4.
31. J. Li, Y. Tian, T. Huang, and W. Gao, "Cost-sensitive rank learning from positive and unlabeled data for visual saliency estimation," IEEE Signal Process. Lett., vol. 17, no. 6, pp. 591-594, Jun. 2010.
32. A. Torralba, "Contextual influences on saliency," in Neurobiological Attention, L. Itti, G. Rees, and J. K. Tsotsos, Eds., 1st ed. Amsterdam, The Netherlands: Elsevier Press, pp. 586-592, 2005.
33. T. Evgeniou, C. A. Micchelli, and M. Pontil, "Learning multiple tasks with kernel methods," J. Mach. Learning Res., vol. 6, pp. 615-637, Apr. 2005.
34. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the em algorithm," J. Royal Statist. Soc. Series B, vol. 39, no. 1, pp. 1-38, 1977.
35. M.-R. Amini, T.-V. Truong, and C. Goutte, "A boosting algorithm for learning bipartite ranking functions with partially labeled data," in Proc. SIGIR, 2008, pp. 99-106.
36. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge University Press, 2008.
37. R. L. Watrous, "Learning algorithms for connectionist networks: Applied gradient methods of nonlinear optimization," in Proc. IEEE Int. Conf. Neural Netw., Jun. 1987, pp. 619-627.
38. T. Evgeniou, C. A. Micchelli, and M. Pontil, "Learning multiple tasks with kernel methods," Mach. Learning Res., vol. 6, pp. 615-637, Apr. 2005.
39. G. Pillonetto, G. D. Nicolao, M. Chierici, and C. Cobelli, "Fast algorithms for nonparametric population modeling of large data sets," Automatica, vol. 45, no. 1, pp. 173-179, Jan. 2009.
40. T. Fawcett, "An introduction to ROC analysis," Pattern Recognit. Lett., vol. 27, no. 8, pp. 861-874, 2006.
41. N. D. Bruce and J. K. Tsotsos, "Saliency based on information maximization," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2006, pp. 155-162.