Saliency density maximization for efficient visual objects discovery

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 12, 2011, Pages 1822-1834

  Luo, Ye ^a   Yuan, Junsong ^a   Xue, Ping ^a   Tian, Qi ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

Author keywords

Branch and bound search; maximum saliency density (MSD); unsupervised salient object discovery; video retargeting

Indexed keywords

BOUNDING BOX; BRANCH AND BOUNDS; DENSITY-BASED; GLOBAL OPTIMAL SOLUTIONS; LEARNING-BASED METHODS; MAXIMUM SALIENCY DENSITY (MSD); PRIOR KNOWLEDGE; PUBLIC DATASET; SALIENCY MAP; SALIENT OBJECT DETECTION; SALIENT OBJECTS; SHAPE AND SIZE; UNSUPERVISED DETECTION; UNSUPERVISED SALIENT OBJECT DISCOVERY; VIDEO RETARGETING; VISUAL OBJECTS; VISUAL SALIENCY;

IMAGE SEGMENTATION; VISUALIZATION;

OBJECT RECOGNITION;

EID: 83255184455     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2147230     Document Type: Article

References (45)

1. D. Walther and C. Koch, "Modeling attention to salient proto-objects," Neural Netw., vol. 19, no. 9, pp. 1395-1407, 2006. (Pubitemid 44708603)
2. A. P. Bradley and F. W. Stentiford, "Visual attention for region of interest coding in JPEG 2000," J. Vis. Commun. Image Representat., vol. 14, no. 3, pp. 232-250, Sep. 2003.
3. L. Itti, "Automatic foveation for video compression using a neurobiological model of visual attention," IEEE Trans. Image Process., vol. 13, no. 10, pp. 1304-1318, Oct. 2004.
4. J. Fan, Y. Wu, and S. Dai, "Discriminative spatial attention for robust tracking," in Proc. ECCV, vol. 1. 2010, pp. 480-493.
5. F. Liu and M. Gleicher, "Video retargeting: Automating pan and scan," in Proc. ACM MM, 2006, pp. 241-250. (Pubitemid 47113539)
6. T. Deselaers, P. Dreuw, and H. Ney, "Pan, zoom, scan time-coherent, trained automatic video cropping," in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
7. S. Goferman, L. Zelnik-Manor, and A. Tal, "Context-aware saliency detection," in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 2376-2383.
8. T. Liu, J. Wang, J. Sun, N. Zheng, X. Tang, and H.-Y. Shum, "Picture collage," IEEE TMM, vol. 11, no. 7, pp. 1225-1239, Nov. 2009.
9. T. Liu, N. Zheng, W. Ding, and Z. Yuan, "Video attention: Learning to detect a salient object sequence," in Proc. ICPR, 2008, pp. 1-4.
10. D. Gao, S. Han, and N. Vasconcelos, "Descriminant saliency, the detection of suspicious coincidences, and applications to visual recognition," IEEE TPAMI, vol. 31, no. 6, pp. 989-1005, Jun. 2009.
11. S. Frintrop, A. N̈uchter, and H. Surmann, "Visual attention for object recognition in spatial 3D data," in Proc. 2nd Int. WAPCV, 2004, pp. 168-182.
12. D. Gao and N. Vasoncelos, "Descriminant saliency for visual recognition from cluttered scenes," in Proc. Adv. NIPS, 2004, pp. 481-488.
13. X. Hou and L. Zhang, "Dynamic visual oattention: Searching for coding length increments," in Proc. Adv. NIPS, 2008, pp. 681-688.
14. N. Bruce and J. Tsotsos, "Saliency based on information maximization," in Proc. Adv. NIPS, vol. 18. 2005, pp. 155-162.
15. Z. Wang and B. Li, "A two-stage approach to saliency detection in images," in Proc. IEEE ICASSP, Mar.-Apr. 2008, pp. 965-968.
16. T. Liu, J. Sun, N. Zheng, X. Tang, and H. Shum, "Learning to detect a salient object," in Proc. IEEE Conf. CVPR, Jun. 2007, pp. 1-8.
17. R. Valenti, N. Sebe, and T. Gevers, "Image saliency by isocentric curvedness and color," in Proc. IEEE ICCV, Oct. 2009, pp. 2185-2192.
18. R. Achanta, S. Hemami, F. Estraday, and S. Susstrunk, "Frequencytuned salient region detection," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 1597-1604.
19. H. J. J. Seo and P. Milanfar, "Static and space-time visual saliency detection by self-resemblance," J. Vision, vol. 9, no. 12, pp. 1-27, 2009.
20. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G. W. Cottrell, "SUN: A Bayesian framework for saliency using natural statistics," J. Vision, vol. 8, no. 7, pp. 1-20, 2008.
21. Z. Liu, Y. Xue, L. Shen, and Z. Zhang, "Nonparametric saliency detection using kernel density estimation," in Proc. ICIP, 2010, pp. 253-256.
22. P. Khuwuthyakorn, A. Robles-Kelly, and J. Zhou, "Object of interest detection by saliency learning," in Proc. ECCV, Sep. 2010, pp. 636-649.
23. C. H. Lampert, M. B. Blaschko, and T. Hofmann, "Efficient subwindow search: A branch and bound framework for object localization," IEEE Trans. Patt. Anal. Mach. Intell., vol. 31, no. 12, pp. 2129-2142, Dec. 2009.
24. T. Lu, Z. Yuan, Y. Huang, D. Wu, and H. Yu, "Video retargeting with nonlinear spatial-temporal saliency fusion," in Proc. ICIP, 2010, pp. 1801-1804.
25. F. Liu and M. Gleicher, "Automatic image retargeting with fisheye-view warping," in Proc. ACM Symp. UIST, 2005, pp. 153-162. (Pubitemid 44531234)
26. X. D. Hou and L. Q. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Conf. CVPR, Jun. 2007, pp. 1-8.
27. V. Gopalakrishnan, Y. Hu, and D. Rajan, "Salient region detection by modeling distributions of color and orientation," IEEE Trans. Multimedia, vol. 11, no. 5, pp. 892-905, Aug. 2009.
28. J. W. Han, K. N. Ngan, M. Li, and H. J. Zhang, "Unsupervised extraction of visual attention objects in color images," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 1, pp. 141-145, Jan. 2006. (Pubitemid 43172623)
29. B. C. Ko and J.-Y. Nam, "Object-of-interest image segmentation based on human attention and semantic region clustering," Virtual J. Biomed. Opt., vol. 1, no. 11, pp. 2462-2470, 2006. (Pubitemid 44781647)
30. Y.-F. Ma and H.-J. Zhang, "Contrast-based image attention analysis by using fuzzy growing," in Proc. ACM MM, 2003, pp. 374-381.
31. L. Marchesotti, C. Cifarelli, and G. Csurka, "A framework for visual saliency detection with applications to image thumbnailing," in Proc. ICCV, 2009, pp. 2232-2239.
32. X. Fan, X. Xie, H. Zhou, and W. Ma, "Looking into video frames on small displays," in Proc. ACM MM, 2003, pp. 247-250.
33. C. Tao, J. Jia, and H. Sun, "Active window oriented dynamic video retargeting," in Proc. ICCV-WDV, 2007.
34. G. Hua, C. Zhang, Z. Liu, Z. Zhang, and Y. Shan, "Efficient scalespace spatiotemporal saliency tracking for distortion-free video retargeting," in Proc. ACCV, 2009, pp. 1597-1604.
35. E. L. Lawler and D. E. Wood, "Branch-and-bound methods: A survey," Oper. Res., vol. 14, no. 4, pp. 699-719, 1966.
36. L. Wolf, M. Guttmann, and D. Cohen-Or, "Non-homogeneous contentdriven video-retargeting," in Proc. IEEE ICCV, Oct. 2007, pp. 1-6.
37. Y.-F. Ma, X.-S. Hua, L. Lie, and H.-J. Zhang, "A generic framework of user attention model and its application in video summarization," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 907-919, Oct. 2005. (Pubitemid 41452519)
38. L. Shi, J. Wang, L. Duan, and H. Lu, "Consumer video retargeting: Context assisted spatial-temporal grid optimization," in Proc. ACM MM, 2009, pp. 301-310.
39. N. Otsu, "A threshold selection method from gray-level histograms," IEEE Trans. Syst., Man Cybern., vol. 9, no. 1, pp. 62-66, Jan. 1979. (Pubitemid 9413341)
40. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Patt. Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
41. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfld, "Learning realistic human actions from movies," in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
42. G. Sperling and E. Weichselgartner, "Episodic theory of the dynamics of spatial attention," Psychol. Rev., vol. 102, no. 3, pp. 503-532, 1995.
43. D. Walther, U. Rutishauser, C. Koch, and P. Perona, "Selective visual attention enables learning and recognition of multiple objects in cluttered scenes," J. Comput. Vision Image Understanding, vol. 100, nos. 1-2, pp. 41-63, Oct. 2005. (Pubitemid 41329896)
44. N. A. Goussies, Z. Liu, and J. Yuan, "Efficient search of top-k video subvolumes for multi-instance action detection," in Proc. ICME, 2010, pp. 328-333.
45. T. Liu, Z. J. Yuan, J. Sun, J. D. Wang, N. N. Zheng, X. Tang, and H. Shum, "Learning to detect a salient object," IEEE Trans. Patt. Anal. Mach. Intell., vol. 33, no. 2, pp. 353-367, Feb. 2011.