Regularized feature reconstruction for spatio-temporal saliency detection

IEEE Transactions on Image Processing

Volumn 22, Issue 8, 2013, Pages 3120-3132

  Ren, Zhixiang ^a   Gao, Shenghua ^b   Chia, Liang Tien ^a   Rajan, Deepu ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b ADVANCED DIGITAL SCIENCES CENTER   (Singapore)

Author keywords

feature reconstruction; motion trajectory; Spatio temporal saliency detection

Indexed keywords

FEATURE RECONSTRUCTION; MOTION TRAJECTORIES; MULTIMEDIA APPLICATIONS; RECONSTRUCTION PROCESS; SALIENCY DETECTION; SPARSE RECONSTRUCTION; SPATIO-TEMPORAL MODELS; STATE-OF-THE-ART APPROACH;

IMAGE PROCESSING; MATHEMATICAL MODELS;

TRAJECTORIES;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; SPATIOTEMPORAL ANALYSIS; VIDEORECORDING; PROCEDURES;

ALGORITHMS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; SPATIO-TEMPORAL ANALYSIS; SUBTRACTION TECHNIQUE; VIDEO RECORDING;

EID: 84879035816     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2013.2259837     Document Type: Article

References (37)

1. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
2. R. Achanta, S. H. F. Estrada, and S. Susstrunk, "Frequency-tuned salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1597-1604.
3. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Advances in Neural Information Processing Systems, Cambridge, MA, USA: MIT Press, Dec. 2007, pp. 545-552.
4. M. Coltheart, "The persistences of vision," Phil. Trans. R. Soc. B, Biol. Sci., vol. 290, no. 1038, pp. 57-69, 1980.
5. R. C. Jain, "Difference and accumulative difference pictures in dynamic scene analysis," Image Vis. Comput., vol. 2, no. 2, pp. 99-108, May 1984.
6. C. Guo, Q. Ma, and L. Zhang, "Spatio-temporal saliency detection using phase spectrum of quaternion Fourier transform," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
7. A. Bugeau and P. Perez, "Detection and segmentation of moving objects in highly dynamic scenes," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
8. S. Marat, T. H. Phuoc, L. Granjon, N. Guyader, D. Pellerin, and A. Guerin Dugue, "Modelling spatio-temporal saliency to predict gaze direction for short videos," Int. J. Comput. Vis., vol. 82, no. 3, pp. 231-243, May 2009.
9. S. Yantis and J. Jonides, "Abrupt visual onsets and selective attention: Evidence from visual search," J. Experim. Psychol., Human Percept. Perform., vol. 10, no. 5, pp. 601-621, 1984.
10. J. R. Brockmole and J. M. Henderson, "Attentional prioritization of new objects in real-world scenes: Evidence from eye movements," J. Experim. Psychol., Human Percept. Perform., vol. 31, no. 5, pp. 857-868, 2005. (Pubitemid 41653556)
11. J. R. Brockmole and J. M. Henderson, "Prioritizing new objects for eye fixation in real-world scenes: Effects of object-scene consistency," Vis. Cognit., vol. 16, nos. 2-3, pp. 375-390, 2008. (Pubitemid 351338370)
12. L. Itti and P. Baldi, "A principled approach to detecting surprising events in video," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 631-637. (Pubitemid 43897253)
13. Z. Ren, S. Gao, D. Rajan, L.-T. Chia, and Y. Huang, "Spatiotemporal saliency detection via sparse representation," in Proc. Int. Conf. Multimedia Expo, Jul. 2012, pp. 158-163.
14. V. Mahadevan and N. Vasconcelos, "Spatiotemporal saliency in dynamic scenes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, pp. 171-177, Jan. 2010.
15. N. Friedman and S. J. Russell, "Image segmentation in video sequences: A probabilistic approach," in Proc. 13th Conf. Uncertainty Artif. Intell., 1997, pp. 175-181.
16. C. Stauffer and W. Grimson, "Adaptive background mixture models for real-time tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 2. Jun. 1999, pp. 1063-6919.
17. A. M. Elgammal, D. Harwood, and L. S. Davis, "Non-parametric model for background subtraction," in Proc. 6th Eur. Conf. Comput. Vis., 2000, pp. 751-767.
18. M. Heikkilä and M. Pietikäinen, "A texture-based method for modeling the background and detecting moving objects," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 657-662, Apr. 2006. (Pubitemid 43264663)
19. S. Liao, G. Zhao, V. Kellokumpu, M. Pietikäinen, and S. Li, "Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 1301-1306.
20. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. 7th Int. Joint Conf. Artif. Intell., Apr. 1981, pp. 674-679. (Pubitemid 14478744)
21. L. Wixson, "Detecting salient motion by accumulating directionally-consistent flow," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 774-780, Aug. 2000.
22. V. Gopalakrishnan, Y. Hu, and D. Rajan, "Sustained observability for salient motion detection," in Proc. 10th Asian Conf. Comput. Vis., 2010, pp. 732-743.
23. E. Rahtu, J. Kannala, M. Salo, and J. Heikkilä, "Segmenting salient objects from images and videos," in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 366-379.
24. S. Goferman, L. Zelnik-Manor, and A. Tal, "Context-aware saliency detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 1-8.
25. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Minneapolis, MN, USA, Jun. 2007, pp. 1-8.
26. V. Gopalakrishnan, Y. Hu, and D. Rajan, "Random walks on graphs to model saliency in images," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1698-1705.
27. Y. Zhai and M. Shah, "Visual attention detection in video sequences using spatiotemporal cues," in Proc. ACM Multimedia, Santa Barbara, CA, USA, Oct. 2006, pp. 815-824. (Pubitemid 47113641)
28. W. Kim, C. Jung, and C. Kim, "Spatiotemporal saliency detection and its applications in static and dynamic scenes," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 4, pp. 446-456, Apr. 2011.
29. H. J. Seo and P. Milanfar, "Static and space-time visual saliency detection by self-resemblance," J. Vis., vol. 9, no. 12, pp. 1-17, 2009.
30. Y. Li, Y. Zhou, L. Xu, X. C. Yang, and J. Yang, "Incremental sparse saliency detection," in Proc. 16th IEEE Conf. Image Process., Nov. 2009, pp. 3093-3096.
31. M. A. G. V. Bruce, P. R. Green, Visual Perception: Physiology, Psychology, and Ecology, 4th ed. Hove, U.K.: Psychology Press, 2003.
32. C. Liu, J. Yuen, T. Antonio, J. Sivic, and W. T. Freeman, "SIFT flow: Dense correspondence across scenes and its applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 978-994, May 2011.
33. S. Gao, I. W.-H. Tsang, and L.-T. Chia, "Laplacian sparse coding, hypergraph Laplacian sparse coding, and applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 92-104, Jan. 2013.
34. L. Zhang, M. Yang, and X. Feng, "Sparse representation or collaborative representation: Which helps face recognition?" in Proc. Int. Conf. Comput. Vis., Nov. 2011, pp. 471-478.
35. H. Lee, A. Battle, R. Raina, and A. Y. Ng, "Efficient sparse coding algorithms," in Proc. Adv. Neural Inf. Process. Syst., Dec. 2007, pp. 801-808.
36. L. Itti, "Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes," Vis. Cognit., vol. 12, no. 6, pp. 1093-1123, Aug. 2005. (Pubitemid 41283179)
37. T. Judd, K. Ehinger, F. Durand, and A. Torralba, "Learning to predict where humans look," in Proc. Int. Conf. Comput. Vis., 2009, pp. 2106-2113.