A generic virtual content insertion system based on visual attention analysis

MM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops

Volumn , Issue , 2008, Pages 379-388

  Liu, Huiying ^a,b,c,d   Jiang, Shuqiang ^a,b   Huang, Qingming ^a,b,c,d   Xu, Changsheng ^d,e  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

^b INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^c UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^d China Singapore Institute of Digital Media   (Singapore)

^e INSTITUTE OF AUTOMATION   (China)

Author keywords

Virtual content insertion; Visual attention

Indexed keywords

AFFINE TRANSFORMATIONS; CRITICAL ISSUES; EMERGING APPLICATIONS; GLOBAL MOTION ESTIMATION; OPTIMAL BALANCE; SPATIAL ATTENTION; SUBJECTIVE EVALUATIONS; SYSTEM-BASED; USER STUDY; VIDEO ANALYSIS; VIDEO CONTENTS; VIRTUAL CONTENT INSERTION; VISUAL ATTENTION;

METHOD OF MOMENTS; MOTION ESTIMATION; MULTIMEDIA SYSTEMS; VISUAL COMMUNICATION;

COMPUTER PERIPHERAL EQUIPMENT;

EID: 70350686594     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1459359.1459410     Document Type: Conference Paper

References (31)

1. X. Yu, X. Yan, T. T. P. Chi and L. F. Cheong, "Inserting 3D Projected Virtual Content into Broadcast Tennis Video", Proceedings of the 14th ACM international conference on Multimedia, pp: 619-622, 2006.
2. K. Wan, C. Xu, "Automatic Content Placement in Sports Highlights", IEEE International Conference on Multimedia & Expo, pp: 1893-1896, 2006.
3. C. Xu, K. W. Wan, S. H. Bui, Q. Tian, "Implanting Virtual Advertisement into Broadcast Soccer Video", Pacific-Rim Conference on Multimedia, pp: 264-271, 2004.
4. Y. Li, K. Wah Wan, X. Yan, C. Xu, "Real Time Advertisement Insertion in Baseball Video Based on Advertisement Effect", Proceedings of the 11th ACM international conference on Multimedia, pp: 343-346, 2005.
5. M. Tamir, et al., "Method and Apparatus for Automatic Electronic Replacement of Billboards in a Video Image", US Patent 6,292,227, 2001.
6. S. Deshpande, et al., "Method and Apparatus for Including Virtual ADs in Video Presentations", US Patent, 7,158,666, 2007.
7. T. Mei, X-S. Hua, L. Yang, S. Li, "VideoSense-Towards Effective Online Video Advertising", 16th ACM International Conference on Multimedia, pp: 1075-1084, 2007.
8. H. Liu, S. Jiang, Q. Huang and C. Xu. "Lower Attentive Region Detection for Virtual Content Insertion", IEEE International Conference on Multimedia & Expo, 2008.
9. S. Das, et al., "Method of Tracking Scene Motion for Live Video Insertion Systems", US Patent 5,808,695, 1998.
10. Kreitman, et al., "Method and System for Perspectively Distorting an Image and Implanting Same into a Video Stream", US Patent 5,731,846, 1998.
11. Y-F. Ma, X-S. Hua, L. Lu, H-J. Zhang. "A Generic Framework of User Attention Model and Its Application in Video Summarization", IEEE Trans on Multimedia, Vol. 7, No. 5, pp: 907- 919, 2005.
12. Y. Zhai, M. Shah. "Visual Attention Detection in Video Sequences Using Spatiatemporal Cues". Proceedings of the 14th annual ACM international conference on Multimedia, pp: 815-824, 2006.
13. O L. Meur, P L. Callet, D. Barba, D. Thoreau, "A Coherent Computational Approach to Model Bottom-up Visual Attention", IEEE Trans on Pattern Analysis and Machine Intelligence, Vol. 28, No. 5, pp: 802-816, May 2006.
14. L. Itti, C. Koch, E. Niebur. "A Model of Saliency-Based Visual Attention for Rapid Scene Analysis", IEEE Trans on Pattern Analysis and Machine Intelligence, Vol. 20, No. 11. pp: 1254-1259, 1998.
15. H. Liu, S. Jiang, Q. Huang, C. Xu, and W. Gao. "Region- Based Visual Attention Analysis with Its Application in Image Browsing on Small Displays". 15th ACM International Conference on Multimedia, pp: 305-308, 2007.
16. Y. Hu, D. Rajan and L-T Chia. "Robust subspace analysis for detecting visual attention regions in images", Proceedings of the 13th annual ACM international conference on Multimedia, pp: 716-724, 2005.
17. Y. Li, Y-F. Ma, H-J. Zhang. "Salient Region Detection and Tracking in Video", International Conference on Multimedia and Expo, Vol. 2, pp: 269-272, 2003.
18. Y. Sun and R. Fisher. "Object-based Visual Attention for Computer Vision", Artificial Intelligence, Vol. 146, No. 1, pp: 77-123, 2003.
19. T.N. Topper, "Selection Mechanisms in Human and Machine Vision", Ph.D. Thesis, University of Waterloo, 1991.
20. N. D. B. Bruce, "Features That Draw Visual Attention: an Information Theoretic Perspective", Neurocomputing, Vol. 65-66, pp: 125-133, 2005.
21. M.T. Lopez, A. Fernandez-Caballero, M. A. Fernandez, J. Mira, A. E. Delgado, "Visual Surveillance by Dynamic Visual Attention Method", Pattern Recognition, Vol. 39, pp: 2194-2211, 2006.
22. L. Itti, P. Baldi, "A Principled Approach to Detecting Surprising Events in Video", IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1, pp: 631-637, 2005.
23. L. Itti. "Automatic Foveation for Video Compression Using a Neurobiological Model of Visual Attention", IEEE Transactions on Image Processing, Vol. 13, No. 10, pp: 1304-1318, 2004.
24. G. Qiu, X. Gu, Z. Chen, Q. Chen and C. Wang, "An Information Theoretic Model of Spatiotemporal Visual Saliency", IEEE International Conference on Multimedia & Expo, pp: 1806-1809, 2007.
25. J. You, G. Liu, L. Sun, H. Li, "A Multiple Visual Models Based Perceptive Analysis Framework for Multilevel Video Summarization", IEEE Trans. Circuits and Systems for Video Technology, Vol. 17, No. 3, pp: 273-285, 2007.
26. C. Liu, H. Liu, S. Jiang, Q. Huang, Y. Zheng and W. Zhang: "JDL at Trecvid 2006 Shot Boundary Detection", TRECVID 2006 Workshop (2006).
27. R. E. Soodak, "Two-dimensional modeling of visual receptive fields using Gaussian subunits", Proc. Antl. Acad, Sci. USA, Vol. 83, pp: 9259-9263, 1986.
28. E. T. Rolls, N. C. Aggelopoulos, and F. Zheng, "Effective size of receptive fields of inferior temporal visual cortex neurons in natural scenes", The Journal of Neuroscience, Vol. 23, No. 1, pp:339-348, 2003.
29. L-Y. Duan, M. Xu, Q. Tian, C-S. Xu, J. S. Jin, "A Unified Framework for Semantic Shot Classification in Sports Video", IEEE Trans on Multimedia, Vol. 7, No. 6, pp: 1066-1083, 2005.
30. F. Dufaux and J. Konrad, "Efficient, robust, and fast global motion estimation for video coding," IEEE Trans. Image Processing, vol. 9, no. 3, pp. 497-501, 2000.
31. X. Chen, J. Yang, J. Zhang, and A. Waibel. "Automatic Detection and Recognition of Signs from Natural Scenes", IEEE Transactions on Image Processing, Vol. 13, No.1, pp: 87-99, 2004.