Content-based attention ranking using visual and contextual attention model for baseball videos

IEEE Transactions on Multimedia

Volumn 11, Issue 2, 2009, Pages 244-255

  Shih, Huang Chia ^a   Hwang, Jenq Neng ^a,b   Huang, Chung Lin ^c  

^a NATIONAL TSING HUA UNIVERSITY   (Taiwan)

^b FO GUANG UNIVERSITY   (Taiwan)

^c University of Washington   (United States)

Author keywords

Attention modeling; Contextual analysis; Information retrieval; Interactive systems; Sports videos

Indexed keywords

INFORMATION RETRIEVAL; INFORMATION RETRIEVAL SYSTEMS; INFORMATION SERVICES; VIDEO SIGNAL PROCESSING;

ATTENTION MODELING; ATTENTION MODELS; BASEBALL VIDEOS; CONTENT-BASED; CONTEXTUAL ANALYSIS; GOOGLE PAGERANK; INTERACTIVE SYSTEMS; MULTIMEDIA DATUM; OBJECT-BASED; RANKING STRATEGIES; RE RANKINGS; SPORTS VIDEOS; USER INTERESTS; VIDEO CONTENTS; VIDEO FRAMES; VISUAL ATTENTION MODELS;

VISUAL COMMUNICATION;

EID: 59049099440     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2008.2009682     Document Type: Article

References (43)

1. J. K. Tsotsos, S. M. Culhane, W. Y. K. Wai, Y. H. Lai, N. Davis, and F. Nuflo, "Modeling visual-attention via selective tuning," Artific. Intell., vol. 78, no. 1-2, pp. 507-545, Nov. 1995.
2. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
3. D. Walther and C. Koch. "Modeling attention to salient proto-objects," Neur. New., vol. 19, pp. 1395-1407, 2006.
4. Y.-F. Ma, X.-S. Hua, L. Lu, and H.-J. Zhang, "A generic framework of user attention model and its application in video summarization," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 907-919, Oct. 2005.
5. W.-H. Cheng, C.-W. Wang, and J.-L. Wu, "Video adaptation for small display based on content recomposition," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 1, pp. 43-58, Jan. 2007.
6. H. C. Shih and C. L. Huang, "Content extraction and interpretation of superimposed captions for broadcasted sports videos," IEEE Trans. Broadcasting, vol. 54, no. 3, pp. 333-346, Sep. 2008.
7. D. Zhong and S. F. Chang, "Spatio-temporal video search using the object-based video representation," in Proc. IEEE ICIP'97, Santa Barbara, CA, Oct. 1997.
8. M. R. Naphade, I. Kozintsev, and T. S. Huang, "A factor graph framework for semantic video indexing," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 1, pp. 40-52, Jan. 2002.
9. Y. Rui, T. S. Huang, M. Ortega, and S. Mehrotra, "Relevance feedback: A power tool in interactive content-based image retrieval," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 5, pp. 644-655, Sep. 1998.
10. R. Zhang and Z. Zhang, "BALAS: Empirical Bayesian learning in the relevance feedback of image retrieval," Image Vis. Comput., vol. 24, no. 3, pp. 211-223, Mar. 2006.
11. I. Ruthven and M. Lalmas, "A survey on the use of relevance feedback for information access systems," Knowl. Eng. Rev., vol. 18, no. 2, pp. 95-145, Jun. 2003.
12. L. Page, S. Brin, R. Motwani, and T. Winograd, The Pagerank Citation Ranking: Bringing Order to the Web Stanford Univ., Palo Alto, CA, Stanford Digital Library Technologies Working Paper, 1999-0120, 1998.
13. S. Brin and L. Page, "The anatomy of a large-scale hypertextual web search engine," in Proc. 7th Int. World Wide Web Conf., New York, 1998, pp. 107-117.
14. M. R. Henzinger, "Hyperlink analysis for the web," IEEE Internet Comput., vol. 5, no. 1, pp. 45-50, Jan.-Feb. 2001.
15. L. Itti and C. Koch, "A comparison of feature combination strategies for saliency-based visual attention systems," in Proc. SPIE Human Vision and Electronic Imaging IV, San Jose, CA, Jan. 1999.
16. C. Kim and J.-N. Hwang, "Fast and robust moving object segmentation in video sequences," in Proc. IEEE ICIP'99, Kobe, Japan, Oct. 1999.
17. C. Kim and J.-N. Hwang, "Fast and automatic video object segmentation and tracking for content-based applications," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 2, pp. 122-129, Feb. 2002.
18. C. Kim and J.-N. Hwang, "Video object extraction for object-oriented applications," J. VLSI Signal Process.-Syst. for Signal, Image, and Video Technol., vol. 29, no. (1/2), pp. 7-22, Aug. 2001.
19. H. C. Shih and C. L. Huang, "Semantics interpretation of superimposed captions in sports videos," in Proc. IEEE-MMSP07', Chania, Crete, Greece, Oct. 1-3, 2007.
20. A. Rosenfeld, R. Hummel, and S. Zucker, "Scene labeling by relaxation operations," IEEE Trans. Syst., Man, Cybern., vol. 6, no. 6, pp. 420-433, Jun. 1976.
21. H. C. Shih, C. L. Huang, and J.-N. Hwang, "Video attention ranking using visual and contextual attention model for content-based sports videos mining," in Proc. IEEE-MMSP07', Chania, Crete, Greece, Oct. 1-3, 2007.
22. T. N. Cornsweet, Visual Perception.. New York: Academic, 1970.
23. R. Zhang, Z. Zhang, M. Li, W.-Y. Ma, and H. J. Zhang, "A probabilistic semantic model for image annotation and multi-modal image retrieval," Multimedia Syst. J., vol. 12, no. 1, pp. 27-33, Aug. 2006.
24. A. D. Doulamis and N. D. Doulamis, "Optimal content-based video decomposition for interactive video navigation," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 6, pp. 757-775, Jun. 2004.
25. K.-H. Choi and J.-N. Hwang, "Automatic creation of a talking head from a video sequence," IEEE Trans. Multimedia, vol. 7, no. 4, pp. 628-637, Aug. 2005.
26. Z. Zhang, R. K. Srihari, and A. Rao, "Face detection and its applications in intelligent and focused image retrieval," in Proc. IEEE-ICTAF99, 1999, pp. 121-128.
27. D. Arijon, Grammar of the Film Language.. Los Angeles, CA: Silman-James, 1991.
28. F. Beaver, Dictionary of Film Terms. New York: Twayne, 1994.
29. G. Davenport, T. A. Smith, and N. Princever, "Cinematic primitives for multimedia," IEEE Comput. Graph. Applic., vol. 11, no. 4, pp. 121-133, 2002.
30. H. C. Shih and C. L. Huang, "MSN: Statistical understanding of broadcasted baseball video using multi-level semantic network," IEEE Trans. Broadcasting, vol. 51, no. 4, pp. 449-459, Dec. 2005.
31. M. K. Kim, E. Kim, D. Shim, S. L. Jang, and G. Kim, "An efficient global motion characterization methods for image processing application." IEEE Trans. Consumer Electron., vol. 43, no. 4, pp. 1010-1018, Nov. 1997.
32. W.-N. Lie and S.-H. Shia, "Combining caption and visual features for semantic event classification of baseball video," in Proc. IEEE ICME'05, Jul. 6-8, 2005.
33. D. Zhang, R. K. Rajendran, and S.-F. Chang, "General and domainspecific techniques for detecting and recognizing superimposed text in video," in Proc. IEEE ICIP'02, Sep. 22-25, 2002.
34. S.-H. Sung and W.-S. Chun, "Knowledge-based numeric open caption recognition for live sportscast," in Proc. IEEE ICPR'02, Aug. 11-15, 2002.
35. N. Babaguchi, Y. Kawai, T. Ogura, and T. Kitahashi, "Personalized abstraction of broadcasted American football video by highlight selection," IEEE Trans. Multimedia, vol. 6, no. 4, pp. 575-586, Aug. 2004.
36. S.-F. Chang, W. Chen, H. J. Meng, H. Sundaram, and D. Zhong, "VideoQ: An automated content based video search system using visual cues," in Proc. ACM Multimedia'97, Seattle, WA, 1997, pp. 313-324.
37. M. Naphade and T. Huang, "A probabilistic framework for semantic indexing and retrieval in video," in Proc. IEEE-ICME'00, New York, 2000, pp. 475-478.
38. C. L. Huang, H. C. Shih, and C. Y. Chao, "Semantic analysis of sports video using dynamic Bayesian network," IEEE Trans. Multimedia, vol. 8, no. 4, pp. 749-760, Aug. 2006.
39. N. D. Doulamis, A. D. Doulamis, and S. D. Kollias, "A neural network approach to interative content-based retrieval of video databases," in Proc. IEEE-ICIP'99, Vancouver, BC, Canada, 1999, pp. 116-120.
40. M. Bicego, M. Cristani, and V. Murino, "Unsupervised scene analysis: A hidden Markov model approach," Comput. Vis. Image Understand., vol. 102, no. 1, pp. 22-41, Apr. 2006.
41. B. Li, H. Pan, and I. Sezan, "A general framework for sports video summarization with its application to soccer," in Proc. IEEE-ICASSP'03, Hong Kong, China, Apr. 2003, pp. 169-172.
42. M. R. Lyu, J. Song, and M. Cai, "A comprehensive method for multilingual video text detection, localization, and extraction," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 2, pp. 243-255, Feb. 2005.
43. K.-H. Liu, M.-F. Weng, C.-Y. Tseng, Y.-Y. Chuang, and M.-S. Chen, "Association and temporal rule mining for post-filtering of semantic concept detection in video," IEEE Trans. Multimedia, vol. 10, no. 2, pp. 240-251, Feb. 2008.