Hierarchical modeling and adaptive clustering for real-time summarization of rush videos

IEEE Transactions on Multimedia

Volumn 11, Issue 5, 2009, Pages 906-917

  Ren, Jinchang ^a,b   Jiang, Jianmin ^a  

^a UNIVERSITY OF BRADFORD   (United Kingdom)

^b NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

Author keywords

Activity level; Adaptive clustering; Hierarchical modelling; TRECVID; Video rushes summarization

Indexed keywords

ACTIVITY LEVEL; ADAPTIVE CLUSTERING; HIERARCHICAL MODELLING; TRECVID; VIDEO RUSHES SUMMARIZATION;

FORMAL LANGUAGES; HIERARCHICAL SYSTEMS; VIDEO RECORDING;

CONTENT BASED RETRIEVAL;

EID: 68549099674     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2009.2021782     Document Type: Article

References (50)

1. C. W. Ngo, Y. F. Ma, and H.-J. Zhang, "Video summarization and scene detection by graph modelling," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 2, pp. 296-305, Feb. 2005.
2. S.-F. Chang and A. Vetro, "Video adaptation: Concepts, technologies, and open issues," Proc. IEEE, vol. 93, no. 1, pp. 148-158, Jan. 2005.
3. A. Hanjalic and L.-Q. Xu, "Affective video content representation and modelling," IEEE Trans. Multimedia, vol. 7, no. 1, pp. 143-154, Feb. 2005.
4. Z. Li, G. M. Schuster, and A. K. Katsaggelos, "Rate-distortion optimal video summary generation," IEEE Trans. Image Process., vol. 14, no. 10, pp. 1550-1560, Oct. 2005.
5. A. Hanjalic and H.-J. Zhang, "An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 8, pp. 1280-1289, Aug. 1999.
6. C. Kim and J. N. Hwang, "Object-based video abstraction for video surveillance systems," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 12, pp. 1128-1138, Dec. 2002.
7. T. Liu, H.-J. Zhang, and F. Qi, "A novel video key-frame extraction algorithm based on perceived motion energy model," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 10, pp. 1006-1013, Oct. 2003.
8. Z. Cernekova, I. Pitas, and C. Nikou, "Information theory-based shot cut/fade detection and video summarization," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 1, pp. 82-91, Jan. 2006.
9. Z. Li, G. M. Schuster, and A. K. Katsaggelos, "MINMAX optimal video summarization," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 10, pp. 1245-1256, Oct. 2005.
10. N. Babaguchi, Y. Kawai, T. Ogura, and T. Kitahashi, "Personalized abstraction of broadcasted American football video by highlight selection," IEEE Trans. Multimedia, vol. 6, no. 4, pp. 575-586, Aug. 2004.
11. A. M. Ferman and A. M. Tekalp, "Two-stage hierarchical video summary extraction to match low-level user browsing preferences," IEEE Trans. Multimedia, vol. 5, no. 2, pp. 244-256, Jun. 2003.
12. X. Zhu, A. K. Elmagarmid, X. Xue, L. Wu, and A. C. Catlin, "In-sightVideo: Toward hierarchical video content organization for efficient browsing, summarization and retrieval," IEEE Trans. Multimedia, vol. 7, no. 4, pp. 648-666, Aug. 2005.
13. A. Ekin, A. M. Tekalp, and R. Mehrotra, "Automatic soccer video analysis and summarization," IEEE Trans. Image Process., vol. 12, no. 7, pp. 796-807, Jul. 2003.
14. A.Hanjalic, "Adaptive extractionof highlights froma sport video based on excitement modelling," IEEE Trans. Multimedia, vol. 7, no. 6, pp. 1114-1122, Dec. 2005.
15. N. Dimitrova, "Context and memory in multimedia content analysis," IEEE Multimedia, vol. 11, no. 3, pp. 7-11, Jul.-Sep. 2004.
16. M. Guironnet, D. Pellerin, N. Guyader, and P. Ladret, "Video summarization based on camera motion and a subjective evaluation model," EURASIP J. Image Video Process., 2007, Article ID 60245.
17. A. G. Money and H. H. Agius, "Video summarization: A conceptual framework and survey of the state of the art," J. Vis. Commun. Image Represent., vol. 19, no. 2, pp. 121-143, 2008.
18. P. Over, A. F. Smeaton, and G. Awad, "The TRECVID 2008 BBC rushes summarization evaluation," in Proc. Int. Workshop TRECVID Video Summarization (TVS'08), Vancouver, BC, Canada, Oct 31, 2008.
19. J.-C. Ren, J.-M. Jiang, and J. Chen, "Shot boundary detection in MPEG videos using local and global indicators," IEEE Trans. Circuits Syst. Video Technol., to be published.
20. B. T. Truong and S. Venkatesh, "Video abstraction: A systematic review and classification," ACM Trans. Multimedia Comput. Commun. Appl. vol. 3, no. 1, pp. 1-37, 2007, Article 3. [Online]. Available: http:// doi.acm.org/10.1145/1198302.1198305.
21. Y. Li, S.-H. Lee, C.-H. Yeh, and C.-C. J. Kuo, "Techniques for movie content analysis and skimming," IEEE Signal Process. Mag., vol. 23, no. 2, pp. 79-89, Mar. 2006.
22. T. Wang, Y. Gao, J. Li, P. P. Wang, X. Tong, W. Hu, Y. Zhang, and J. Li, "THU-ICRC at rush summarization of TRECVID 2007," in Proc. Int. Workshop TRECVID Video Summarization (TVS'07), Augsburg, Bavaria, Germany, Sep. 28, 2007, pp. 79-83.
23. J.-C. Ren and J. Jiang, "Hierarchical modeling and adaptive clustering for real-time summarization of rush videos in TRECVID'08," in Proc. Int. Workshop TRECVID Video Summarization (TVS'08), Vancouver, BC, Canada, Oct. 31, 2008.
24. J. Bescos, J. M. Martinez, L. Herranz, and F. Tiburzi, "Content-driven adaptation of on-line video," Signal Process.: Image Commun., vol. 22, no. 7-8, pp. 651-668, 2007.
25. D. Tjondronegoro, Y. P. Chen, and B. Pham, "Integrating highlights for more complete sports video summarization," IEEE Multimedia, vol. 11, no. 4, pp. 22-37, Oct.-Dec. 2004.
26. X. Zhu, J. Fan, A. K. Elmagarmid, and X. Wu, "Hierarchical video content description and summarization using unified semantic and visual similarity," Multimedia Syst., vol. 9, no. 1, pp. 31-53, 2003.
27. N. Doulamis, A. Doulamis, and K. Ntalianis, "An optimal interpolation-based scheme for video summarization," in Proc. Int. Conf. Multimedia and Expo., Lausanne, Switzerland, Aug. 26-29, 2002, pp. 297-300.
28. Y. Takeuchi and M. Sugimoto, "User-adaptive home video summarization using personal photo libraries," in Proc. 6th ACM Int. Conf. Image and Video Retrieval, Amsterdam, The Netherlands, 2007, pp. 472-479.
29. A. Doulamis, N. Doulamis, Y. Avrithis, and S. Kollias, "A fuzzy video content representation for video summarization and content-based retrieval," Signal Process., vol. 80, no. 6, pp. 1049-1067, 2000.
30. J. Lee, G. Lee, and W. Kim, "Automatic video summarizing tool using MPEG-7 descriptors for personal video recorder," IEEE Trans. Consum. Electron., vol. 49, no. 3, pp. 742-749, Aug. 2003.
31. J. Kim, H. Chang, K. Kang, M. Kim, and H. Kim, "Summarization of news video and its description for content-based access," Int. J. Imag. Syst. Technol., vol. 13, no. 5, pp. 267-274, 2004.
32. Y.-F. Ma, X.-S. Hua, L. Lu, and H.-J. Zhang, "A generic framework of user attention model and its application in video summarization," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 907-919, Oct. 2005.
33. I. Otsuka, K. Nakane, A. Divakaran, K. Hatanaka, and M. Ogawa, "A highlight scene detection and video summarization system using audio feature for a personal video recorder," IEEE Trans. Consum. Electron., vol. 51, no. 1, pp. 112-116, Feb. 2005.
34. Y. Wang, Z. Liu, and J. Huang, "Multimedia content analysis: Using both audio and visual clues," IEEE Signal Process. Mag., vol. 17, no. 6, pp. 12-36, Nov. 2000.
35. R. Lienhart, S. Pfeiffer, and W. Effelsberg, "Video abstracting," Commun. ACM, vol. 40, no. 12, pp. 54-62, 1997.
36. X. Zhu, X. Wu, J. Fan, A. Elmagarmid, and W. Aref, "Exploring video content structure for hierarchical summarization," Multimedia Syst., vol. 10, no. 2, pp. 98-115, 2004.
37. C. Gianluigi and S. Raimondo, "An innovative algorithm for key frame extraction in video summarization," J. Real-Time Image Process., vol. 1, no. 1, pp. 69-88, 2006.
38. M. S. Drew and J. Au, "Clustering of compressed illumination- invariant chromaticity signatures for efficient video summarization," Image Vis. Comput., vol. 21, no. 8, pp. 705-716, 2003.
39. L.-H. Chen, C.-W. Su, H.-Y. M. Liao, and C.-C. Shih, "On the preview of digital movies," J. Vis. Commun. Image Represent., vol. 14, no. 3, pp. 358-368, 2003.
40. P. M. Fonseca and F. Pereira, "Automatic video summarization based on MPEG-7 descriptions," Signal Process.: Image Commun., vol. 19, no. 8, pp. 685-699, 2004.
41. B. Lehane, N. E. O'Connor, H. Lee, and A. F. Smeaton, "Indexing of fictional video content for event detection and summarisation," EURASIP J. Image Video Process., pp. 1-15, 2007, Article ID 14615.
42. A. Hanjalic, "Towards theoretical performance limitsof video parsing," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 3, pp. 261-272, Mar. 2007.
43. S. X. Ju, M. J. Black,S. Minneman, and D. Kimber, "Summarization of videotaped presentations: Automatic analysis of motion and gesture," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 5, pp. 686-696, May 1998.
44. N. D. Doulamis, A. D. Doulamis, Y. S. Avrithis, K. S. Ntalianis, and S. D. Kollias, "Efficient summarization of stereoscopic video sequences," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 4, pp. 501-517, Apr. 2000.
45. Y. Peng and C.-W. Ngo, "Clip-based similarity measure for query-dependent clip retrieval and video summarization," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 5, pp. 612-627, May 2006.
46. J. You, G. Liu, L. Sun, and H. Li, "A multiple visual models based perceptive analysis framework for multilevel video summarization," Trans. Circuits Syst. Video Technol., vol. 17, no. 3, pp. 273-285, Mar. 2007.
47. J. Calic, D. P. Gibson, and N. W. Campbell, "Efficient layout of comiclike video summaries," Trans. Circuits Syst. Video Technol., vol. 17, no. 7, pp. 931-936, Jul. 2007.
48. S.-C. S. Cheung and A. Zakhor, "Efficient video similarity measurement with video signature," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 1, pp. 59-74, Jan. 2003.
49. S.-C. S. Cheung and A. Zakhor, "Fast similarity search and clustering of video sequences on the world-wide-web," IEEE Trans. Multimedia, vol. 7, no. 3, pp. 524-537, Jun. 2005.
50. K. Kashino, T. Kurozumi, and H. Murase, "A quick search method for audio and video signals based on histogram pruning," IEEE Trans. Multimedia, vol. 5, no. 3, pp. 348-357, Sep. 2003.