Summarizing rushes videos by motion, object, and event understanding

IEEE Transactions on Multimedia

Volumn 14, Issue 1, 2012, Pages 76-87

  Wang, Feng ^a   Ngo, Chong Wah ^b  

^a EAST CHINA NORMAL UNIVERSITY   (China)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Motion analysis; object and event understanding; rushes video structuring; video summarization

Indexed keywords

AUTOMATICALLY GENERATED; CAMERA MOTIONS; FILM-MAKING INDUSTRIES; HIERARCHICAL HIDDEN MARKOV MODELS; MOTION ACTIVITY; MOTION ANALYSIS; MOTION FEATURES; MOVING OBJECTS; OBJECT AND EVENT UNDERSTANDING; REDUNDANT INFORMATIONS; REPRESENTABILITY; RUSHES VIDEO STRUCTURING; SCENE CHANGE; SUBJECTIVE EVALUATIONS; TRECVID; UNIFIED FRAMEWORK; VIDEO CLIPS; VIDEO EDITOR; VIDEO SEGMENTS; VIDEO SUMMARIES; VIDEO SUMMARIZATION;

FILTRATION; GOLD; HIDDEN MARKOV MODELS; VIDEO RECORDING;

MOTION PICTURES;

EID: 84862940135     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2165531     Document Type: Article

References (46)

1. B. P. Allen, V. A. Petrushin, G.Wei, and D. Roqueiro, "Semantic web techniques for searching and navigating video shots in BBC rushes," in Proc. NIST TRECVID Workshop, 2006.
2. W. Bailer and G. Thallinger, "A framework for multimedia content abstraction and its application to rushes exploitation," in Proc. ACM Conf. Image and Video Retrieval, 2007.
3. W. Bailer and G. Thallinger, "Comparison of content selection methods for skimming rushes video," in Proc. TRECVID Workshop BBC Rushes Summarization in ACM Multimedia, 2008.
4. D. Byrne, P. Kehoe, H. Lee, C. Conaire, and A. F. Smeaton, "A user-centered approach to rushes summarization via highlight-detected keyframes," in Proc. TRECVID Workshop BBC Rushes Summarization at ACM Multimedia, 2007.
5. F. Chen, M. Cooper, and J. Adcock, "Video summarization preserving dynamic content," in Proc. TRECVID Workshop BBC Rushes Summarization at ACM Multimedia, 2007.
6. M. G. Christel, A. G. Hauptmann, W. Lin, M. Chen, J. Yang, B. Maher, and R. Baron, "Exploring the utility of fast-forward surrogates for BBC rushes," in Proc. TRECVID Workshop BBC Rushes Summarization in ACM Multimedia, 2008.
7. E. Dumont and B. Merialdo, "Split-screen dynamically accelerated video summaries," in Proc. TRECVID Workshop BBC Rushes Summarization at ACM Multimedia, 2007.
8. A. M. Ferman and A. M. Tekalp, "Two-stage hierarchical video summary extraction to match low-level user browsing preerences," IEEE Trans. Multimedia, vol. 5, no. 2, pp. 244-256, Jun. 2003.
9. A. G. Hauptmann, M. G. Christel, W. Lin, B. Maher, J. Yang, R. V. Baron, and G. Xiang, "Clever clustering vs. simple speed-up for summarizing BBC rushes," in Proc. TRECVID Workshop BBC Rushes Summarization at ACM Multimedia, 2007.
10. X. S. Hua, T. Mei, W. Lai, M. Wang, J. Tang, G. J. Qi, L. Li, and Z. Gu, "Microsoft Research Asia TRECVID 2006 high-level feature extraction and rushes exploitation," in Proc. NIST TRECVID Workshop, 2006.
11. K. Ishihara and Y. Sakai, "BBC rush summarization and high-level feature extraction in TRECVID2008," in Proc. NIST TRECVID Workshop, 2008.
12. C. Kim and J.-N. Hwang, "Object-based video abstraction for video surveillance systems," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 12, pp. 1128-1138, Dec. 2002.
13. M. Koskela, M. Sjoberg, V. Viitaniemi, and J. Laaksonen, "PicSOM experiments in TRECVID2008," in Proc. NIST TRECVID Workshop, 2008.
14. Y. Liu, Y. Liu, T. Ren, and K. C. Chan, "Rushes video summarization using audio-visual information and sequence alignment," in Proc. TRECVIDWorkshop BBC Rushes Summarization in ACMMultimedia, 2008.
15. Z. Liu, E. Zavesky, B. Shahraray, D. Gibbon, and A. Basso, "Brief and high-interest video summary generation: Evaluating the AT&T labs rushes summarization," in Proc. TRECVIDWorkshop BBC Rushes Summarization in ACM Multimedia, 2008.
16. Y. F. Ma, L. Lu, H. J. Zhang, and M. Li, "A user attention model for video summarization," in Proc. ACM Multimedia Conf., 2002.
17. T. Mei, X. S. Hua, C. Z. Zhu, H. Q. Zhou, and S. Li, "Home video visual quality assessment with spatiotemporal factors," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 6, pp. 699-706, Jun. 2007. (Pubitemid 46883406)
18. S. Naci, U. Damnjanovic, B. Mansencal, J. B. Pineau, C. Kaes, M. Corvaglia, E. Rossi, and N. Aginako, "The COST292 experimental framework for rushes summarization task in TRECVID 2008," in Proc. TRECVIDWorkshop BBC Rushes Summarization in ACMMultimedia, 2008.
19. J. Nam and A. H. Tewfik, "Dynamic video summarization and visualization," in Proc. ACM Multimedia Conf., 1999.
20. C. W. Ngo, T. C. Pong, and R. T. Chin, "Video partitioning by temporal slice coherency," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 8, pp. 941-953, Aug. 2001. (Pubitemid 32780003)
21. C. W. Ngo, Z. Pan, and X. Y.Wei, "Hierarchical hidden Markov model for rushes structuring and indexing," in Proc. ACM Int. Conf. Image and Video Retrieval, 2006.
22. C. W. Ngo, W. L. Zhao, and Y. G. Jiang, "Fast tracking of near-duplicate keyframes in broadcast domain with transitivity propagation," in Proc. ACM Multimedia Conf., 2006.
23. C. W. Ngo, Z. Pan, X. Wei, X. Wu, H. K. Tan, and W. Zhao, "Motion driven approaches to shot boundary detection, low-level feature extraction and BBC rushes characterization at TRECVID 2005," in Proc. TRECVID Workshop, 2005.
24. P. Over, A. F. Smeaton, and P. Kelly, "The TRECVID 2007 BBC rushes summarization evaluation pilot," in Proc. TRECVID Workshop BBC Rushes Summarization in ACM Multimedia, 2007.
25. P. Over, A. F. Smeaton, and G. Awad, "The TRECVID 2008 BBC rushes summarization evaluation," in Proc. TRECVID Workshop BBC Rushes Summarization in ACM Multimedia, 2008.
26. Z. Pan and C. W. Ngo, "Structuring home video by snippet detection and pattern parsing," in Proc. ACM SIGMM Int. Workshop Multimedia Information Retrieval, 2004.
27. Z. Pan and C. W. Ngo, "Moving object detection, association and selection in home videos," IEEE Trans. Multimedia, vol. 9, no. 2, pp. 268-279, Feb. 2007. (Pubitemid 46183098)
28. J. Ren and J. Jiang, "Hierarchical modeling and adaptive clustering for real-time summarization of rushes videos," IEEE Trans. Multimedia, vol. 11, no. 5, pp. 906-917, Aug. 2009.
29. J. Ren and J. Jiang, "Hierarchical modeling and adaptive clustering for real-time summarization of rushes videos in TRECVID'08," in Proc. TRECVIDWorkshop BBC Rushes Summarization in ACMMultimedia, 2008.
30. P. J. Rousseeuw and A. M. Leroy, Robust Regression and Outlier Detection. New York: Wiley, 1987.
31. J. Sasongko, C. Rohr, and D. Tjondronegoro, "Efficient generation of pleasant video summaries," in Proc. TRECVID Workshop BBC Rushes Summarization in ACM Multimedia, 2008.
32. L. Tang, T. Mei, and X. S. Hua, "Near-lossless video summarization," in Proc. ACM Multimedia, 2009.
33. S. Tang, Y. Zhang, J. Li, X. Pan, T. Xia, and M. Li, "Rushes exploitation 2006 by CAS MCG," in Proc. NIST TRECVID Workshop, 2006.
34. C. M. Taskiran, Z. Pizlo, A. Amir, D. Ponceleon, and E. Delp, "Automated video program summarization using speech transcripts," IEEE Trans. Multimedia, vol. 8, no. 4, pp. 775-791, 2006.
35. B. T. Truong and S. Venkatesh, "Video abstraction: A systematic review and classification," ACM Trans. Multimedia Comput., Commun., Appl., vol. 3, no. 1, pp. 1-37, 2006.
36. B. T. Truong and S. Venkatesh, "Curtin at TRECVID 2006-Rushes summarization," in Proc. NIST TRECVID Workshop, 2006.
37. B. T. Truong and S. Venkatesh, "Generating comprehensible summaries of rushes sequences based on robust feature matching," in Proc. TRECVID Workshop Rushes Summarization at ACM Mltimedia, 2007.
38. F. Wang and C. W. Ngo, "Rushes video summarization by object and event understanding," in Proc. TRECVID Workshop Rushes Summarization at ACM Mltimedia, 2007.
39. M.Wang, X. S. Hua, R. Hong, J. Tang, G. J. Qi, and Y. Song, "Unified video annotation via multigraph learning," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 5, pp. 733-746, May 2009.
40. M. Wang, X. S. Hua, J. Tang, and R. Hong, "Beyond distance measurement: Constructing neighborhood similarity for video annotation," IEEE Trans. Multimedia, vol. 11, no. 3, pp. 465-476, Apr. 2009.
41. T.Wang, S. Feng, P. P.Wang, W. Hu, S. Zhang, W. Zhang, Y. Du, J. Li, J. Li, and Y. Zhang, "THU-intel at rushes summarization of TRECVID 2008," in Proc. TRECVID Workshop BBC Rushes Summarization in ACM Multimedia, 2008.
42. L. Xie, S. Chang, A. Divakaran, and H. Sun, Learning Hierarchical Hidden Markov Models for Video Structure Discovery, Columbia Univ., Tech. Rep., 2002.
43. J. You, G. Liu, L. Sun, and H. Li, "A multiple visual models based perceptive analysis framework for multilevel video summarization," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 3, pp. 273-285, Mar. 2007. (Pubitemid 46394438)
44. W. L. Zhao, C. W. Ngo, H. K. Tan, and X. Wu, "Near-duplicate keyframe identification with interest point matching and pattern learning," IEEE Trans. Multimedia, vol. 9, no. 5, pp. 1037-1048, Aug. 2007. (Pubitemid 47171260)
45. Face Detection Project at CMU. [Online].Available: http://vasc.ri.cmu. edu/NNFaceDetector/.
46. TRECVID Workshop. [Online]. Available: http://www-nlpir.nist.gov/ projects/trecvid.