Video Summarization: Methods and Landscape

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 5242, Issue , 2003, Pages 1-13

  Barbieri, Mauro ^a   Agnihotri, Lalitha ^a   Dimitrova, Nevenka ^a  

^a PHILIPS RESEARCH LABORATORIES   (Netherlands)

Author keywords

Classification; Video highlights; Video skimming; Video summarization

Indexed keywords

ABSTRACTING; CLASSIFICATION (OF INFORMATION); CONTENT BASED RETRIEVAL; CONTEXT FREE GRAMMARS; FEATURE EXTRACTION; METADATA; MULTIMEDIA SYSTEMS; PROBLEM SOLVING;

VIDEO HIGHLIGHTS; VIDEO SKIMMING; VIDEO SUMMARIZATION;

VIDEO RECORDING;

EID: 2342641469     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.515733     Document Type: Conference Paper

References (45)

1. L. Agnihotri, K. Devara, T. McGee, and N. Dimitrova, "Summarization of Video Programs Based on Closed Captioning," SPIE Conf. on Storage and Retrieval in Media Databases, San Jose, CA, January 2001, pp. 599-607.
2. L. Agnihotri, N. Dimitrova, J. Kender, J. Zimmerman, "Study on Requirement specifications for Personalized Multimedia Summarization," in Proc. of IEEE Conference on Multimedia and Expo, June 2003, Baltimore, MD, USA.
3. K. Aizawa, K. -I. Ishijima, M. Shiina, "Summarizing Wearable Video," Proc. Int. Conf. on Image Processing, 2001, vol. 3, pp. 7-10, October 2001.
4. A. Aner and J. R. Kender, "Video Summaries through Mosaic-Based Shot and Scene Clustering," Proc. European Conf. on Computer Vision, Denmark, May 2002.
5. N. Babaguchi, Y. Kawai, and T. Kitahashi, "Generation of Personalized Abstract of Sports Video," Proc. of IEEE Int. Conf. on Multimedia and Expo, ICME 2001, pp. 800-803, Tokyo, Japan, August 2001.
6. P. Chiu, A. Girgensohn, W. Polak, E. Rieffel, and L. Wilcox, "A genetic algorithm for video segmentation and summarization," Proc. of IEEE Int. Conf on Multimedia and Expo, ICME 2000, vol. 3, August 2000, pp 1329-1332.
7. S. Dagtas, T. McGee, and M. Abdel-Mottaleb, "SmartWatch: An automated video event finder," in Proc. ACM Multimedia 2000, Los Angeles, CA.
8. M.G. Christel, A.G. Hauptmann, H.D. Wactlar, and T.D. Ng, "Collages as Dynamic Summaries for News Video," Proceedings of the ACM Multimedia Conference, Juan-les-Pins, France, December 1-6, 2002, pp. 561-569.
9. D. DeMenthon, V. Kobla, and D. Doermann, "Video summarization by curve simplification," Proceedings of the sixth ACM International Conference on Multimedia, Bristol, UK, September 1998.
10. N. Dimitrova, J. Martino, L. Agnihotri, and H. Elenbaas, "Superhistograms for video representation," IEEE ICIP 1999, Kobe, Japan. Volume: 3, 24-28 Oct. 1999 Page(s): 314-318 vol.3
11. N. Dimitrova, H-J Zhang, B. Shahraray, I. Sezan, T. Huang, and A. Zakhor, "Applications of Video Content Analysis and Retrieval," IEEE Multimedia, Vol. 9, No. 3, Jul-Sept. 2002, pp. 42-55.
12. N. Dimitrova, L. Agnihotri, C. Dorai, and R. Bolle, "MPEG-7 VideoText Description Scheme for Superimposed Text," International Signal Processing and Image Communications Journal, September, 2000.
13. N. Dimitrova, T. McGee and H. Elenbaas, "Video Keyframe Extraction and Filtering: A Keyframe is not a Keyframe to Everyone," Proceedings of ACM Conference on Information and Knowledge Management, Nov. 97
14. N. Dimitrova, J. Zimmerman, A. Janevski, L. Agnihotri, N. Haas, and R. Bolle, "Content Augmentation Aspects of Personalized Entertainment Experience," Ninth International Conference on User Modeling, TV'03: the 3rd Workshop on Personalization in Future TV (UM), Johnstown, PA, June 2003, pp 42-51.
15. W. Ding, G. Marchionini, and D. Soergel, "Multimodal Surrogates for Video Browsing," in Proc. ACM Conf. On Digital Lib. (Berkeley, CA, Aug. 1999), ACM Press, 85-93.
16. D. Farin, W. Effelsberg, P.H.N. de With, "Robust clustering-based video-summarization with integration of domain-knowledge," Proceedings of IEEE International Conference on Multimedia and Expo (ICME), vol. 1, pp. 89-92, Lausanne, Switzerland, August 2002.
17. Y. Gong and X. Liu, "Summarizing Video by Minimizing Visual Content Redundancies," Proc. of IEEE Int. Conf. on Multimedia and Expo, ICME 2001, Tokyo, Japan, 2001.
18. A. Hanjalic, H. -J. Zhang, "An Integrated Scheme for Automated Video Abstraction based on Unsupervised Cluster-Validity Analysis," IEEE Transactions on Circuits and Systems for Video Technology (USA), vol. 9, no. 8, pp. 1280-1289, Dec. 1999.
19. A. Hauptmann and M. Smith, "Text, speech, and vision for video segmentation: The Informedia project," AAAI Fall 1995 Symposium on Computational Models for Integrating Language and Vision, 1995.
20. L. He, E. Sanocki, A. Gupta, and J. Grudin, "Auto-Summarization of Audio-Video Presentations," Proceedings of ACM Multimedia 1999, pp. 489-498, Orlando, FL, USA, November 1999.
21. R. Jasinschi, N. Dimitrova, T. McGee, L. Agnihotri, and J. Zimmerman. "Video Scouting: An Architecture and System for the Integration of Multimedia Information in Personal TV Applications," IEEE ICASSP, Salt Lake City, UT, USA, May 7-11, 2001, pp. 1405-1408.
22. D. Li, I. K. Sethi, N. Dimitrova, and T. McGee, "Classification of General Audio Data for Content-Based Retrieval," Pattern Recognition Letters, 2000.
23. Y. Li, W. Ming, and C. -C. Jay Kuo, "Semantic video content abstraction based on multiple cues," Proceedings of ICME, Japan, 2001, pp 804-808.
24. R. Lienhart, "Dynamic video summarization of home video," Storage and Retrieval for Media Databases 2000, San Jose, CA, USA, 26-28 Jan. 2000.
25. Y. -F. Ma, L. Lu, H.-J. Zhang, and M. Li, "A User Attention Model for Video Summarization," ACM Multimedia 2002, Juan Les Pin, December 1-5, 2002, pp 533-542.
26. G. Mekenkamp, M. Barbieri, B. Huet, I. Yahiaoui, B. Merialdo, R. Leonardi, M. Rose, "Generating TV Summaries for CE-devices," Proc. 2002 ACM Int. Conf. on Multimedia, Juan les Pins, France, December 2002, pp 83-84.
27. A. Merlino, M. Maybury, "An Empirical Study of the Optimal Presentation of Multimedia Summaries of Broadcast News," Advances in Automatic Text Summarization, edited by Inderjeet Mani and Mark T. Maybury, 1999, pp 391-401.
28. B. Merialdo, K. T. Lee, D. Luparello, and J. Roudaire, "Automatic construction of personalized TV News programs," Proceedings of ACM Multimedia 1999, pp. 323-331, Orlando, FL, USA, November 1999.
29. M. M. Yeung, B.-L. Yeo, "Video Visualization for Compact Presentation and Fast Browsing of Pictorial Content," IEEE Transaction on Circuits and Systems for Video Technology, vol. 7, no. 5, October 1997.
30. J. Nam, "Video Abstract of Video," Proc. of the IEEE Workshop on Multimedia Signal Processing, Copenhagen, Denmark, September 1999.
31. N. Omoigui, L. He, A. Gupta, J. Grudin, and E. Sanocki, "Time-Compression: Systems Concerns, Usage, and Benefits," Proceedings of the ACM CHI 1999, Pittsburgh, PA, USA.
32. I. Paulussen, M. Barbieri, G. Mekenkamp, "The SPATION Project: Embedding Content Analysis in Consumer Electronic Networks," Third International Workshop on Content-Based Multimedia Indexing, CBMI 2003, September 2003, Rennes, France.
33. K. A. Peker, A. Divakaran, and H. Sun, "Constant pace skimming and temporal sub-sampling of video using motion activity," Proceedings 2001 International Conference on Image Processing, vol. 3, pp. 414-417, Thessaloniki, Greece, October 2001.
34. M. Petkovic, V. Mihajlovic, and W. Jonker, "Multi-modal extraction of highlights from TV formula 1 programs," in Proc. IEEE Int. Conf. on Multimedia and Expo, ICME 2002, Lausanne, Switzerland, 2002.
35. S. Pfeiffer, R. Lienhart, S. Fischer, and W. Effelsberg, "Abstracting Digital Movies Automatically," J. Visual Commumication and Image Representation, vol. 7, pp. 345-353, 1996.
36. D. M. Russell, "A Design Pattern-based Video Summarization Technique: Moving from Low-level Signals to High-level Structure," Proceedings of the 33rd Annual Hawaii International Conference on System Sciences, Jan 4-7, 2000.
37. J. Saarela, and B. Merialdo, "Using content models to build audio-video summaries," Storage and Retrieval for Image and Video Databases VII, San Jose, CA, USA, 26-29 Jan. 1999.
38. G. Salton et al., "Automatic Text Structuring and Summarization," Information Processing & Management, vol. 22, no. 2, 1997, pp.193-207.
39. H. Sundaram, L. Xie, and S-F Chang, "A Utility Framework for the Automatic Generation of Audio-Visual Skims," ACM Multimedia 2002, Juan Les Pin, December 1-5, 2002.
40. T. Syeda-Mahmood, and D. Ponceleon, "Learning Video Browsing Behavior and Its Application in the Generation of Video Previews," Proc. of the ninth ACM international conference on Multimedia, pp. 119-128, October 2001, Ottawa, Canada.
41. C. Toklu, S.-P. Liou, and M. Das, "Videoabstract: A Hybrid Approach to generate semantically meaningful video summaries," In Proc. IEEE conference on Multimedia and Expo, 2000, pp. 1333-1336.
42. http://www-nlpir.nist.gov/projects/tv2003/tv2003.html
43. S. Uchihashi, J. Foote, A. Girgensohn, and J. Boreczky, "Video Manga: Generating Semantically Meaningful Video Summaries," In Proceedings ACM Multimedia, (Orlando, FL) ACM Press, pp. 383-392, 1999.
44. I. Yahiaoui, B. Merialdo and B. Huet, "Generating Summaries of Multi-episode Video," Proc. of IEEE Int. Conf. on Multimedia and Expo, ICME 2001, Tokyo, Japan, 2001.
45. Di Zhong, Raj Kumar, Shih-Fu Chang, "Demonstrations: Real-time personalized sports video filtering and summarization," Proceedings of the ninth ACM international conference on Multimedia, October 2001, pp. 623 - 625.