Automated video summarization using speech transcripts

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 4676, Issue , 2002, Pages 371-382

  Taskiran, Cuneyt M ^a   Amir, Arnon ^b   Ponceleon, Dulce ^b   Delp, Edward J ^a  

^a PURDUE UNIVERSITY   (United States)

^b IBM ALMADEN RESEARCH CENTER   (United States)

Author keywords

Content based video analysis; Segmentation of speech transcripts; Speech analysis; Summary evaluation; Video databases; Video skimming; Video summarization

Indexed keywords

ALGORITHMS; SPEECH PROCESSING; SPEECH RECOGNITION; STATISTICAL METHODS;

VIDEO SKIMMING;

IMAGE ANALYSIS;

EID: 0036029690     PISSN: 0277786X     EISSN: None     Source Type: Journal    
DOI: 10.1117/12.451107     Document Type: Article

References (32)

1. M.G. Christel, M.A. Smith, R. Taylor, and D.B. Winker, "Evolving video skims into useful multimedia abstractions," Proceedings of the ACM Computer-Human Interface Conference (CHI'98), April 18-23 1998, Los Angeles, CA, pp. 171-178.
2. L. He, E. Sanocki, A. Gupta, and J. Grudin, "Comparing presentation summaries: Slides vs. reading vs. listening," Conference on Human Factors in Computing Systems (CHI 2000), April 1-6 2000, The Hague, Netherlands, pp. 177-184.
3. S. Srinivasan, D. Ponceleon, A. Amir, B. Blanchard, and D. Petkovic, "Engineering the web for multimedia," Proceeding of the Web Engineering Workshop (WEBE), WWW-9, May 15-19 2000, Amsterdam, Netherlands.
4. A.W.M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 12, pp. 1349-1380, December 2000.
5. M.M. Yeung and B.-L. Yeo, "Video visualization for compact presentation and fast browsing of pictorial content," IEEE Transactions on Circuits and Systems for Video Technology, vol. 7, no. 5, pp. 771-785, October 1997.
6. Y. Taniguchi, A. Akutsu, and Y. Tonomura, "Panorama excerpts: Extracting and packing panoramas for video browsing," Proceedings of the ACM Multimedia, November 9-13 1997, Seattle, WA, pp. 427-436.
7. N. Vasconcelos and A. Lippman, "Bayesian modeling of video editing and structure: Semantic features for video summarization and browsing," Proceedings of IEEE International Conference on Image Processing, October 4-7 1998, Chicago, IL.
8. C. Taskiran, J. Chen, C.A. Bouman, and E.J. Delp, "A compressed video database structured for active browsing and search," Proceedings of the IEEE International Conference on Image Processing, October 4-7 1998, Chicago, IL.
9. D. DeMenthon, V. Kobla, and D. Doerman, "Video summarization by curve simplification," Proceedings of the ACM Multimedia Conference, September 12-16 1998, Bristol, England, pp. 211-218.
10. S. Uchihashi, J. Foote, A. Girgenson, and J. Boreczky, "Video manga: Generating semantically meaningful video summaries," Proceedings of ACM Multimedia'99, October 30 - November 5 1999, Orlando, FL, pp. 383-392.
11. A. Stefanidis, P. Partsinevelos, P. Agouris, and P. Doucette, "Summarizing video datasets in the spatiotemporal domain," Proceedings of the International Workshop on Advanced Spatial Data Management (ASDM'2000), September 6-7 2000, Greenwich, England.
12. J. Oh and K.A. Hua, "An efficient technique for summarizing videos using visual contents," Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'2000), July 30-August 2 2000, New York, NY.
13. S. Pfeiffer, R. Lienhart, S. Fischer, and W. Effelsberg, "Abstracting digital movies automatically," Journal of Visual Communication and Image Processing, vol. 7, no. 4, pp. 345-353, December 1996.
14. R. Lienhart, "Dynamic video summarization of home video," Proceedings of SPIE Conference on Storage and Retrieval for Media Databases 2000, vol. 3972, January 2000, San Jose, CA, pp. 378-389.
15. L. He, E. Sanocki, A. Gupta, and J. Grudin, "Auto-summarization of audio-video presentations," Proceedings of the 7th ACM International Multimedia Conference, 30 October - 5 November 1999, Orlando, FL, pp. 489-498.
16. K. Ratakonda, I.M. Sezan, and R.J. Crinon, "Hierarchical video summarization," Proceedings of SPIE Conference Visual Communications and Image Processing, vol. 3653, January 1999, San Jose, CA, pp. 1531-1541.
17. S.M. Iacob, R.L. Lagendijk, and M.E. Iacob, "Video abstraction based on asymmetric similarity values," Proceedings of SPIE Conference on Multimedia Storage and Archiving Systems IV, vol. 3846, September 1999, Boston, MA, pp. 181-191.
18. L. Agnihotri, K.V. Devera, T. McGee, and N. Dimitrova, "Summarization of video programs based on closed captions," Proceedings of SPIE Conference on Storage and Retrieval for Media Databases 2001, vol. 4315, January 2001, San Jose, CA, pp. 599-607.
19. M.A. Smith and T. Kanade, "Video skimming and characterization through the combination of image and language understanding techniques," Proceedings of the IEEE Conference on Computer Vision and Pattren Recognition, June 1997, San Juan, PR.
20. M. Christel, A.G. Hauptman, A.S. Warmack, and S.A. Crosby, "Adjustable filmstrips and skims as abstractions for a digital video library," Proceedings of the IEEE Conference on Advances in Digital Libraries, May 19-21 1999, Baltimore, MD.
21. J. Saarela and B. Merialdo, "Using content models to build audio-video summaries," Proceedings of SPIE Conference on Storage and Retrieval for Image and Video Databases VII, vol. 3656, January 1999, San Jose, CA, pp. 338-347,.
22. D. Ponceleon and A. Dieberger, "Hierachical brushing in a collection of video data," Proceedings of the 34th Hawaii International Conference on System Sciences (HICSS'34), January 3-6 2001, Maul, Hawaii.
23. Q. Huang, Z. Liu, A. Rosenberg, D. Gibbon, and B. Shahraray, "Automated generation of news content hierarchy by integrating audio, video, and text information," Proceedings of IEEE International Conference on Acoustic, Speech and Signal Processing, March 15-19 1999, Phoenix, AR, pp. 3025-3028.
24. K.S. Jones, "What might be in a summary?," Information Retrieval, pp. 9-26, September 1993.
25. L.R. Bahl, S. Balakrishnan-Aiyer, J.R. Bellegarda, M. Franz, P.S. Gopalakrisnan, D. Nahamoo, M. Novak, M. Padmanabhan, M.A. Picheny, and S. Roukos, "Performance of the IBM large vocabulary continuous speech recognition system on the ARPA Wall Street Journal task," Proceedings of IEEE International Conference on Acoustic, Speech and Signal Processing, May 8-12 1995, Detroit, MI, pp. 41-44.
26. A. Amir, D. Ponceleon, B. Blanchard, S. Srinivasan, and G. Cohen, "Using audio time scale modification for video browsing," Proceedings of the 33rd Hawaii International Conference on System Sciences (HICSS-2000), January 2000, Maul, Hawaii.
27. B.-L. Yeo and B. Liu, "Rapid scene analysis on compressed video," IEEE Transactions on Circuits and Systems for Video Technology, vol. 5, no. 6, pp. 533-544, December 1995.
28. K.S. Jones, S. Walker, and S.E. Robertson, "A probabilistic model of information retrieval: Development and status," Information Processing and Management, vol. 36, no. 6, pp. 779-840, 2000.
29. T.E. Dunning, "Accurate methods for the statistics of surprise and coincidence," Computational Linguistics, vol. 19, no. 1, pp. 61-74, 1993.
30. S. Martello and P. Toth, Knapsack Problems: Algorithms and Computer Implementations. Chichester, NY: J. Wiley and Sons, 1990.
31. K.S. Jones and J.R. Galliers, Evaluating Natural Language Processing Systems: An Analysis and Review. New York, NY: Springer, 1996.
32. H. Jing, R. Barzilay, K. McKeown, and M. Elhadad, "Summarization evaluation methods: Experiments and analysis," Proceedings of the AAAI Symposium on Intelligent Summarization, March 23 - 25 1998, Palo Alto, CA.