Multimedia surrogates for video gisting: Toward combining spoken words and imagery

Information Processing and Management

Volumn 45, Issue 6, 2009, Pages 615-630

  Marchionini, Gary ^a   Song, Yaxiao ^a   Farrell, Robert ^b  

^a UNIVERSITY OF NORTH CAROLINA   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Human factors; Surrogates; Video browsing; Video retrieval; Video summarization

Indexed keywords

HUMAN FACTORS; SURROGATES; VIDEO BROWSING; VIDEO RETRIEVAL; VIDEO SUMMARIZATION;

AUDIO SYSTEMS; HUMAN ENGINEERING; MULTIMEDIA SYSTEMS; VIDEO RECORDING;

IMAGE RETRIEVAL;

EID: 69249205399     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2009.05.007     Document Type: Article

References (29)

1. Boguraev, B., & Neff, M. (2000). Lexical cohesion, discourse segmentation and document summarization. In Proceedings of RIAO-2000, content-based multimedia information access, Paris, France.
2. Christel, M. (2007). Establishing the utility of non-text search for news video retrieal with real world users. In Proceedings of ACM multimedia, Augsburg, Germany, September, 2007 (pp. 706-717).
3. Christel M. Automated metadata in multimedia information systems: Creation, refinement, use in surrogates, and evaluation (2009), Morgan-Claypool Publishers, San Rafael, CA
4. Christel, M., Smith, M., Taylor, C., & Winkler, D. (1998). Evolving video skims into useful multimedia abstractions. In Proceedings of CHI, April 1998 (pp. 171-178).
5. Davis F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly 13 3 (1989) 319-340
6. Dorai, C., Farrell, R. G., Katriel, A., Kofman, G., Li, Ying, & Park, Y. (2006). MAGICAL demonstration: System for automated metadata generation for instructional content. In Proceedings of the 14rg ACM international conference on multimedia 2006 (pp. 491-492).
7. Ferrucci D., and Lally A. UIMA: An architectural approach to unstructured information processing in the corporate research environment. Natural Language Engineering 10 3-4 (2004) 327-348
8. Ghani, J., Supnick, R., & Rooney, P. (1991). The experience of flow in computer-mediated and in face-to-face groups. In Proceedings of the 12th international conference on information systems (pp. 229-237).
9. Li, Y., Dorai, C., & Farrell, R. G. (2005). Creating MAGIC: System for generating learning object metadata for instructional content. In Proceedings of the 13th ACM international conference on multimedia 2005 (pp. 367-370).
10. Mani I., and Maybury M. Advances in automatic text summarization (1999), MIT Press, Cambridge, MA
11. Marchionini G., Wildemuth B., and Geisler G. The open video digital library: A mobius strip of theory and practice. Journal of the American Society for Information Science and Technology 57 2 (2006) 1629-1643
12. Mayer R., and Moreno R. A split-attention effect in multimedia learning: Evidence for dual processing systems in working memory. Journal of Educational Psychology 90 2 (1998) 312-320
13. Natsev, A., Tesic, J., Xie, L., Yan, R., & Smith, J. R. (2007). IBM multimedia search and retrieval system. In Proceedings of the 6th ACM international conference on image and video retrieval (pp. 645-645).
14. Neff M.S., Byrd R.J., and Boguraev B.K. The talent system: TEXTRACT architecture and data model. Natural Language Engineering 10 (2004) 307-326
15. Park, Y., Byrd, R. J., & Boguraev, B. K. (2002). Automatic glossary extraction: Beyond terminology identification. In Proceedings of COLING02, August 2002.
16. Ponceleon, D., Amir, A., Srinivasan, S., Syeda-Mahmood, T., & Petkovic, D. (1999). CueVideo: Automated multimedia indexing and retrieval. In Proceedings ACM MM '99, Orlando, Florida, October 30-November 05, 1999.
17. Smeaton, A., Over, P., & Kraaij, W. (2006). Evaluation campaigns and TRECVis. In Proceedings of ACM multimedia information workshop, Santa Barbara, CA, Ocotber 26-27, 2006 (pp. 321-330).
18. Smith, M., & Kanade, T. (1998). Video skimming and characterization through the combination of image and language understanding. In Proceedings of 1998 IEEE international workshop on content-based access of image and video database, Bombay, India, January 3, 1998 (pp. 61-70). Los Alimitos, CA: IEEE.
19. Snoek C., Worring M., Koelma D., and Smeulders A. A learned lexicon-driven paradigm for interactive video retrieval. IEEE Transactions on Multimedia 9 2 (2007) 280-292
20. Song, Y., & Marchionini, G. (2007). Effects of audio and visual surrogates for making sense of digital video. In Proceedings of ACM conference on human-computer interaction, April 28-May 3, 2007, San Jose, CA (pp. 867-876). NY: ACM Press.
21. Spence R. Rapid, serial and visual: A presentation technique with potential. Information Visualization 1 1 (2002) 13-19
22. Srinivasan S., Petkovic D., and Ponceleon D. Towards robust features for classifying audio in the CueVideo system. ACM Multimedia 1 (1999) 393-400
23. Sundaram H., Lexing X., and Chang S. A utility framework for the automatic generation of audio-visual skims. ACM Multimedia (2002) 189-198
24. Tindall-Ford S., Chandler P., and Sweller J. When two sensory modes are better than one. Journal of Experimental Psychology 3 4 (1997) 257-287
25. Tse, T., Marchionini, G., Ding, W., Slaughter, L., & Komlodi, A. (1998). Dynamic key frame presentation techniques for augmenting video browsing. In Proceedings of AVI '98: Advanced visual interfaces, L' Aquila, Italy, May 25-27 (pp. 185-194).
26. Wactlar H., Christel M., Gong Y., and Hauptmann A. Lessons learned from building a terabyte digital video library. Computer 32 2 (1999) 66-73
27. Wildemuth, B., Marchionini, G., Yang. M., Geisler, G., Wilkens, T., Hughes, A., et al. (2003). How fast is too fast? Evaluating fast forward surrogates for digital video. In Proceedings of the ACM/IEEE joint conference on research on digital libraries (pp. 221-230).
28. Witbrock, M. J., & Mittal, V. O. (1999). Ultra-summarization (poster abstract): A statistical approach to generating highly condensed non-extractive summaries. In Proceedings of the 22nd annual international ACM SIGIR conference on research and development in information retrieval (pp. 315-316).
29. Wittenburg, K., Nicol, J., Paschetto, J., & Martin, C. (1999). Browsing with dynamic key frame collages in web-based entertainment video services. In Proceedings of IEEE international conference on multimedia computing and systems, Florence, Italy (pp. 913-918).