A natural language approach to content-based video indexing and retrieval for interactive e-Learning

IEEE Transactions on Multimedia

Volumn 6, Issue 3, 2004, Pages 450-458

  Zhang, Dongsong ^a   Nunamaker, Jay F ^b  

^a University of Marylandw Baltimore County   (United States)

^b UNIVERSITY OF ARIZONA   (United States)

Author keywords

Learning by asking; Natural language processing; Video indexing and retrieval

Indexed keywords

INFORMATION RETRIEVAL; INTERNET; KNOWLEDGE ACQUISITION; LEARNING SYSTEMS; MULTIMEDIA SYSTEMS; VIDEO SIGNAL PROCESSING;

INTERACTIVE E-LEARNING; LEARNING BY ASKING (LBA); VIDEO INDEXING AND RETRIEVAL;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 2642577417     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2004.827505     Document Type: Article

References (45)

1. L. Carswell, "Teaching via the internet: The impact of the internet as a communication medium on distance learning introductory computing students," in Conf. Integrating Technology into Computer Science Education , Uppsala, Sweden, 1997, pp. 1-5.
2. M. R. Syed, "Diminishing the distance in distance education," IEEE Multimedia, vol. 8, pp. 18-21, 2001.
3. S. Carville and D. Mitchell, "It's a bit like star trek': The effectiveness of video conferencing," Innov. Educ. Training Int., vol. 37, pp. 42-49, 2000.
4. A. Hampapur and R. Jain, "Video data management systems: Metadata and architecture," in Multimedia Data Management, W. Klas and A. Sheth, Eds. New York: McGraw-Hill, 1998, ch. 9.
5. H. Simpson, H. L. Pugh, and S. W. Parchman, The Use of Videoteletraining to Deliver Hands-On Training: Concept Test and Evaluation. San Diego, CA: Navy Personal Research and Development Center, 1992.
6. C. Morales, C. Cory, and D. Bozell, "A comparative efficiency study between a live lecture and a web-based live-switched multi-camera streaming video distance learning instructional unit," in 2001 Information Resources Management Assoc. Int. Conf., Toronto, ON, Canada, 2001.
7. R. Burke and A. Kass, "Supporting learning through active retrieval of video stories," Expert Syst. Applicat., vol. 9, pp. 361-378, 1995.
8. D. Marinelli and S. Stevens, "Synthetic interviews: The art of creating a "Dyad" between humans and machine-based characters," in Interactive Voice Technology for Telecommunications Applications'98, 1998, pp. 43-48.
9. M. d. G. Pimentel, Y. Ishiguro, G. D. Abowd, B. Kerimbaev, and M. Guzdial, "Supporting educational activities through dynamic web interfaces," Interact. Comput., vol. 13, pp. 353-374, 2001.
10. A. Amir, G. Ashour, and S. Srinivasan, "Toward automatic real time preparation of online video proceedings for conference talks and presentations," in 34th Hawaii Int. Conf System Sciences, Maui, HI, 2001, pp. 1662-1669.
11. H. S. Chang, S. Sull, and S. U. Lee, "Efficient video indexing scheme for content-based retrieval," IEEE Trans. Circuits Syst. Video Technol., vol. 9, pp. 1269-1279, Dec. 1999.
12. N. Dimitrova, T. McGee, and H. Elenbass, "Video keyframe extraction and filtering: A keyframe is not a keyframe to everyone," in Proc. ACM Conf. Information and Knowledge Management, Las Vegas, NV, Nov. 10-14, 1999, pp. 113-120.
13. E. Ardizzone and M. Cascia, "Automatic video database indexing and retrieval," Multimedia Tools Applicat., vol. 4, pp. 29-56, 1997.
14. D. Papadias, M. Mantzourogiannis, P. Kalnis, N. Mamoulis, and I. Ahmad, "Content-based retrieval using heuristic search," in 22nd Annu. Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Berkeley, CA, 1999, pp. 168-175.
15. D. Zhong and S. F. Chang, "Video object model and segmentation for content-based video indexing," in 1997 IEEE Int. Symp. Circuits and Systems , Hong Kong, 1997, pp. 1492-1495.
16. S.-Y. Kim and Y. M. Ro, "Fast content-based MPEG video indexing using object motion histogram," in IEEE Region 10 Conf. (TENCON 99), Cheju Island, Korea, 1999, pp. 1506-1509.
17. B. Gunsel, A. M. Tekalp, and P. J. L. Van Beek, "Object-based video indexing for virtual-studio production," in IEEE Comput. Soc. Conf. Computer Vision and Pattern Recognition, San Juan, Puerto Rico, 1997, pp. 769-774.
18. S. Dagtas, W. Al-khatib, A. Ghafoor, and R. L. Kashyap, "Models for motion-based video indexing and retrieval," IEEE Trans. Image Processing, vol. 9, pp. 88-101, Jan. 2000.
19. S. W. Smoliar and H. Zhang, "Content based video indexing and retrieval," IEEE Multimedia, vol. 1, pp. 62-72, 1994.
20. H. D. Wactlar, M. G. Christel, Y. Gong, and A. G. Hauptmann, "Lessons learned from building a terabyte digital video library," IEEE Computer, vol. 32, pp. 66-73, 1999.
21. Y.-L. Chang, W. Zeng, I. Kamel, and R. Alonso, "Integrated image and speech analysis for content-based video indexing," in Third IEEE Int. Multimedia Computing and Systems , Hiroshima, Japan, 1996, pp. 306-313.
22. S. Tsekeridou and I. Pitas, "Content-based video parsing and indexing based on audio-visual interaction," IEEE Trans. Circuits and Systems for Video Technology, vol. 11, pp. 522-535, Apr. 2001.
23. E. Wold, T. Blum, D. Keislar, and J. Wheaton, "Content-based classification, search, and retrieval of audio," IEEE Multimedia, vol. 3, pp. 27-36, 1996.
24. M. Brown, J. Foote, G. Jones, K. Sparck-Jones, and S. Young, "Open-Vocabulary speech indexing for voice and video mail retrieval," in Fourth ACM Int. Multimedia Conf., Boston, MA, 1996, pp. 307-316.
25. W. Li, S. Gauch, J. Gauch, and K. M. Pua, "Vision: A digital video library," in 1st ACM Int. Conf. Digital Libraries , Bethesda, MD, 1996, pp. 19-27.
26. H. D. Wactlar, A. G. Hauptmann, M. G. Christel, R. A. Houghton, and A. M. Olligschlaeger, "Complementary video and audio analysis for broadcast news archives," Commun. ACM, vol. 43, pp. 42-47, 2000.
27. R. Lienhart, "Automatic text recognition for video indexing," in Fourth ACM Int. Conf. Multimedia , Boston, MA, 1996, pp. 11-20.
28. Y. Kuwano, H. A. Taniguchi, S. Mori, and H. K. Kurakake, "Telop-on-demand: Video structuring and retrieval based on text recognition," in 2000 IEEE Int. Conf. Multimedia and Expo (ICME 2000) United States, New York, 2000, pp. 759-762.
29. R. Burke, "Conceptual indexing and active retrieval of video for interactive learning environments," Knowl.-Based Syst., vol. 9, pp. 491-499, 1996.
30. C. Johnson, L. Birnbaum, R. Bareiss, and T. Hinrichs, "War stories: Harnessing organizational memories to support task performance," Intelligence, pp. 17-31, 2000.
31. H. Jiang and A. K. Elmagarmid, "WVTDB - A semantic content-based video database system on the world wide web," IEEE Trans. Knowl. Data Eng., vol. 10, pp. 947-966, Nov./Dec. 1998.
32. O. Javed, S. Khan, Z. Rasheed, and M. Shah, "A framework for segmentation of interview videos," in IASTED Int. Conf. Internet and Multimedia Systems and Applications United States, Las Vegas, NV, 2000.
33. S. Boykin and A. Merlino, "Machine learning of event segmentation for news on demand," Commun. ACM, vol. 43, pp. 35-41, 2000.
34. P. Chiu, A. Girgensohn, W. Polak, E. Rieffel, and L. Wilcox, "A genetic algorithm for video segmentation and summarization," in 2000 IEEE Int. Conf. Multimedia and Expo , vol. 3, New York, 2000, pp. 1329-1332.
35. E. M. Voorhees and D. M. Tice, "The TREC-8 question answering track evaluation," in Eighth Text REtrieval Conference (TREC-8), Gaithersburg, MD, 1999.
36. K. C. Litkowski, "Syntactic clues and lexical resources in question-answering," in Ninth Text REtrieval Conference (TREC-9), Gaithersburg, MD, 2000, pp. 83-106
37. R. Burke, K. Hammond, V. Kulyukin, S. Lytinen, N. Tomuro, and S. Schoenberg, "Question answering from frequently-asked question files: Experiences with the FAQ finder system," AI Mag., vol. 18, pp. 57-66, 1997.
38. H. D. Wactlar. Informedia - Search and summarization in the video medium, presented at Imagina 2000 Conf.. [Online] Available http://www.informedia.cs. cmu.edu/documents/imagina2000.pdf
39. N. Chinchor. MUC-7 named entity task definition, presented at Seventh Message Understanding Conf. (MUC-7). [Online] Available http://www.itl.nist.gov/ iaui/894.02/related_projects/muc/index.html
40. R. Grishman, "The NYU system for MUC-6 or where's the syntax?," in Sixth Message Understanding Conf. (MUC-6) , Columbia, MD, 1995, pp. 167-175.
41. D. M. Bikel, R. Schwartz, and R. M. Weischedel, "An algorithm that learns what's in a name," Mach. Learn., vol. 34, pp. 211-231, 1999.
42. A. Voutilainen, "Helsinki taggers and parsers for english," in Corpora Galore: Analysis and Techniques in Describing English , J. M. Kirk, Ed. Amsterdam, The Netherlands/Atlanda, GA: Rodopi, 2000.
43. R. Srihari and W. Li, "Information extraction supported question answering," in Eighth Text REtrieval Conf. (TREC-8), Gaithersburg, MD, 1998. pp. 185-196.
44. G. Salton, The SMART Retrieval System. Englewood Cliffs, NJ: Prentice-Hall, 1971.
45. W. A. Cook, Case Grammar Theory. Washington, D.C.: Georgetown Univ. Press, 1989.