Summarization of visual content in instructional videos

IEEE Transactions on Multimedia

Volumn 9, Issue 7, 2007, Pages 1443-1455

  Choudary, Chekuri ^a   Liu, Tiecheng ^a  

^a University of South Carolina   (United States)

Author keywords

E learning; Instructional video analysis; Key frame selection

Indexed keywords

CAMERA MOVEMENT; CONNECTED COMPONENT; CONTENT-BASED; EXISTING METHOD; HAUSDORFF DISTANCE; IMAGE NOISE; INSTRUCTIONAL VIDEOS; KEY FRAME SELECTION; KEY FRAMES; LOW-LEVEL IMAGE FEATURES; NONUNIFORMITY; PERFORMANCE EVALUATION; ROBUST ALGORITHM; STATISTICAL MODELLING; VIDEO SUMMARIZATION; VISUAL CONTENT;

E-LEARNING; EDGE DETECTION; IMAGE PROCESSING; VIDEO RECORDING; VISUAL COMMUNICATION;

CLUSTERING ALGORITHMS;

EID: 50849135512     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2007.906602     Document Type: Article

References (50)

1. A. Mittal, P. V. Krishnan, and E. Altman, "Content classification and context based retrieval system for E-learning, " Int. J. Educ. Technol. Soc, vol. 9, no. 1, pp. 349-358, 2006.
2. C. Dorai, V. Oria, and V. Neelavalli, "Structuralizing educational videos based on presentation content, " in Proc. ICIP, 2003, vol. 3, pp. 1029-1032.
3. D. Phung, S. Venkatesh, and C. Dorai, "Narrative sturcture analysis with education and training videos for E-learning, " in Proc. Int. Conf. Pattern Recognition, 2002, vol. 2, pp. 835-838.
4. E. Altman, Y. Chen, and W. C. Low, "Semantic exploration of lecture videos, " in ACM Multimedia, 2002, pp. 416-417.
5. H. S. Chang, S. Sull, and S. U. Lee, "Efficient video indexing scheme for content-based retrieval, " IEEE Trans. Circuits Syst. Video Technol, vol. 9, no. 8, pp. 1269-1279, 1999.
6. P. Campisi, A. Longari, and A. Neri, "Automatic key frame selection using a wavelet based approach, " in Proc. SPIE, 1999, vol. 3813, pp. 861-872.
7. D. DeMenthon, V. Kobla, and D. Doermann, "Video summarization by curve simplification, " in ACM Multimedia, 1998, pp. 211-218.
8. T. Liu and J. R. Kender, "Time-constrained dynamic semantic compression for video indexing and interactive searching, " in Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 2001, vol. 2, pp. 531-538.
9. M. Yeung and B. Liu, "Efficient matching and clustering of video shots, " in Proc. ICIP, 1995, vol. 1, pp. 338-341.
10. Y. Zhuang, Y. Rui, T. S. Huang, and S. Mehrotra, "Adaptive key frame extraction using unsupervised clustering, " in Proc. ICIP, 1998, pp. 866-870.
11. A. Divakaran, R. Radhakrishnan, and K. A. Peker, "Motion activitybased extraction of key-frames from video shots, " in Proc. ICIP, 2002, vol. 1, pp. 932-935.
12. W. Wolf, "Key frame selection by motion analysis, " in Proc. ICASSP, 1996, pp. 1228-1231.
13. H. Li, D. Doermann, and O. Kia, "Automatic text detection and tracking in digital video, " IEEE Trans. Image Process., vol. 9, no. 2, pp. 147-156, 2000.
14. R. Lienhart and A. Wernicke, "Localizing and segmenting text in images and videos, " IEEE Trans. Circuits Syst. Video Technol, vol. 12, no. 4, pp. 256-268, 2002.
15. C.-W. Ngo and C.-K. Chan, "Video text detection and segmentation for optical character recognition, " Multimedia Syst., vol. 10, no. 3, pp. 261-272, 2005.
16. M. R. Lyu, J. Song, and M. Cai, "A comprehensive method for multilingual video text detection, localization, and extraction, " IEEE Trans. Circuits Syst. Video Technol, vol. 15, no. 2, pp. 243-255, 2005.
17. M. Sezgin and B. Sankur, "Survey over image thresholding techniques and quantitative performance evaluation, " J. Electron. Imag., vol. 13, no. 1, pp. 146-168, 2004.
18. J. Liang, D. Doermann, and H. Li, "Camera-based analysis of text and documents:A survey, " Int. J. Document Anal. Recognit., vol. 7, no. 2-3, pp. 84-104, 2005.
19. S. X. Ju, M. J. Black, S. Minneman, and D. Kimber, "Summarization of videotaped presentations: Automatic analysis of motion and gesture, " IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 5, pp. 686-696, 1998.
20. T. Liu and J. R. Kender, "Rule-based semantic summarization of instructional videos, " in Proc. ICIP, 2002, vol. 1, pp. 601-604.
21. T. Liu and J. R. Kender, "Semantic mosaic for indexing and compressing instructional videos, " in Proc. ICIP, 2003, vol. 1, pp. 921-924.
22. Y. Chen and W. J. Heng, "Automatic synchronization of speech transcript and slides in presentation, " in Proc. Int. Symp. Circuits and Systems, 2003, vol. 2, pp. 568-571.
23. F. Wang, C.-W. Ngo, and T.-C. Pong, "Synchronization of lecture videos and electronic slides by video text analysis, " in ACM Multimedia, 2003, pp. 315-318.
24. L. He, E. Sanocki, A. Gupta, and J. Grudin, "Auto-summarization of audio-video presentations, " in ACM Multimedia, 1999, pp. 489-498.
25. T. Liu, R. Hejelsvold, and J. R. Kender, "Analysis and enhancement of videos of electronic slide presentations, " in IEEE International Conference on Multimedia and Expo, 2002, vol. 1, pp. 77-80.
26. T. Syeda-Mahmood and S. Srinivasan, "Detecting topical events in digital video, " in ACM Multimedia, 2000, pp. 85-94.
27. S. Mukhopadhyay and B. Smith, "Passive capture and structuring of lectures, " in ACM Multimedia, 1999, pp. 477-487.
28. C.-W. Ngo, F. Wang, and T.-C. Pong, "Structuring lecture videos for distance learning applications, " in Proc. IEEE Int. Symp. Multimedia and Software Engineering, 2003, pp. 215-222.
29. M. Onishi, M. Izumi, and K. Fukunaga, "Production of video image by computer controlled camera operation based on distribution of spatiotemporal mutual information, " in Proc. Int. Conf. Pattern Recognition, 2000, vol. 4, pp. 102-105.
30. Q. Stafford-Fraser and P. Robinson, "Brightboard:A video-augmented environment, " in Proc. Conf. Computer Human Interface, 1996, pp. 134-141.
31. W. J. Heng and Q. Tian, "Content enhancement for E-learning lecture videos using foreground/background separation, " in IEEE Workshop on Multimedia Signal Processing, 2002, pp. 436-439.
32. T. Liu and C. Choudary, "Content adaptive wireless streaming of instructional videos, " Multimedia Tools Applicat., vol. 28, no. 1, pp. 157-171, 2006.
33. A. Mittal, S. Gupta, S. Jain, and A. Jain, "Content-based adaptive compression of educational videos using phase correlation techniques, " Multimedia Syst., vol. 13, no. 3, pp. 249-259, 2006.
34. M. N. Wallick, R. M. Heck, and M. L. Gleicher, "Marker and chalkboard regions, " in Mirage 2005, 2005, pp. 223-228.
35. T. Yokoi and H. Fujiyoshi, "Generating a time shrunk lecture video by event detection, " in Proc. IEEE Int. Conf. Multimedia and Expo, 2006, pp. 641-644.
36. F. Wang, C.-W. Ngo, and T.-C. Pong, "Lecture video enhancement and editing by integrating posture, gesture, and text, " IEEE Trans. Multimedia, vol. 9, pp. 397-409, 2007.
37. L. He, Z. Liu, and Z. Zhang, "Why take notes? use the whiteboard capture system, " in IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003, pp. 776-779.
38. L. He and Z. Zhang, "Real-time whiteboard capture and processing using a video camera for teleconferencing, " in Proc. ICASSP, 2005, pp. 1113-1116.
39. M. Wienecke, G. A. Fink, and G. Sagerer, "Toward automatic videobased whiteboard reading, " Int. J. Doc. Anal. Recognit., vol. 7, no. 2-3, pp. 188-200, 2005.
40. Z. Zhang and L. He, "Notetaking with a camera: Whiteboard scanning and image enhancement, " in Proc. ICASSP, 2004, vol. 3, pp. 533-536.
41. A. Haubold and J. R. Kender, "Analysis and visualization of index words from audio transcripts of instructional videos, " in Proc. IEEE Sixth Int. Symp. Multimedia Software Engineering, 2004, pp. 961-964.
42. Y. Li and C. Dorai, "Instructional video content analysis using audio information, " IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 6, pp. 188-200, 2006.
43. M. Lin, M. Chau, J. Cao, and J. F. Nunamaker, Jr, "Automated video segmentation for lecture videos: A linguistics based approach, " Int. J. Technol. Human Interact., vol. 1, no. 2, pp. 27-45, 2005.
44. I. Malioutov and R. Barzilay, "Minimum cut model for spoken lecture segmentation, " in Int. Conf. Computational Linguistics and 44th Annu. Meeting of the ACL, 2006, pp. 25-32.
45. S. Repp and C. Meinel, "Semantic indexing for recorded educational lecture videos, " in IEEE Int. Conf. Pervasive Computing and Communications Workshops, 2006.
46. N. Yamamoto, J. Ogata, and Y. Ariki, "Topic segmentation and retrieval system for lecture videos based on spontaneous speech recognition, " in Proc. Eurospeech, 2003, pp. 961-964.
47. B. Erol and Y. Li, "An overview of technologies for E-meeting and E-lecture, " in IEEE Int. Conf. Multimedia and Expo, 2005.
48. C. Choudary and T. Liu, "Extracting content from instructional videos by statistical modeling and classification, " Int. J. Pattern Anal. Applicat., vol. 10, no. 2, pp. 69-81, 2007.
49. D. Comaniciu and P. Meer, "Mean shift: A robust approach towards feature space analysis, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, 2002.
50. D. Huttenlocher, D. Klanderman, and A. Rucklige, "Comparing images using the Hausdorff distance, " IEEE Trans. Pattern Anal Mach. Intell., vol. 15, no. 9, pp. 850-863, 1993.