Lecture video enhancement and editing by integrating posture, gesture, and text

IEEE Transactions on Multimedia

Volumn 9, Issue 2, 2007, Pages 397-409

  Wang, Feng ^b   Ngo, Chong Wah ^a,c   Pong, Ting Chuen ^b  

^a IEEE   (Hong Kong)

^b HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^c CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Gesture; Lecture video editing; Posture and video text recognition

Indexed keywords

FINITE STATE MACHINE (FSM); LECTURE VIDEO EDITING; VIDEO EDITING; VIDEO TEXT RECOGNITION;

FEATURE EXTRACTION; GESTURE RECOGNITION; IMAGE ANALYSIS; IMAGE QUALITY;

IMAGE ENHANCEMENT;

EID: 33846578711     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2006.886292     Document Type: Article

References (30)

1. G. D. Abowd, C. G. Atkeson, A. Feinstein, and C. Hmelo, "Teaching and learning as multimedia authoring: The classroom 2000 project," in ACM Multimedia Conf., 2000, pp. 187-198.
2. D. Bordwell and K. Thompson, Film An: An Introduction. New York: Random House, 1986.
3. M. Chen, "Visualizing the pulse of a classroom," in ACM Multimedia Conf., 2003.
4. _, "Achieving effective floor control with a low-bandwidth gesture-sensitive videoconferencing system," in ACM Multimedia Conf., 2002.
5. B. Erol, J. J. Hull, and D. S. Lee, "Linking multimedia presentations with their symbolic source documents: Algorithm and applications," in ACM Multimedia, 2003.
6. M. Gleicher and J. Masanz, "Towards virtual videography," in ACM Multimedia Conf., 2000.
7. M. Gleicher, R. M. Heck, and M. N. Wallick, "A framework for virtual videography," in Int. Symp. on Smart Graphics, 2002.
8. L. He, E. Sanocki, A. Gupta, and J. Grudin, "Auto-summarization of audio-video presentations," in ACM Multimedia Conf., 1999.
9. L. He and Z. Zhengyou, "Note-taking with a camera: Whiteboard scanning and image enhancement," in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2004.
10. R. L. Hsu, M. Abdel-Mottaleb, and A. Jain, "Face detection in color images," IEEE Trans. on Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 696-706, May 2002.
11. S. X. Ju, M. J. Black, S. Minneman, and D. Kimber, "Summarization of videotaped presentations: Automatic analysis of motion and gesture," IEEE Transactions on Circuits and Systems for Video Technology, 1998.
12. T. Liu, R. Hjelsvold, and J. R. Render, "Analysis and enhancement of videos of electronic slide presentations," in Int. Conf. on Multimedia & Expo, 2002.
13. T. Liu and J. R. Render, "Spatio-temporal semantic grouping of instructional video content," in Int. Conf. on Image and Video Retrieval, 2003.
14. Q. Liu, Y. Rui, A. Gupta, and J. J. Cadiz, "Automatic camera management for lecture room environment," in Int. Conf. on Human Factors in Computing Systems, 2001.
15. T. F. S. -Mahmood and S. Srinivasan, "Detecting topical events in digital video," in ACM Multimedia Conf., 2000.
16. E. Machnicki and L. Rowe, "Virtual director: Automating a webcast," Multimedia Comput. Network., 2002.
17. J. Martin and J. B. Durand, "Automatic gesture recognition using hidden markov models," in Proc. Int. Conf. Automatic Face and Gesture Recognition, 2000.
18. Y. Matsuo, M. Amano, and K. Uehara, "Mining video editing rules in video streams," in Five. ACM Multimedia Conf., 2002.
19. S. Mukhopadhyay and B. Smith, "Passive capture and structuring of lectures," in Proc. ACM Multimedia Conf., 1999.
20. C. W. Ngo, T. C. Pong, and T. S. Huang, "Detection of slide transition for topic indexing," in Int. Conf. Multimedia Expo, 2002.
21. M. Onishi and K. Fukunaga, "Shooting the lecture scene using computer-controlled cameras based on situation understanding and evaluation of video images," in Proc. Int. Conf. Pattern Recognition, 2004.
22. J. Kovac, P. Peer, and F. Solina, "Human skin colour clustering for face detection," in Proc. Int. Conf. on Computer as a Tool, 2003.
23. D. Q. Phung, S. Venkatesh, and C. Dorai, "Hierarchical topical segmentation in instructional films based on cinematic expressive functions," in Proc. ACM Multimedia Conf., 2003.
24. L. A. Rowe and J. M. Gonzlez, BMRC Lecture Browser [Online]. Available: http://bmrc.berkeley.edu/frame/projects/lb/index.html
25. Y. Rui, A. Gupta, and J. Grudin, "Videography for telepresentations," in Proc. Int. Conf. Human Factors Computing Systems, 2003.
26. J. Luis, "Active face and feature tracking," in Proc. Int. Conf. Image Analysis and Processing, 1999.
27. F. Wang, C. W. Ngo, and T. C. Pong, "Synchronization of lecture videos and electronic slides by video text analysis," in Proc. ACM Multimedia Conf., 2003.
28. _, "Gesture tracking and recognition for lecture video editing," in Proc. Int. Conf. Pattern Recognition, 2004.
29. _, "Exploiting self-adaptive posture-based focus estimation for lecture video editing," in Proc. ACM Multimedia Conf., 2005.
30. IBM Auto Auditorium System [Online]. Available: http://www. autoauditorium.com