Incorporating audio cues into dialog and action scene extraction

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 5021, Issue , 2003, Pages 252-263

  Chen, Lei ^a   Rizvi, Shariq J ^b   Özsu, M Tamer ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

^b INDIAN INSTITUTE OF TECHNOLOGY BOMBAY   (India)

Author keywords

Audio classification; Editing rules; Finite state machine; Scene; Shot; Support vector machine

Indexed keywords

CLASSIFICATION (OF INFORMATION); MOTION PICTURES; SOUND RECORDING; VIDEO RECORDING;

AUDIO CUES;

FEATURE EXTRACTION;

EID: 0037718461     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.476317     Document Type: Conference Paper

References (34)

1. T. Kikukawa and S. Kawafuchi, "Development of an automatic summary editing system for the audio-visual resources," Transactions on Electronics and Information J72(A), pp. 204-212, 1992.
2. B. Shahraray, "Scene change detection and content-based sampling of video sequences," in Proceedings of IS&T/SPIE 2419, pp. 2-13, 1995.
3. H. Zhang, A. Kankanhalli, and S. Smoliar, "Automatic partitioning of full-motion video," Multimedia Systems 1, pp. 10-28, 1993.
4. A. Nagasaka and Y. Tanaka, "Automatic video indexing and full video search for object appearances," in Proceedings of 2nd Working Conference on Visual Database System, pp. 119-133, 1991.
5. Y.Tonomura, A. Akutsu, K. Otsuji, and T.Sadakata, "VideoMap and video Spacelcon: Tools for anatomizing video content," in Proceedings of ACM INTERCHI, pp. 131-141, 1993.
6. H. J. Zhang, C. Y. Low, S. W. Smoliar, and J. H. Wu, "Video parsing, retrieval and browsing: An integrated and content based solution," in Proceedings of ACM International Conference on Multimedia, pp. 15-24, (San Francisco, CA), 1995.
7. M. Yeung and B.-L. Yeo, "Time-constrained clustering for segmentation of video into story units," in Proceedings of 13th International Conference on Pattern Recognition, 3, pp. 375-380, 1996.
8. Y. Rui, T. S. Huang, and S. Mehrotra, "Exploring video structure beyond the shots," in Proceedings of IEEE International Conference on Multimedia Computing and Systems, pp. 237-240, 1992.
9. A. Hanjalic, R. Lagendijk, and J.Biemond, "Automatically segmenting movies into logical story units," in Proceedings of International Conference on Visual Information Systems, pp. 229-236, 1999.
10. W. Mahdi, M. Ardebilian, and L.M.Chen, "Automatic video scene segmentation based on spatial-temporal clues and rhythm," Networking and Information Systems Journal 2(5), pp. 1-25, 2000.
11. D. Arijon, Grammar of the Film Language, Focal Press, 1976.
12. A. Yoshitaka, T. Ishii, and A. Hirakawa, "Content-based retrieval of video data by the grammar of film," in Proceedings of IEEE Symposium on Visual Languages, 3, pp. 310-317, 1997.
13. L. Chen and M. T. Özsu, "Rule-based scene extraction from video," in Proceedings of IEEE International Conference on Image Processing, pp. 737-740, September 2002.
14. J. Saunders, "Real-time discrimination of broadcast speech/music," in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 993-996, May 1996.
15. E. Scheirer and M. Slaney, "Construction and evaluation of a robust multifeature speech/music discriminator," in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 21-24, April 1997.
16. K. El-Maleh, M. Klein, G. Petrucci, and P. Kabal, "Speech/music discrimination for multimedia applications," in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 2445-2448, June 2000.
17. L. Lu, H. Jiang, and H. J. Zhang, "A robust audio classification and segmentation method," in Proceedings of ACM International Conference on Multimeida, 2001.
18. T. Zhang and C. C. J. Kuo, "Audio content analysis for online audiovisual data," IEEE Transaction on Speech and Audio Processing 9, pp. 619-625, 5 2001.
19. S. Srinivasan, D. Petkovic, and D. Ponceleon, "Towards robust features for classifying audio in the Cue Video system," in Proceedings of ACM International Conference on Multimedia, 1999.
20. Y. Day, S. Dagtas, M. Iino, A. Khokhar, and A. Ghafoor, "Object-oriented conceptual modeling of video data," in Proceedings of the Eleventh International Conference on Proceedings on Data Engineering, pp. 401-408, March 1995.
21. S. D. Katz, Film Directing shot by shot visualizing from concept to screen, Michael Wiese Productions, 1991.
22. G. J. Lu and T. Hankinson, "A technique towards automatic audio classification and retrieval," in Proceedings of IEEE International Conference on Signal Processing, pp. 1142-1145, Oct 1998.
23. M. C. Liu and C. Wan, "A study on content-based classification and retrieval of audio database," in Proceedings of IEEE International Symposium on Database Engineering and Applications, pp. 339-345, July 2001.
24. S. Pfeiffer, S. Fischer, and W. Effelsberg, "Automatic audio content analysis," in Proceedings of ACM International Conference on Multimedia, 1996.
25. C. J. C. Burges., "A tutorial on support vector machines for pattern recognition," Data Mining and Knowledge Discovery 2(2), pp. 121-167, 1998.
26. V. Vapnik, Statistical Learning Theory, Wiley, 1998.
27. T. Joachims, "SVMlight support vector machine." http://svmlight.joachims.org/.
28. J. L. Hein, Theory of Computation: An introduction, Jones and Bartlett Publishers, 1996.
29. R. Lienhart, S. Pfeiffer, and W. Effelsberg, "Scene determination based on video and audio features," in Proceedings of International Conference on Visual Information Systems, pp. 685-690, 1999.
30. M. Carey, E. S. Parris, and H. Lloyd-Thomas, "A comparison of features for speech, music discrimination," in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 149-152, April 1999.
31. G. Lu and H. Templar, "An investigation of automatic audio classification and segmentation," in Proceedings of WCCC-ICSP 2000, 5th International Conference on Signal Processing, pp. 776-781.
32. E. Wold, T. Blum, D. Keislar, and J. Wheaten, "Content-based classification, search, and retrieval of audio," IEEE Multimedia 3(3), pp. 27-36, 1996.
33. S. Z. Li, "Content-based audio classification and retrieval using the nearest feature line method," IEEE Transaction on Speech and Audio Processing 8(5), 2000.
34. T. Zhang and C. C. J. Kuo, "Audio content analysis for online audiovisual data," IEEE Transaction on Speech and Audio Processing 9, pp. 619-625, 5 2001.