Audiovisual integration with Segment Models for tennis video parsing

Computer Vision and Image Understanding

Volumn 111, Issue 2, 2008, Pages 142-154

  Delakis, Manolis ^a   Gravier, Guillaume ^a   Gros, Patrick ^a  

^a CAMPUS DE BEAULIEU   (France)

Author keywords

Hidden Markov Models; Multimodal fusion; Segment Models; Video indexing; Video summarization

Indexed keywords

COMPUTATIONAL GRAMMARS; FUSION REACTIONS; IMAGING TECHNIQUES; LEARNING SYSTEMS; MARKOV PROCESSES; NUCLEAR PHYSICS; OBJECT RECOGNITION; PHOTOGRAPHY; RECORDING INSTRUMENTS; SPEECH RECOGNITION; VIDEO RECORDING; VISUAL COMMUNICATION;

ASYNCHRONOUS FUSION; AUDIOVISUAL (AV); AUDIOVISUAL (AV) FUSION; MARKOV MODELLING; MULTI-MODAL INFORMATION; NUMEROUS APPLICATIONS; PERSONAL VIDEO RECORDING SYSTEMS; SAMPLING RATE (SR); SEGMENT MODEL (SM); SYNCHRONIZATION POINTS; VIDEO DATABASES; VIDEO SCENES; VIDEO-CONTENT ANALYSIS; VISUAL FEATURES;

HIDDEN MARKOV MODELS;

EID: 47049092919     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2007.09.002     Document Type: Article

References (32)

1. Brunelli R., Mich O., and Modena C.M. A survey on the automatic indexing of video data. Journal of Visual Communication and Image Representation 10 2 (1999) 78-112
2. Snoek C., and Worring M. Multimodal video indexing: a review of the state-of-the-art. Multimedia Tools and Applications 25 1 (2005) 5-35
3. Rabiner L. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 77 2 (1989) 257-285
4. W. Wolf, Hidden Markov model parsing of video programs, in: Proceedings of ICASSP, 1997, pp. 2609-2611.
5. Kijak E., Gravier G., Oisel L., and Gros P. Audiovisual integration for tennis broadcast structuring. Multimedia Tools and Applications 30 3 (2006) 289-311
6. Ostendorf M., Digalakis V., and Kimball O. From HMMs to segment models: a unified view of stochastic modeling for speech recognition. IEEE Transactions on Speech and Audio Processing 4 5 (1996) 360-378
7. Wang Y., Liu Z., and Huang J. Multimedia content analysis. IEEE Signal Processing Magazine 17 6 (2000) 12-36
8. J. Calic, N. Campbell, S. Dasiopoulou, Y. Kompatsiaris, An overview of multimodal video representation for semantic analysis, in: Proceedings of the European Workshop on the Integration of Knowledge, Semantics and Digital Media Technologies (EWIMT 2005), IEE, 2005.
9. J. Huang, Z. Liu, Y. Wang, Y. Chen, E. Wong, Integration of multimodal features for video classification based on HMM, in: Proceedings of IEEE Signal Processing Society Workshop on Multimedia Signal Processing, 1999, pp. 53-58.
10. J. Boreczky, L. Wilcox, A hidden Markov model framework for video segmentation using audio and image features, in: Proceedings of ICASSP, 1998, pp. 3741-3744.
11. T. Bae, S. Jin, Y. Ro, Video segmentation using hidden Markov model with multimodal features, in: Proceedings of the International Conference on Image and Video Retrieval, 2004, pp. 401-409.
12. Alatan A., Akansu A., and Wolf W. Multi-modal dialog scene detection using hidden Markov models for content-based multimedia indexing. Multimedia Tools and Applications 14 2 (2001) 137-151
13. N. Dimitrova, L. Agnihorti, G. Wei, Video classification based on HMM using text and faces, in: Proceedings of the European Signal Processing Conference, 2000.
14. S. Eickeler, S. Muller, Content-based video indexing of TV broadcast news using Hidden Markov Models, in: IEEE Int. Conference on Acoustics, Speech, and Signal Processing (ICASSP), 1999, pp. 2997-3000.
15. U. Iurgel, R. Meermeier, S. Eickeler, G. Rigoll, New approaches to audio-visual segmentation of TV news for automatic topic retrieval, in: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2001, pp. 1397-1400.
16. Potamianos G., Neti C., Gravier G., Garg A., and Senior A.W. Recent advances in the automatic recognition of audiovisual speech. Proceedings of the IEEE 91 9 (2003) 1306-1326
17. H. Bourlard, S. Dupont, A new ASR approach based on independent processing and recombination of partial frequency bands, in: Proceedings of the ICSLP'96, 1, Philadelphia, PA, 1996, pp. 426-429.
18. H. Glotin, D. Vergyri, C. Neti, G. Potamianos, J. Luettin, Weighting schemes for audio-visual fusion in speech recognition, in: Proceedings of Int. Conf. Acoust. Speech Signal Process, 2001.
19. Bengio S. An asynchronous hidden Markov model for audio-visual speech recognition. In: Becker S., Thrun S., and Obermayer K. (Eds). Advances in Neural Information Processing Systems. NIPS 15 (2003), MIT Press 1237-1244
20. McCowan I., Gatica-Perez D., Bengio S., Lathoud G., Barnard M., and Zhang D. Automatic analysis of multimodal group actions in meetings. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 27 3 (2005) 305-317
21. Oliver N., Garg A., and Horvitz E. Layered representations for learning and inferring office activity from multiple sensory channels. Computer Vision and Image Understanding 96 2 (2004) 163-180
22. D. Zhang, D. Gatica-Perez, S. Bengio, I. McCowan, G. Lathoud, Modeling individual and group actions in meetings: a two-layer HMM framework, in: IEEE Workshop on Event Mining at the Conference on Computer Vision and Pattern Recognition, CVPR, vol. 7, 2004, pp. 117-124.
23. Xie L., Xu P., Chang S.-F., Divakaran A., and Sun H. Structure analysis of soccer video with domain knowledge and hidden Markov models. Pattern Recognition Letters 25 7 (2004) 767-775
24. M. Delakis, G. Gravier, P. Gros, Score oriented viterbi search in sport video structuring using HMM and segment models, in: Proceedings of the International Workshop on Multimedia Signal Processing (MMSP'06), 2006.
25. B. Truong, C. Dorai, S. Venkatesh, New enhancements to cut, fade, and dissolve detection processes in video segmentation, in: Proceedings of the ACM on Multimedia, 2000, pp. 219-227.
26. R. Dahyot, A. Kokaram, N. Rea, H. Denman, Joint audio visual retrieval for tennis broadcasts, in: IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 3, 2003, pp. 561-564.
27. D. Zhong, S.-F. Chang, Structure analysis of sports video using domain models, in: IEEE International Conference on Multimedia and Expo, 2001.
28. Rousseeuw P.J., and Leroy A.M. Robust Regression and Outlier Detection (1987), John Wiley
29. M. Betser, G. Gravier, Multiple events tracking in sound tracks, in: Intl. Conf. Multimedia and Exhibition, 2004.
30. A. Tritschler, A segmentation-enabled speech recognition application using the BIC criterion, Ph.D. thesis, Institut EURECOM, France (1998).
31. Fine S., Singer Y., and Tishby N. The hierarchical hidden Markov model: analysis and applications. Machine Learning 32 1 (1998) 41-62
32. C. Snoek, M. Worring, A. Smeulders, Early versus late fusion in semantic video analysis, in: MULTIMEDIA'05: Proceedings of the 13th annual ACM international conference on Multimedia, ACM Press, New York, NY, USA, 2005, pp. 399-402.