Hierarchical audio-visual cue integration framework for activity analysis in intelligent meeting rooms

2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009

Volumn , Issue , 2009, Pages 107-114

  Shivappa, Shankar T ^a   Trivedi, Mohan M ^a   Rao, Bhaskar D ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; INFORMATION ANALYSIS; SEMANTICS;

AUDIO AND VISUAL CUES; HEAD POSE ESTIMATION; HUMAN ACTIVITY ANALYSIS; INTELLIGENT MEETING ROOMS; LOCALIZATION AND TRACKING; RE IDENTIFICATIONS; SCENE UNDERSTANDING; SMART MEETING ROOMS;

SPEECH RECOGNITION;

EID: 70449556249     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2009.5204224     Document Type: Conference Paper

References (24)

1. P. S. Aleksic and A. K. Katsaggelos. Audio-visual biometrics. Proceedings of the IEEE, 94(11):2025-2044, Nov. 2006. 1
2. L. Bahl, J. Cocke, R Jelinek, and J. Raviv. Optimal decoding of linear codes for minimizing symbol error rate. IEEE Transactions on Information Theory, IT-20(2):284-287, Mar. 1974. 3
3. K. Bernardin, T. Gehrig, and R. Stiefelhagen. Multi-Level Particle Filter Fusion of Features and Cues for Audio-Visual Person Tracking. In CLEAR Evaluation Workshop 2007, 2007. 1
4. K. Bernardin, R. Stiefelhagen, and A. Waibel. Probabilistic integration of sparse audio-visual cues for identity tracking. In MM '08: Proceeding of the 16th ACM international conference on Multimedia, pages 151-158, New York, NY, USA, 2008. ACM. 2, 4
5. N. Checka, K. W. Wilson, M. R. Siracusa, and T. Darrell. Multiple person and speaker activity tracking with a particle filter. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, 2004. 1
6. T. Choudhury, J. M. Rehg, V. Pavlovic, and A. Pentland. Boosting and structure learning in dynamic bayesian networks for audio-visual speaker detection. In ICPR '02: Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 3, page 30789, Washington, DC, USA, 2002. IEEE Computer Society. 1
7. P. Dai and G. Xu. Context-aware computing for assistive meeting system. In PETRA '08: Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments, pages 1-7, New York, NY, USA, 2008. ACM. 2
8. J. H. DiBiase, H. F. Silverman, and M. S. Branstein. Robust localization in reverberant rooms. Microphone Arrays: Signal Processing Techniques and Applications, 2001. 2
9. D. Gatica-Perez, G. Lathoud, J. Odobez, and I. McCowan. Audiovisual probabilistic tracking of multiple speakers in meetings. IEEE Transactions on Audio, Speech and Language Processing, 15, 2007. 1
10. T. Gustafsson, B. D. Rao, and M. M. Trivedi. Source localization in reverberant environments: Modeling and statistical analysis. IEEE Transactions on Speech and Audio Processing, 11(6), Nov. 2003. 4
11. K. S. Huang and M. M. Trivedi. Integrated detection, tracking, and recognition of faces with omnivideo array in intelligent environments. EURASIP Journal on Image and Video Processing, 2008(1), 2008. 4
12. H. K. Maganti, D. Gatica-Perez, and I. McCowan. Speech enhancement and recognition in meetings with an audiovisual sensor array. IEEE Trans, on Audio, Speech, and Language Processing, 15(11):2257-2269, Nov 2007. 2, 4
13. E. Murphy-Chutorian and M. M. Trivedi. 3d tracking and dynamic analysis of human head movements and attentional targets. Distributed Smart Cameras, 2008. ICDSC 2008. Second ACM/IEEE International Conference on, pages 1-8, Sept. 2008. 4
14. E. Murphy-Chutorian and M. M. Trivedi. Head pose estimation in computer vision: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 99(1), 5555. 4
15. C. Neti, G. Potamianos, J. Luettin, I. Matthews, H. Glotin, and D. Vergyri. Large-vocabulary audio-visual speech recognition: A summary of the Johns Hopkins summer 2000 workshop. In Proceedings of IEEE Workshop Multimedia Signal Processing, Cannes, 2001. 1
16. A. ODonovan and R. Duraiswami. Microphone arrays as generalized cameras for integrated audio visual processing. In Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, Minneapolis, USA, 2007. 1
17. N. M. Oliver, B. Rosario, and A. Pentland. A Bayesian computer vision system for modeling human interactions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8):831-843, 2000. 2
18. S. T. Shivappa, B. D. Rao, and M. M. Trivedi. An iterative decoding algorithm for fusion of multi-modal information. EURASIP Journal on Advances in Signal Processing, Special Issue on Human-Activity Analysis in Multimedia Data, 2008. 1
19. S. T. Shivappa, B. D. Rao, and M. M. Trivedi. Multimodal information fusion using the iterative decoding algorithm and its application to audio-visual speech recognition. In Acoustics, Speech and Signal Processing, 2008. ICASSP 2008. IEEE International Conference on, Las Vegas, Nevada, USA, 2008. 1
20. S. T. Shivappa, B. D. Rao, and M. M. Trivedi. Role of head pose estimation in speech acquisition from distant microphones. In Accepted at Acoustics, Speech and Signal Processing, 2009. ICASSP 2009. IEEE International Conference on, Taiwan, 2009. 2, 4
21. S. T. Shivappa, M. M. Trivedi, and B. D. Rao. Person tracking with audio-visual cues using the iterative decoding framework. In 5th IEEE International Conference On Advanced Video and Signal Based Surveillance, Santa Fe, New Mexico, USA, [Best Paper Award], 2008. 1, 3, 5
22. M. M. Trivedi, K. S. Huang, and I. Mikic. Dynamic context capture and distributed video arrays for intelligent spaces. IEEE Transactions on Systems, Man and Cybernetics, 35, Jan. 2005. 1
23. Z. Zeng, J. Tu, B. M. Pianfetti, and T. S. Huang. Audiovisual affective expression recognition through multistream fused hmm. Multimedia, IEEE Transactions on, 10(4):570-577, June 2008. 1
24. D. Zhang, D. Gatica-Perez, S. Bengio, I. McCowan, and G. Lathoud. Modeling individual and group actions in meetings: A two-layer hmm framework. Computer Vision and Pattern Recognition Workshop, 2004 Conference on, pages 117-117, June 2004. 2