Audio-visual perception of a lecturer in a smart seminar room

Signal Processing

Volumn 86, Issue 12, 2006, Pages 3518-3533

  Stiefelhagen, R ^a   Bernardin, K ^a   Ekenel, H K ^a   McDonough, J ^a   Nickel, K ^a   Voit, M ^a   Wolfel M ^a  

^a UNIVERSITY OF KARLSRUHE   (Germany)

Author keywords

Audio visual tracking; Face recognition; Far field speech recognition; Head pose estimation; Multimodal multisensor interfaces; Smart rooms

Indexed keywords

AUDIO VISUAL TRACKING; FAR FIELD SPEECH RECOGNITION; HEAD POSE ESTIMATION; MULTIMODAL MULTISENSOR INTERFACES; SMART ROOMS;

CAMERAS; FACE RECOGNITION; IDENTIFICATION (CONTROL SYSTEMS); MODAL ANALYSIS; SPEECH RECOGNITION; TRACKING (POSITION);

INTELLIGENT BUILDINGS;

EID: 33749431842     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2006.02.043     Document Type: Article

References (37)

1. B. Brumitt, B. Meyers, J. Krumm, A. Kern, S. Shafer, Easyliving: technologies for intelligent environments, in: Handheld and Ubiquitous Computing, September 2000.
2. Abowd G.D., Atkeson C., Feinstein A., Hmelo C., Kooper R., Long S., Sawhney N., and Tani M. Teaching and learning as multimedia authoring: the classroom 2000 project. Proceedings of the ACM Multimedia'96 Conference (November 1996) 187-198
3. McCowan I., Bengio S., Gatica-Perez D., Lathoud G., Monay F., Moore D., Wellner P., and Bourlard H. Modeling human interaction in meetings. ICASSP (2003)
4. A. Janin, J. Ang, S. Bhagat, R. Dhillon, J. Edwards, J. Macias-Guarasa, N. Morgan, B. Peskin, E. Shriberg, A. Stolcke, C. Wooters, B. Wrede, The icsi meeting project: resources and research, in: NIST 2004 Meeting Recognition Workshop, Montreal, May 2004 (AMI-06).
5. The NIST smart space project. 〈http://www.nist.gov/smartspace/〉.
6. C.D. Kidd, R.J. Orr, G.D. Abowd, C.G. Atkeson, I.A. Essa, B. MacIntyre, E. Mynatt, T.E. Starner, W. Newstetter, The aware home: a living laboratory for ubiquitous computing research, in: International Workshop on Cooperative Buildings-CoBuild'99.
7. E.M. Tapia, S.S. Intille, K. Larson, Activity recognition in the home setting using simple and ubiquitous sensors, in: Proceedings of PERVASIVE 2004, Lecture Notes in Computer Science, vol. 3001, Springer, Berlin, 2004, pp. 158-175.
8. Argyle M. Social Interaction (1969), Methuen, London
9. P.P. Maglio, T. Matlock, C.S. Campbell, S. Zhai, B.A. Smith, Gaze and speech in attentive user interfaces, in: Proceedings of the International Conference on Multimodal Interfaces, Lecture Notes in Computer Science, vol. 1948, Springer, Berlin, 2000.
10. B. Brumitt, J.J. Cadiz. Let there be light: examining interfaces for homes of the future, in: Proceedings of Interact'01, pp. 375-382. Also available as Microsoft Technical Report TR-2000-92.
11. Focken D., and Stiefelhagen R. Towards vision-based 3-d people tracking in a smart room. International Conference on Multimodal Interfaces. Pittsburgh, PA (October 2002), IEEE 400-405
12. Isard M., and Blake A. Condensation-conditional density propagation for visual tracking. Internat. J. Comput. Vision 29 1 (1998) 5-28
13. Vermaak J., Gangnet M., Blake A., and Pérez P. Sequential Monte Carlo fusion of sound and vision for speaker tracking. Proceedings of the IEEE International Conference on Computer Vision vol. 1 (2001) 741-746
14. Checka N., Wilson K., Rangarajan V., and Darrell T. A probabilistic framework for multi-modal multi-person tracking. IEEE Workshop on Multi-Object Tracking (in Conjunction with CVPR) (2003)
15. Gatica-Perez D., Lathoud G., McCowan I., and Odobez J.-M. A mixed-state i-particle filter for multi-camera speaker tracking. Proceedings of the IEEE ICCV Workshop on Multimedia Technologies in E-Learning and Collaboration (ICCV-WOMTEC) (2003)
16. Mikic I., Santini S., and Jain R. Tracking objects in 3d using multiple camera views. ACCV (2000)
17. Zotkin D., Duraiswami R., and Davis L. Joint audio-visual tracking using particle filters. EURASIP J. Appl. Signal Process. 2002 11 (2002)
18. T. Gehrig, K. Nickel, H.K. Ekenel, U. Klee, J. McDonough, Kalman filters for audio-video source localization, in: IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, New Paltz, New York, 2005.
19. Nickel K., Gehrig T., Stiefelhagen R., and McDonough J. A joint particle filter for audiovisual speaker tracking. International Conference on Multimodal Interfaces, ICMI. Trento, Italy (2005), ACM, New York
20. Omologo M., and Svaizer P. Acoustic event localization using a crosspower-spectrum phase based technique. Proceedings of the ICASSP vol. II (1994) 273-276
21. Chen J., Benesty J., and Huang Y.A. Robust time delay estimation exploiting redundancy among multiple microphones. IEEE Trans. Speech Audio Proc. 11 6 (November 2003) 549-557
22. Vaidyanathan P.P. Multirate Systems and Filter Banks (1993), Prentice-Hall, Englewood Cliffs
23. Van Trees H.L. Optimum Array Processing (2002), Wiley-Interscience, New York
24. Linguistic Data Consortium (LDC), English broadcast news speech (Hub-4) 〈www.ldc.upenn.edu/Catalog/LDC97S44.html〉.
25. M. Wölfel, K. Nickel, J. McDonough, Microphone array driven speech recognition: influence of localization on the word error rate, Workshop on Multimodal Interaction and Machine Learning, 2005.
26. Wölfel M., and McDonough J. Minimum variance distortionless response spectral estimation, review and refinements. IEEE Signal Process. Magazine 22 5 (September 2005) 117-126
27. Stanford V., Rochet C., Michel M., and Garofolo J. Beyond close-talk-issues in distant speech acquisition, conditioning classification and recognition. ICASSP 2004 Meeting Recognition Workshop (2004)
28. Stiefelhagen R., Yang J., and Waibel A. Simultaneous tracking of head poses in a panoramic view. International Conference on Pattern Recognition vol. 3 (September 2000) 726-729
29. Stiefelhagen R. Tracking focus of attention in meetings. International Conference on Multimodal Interfaces. Pittsburgh, PA (October 2002), IEEE 273-280
30. Viola P., and Jones M. Robust real-time object detection. ICCV Workshop on Statistical and Computation Theories of Vision (2001)
31. M. Voit, K. Nickel, R. Stiefelhagen, Multi-view head pose estimation using neural networks, in: Second Workshop on Face Processing in Video (FPiV'05), Victoria, BC, Canada, May 2005.
32. Ekenel H., and Stiefelhagen R. Local appearance based face recognition using discrete cosine transform. EUSIPCO'05 (2005)
33. Bartlett M.S., et al. Face recognition by independent component analysis. IEEE Trans. Neural Networks 13 6 (2002) 1450-1454
34. Belhumeur P.N., et al. Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Machine Intell. 19 7 (1997) 711-720
35. Turk M., and Pentland A. Eigenfaces for recognition. J. Cognitive Sci. (1991) 71-86
36. Gottumukkal R., and Asari V.K. An improved face recognition technique based on modular PCA approach. Pattern Recognition Lett. 25 4 (2004)
37. H. Ekenel, R. Stiefelhagen, Two-class linear discriminant analysis for face recognition, Technical Report, University of Karlsruhe, 2005.