Robust joint audio-video localization in video conferencing using reliability information

IEEE Transactions on Instrumentation and Measurement

Volumn 53, Issue 4, 2004, Pages 1132-1139

  Lo, David ^a   Goubran, Rafik A ^a   Dansereau, Richard M ^a   Thompson, Graham ^b   Schulz, Dieter ^b  

^a CARLETON UNIVERSITY   (Canada)

^b Mitel Networks Corporation   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; MICROPHONES; PROBABILITY; RELIABILITY THEORY; VIDEO CAMERAS;

AUDIO VIDEO LOCALIZATION; DATA FUSION; LOCALIZATION; MICROPHONE ARRAY; RELIABILITY INFORMATION;

VIDEO CONFERENCING;

EID: 4043181855     PISSN: 00189456     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIM.2004.831181     Document Type: Article

References (22)

1. C. Wang and M. Brandstein, "A hybrid real-time face tracking system," in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing, vol. 6, 1998, pp. 3737-3740.
2. C. Messom, S. Demidenko, K. Subramaniam, and G. Gupta, "Size/position identification in real-time image processing using run length encoding," in Proc. 19th IEEE Instrumentation and Measurement Technology Conf., vol. 2, 2002, pp. 1055-1059.
3. C. Wang, S. Griebel, and M. Brandstein, "Robust automatic video-conferencing with multiple cameras and microphones," in Proc. IEEE Int. Conf. Multimedia and Expo, vol. 3, 2000, pp. 1585-1588.
4. D. Zotkin, R. Duraiswami, L. Davis, and I. Haritaoglu, "An audio-video front-end for multimedia applications," in Proc. IEEE Int. Conf. Systems, Man, and Cybernetics, vol. 2, 2000, pp. 786-791.
5. J. G. Ryan and R. A. Goubran, "Array optimization applied in the near field of a microphone array," IEEE Trans. Speech Audio Processing, vol. 8, no. 2, pp. 173-176, Mar. 2000.
6. J. G. Ryan, "Application of near-field optimum microphone arrays to hands-free mobile telephony," IEEE Trans. Veh. Technol., vol. 52, pp. 390-400, Mar. 2003.
7. J. G. Ryan, "Optimum near-field response for microphone arrays," in Proc. IEEE Workshop Applications of Signal Processing to Audio and Acoustics, 1997, pp. 19-22.
8. D. Lo, R. Goubran J. Gammal, G. Thompson, and D. Schulz, "Robust joint audio-video localization in video conferencing using reliability information," in Proc. 20th IEEE Instrumentation and Measurement Technology Conf., vol. 2, 2003, pp. 1414-1418.
9. M. Omologo and P. Svaizer, "Acoustic source location in noisy and reverberant environment using CSP analysis," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, vol. 2, 1996, pp. 921-924.
10. C. Wang and M. Brandstein, "Multi-source face tracking with audio and visual data," in Proc. IEEE 3rd Workshop Multimedia Signal Processing, 1999, pp. 169-174.
11. J. C. Terrillon, M. David. and S. Akamatsu, "Detection of human faces in complex scene images by use of a skin color model and of invariant Fourier-Mellin moments," in Proc. 14th Int. Conf. Pattern Recognition, vol. 2, 1998, pp. 1350-1355.
12. R. Hsu, M. Abdel-Mottaleb, and A. Jain, "Face detection in color images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, pp. 696-706, May 2002.
13. N. Strobel, S. Spors, and R. Rabenstein, "Joint audio-video object localization and tracking," IEEE Signal Processing Mag., vol. 18, pp. 22-31, Jan. 2001.
14. H. Wu, M. Siegel, R. Stiefelhagen, and J. Yang, "Sensor fusion using Dempster-Shafer theory," in Proc. 19th IEEE Instrumentation and Measurement Technology Conf., vol. 1, 2002, pp. 7-12.
15. K. Toyama and E. Horvitz, "Bayesian modality fusion: probabilistic integration of multiple vision algorithms for head tracking," in Proc. 4th Asian Conf. Computer Vision. Jan. 2000.
16. D. Johnson and D. Dudgeon, Array Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1993, pp. 112-113.
17. J. C. Terrillon, M. N. Shirazi, H. Fukamachi, and S. Akamatsu, "Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images," in Proc. IEEE Int. Conf. Face and Gesture Recognition, 2000, pp. 54-61.
18. C. A. Poynton, A Technical Introduction to Digital Video. New York: Wiley, 1996, pp. 176-177.
19. H. Bacakoglu and M. Kamel, "A three-step camera calibration method," IEEE Trans. Instrum. Meas., vol. 46. pp. 1165-1172, Oct. 1997.
20. Z. Zhang, "A flexible new technique for camera calibration," IEEE Trans. Pattern Anal. Machine Intell., vol. 22, pp. 1330-1334. Nov. 2000.
21. J. Heikkila and O. Silven, "A four-step camera calibration procedure with implicit image correction," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 1997, pp. 1106-1112.
22. R. Y. Tsai, "A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses," IEEE Trans. Robot. Automat., vol. RA-3, pp. 323-344, Aug. 1987.