Audio-visual active speaker tracking in cluttered indoors environments

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 38, Issue 3, 2008, Pages 799-807

  Talantzis, Fotios ^a,b   Pnevmatikakis, Aristodemos ^a   Constantinides, Anthony G ^b  

^a ATHENS INFORMATION TECHNOLOGY   (Greece)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Information theory; Particle filters (PFs); Person tracking

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; INFORMATION THEORY; REVERBERATION; SIGNAL DETECTION;

AUDIOVISUAL INFORMATION; PARTICLE FILTER (PF);

AUDIO ACOUSTICS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATIC SPEECH RECOGNITION; BIOMETRY; COMPUTER ASSISTED DIAGNOSIS; ENVIRONMENT; METHODOLOGY; SOUND DETECTION;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRY; ENVIRONMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; SOUND SPECTROGRAPHY; SPEECH RECOGNITION SOFTWARE;

EID: 44949225951     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2008.922063     Document Type: Article

References (30)

1. M. Brandstein and D. B. Ward, Microphone Arrays Signal Processing Techniques and Applications. New York: Springer-Verlag, 2001.
2. T. Nishiura, R. Gruhn, and S. Nakamura, "Automatic steering of microphone array and video camera toward multi-lingual tele-conference through speech-to-speech translation," in Proc. IEEE Int. Conf. Multimedia Expo, Aug. 2001, pp. 447-450.
3. S. Azodolmolky, N. Dimakis, and V. Mylonakis, "Middleware for indoor ambient intelligence: The PolyOmaton system," in Proc. 2nd NGNM Workshop, Netw., Waterloo, ON, Canada, May 2005.
4. C. H. Knapp and G. C. Carter, "The generalized correlation method for estimation of time delay," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-24, no. 4, pp. 320-327, Aug. 1976.
5. M. S. Brandstein, J. E. Adcock, and H. Silverman, "A closed-form location estimator for use with room environment microphone arrays," IEEE Trans. Acoust., Speech, Signal Process., vol. 5, no. 1, pp. 45-50, Jan. 1997.
6. F. Talantzis, A. G. Constantinides, and L. C. Polymenakos, "Estimation of direction of arrival using information theory," IEEE Signal Process. Lett., vol. 12, no. 8, pp. 561-564, Aug. 2005.
7. O. Lanz, "Approximate Bayesian multibody tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 9, pp. 1436-1449, Sep. 2006.
8. N. Katsarakis, F. Talantzis, A. Pnevmatikakis, and L. Polymenakos, "The AIT 3D audio/visual person tracker for CLEAR 2007," in Proc. 2nd Int. CLEAR Eval. Workshop - Multimodal Technologies Perception Humans 2007, pp. 35-46.
9. A. Waibel, H. Steusloff, and R. Stiefelhagen, "CHIL: Computers in the human interaction loop," in Proc. 5th Int. WIAMIS, Lisbon, Portugal, 2004.
10. P. Perez, J. Vermaak, and A. Blake, "Data fusion for visual tracking with particles," Proc. IEEE, vol. 92, no. 3, pp. 495-513, Mar. 2004.
11. E. A. Lehmann and A. M. Johansson, "Particle filter with integrated voice activity detection for acoustic source tracking," EURASIP J. Adv. Signal Process., vol. 2007, no. 1, pp. 28-39, 2007. Article ID 50870.
12. D. B. Ward, E. A. Lehman, and R. C. Williamson, "Particle filtering algorithms for tracking an acoustic source in a reverberant environment," IEEE Trans. Speech Audio Process., vol. SAP-11, no. 6, pp. 826-836, Nov. 2003.
13. Z. Zhang, "A flexible new technique for camera calibration," Microsoft Res., Redmond, WA, Tech. Rep. MSR-TR-98-71, Aug. 2002.
14. C. Stauffer and W. E. L. Grimson, "Learning patterns of activity using real-time tracking," IEEE Trans. Pattern Anal.Mach. Intell., vol. 22, no. 8, pp. 747-757, Aug. 2000.
15. A. Pnevmatikakis and L. Polymenakos, "Kalman tracking with target feedback on adaptive background learning," in Proc. MLMI, S. Renals, S. Bengio, and J. Fiscus, Eds., 2006, pp. 114-122.
16. N. J. Gordon, D. J. Salmond, and A. F. M. Smith, "Novel approach to nonlinear/non-Gaussian Bayesian state estimation," Proc. Inst. Electr. Eng. F - Radar Signal Process., vol. 140, no. 2, pp. 107-113, Apr. 1993.
17. J. Vermaak and A. Blake, "Nonlinear filtering for speaker tracking in noisy and reverberant environments," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Salt Lake City, UT, May 2001, vol. 5, pp. 3021-3024.
18. T. M. Cover and J. A. Thomas, Elements of Information Theory. Hoboken, NJ: Wiley, 1991.
19. J. Sohn, N. S. Kim, and W. Sung, "A statistical model-based voice activity detection," IEEE Signal Process. Lett., vol. 6, no. 1, pp. 1-3, Jan. 1999.
20. M. Bolic, P. M. Djuric, and S. Hong, "New resampling algorithms for particle filters," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Hong Kong, 2003, vol. 2, pp. 589-592.
21. O. Lanz, P. Chippendale, and R. Brunelli, "An appearance-based particle filter for visual tracking in smart rooms," in Proc. 2nd Int. CLEAR Eval. Workshop - Multimodal Technologies Perception Humans, 2007, pp. 175-187.
22. G. Bradski, "Computer vision face tracking for use in a perceptual user interface," Intel Technol. J., vol. 2, no. 2, pp. 1-15, 1998.
23. A. Pnevmatikakis and L. Polymenakos, "Robust estimation of background for fixed cameras," in Proc. CIC, Mexico City, Mexico, 2006, pp. 37-42.
24. R. E. Kalman, "A new approach to linear filtering and prediction problems," Trans. ASME - J. Basic Eng., vol. 82, no. 1, pp. 35-45, 1960.
25. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Conf. Comput. Vis. Pattern Recog. Kauai, HI, Dec. 2001, pp. I-511-I-518.
26. G. Bradski, A. Kaehler, and V. Pisarevsky, "Learning-based computer vision with Intel's open source computer vision library," Intel Technol. J., vol. 9, no. 2, pp. 119-130, 2005.
27. M. Jones and J. Rehg, "Statistical color models with application to skin detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 1999, pp. 274-280.
28. S. Blackman, Multiple-Target Tracking With Radar Applications. Dedham, MA: Artech House, 1986, ch. 14.
29. R. Stiefelhagen, K. Bernardin, R. Bowers, J. Garofolo, D. Mostefa, and P. Soundararajan, "The CLEAR 2006 evaluation," in Proc. CLEAR, R. Stiefelhagen and J. Garofolo, Eds., 2007, pp. 1-44.
30. National Institute of Standards and Technology, Classification of Events, Activities and Relationships (CLEAR) 2007. [Online]. Available: http://www.clear-evaluation.org/