A multimodal approach to blind source separation of moving sources

IEEE Journal on Selected Topics in Signal Processing

Volumn 4, Issue 5, 2010, Pages 895-910

  Naqvi, Syed Mohsen ^a   Yu, Miao ^a   Chambers, Jonathon A ^a  

^a LOUGHBOROUGH UNIVERSITY   (United Kingdom)

Author keywords

3 D tracking; Beamforming; blind source separation (BSS); FastICA; Markov Chain Monte Carlo (MCMC) particle filtering; multimodal signal processing

Indexed keywords

3-D TRACKING; BEAMFORMING ALGORITHMS; FASTICA; FREQUENCY DOMAIN BLIND SOURCE SEPARATION; FREQUENCY-DOMAIN BSS; MARKOV CHAIN MONTE CARLO; MOVING SOURCE; MULTI-MODAL APPROACH; MULTI-MODAL SIGNAL PROCESSING; PERMUTATION PROBLEMS; REAL TIME; REVERBERANT ENVIRONMENT; SAMPLING EFFICIENCY; SOURCE SIGNALS; STATIONARY SOURCES; STATISTICAL KNOWLEDGE; TIME VARYING; UNMIXING; VISUAL MODALITIES;

BEAMFORMING; FREQUENCY DOMAIN ANALYSIS; MARKOV PROCESSES; MONTE CARLO METHODS; NONLINEAR FILTERING; SIGNAL ANALYSIS; SIGNAL PROCESSING; SPEECH ENHANCEMENT; THREE DIMENSIONAL; VIDEO CAMERAS;

BLIND SOURCE SEPARATION;

EID: 77956714096     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2010.2057198     Document Type: Article

References (67)

1. S. Haykin et al., Unsupervised Adaptive Filtering (Volume I: Blind Source Separation). New York: Wiley, 2000.
2. A. S. Bregman, Auditory Scence Analysis. Cambridge, MA: MIT Press, 1990.
3. A. Cichocki and S. Amari, Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications. New York: Wiley, 2002.
4. W. Wang, S. Sanei, and J. Chambers, "Penalty function based joint diagonalization approach for convolutive blind separation of nonstationary sources," IEEE Trans. Signal Process., vol.53, no.5, pp. 1654-1669, May 2005.
5. L. Parra and C. Spence, "Convolutive blind separation of non-stationary sources," IEEE Trans. Speech Audio Process., vol.8, no.3, pp. 320-327, Mar. 2000.
6. S. Sanei, S. M. Naqvi, J. A. Chambers, and Y. Hicks, "A geometrically constrained multimodal approach for convolutive blind source separation," in Proc. IEEE ICASSP, 2007, pp. 969-972.
7. T. Tsalaile, S. M. Naqvi, K. Nazarpour, S. Sanei, and J. A. Chambers, "Blind source extraction of heart sound signals from lung sound recordings exploiting periodicity of the heart sound," in Proc. IEEE ICASSP, Las Vegas, NV, 2008, pp. 461-464.
8. S. M. Naqvi, Y. Zhang, T. Tsalaile, S. Sanei, and J. A. Chambers, "A multimodal approach for frequency domain independent component analysis with geometrically-based initialization," in Proc. EUSIPCO, Lausanne, Switzerland, 2008.
9. S. Makino, H. Sawada, R. Mukai, and S. Araki, "Blind separation of convolved mixtures of speech in frequency domain," IEICE Trans. Fundamentals, vol.E88-A, no.7, pp. 1640-1655, 2005.
10. W. Wang, S. Sanei, and J. A. Chambers, "A joint diagonalization method for convolutive blind separation of nonstationary sources in the frequency domain," in Proc. ICA, Nara, Japan, 2003.
11. S. Ding, J. Huang, D.Wei, and A. Cichocki, "A near real-time approach for convolutive blind source separation," IEEE Trans. Circuit Syst.-I, vol.53, no.1, pp. 114-128, Jan. 2006.
12. H. Nguyen and C. Jutten, "Blind source separation for convolutive mixtures," Signal Process., vol.45, pp. 209-229, 1995.
13. S. Douglas, Blind Separation of Acoustic Signals (in Microphone Arrays: Techniques and Applications). Berlin, Germany: Springer, 2001.
14. P. Smaragdis, "Blind separation of convolved mixtures in the frequency domain," Neurocomputing, vol.22, pp. 21-34, 1998.
15. S. Makino, Blind Source Separation of Convolutive Mixtures of Speach, (in Adaptive Signal Processing: Applications to Real-World Problems). Berlin, Germany: Springer, 2003.
16. C. Jutten, "Blind separation of sources: An algorithm for sepration of convolitive mixtures," in Proc. Int. Signal Process. Workshop, 1992, pp. 275-278, Elsevier.
17. C. Cherry, "Some experiments on the recognition of speech, with one and with two ears," J. Acoust. Soc. Amer., vol.25, pp. 975-979, Sep. 1953.
18. R. Mukai, H. Sawada, S. Araki, and S. Makino, "Robust real-time blind source separation for moving speakers in a room," in Proc. IEEE ICASSP, Hong Kong, 2003, pp. 469-472.
19. A. Koutras, E. Dermatas, and G. Kokkinakis, "Blind source separation of moving speakers in real reverberant environment," in Proc. IEEE ICASSP, 2000, pp. 1133-1136.
20. S. M. Naqvi, Y. Zhang, and J. A. Chambers, "A multimodal approach for frequency domain blind source separation for moving sources in a room," in Proc. IAPR CIP2008, Santorini, Greece, 2008, pp. 200-204.
21. R. E. Prieto and P. Jinachitra, "Blind source separation for time-variant mixing systems using piecewise linear approximations," in Proc. IEEE ICASSP, 2005, pp. 301-304.
22. K. E. Hild-II, D. Erdogmus, and J. C. Principe, "Blind source extraction of time-varying, instantaneous mixtures using an on-line algorithm," in Proc. IEEE ICASSP, Orlando, FL, 2002, pp. I-993-I-996.
23. J. Anemuller and T. Gramss, "On-line blind separation of moving sound sources," in Proc. ICA'99, 1999.
24. W. Addison and S. Roberts, "Blind source separtion with non-stationary mixing using wavelets," in Proc. Int. Conf. Ind. Compon. Anal. Blind Source Separ., 2006.
25. S. Haykin, J. C. Principe, T. J. Sejnowski, and J. McWhirter, New Directions in Statiatical Signal Processing: From Systems to Brain. Cambridge, MA: MIT Press, 2007.
26. B. D. V.Veen and K. M. Buckley, "Beamforming: A versatile approach to spatial filtering," IEEE ASSP Mag., vol.5, no.2, pp. 4-21, Apr. 1988.
27. P. Aarabi and S. Zaky, "Robust sound localization using multi-source audiovisual information fusion," Inf. Fusion, vol.3, no.2, pp. 209-223, 2001. (Pubitemid 33396502)
28. M. Beal, H. Attias, and N. Jojic, "Audio-video sensor fusion with probabilistic graphical models," in Proc. Eur. Conf. Comput. Vis. (ECCV), 2002.
29. N. Checka, K. Wilson, M. Siracusa, and T. Darrell, "Multiple person and speaker activity tracking with a particle filter," in Proc. IEEE ICASSP, 2004, pp. 881-884.
30. Y. Chen and Y. Rui, "Real-time speaker tracking using particle filter sensor fusion," Proc. IEEE, vol.92, no.3, pp. 485-494, Mar. 2004.
31. J. Vermaak and A. Blake, "Nonlinear filtering for speaker tracking in noisy and reverberant environments," in Proc. IEEE ICASSP, 2001, pp. 3021-3024.
32. J. Fisher, T. Darrell, W. T. Freeman, and P. Viola, "Learning joint statistical models for audio-visual fusion and segregation," in Proc. Neural Inf. Process. Syst. (NIPS), 2000, pp. 772-778.
33. D. Gatica-Perez, G. Lathoud, I. McCowan, and J. M. Odobez, "A mixed-state i-particle filter for multi-camera speaker tracking," in Proc. IEEE Int. Conf. Comput. Vision, Workshop Multimedia Technologies for E-Learning and Collaboration (ICCV-WOMTEC), 2003.
34. S. M. Griebel and M. S. Brandstein, "Microphone array source localization using realizable delay vectors," in Proc. IEEE Workshop Applicat. Signal Process. Audio Acoust. (WASPAA), 2001.
35. J. Hershey and J. Movellan, "Real-time speaker tracking using particle filter sensor fusion," in Proc. Audio Vision: Using Audio-Visual Synchrony to Locate Sounds, in Proc. Neural Inf. Process. Syst. (NIPS), 1999.
36. M. Isard and J. MacCormick, "Bramble: A Bayesian multi-blob tracker," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2001, pp. 34-41.
37. B. Kapralos, M. Jenkin, and E. Milios, "Audio-visual localization of multiple speakers in a video teleconferencing setting," Int. J. Imag. Syst. Technol., vol.13, pp. 95-105, 2003.
38. G. Lathoud and M. Magimai-Doss, "Asector-based, frequency-domain approach to detection and localization of multiple speakers," in Proc. IEEE ICASSP, 2005, pp. 265-268.
39. I. Potamitis, H. Chen, and G. Tremoulis, "Tracking of multiple moving speakers with multiple microphone arrays," IEEE Trans. Speech Audio Process, vol.12, no.5, pp. 520-529, Sep. 2004.
40. D. Gatica-Perez, G. Lathoud, J. Odobez, and I. McCowan, "Audiovisual probabilistic tracking of multiple speakers in meetings," IEEE Trans. Audio, Speech, Lang. Process., vol.15, no.2, pp. 601-616, Feb. 2007.
41. D. Sturim, M. Brandstein, and H. Silverman, "Tracking multiple talkers using microphone array measurements," in Proc. IEEE ICASSP, 1997, pp. 371-374.
42. J. Vermaak, M. Gagnet, A. Blake, and P. Perez, "Sequential Monte Carlo fusion of sound and vision for speaker tracking," in Proc. Int. Conf. Comput. Vis. ICCV, 2001, pp. 741-746.
43. B. Vo, S. Singh, and W. K. Ma, "Tracking multiple speakers using random sets," in Proc. IEEE ICASSP, 2004, pp. 357-360.
44. D. B. Ward, E. A. Lehmann, and R. C. Williamson, "Particle filtering algorithms for acoustic source localization," IEEE Trans. Speech Audio Process, vol.11, no.6, pp. 826-836, Nov. 2003.
45. F. Talantzis, A. Pnevmatikakis, and A. G. Constantinides, "Audio and visual active speaker tracking in cluttered indoors environments," IEEE Trans. Syst., Man, Cybern.-B: Cybern., vol.39, no.1, pp. 7-15, Jan. 2009.
46. R. Y. Tsai, "A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses," IEEE J. Robot. Autom., vol.RA-3, no.4, pp. 323-344, 1987.
47. H. K. Maganti, D. Gatica-Perez, and I. McCowan, "Speech enhancement and recognition in meetings with an audio-visual sensor array," IEEE Trans. Audio, Speech, Lang. Process., vol.15, no.8, pp. 2257-2269, Nov. 2007.
48. I. McCowan, M. Hari-Krishna, D. Gatica-Perez, D. Moore, and S. Ba, "Speech acquisition in meetings with an audio visual sensor array," in Proc. IEEE Int. Conf. Multimedia ICME, 2005, pp. 1382-1385.
49. M. Fallon, S. Godsill, and A. Black, "Joint acoustic source localization and orientation estimation using sequential monte carlo," in Proc. Digital Audio Effects (DAFx-06), 2006.
50. C. Cherry and W. K. Taylor, "Some further experiments upon the recognition of speech, with one and with two ears," J. Acoust. Soc. Amer., vol.26, no.4, pp. 554-559, 1954.
51. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Conf. Comput. Vis. Pattern Recognition (CVPR), 2001, pp. 511-518.
52. B. Ristic, S. Arulampalam, and N. Gordon, Beyond the Kalman Filter: Particle Filter for Tracking Applications. Boston, MA: Artech House, 2004.
53. S. M. Naqvi, Y. Zhang, and J. A. Chambers, "Multimodal blind source separation for moving sources," in Proc. IEEE ICASSP, Taipei, Taiwan, 2009, pp. 125-128.
54. M. Isard and A. Blake, "Condensation: Conditional density propagation for visual tracking," Int. J. Comput. Vis., vol.29, no.1, pp. 5-28, 1998.
55. K. Astom, Introduction to Stochastic Control Theory. New York: Academic, 1970.
56. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge, U.K.: Cambridge Univ. Press, 2001.
57. W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, Markov Chain Monte Carlo in Practice. New York: Chapman & Hall, 1996.
58. , A. Doucet, N. de Freitas, and N. Gordon, Eds., Sequential Monte Carlo Methods in Practice. New York: Springer-Verlag, 2001.
59. Z. Khan, T. Balch, and F. Dellaert, "An MCMC-based particle filter for tracking multiple interacting targets," in Proc. Eur. Conf. Comput. Vis. (ECCV), Prague, Czech Republic, 2004, pp. 279-290.
60. Z. Khan, T. Balch, and F. Dellaert, "MCMC-based particle filtering for tracking a variable number of interacting targets," IEEE Trans. Pattern Anal. Mach. Intell., vol.27, no.11, pp. 1805-1818, Nov. 2005.
61. J. S. Liu, Monte Carlo Strategies in Scientific Computing. New York: Springer-Verlag, 2001.
62. S. Haykin, Adaptive Filter Theory. Upper Saddle River, NJ: Prentice-Hall, 2001.
63. I. McCowan and H. Bourlard, "Microphone array post-filter based on noise field coherence," IEEE Trans. Speech Audio Process., vol.11, no.6, pp. 709-716, Nov. 2003.
64. H. Saruwatari, T. Kawamura, T. Nishikawa, A. Lee, and K. Shikano, "Blind source separation based on a fast-convergence algorithm combining ICA and beamforming," IEEE Trans. Audio, Speech, Lang. Process., vol.14, no.2, pp. 666-678, Mar. 2006.
65. L. Parra and C. V. Alvino, "Geometric source separation: Merging convolutive source separation with geometric beamforming," IEEE Trans. Speech Audio Process., vol.10, no.7, pp. 352-362, Sep. 2002.
66. E. Bingham and A. Hyvärinen, "A fast fixed point algorithm for independent component analysis of complex valued signals," Int. J. Neural Netw., vol.10, no.1, pp. 1-8, 2000.
67. A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis. New York: Wiley, 2001.