Microphone array processing for distant speech recognition: From close-talking microphones to far-field sensors

IEEE Signal Processing Magazine

Volumn 29, Issue 6, 2012, Pages 127-140

  Kumatani, Kenichi ^a   McDonough, John ^b   Raj, Bhiksha ^b  

^a DISNEY RESEARCH   (United States)

^b Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTICS; ARRAY PROCESSING; DEEP NEURAL NETWORKS; DISTRIBUTED COMPUTER SYSTEMS; HUMAN COMPUTER INTERACTION; MICROPHONES; SPEECH; SPEECH PROCESSING; SPHERES;

DISTANT SPEECH RECOGNITION; EMERGING TECHNOLOGIES; HUMAN COMPUTER INTERFACES; MICROPHONE ARRAY PROCESSING; MICROPHONE ARRAYS; PERFORMANCE COMPARISON; RECOGNITION ACCURACY; SPHERICAL MICROPHONE ARRAY;

SPEECH RECOGNITION;

EID: 85032750883     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2012.2205285     Document Type: Article

References (43)

1. M. Omologo, M. Matassoni, and P. Svaizer, "Environmental conditions and acoustic transduction in hands-free speech recognition," Speech Commun., vol. 25, no. 1-3, pp. 75-95, 1998. (Pubitemid 128413635)
2. M. Wölfel and J. McDonough, Distant Speech Recognition. Hoboken, NJ: Wiley, 2009.
3. M. Omologo, "A prototype of distant-talking interface for control of interactive TV," in Proc. Asilomar Conf. Signals, Systems and Computers (ASILOMAR), Pacific Grove, CA, 2010, pp. 1711-1715.
4. M. Lincoln, I. McCowan, I. Vepa, and H. K. Maganti, "The multi-channel Wall Street Journal audio visual corpus (MCWSJ-AV): Specification and initial experiments," in Proc. IEEE Workshop Automatic Speech Recognition and Understanding (ASRU), 2005, pp. 357-362.
5. J. McDonough, K. Kumatani, T. Gehrig, E. Stoimenov, U. Mayer, S. Schacht, M. Wölfel, and D. Klakow, "To separate speech!: A system for recognizing simultaneous speech," in Proc. MLMI, 2007, pp. 283-294.
6. J. McDonough and M. Wölfel, "Distant speech recognition: Bridging the gaps," in Proc. IEEE Joint Workshop Hands-free Speech Communication and Microphone Arrays (HSCMA), Trento, Italy, 2008, pp. 108-114.
7. M. Seltzer, "Bridging the gap: Towards a unified framework for hands-free speech recognition using microphone arrays," in Proc. HSCMA, Trento, Italy, 2008, pp. 104-107.
8. H. Christensen, J. Barker, N. Ma, and P. Green, "The CHiME corpus: A resource and a challenge for computational hearing in multisource environments," in Proc. Interspeech, Makuhari, Japan, 2010, pp. 1918-1921.
9. T. Nakatani, T. Yoshioka, S. Araki, M. Delcroix, and M. Fujimoto, "Logmax observation model with MFCC-based spectral prior for reduction of highly nonstationary ambient noise," in Proc. ICASSP 2012, Kyoto, Japan, pp. 4029-4032.
10. F. Weninger, M. Wöllmer, J. Geiger, B. Schuller, J. F. Gemmeke, A. Hurmalainen, T. Virtanen, and G. Rigoll, "Non-negative matrix factorization for highly noise-robust ASR: To enhance or to recognize?" in Proc. ICASSP 2012, Kyoto, Japan, pp. 4681-4684.
11. R. F. Astudillo, A. Abad, and J. P. S. Neto, "Integration of beamforming and automatic speech recognition through propagation of the wiener posterior," in Proc. ICASSP 2012, Kyoto, Japan, pp. 4909-4912.
12. I. McCowan, I. Himawan, and M. Lincoln, "A microphone array beamforming approach to blind speech separation," in Proc. MLMI, 2007, pp. 295-305.
13. S. T. Shivappa, B. D. Rao, and M. M. Trivedi, "Audio-visual fusion and tracking with multilevel iterative decoding: Framework and experimental evaluation," J. Sel. Topics Signal Processing, vol. 4, no. 5, pp. 882-894, 2010.
14. M. Wölfel, K. Nickel, and J. W. McDonough, "Microphone array driven speech recognition: Influence of localization on the word error rate," in Proc. MLMI, 2005, pp. 320-331.
15. I. J. Tashev, Sound Capture and Processing: Practical Approaches. Chichester, UK: Wiley, 2009.
16. M. Brandstein and D. Ward, Eds., Microphone Arrays. Heidelberg, Germany: Springer-Verlag, 2001.
17. H. L. Van Trees, Optimum Array Processing. New York: Wiley-Interscience, 2002.
18. J. Chen, J. Benesty, and Y. Huang, "Time delay estimation in room acoustic environments: An overview," EURASIP J. Adv. Signal Processing, vol. 2006, no. AD-26503, pp. 1-19, 2006.
19. A. Brutti, M. Omologo, and P. Svaizer, "Comparison between different sound source localization techniques based on a real data collection," in Proc. HSCMA, Trento, Italy, 2008, pp. 69-72.
20. U. Klee, T. Gehrig, and J. McDonough, "Kalman filters for time delay of arrivalbased source localization," EURASIP J. Adv. Signal Processing, vol. 2006, no. AD-12378, pp. 1-15, 2006.
21. T. Gehrig, K. Nickel, H. K. Ekenel, U. Klee, and J. McDonough, "Kalman filters for audio-video source localization," in Proc. IEEE Workshop Applications of Signal Processing to Audio and Acoustics (WASPAA), New Paltz, NY, 2005, pp. 118-121. (Pubitemid 44461808)
22. T. Gehrig, U. Klee, J. McDonough, S. Ikbal, M. Wölfel, and C. Fügen, "Tracking and beamforming for multiple simultaneous speakers with probabilistic data association filters," in Proc. Interspeech, 2006, pp. 2594-2597.
23. H. Cox, R. M. Zeskind, and M. M. Owen, "Robust adaptive beamforming," IEEE Trans. Audio Speech Language Processing, vol. ASSP-35, no. 10, pp. 1365-1376, 1987.
24. S. Haykin, Adaptive Filter Theory, 4th ed. New York: Prentice-Hall, 2002.
25. I. A. McCowan and H. Bourlard, "Microphone array post-filter based on noise field coherence," IEEE Trans. Speech Audio Processing, vol. 11, no. 6, pp. 709-716, 2003.
26. T. Wolff and M. Buck, "A generalized view on microphone array postfilters," in Proc. Int. Workshop Acoustic Echo and Noise Control, Tel Aviv, Israel, 2010.
27. C. Marro, Y. Mahieux, and K. U. Simmer, "Analysis of noise reduction and dereverberation techniques based on microphone arrays with postfiltering," IEEE Trans. Speech Audio Processing, vol. 6, pp. 240-259, 1998. (Pubitemid 128720650)
28. K. Kumatani, J. McDonough, D. Klakow, P. N. Garner, and W. Li, "Beamforming with a maximum negentropy criterion," IEEE Trans. Audio Speech Language Processing, vol. 17, no. 5, pp. 994-1008, Aug. 2008.
29. K. Kumatani, J. McDonough, S. Schacht, D. Klakow, P. N. Garner, and W. Li, "Filter bank design based on minimization of individual aliasing terms for minimum mutual information subband adaptive beamforming," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Las Vegas, NV, 2008, pp. 1609-1612.
30. A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis. New York: Wiley-Interscience, 2001.
31. K. Kumatani, J. McDonough, B. Rauch, and D. Klakow, "Maximum negentropy beamforming using complex generalized Gaussian distribution model," in Proc. ASILOMAR, Pacific Grove, CA, 2010, pp. 1420-1424.
32. K. Kumatani, J. McDonough, B. Rauch, P. N. Garner, W. Li, and J. Dines, "Maximum kurtosis beamforming with the generalized sidelobe canceller," in Proc. Interspeech, Brisbane, Australia, Sept. 2008, pp. 423-426.
33. K. Kumatani, J. McDonough, and B. Raj, "Maximum kurtosis beamforming with a subspace filter for distant speech recognition," in Proc. ASRU, 2011, pp. 179-184.
34. K. Kumatani, J. McDonough, J. Lehman, and B. Raj, "Channel selection based on multichannel crosscorrelation coefficients for distant speech recognition," in Proc. HSCMA, Edinburgh, UK, 2011, pp. 1-6.
35. E. Warsitz, A. Krueger, and R. Haeb-Umbach, "Speech enhancement with a new generalized eigenvector blocking matrix for application in a generalized sidelobe canceller," in Proc. ICASSP, Las Vegas, NV, 2008, pp. 73-76.
36. K. Kumatani, L. Lu, J. McDonough, A. Ghoshal, and D. Klakow, "Maximum negentropy beamforming with superdirectivity," in Proc. European Signal Processing Conf. (EUSIPCO), Aalborg, Denmark, 2010, pp. 2067-2071.
37. J. Meyer and G. W. Elko, "Spherical microphone arrays for 3D sound recording," in Audio Signal Processing for Next-Generation Multimedia Communication Systems. Y. Huang and J. Benesty, Eds. Boston, MA: Kluwer Academic, 2004, pp. 67-90.
38. Z. Li and R. Duraiswami, "Flexible and optimal design of spherical microphone arrays for beamforming," IEEE Trans. Speech Audio Processing, vol. 15, no. 2, pp. 2007, 702-714.
39. B. Rafaely, "Analysis and design of spherical microphone arrays," IEEE Trans. Speech Audio Processing, vol. 13, no. 1, pp. 135-143, 2005. (Pubitemid 40049946)
40. S. Yan, H. Sun, U. P. Svensson, X. Ma, and J. M. Hovem, "Optimal modal beamforming for spherical microphone arrays," IEEE Trans. Audio Speech Language Processing, vol. 19, no. 2, pp. 361-371, 2011.
41. E. G. Williams, Fourier Acoustics. San Diego, CA: Academic, 1999.
42. F. W. J. Olver and L. C. Maximon, "Bessel functions," in NIST Handbook of Mathematical Functions, F. W. J. Olver, D. W. Lozier, R. F. Boisvert, and C. W. Clark, Eds. New York, NY: Cambridge Univ. Press, 2010.
43. H. Teutsch, Modal Array Signal Processing: Principles and Applications of Acoustic Wavefield Decomposition. Heidelberg: Springer, 2007.