Acoustic space learning for sound-source separation and localization on binaural manifolds

International Journal of Neural Systems

Volumn 25, Issue 1, 2015, Pages

  Deleforge, Antoine ^a   Forbes, Florence ^a   Horaud, Radu ^a  

^a INRIA RHÔNE ALPES   (France)

Author keywords

Binaural hearing; EM inference; manifold learning; mixture of regressors; sound localization; sound source separation

Indexed keywords

ACOUSTIC GENERATORS; AUDITION; BAYESIAN NETWORKS; CLUSTERING ALGORITHMS; DIMENSIONALITY REDUCTION; FREQUENCY ESTIMATION; INFERENCE ENGINES; MAXIMUM PRINCIPLE; PIECEWISE LINEAR TECHNIQUES; SEPARATION;

BINAURAL HEARING; EM INFERENCE; MANIFOLD LEARNING; SOUND LOCALIZATION; SOUND SOURCE SEPARATION;

SOURCE SEPARATION;

ACOUSTICS; ASSOCIATION; BAYES THEOREM; HUMAN; LEARNING; PHYSIOLOGY; PRINCIPAL COMPONENT ANALYSIS; SIGNAL PROCESSING; SOUND DETECTION; SPECTROSCOPY; THEORETICAL MODEL;

ACOUSTICS; BAYES THEOREM; CUES; HUMANS; LEARNING; MODELS, THEORETICAL; PRINCIPAL COMPONENT ANALYSIS; SIGNAL PROCESSING, COMPUTER-ASSISTED; SOUND LOCALIZATION; SPECTRUM ANALYSIS;

EID: 84924985938     PISSN: 01290657     EISSN: 17936462     Source Type: Journal    
DOI: 10.1142/S0129065714400036     Document Type: Article

References (52)

1. J. Blauert, Spatial Hearing: The Psychophysics of Human Sound Localization (MIT Press, 1997).
2. D. Wang and G. J. Brown, Computational Auditory Scene Analysis : Principles, Algorithms and Applications (IEEE Press, 2006).
3. A. Deleforge and R. P. Horaud, The cocktail party robot: Sound source separation and localisation with an active binaural head, In Proc. 7th ACM/IEEE Int. Conf. Human Robot Interaction (HRI) (2012), pp. 431-438.
4. E. C. Cherry, Some experiment on the recognition of speech, with one and with two ears, J. Acoust. Soc. Am. 25(5) (1953) 975-979.
5. S. Haykin and Z. Chen, The cocktail party problem, Neural Comput. 17 (2005) 1875-1902.
6. L. Rayleigh, On our perception of sound direction, Philos. Mag. 13 (1907) 214-232.
7. J. C. Middlebrooks and D. M. Green, Sound localization by human listeners, Annu. Rev. Psychol. 42 (1991) 135-159.
8. R. S. Woodworth and H. Schlosberg, Experimental Psychology (Holt, 1965).
9. P. M. Hofman and A. J. Van Opstal, Spectrotemporal factors in two-dimensional human sound localization, J. Acoust. Soc. Am. 103(5) (1998) 2634-2648.
10. R. Liu and Y. Wang, Azimuthal source localization using interaural coherence in a robotic dog: Modeling and application, Robotica 28(7) (2010) 1013-1020.
11. X. Alameda-Pineda and R. P. Horaud, Geometrically constrained robust time delay estimation using non-coplanar microphone arrays, in Proc. 20th Eur. Signal Processing Conf. (EUSIPCO) (2012), pp. 1309-1313.
12. M. I. Mandel, D. P. W. Ellis and T. Jebara, An EM algorithm for localizing multiple sound sources in reverberant environments, in Proc. Neural Information Processing Systems (NIPS) Conf. (2007), pp. 953-960.
13. A. Deleforge and R. P. Horaud, A latently constrained mixture model for audio source separation and localization, in Proc. 10th Int. Conf., LVA/ICA (2012), pp. 372-379.
14. J. Woodruff and D. Wang, Binaural localization of multiple sources in reverberant and noisy environments, IEEE Trans. Acoust., Speech, Signal Process. 20(5) (2012) 1503-1512.
15. O. Yilmaz and S. Rickard, Blind separation of speech mixtures via time-frequency masking, IEEE Trans. Signal Process. 52 (2004) 1830-1847.
16. H. Viste and G. Evangelista, On the use of spatial cues to improve binaural source separation, in Proc. Int. Conf. Digital Audio Effects (DAFX) (2003), pp. 209-213.
17. A. R. Kullaib, M. Al-Mualla and D. Vernon, 2D binaural sound localization: For urban search and rescue robotics, in Proc. Mobile Robotics (2009), pp. 423-435.
18. F. Keyrouz, W. Maier and K. Diepold, Robotic localization and separation of concurrent sound sources using self-splitting competitive learning, in Proc. IEEE Symp. Computational Intelligence in Image and Signal Processing (CIISP) (2007), pp. 340-345.
19. J. Hörnstein, M. Lopes, J. Santos-Victor and F. Lacerda, Sound localization for humanoid robots - Building audio-motor maps based on the HRTF, in Proc. IEEE/RSJ IROS Int. Conf. Intelligent Robots and Systems (2006), pp. 1170-1176.
20. P. M. Hofman, J. G. Van Riswick, A. J. Van Opstal et al., Relearning sound localization with new ears, Nature Neurosci. 1(5) (1998) 417-421.
21. B. A. Wright and Y. Zhang, A review of learning with normal and altered sound-localization cues in human adults, Int. J. Audiol. 45(S1) (2006) 92-98.
22. M. Aytekin, C. F. Moss and J. Z. Simon, A sensorimotor approach to sound localization, Neural Comput. 20(3) (2008) 603-635.
23. H. Poincaré, The Foundations of Science; Science and Hypothesis, the Value of Science, Science and Method (Science Press, New York, 1929), by G. B. Halsted, Trans. of La valeur de la science (1905).
24. J. K. O'Regan and A. Noe, A sensorimotor account of vision and visual consciousness, Behav. Brain Sci. 24 (2001) 939-1031.
25. R. Held and A. Hein, Movement-produced stimulation in the development of visually guided behavior, J. Comp. Physiol. Psychol. 56(5) (1963) 872-876.
26. A. Deleforge and R. P. Horaud, 2D sound-source localization on the binaural manifold, in IEEE Workshop on Machine Learning for Signal Processing (IEEE, Santander, Spain, 2012), pp. 1-6.
27. A. Deleforge, F. Forbes and R. P. Horaud, Variational EM for binaural sound-source separation and localization, in ICASSP 2013-38th Int. Conf. Acoustics, Speech, and Signal Processing (IEEE, Vancouver, Canada, 2013), pp. 76-80.
28. S. T. Roweis, One microphone source separation, in Advances in Neural Information Processing Systems, Vol. 13 (MIT Press, 2000), pp. 793-799.
29. S. Bensaid, A. Schutz and D. T. M. Slock, Single microphone blind audio source separation using EMKalman filter and short+long term AR modeling, in Latent Variable Analysis and Signal Separation (Springer, 2010), pp. 106-113.
30. P. Comon and C. Jutten, Handbook of Blind Source Separation, Independent Component Analysis and Applications (Academic Press (Elsevier), 2010).
31. N. Q. K. Duong, E. Vincent and R. Gribonval, Under-determined reverberant audio source separation using a full-rank spatial covariance model, IEEE Trans. Audio Signal Lang. Process. 18(7) (2010) 1830-1840.
32. M. I. Mandel, R. J. Weiss and D. P. W. Ellis, Modelbased expectation-maximization source separation and localization, IEEE Trans. Audio, Speech Lang. Process. 18(2) (2010) 382-394.
33. R. Rosipal and N. Krämer, Overview and recent advances in partial least squares, in Subspace, Latent Structure and Feature Selection, Vol. 3940 (Springer, 2006), pp. 34-51.
34. K. C. Li, Sliced inverse regression for dimension reduction, J. Am. Stat. Assoc. 86(414) (1991) 316-327.
35. H. M. Wu, Kernel sliced inverse regression with applications to classification, J. Comput. Graph. Stat. 17(3) (2008) 590-610.
36. R. D. de Veaux, Mixtures of linear regressions, Comput. Stat. Data Anal. 8(3) (1989) 227-245.
37. L. Xu, M. I. Jordan and G. E. Hinton, An alternative model for mixtures of experts, in Proc. Neural Information Processing Systems (NIPS) Conf., Vol. 7 (1995), pp. 633-640.
38. A. Kain and M. W. Macon, Spectral voice conversion for text-to-speech synthesis, in Proc. Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Vol. 1 (1998), pp. 285-288.
39. Y. Stylianou, O. Cappé and E. Moulines, Continuous probabilistic transform for voice conversion, IEEE Trans. Acoust., Speech, Signal Process. 6 (1998) 131-142.
40. T. Toda, A. Black and K. Tokuda, Statistical mapping between articulatory movements and acoustic spectrum using a gaussian mixture model, Speech Commun. 50(3) (2008) 215-227.
41. Y. Qiao and N. Minematsu, Mixture of probabilistic linear regressions: A unified view of GMM-based mapping techniques, in Proc. Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP) (2009) pp. 3913-3916.
42. A. Deleforge, F. Forbes and R. Horaud, Highdimensional regression with gaussian mixtures and partially-latent response variables, arXiv.1308.2302 (2013).
43. M. Otani, T. Hirahara and S. Ise, Numerical study on source-distance dependency of head-related transfer functions, J. Acoust. Soc. Am. 125(5) (2009) 3253-3261.
44. J. S. Garofolo et al., TIMIT Acoustic-Phonetic Continuous Speech Corpus, Linguistic Data Consortium, Philadelphia (1993).
45. R. Talmon, I. Cohen and S. Gannot, Supervised source localization using diffusion kernels, in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) (2011), pp. 245-248.
46. Z. Zhang and H. Zha, Principal manifolds and nonlinear dimensionality reduction via tangent space alignment, Journal of Shanghai University (English Edition) 8(4) (2004) 406-424.
47. M. Beal and Z. Ghahramani, The variational Bayesian EM algorithm for incomplete data: With application to scoring graphical model structures, Bayesian Stat. 7 (2003) 453-464.
48. P. Aarabi, Self-localizing dynamic microphone arrays, IEEE Trans. Syst. Man, Cybern. C, Appl. Rev. 32(4) (2002) 474-484.
49. J. Mouba and S. Marchand, A source localization/separation/respatialization system based on unsupervised classification of interaural cues, in Proc. Int. Conf. Digital Audio Effects (Montreal, Canada, 2006), pp. 233-238.
50. H. Buchner, R. Aichner and W. Kellermann, A generalization of blind source separation algorithms for convolutive mixtures based on second-order statistics, IEEE Trans. Audio, Speech Lang. Process. 13(1) (2005) 120-134.
51. H. Sawada, S. Araki and S. Makino, A Two-stage frequency-domain blind source separation method for underdetermined convolutive mixtures, in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) (New Paltz, NY, 2007), pp. 139-142.
52. E. Vincent, R. Gribonval and C. Févotte, Performance measurement in blind audio source separation, IEEE Trans. Audio, Speech Lang. Process. 14(4) (2006) 1462-1469.