3D-audio matting, postediting, and rerendering from field recordings

Eurasip Journal on Advances in Signal Processing

Volumn 2007, Issue , 2007, Pages

  Gallo, Emmanuel ^a,b   Tsingos, Nicolas ^a   Lemaitre, Guillaume ^a  

^a INRIA   (France)

^b Centre Scientifique   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC FIELDS; ALGORITHMS; MATHEMATICAL MODELS; MICROPHONES; REAL TIME SYSTEMS; TIME DELAY;

ARRIVAL ESTIMATION; HIERARCHICAL LOCALIZATION ALGORITHMS; REAL TIME SPATIAL RENDERING; SPATIAL CALIBRATION;

SOUND RECORDING;

EID: 33947129139     PISSN: 11108657     EISSN: 16870433     Source Type: Journal    
DOI: 10.1155/2007/47970     Document Type: Article

References (74)

1. D. G. Malham A. Myatt 3-D sound spatialization using ambisonic techniques. Computer Music Journal 19 4 1995 58 70
2. Soundfield http://www.soundfield.com/
3. D. G. Aliaga I. Carlbom Plenoptic stitching: a scalable method for reconstructing 3D interactive walkthroughs. Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01) Los Angeles, Calif, USA 2001 443 450
4. C. Buehler M. Bosse L. McMillan S. Gortler M. Cohen Unstructured lumigraph rendering. Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01) Los Angeles, Calif, USA 2001 425 432
5. S. E. Chen L. Williams View interpolation for image synthesis. Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '93) Anaheim, Calif, USA 1993 279 288
6. Y. Horry K.-I. Anjyo K. Arai Tour into the picture: using a spidery mesh interface to make animation from a single image. Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '97) Los Angeles, Calif, USA 1997 225 232
7. T. Porter T. Duff Compositing digital images. Proceedings of the 11th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '84) Minneapolis, Minn, USA 1984 253 259
8. D. L. Yewdall Practical Art of Motion Picture Sound. 2nd Focal Press Boston, Mass, USA 2003
9. R. Streicher The decca tree - it's not just for stereo anymore. http://www.wesdooley.com/pdf/Surround_Sound_Decca_Tree-urtext.pdf
10. R. Streicher F. A. Everest The New Stereo Soundbook. Audio Engineering Associate Pasadena, Calif, USA 1998 2nd
11. J. Daniel J.-B. Rault J.-D. Polack Ambisonics encoding of other audio formats for multiple listening conditions. Proceedings of the 105th Convention of the Audio Engineering Society San Francisco, Calif, USA 1998 preprint 4795
12. M. A. Gerzon Ambisonics in multichannel broadcasting and video. Journal of the Audio Engineering Society 33 11 1985 859 871
13. M. J. Leese Ambisonic surround sound FAQ (version 2.8). 1998 http://members.tripod.com/martin_leese/Ambisonic/
14. J. Merimaa Applications of a 3-D microphone array. 112th AES Convention Munich, Germany 2002 preprint 5501
15. A. Laborie R. Bruno S. Montoya A new comprehensive approach of surround sound recording. Proceedings of the 114th Convention of the Audio Engineering Society Amsterdam, The Netherlands 2003 preprint 5717
16. J.-M. Jot V. Larcher J.-M. Pernaux A comparative study of 3D audio encoding and rendering techniques. Proceedings of the AES 16th International Conference on Spatial Sound Reproduction Rovaniemi, Finland 1999
17. T. D. Abhayapala D. B. Ward Theory and design of high order sound field microphones using spherical microphone array. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '02) Orlando, Fla, USA 2 2002 1949 1952
18. A. Laborie R. Bruno S. Montoya High spatial resolution multi-channel recording. Proceedings of the 116th Convention of the Audio Engineering Society Berlin, Germany 2004 preprint 6116
19. J. Meyer G. Elko Y. (Arden) Huang J. Benesty Spherical microphone arrays for 3D sound recording. Audio Signal Processing for Next-Generation Multimedia Communication Systems Kluwer Academic Boston, Mass, USA 2004 2
20. A. J. Berkhout D. de Vries P. Vogel Acoustic control by wave field synthesis. Journal of the Acoustical Society of America 93 5 1993 2764 2778
21. M. M. Boone E. N. G. Verheijen P. F. van Tol Spatial sound-field reproduction by wave-field synthesis. Journal of the Audio Engineering Society 43 12 1995 1003 1012
22. T. Ajdler M. Vetterli The plenacoustic function and its sampling. Proceedings of the 1st IEEE Benelux Workshop on Model Based Processing and Coding of Audio (MPCA '02) Leuven, Belgium 2002
23. M. N. Do minhdo@uiuc.edu Toward sound-based synthesis: the far-field case. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '04) Montreal, Que, Canada 2 2004 601 604
24. S. J. Gortler R. Grzeszczuk R. Szeliski M. F. Cohen The lumigraph. Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '96) New Orleans, La, USA 1996 43 54
25. M. Levoy P. Hanrahan Light field rendering. Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '96) New Orleans, La, USA 1996 31 42
26. U. Horbach A. Karamustafaoglu R. Pellegrini P. Mackensen G. Theile Design and applications of a data-based auralization system for surround sound. Proceedings of the 106th Convention of the Audio Engineering Society Munich, Germany 1999 preprint 4976
27. R. S. Pellegrini Comparison of data and model-based simulation algorithms for auditory virtual environments. 106th Convention of the Audio Engineering Society Munich, Germany 1999 preprint 4953
28. A. S. Bregman Auditory Scene Analysis, The Perceptual Organization of Sound. MIT Press Cambridge, Mass, USA 1990
29. F. Baumgarte fb@agere.com C. Faller cfaller@agere.com Binaural cue coding - part I: psychoacoustic fundamentals and design principles. IEEE Transactions on Speech and Audio Processing 11 6 2003 509 519
30. C. Faller cfaller@agere.com F. Baumgarte fb@agere.com Binaural cue coding - part II: schemes and applications. IEEE Transactions on Speech and Audio Processing 11 6 2003 520 531
31. J. Merimaa V. Pulkki Spatial impulse response rendering. Proceedings of the 7th International Conference on Digital Audio Effects (DAFx '04) Naples, Italy 2004 139 144
32. V. Pulkki Directional audio coding in spatial sound reproduction and stereo upmixing. Proceedings of the 28th AES International Conference Pitea, Sweden 2006
33. P. D. O'Grady B. A. Pearlmutter S. T. Rickard Survey of sparse and non-sparse methods in source separation. International Journal of Imaging Systems and Technology 15 2005 1 18 33
34. E. Vincent X. Rodet A. Röbel A tentative typology of audio source separation tasks. Proceedings of the 4th International Symposium on Independent Component Analysis and Blind Signal Separation (ICA '03) Nara, Japan 2003 715 720
35. S. Rickard Sparse sources are separated sources. Proceedings of the 14th Annual European Signal Processing Conference Florence, Italy 2006
36. M. S. Lewicki Efficient coding of natural sounds. Nature Neuroscience 5 4 2002 356 363
37. P. Comon Independent component analysis. A new concept? Signal Processing 36 3 1994 287 314
38. H. Sawada S. Araki R. Mukai S. Makino Blind extraction of dominant target sources using ICA and time-frequency masking. IEEE Transactions on Audio, Speech and Language Processing 14 2006 6 2165 2173
39. A. Jourjine S. Rickard O. Yilmaz Blind separation of disjoint orthogonal signals: demixing N sources from 2 mixtures. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '00) Istanbul, Turkey 5 2000 2985 2988
40. . Yilmaz oyilmaz@math.umd.edu S. Rickard rickard@ieee.org Blind separation of speech mixtures via time-frequency masking. IEEE Transactions on Signal Processing 52 7 2004 1830 1847
41. C. Avendano Frequency-domain source identification and manipulation in stereo mixes for enhancement, suppression and re-panning applications. Proceedings of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA '03) New Paltz, NY, USA 2003 55 58
42. R. Radke S. Rickard Audio interpolation. Proceedings of the AES 22nd International Conference on Virtual, Synthetic and Entertainment Audio (AES22 '02) Espoo, Finland 2002 51 57
43. R. L. Moses D. Krishnamurthy R. Patterson An auto-calibration method for unattended ground sensors. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '02) Orlando, Fla, USA 3 2002 2941 2944
44. O. Faugeras Three-Dimensional Computer Vision: A Geometric Viewpoint. MIT Press Cambridge, Mass, USA 1993
45. B. C. J. Moore An Introduction to the Psychology of Hearing. 4th Academic Press New York, NY, USA 1997
46. P. Aarabi parham@ecf.utoronto.ca The fusion of distributed microphone arrays for sound localization. EURASIP Journal on Applied Signal Processing 2003 4 2003 338 347
47. Y. (Arden) Huang J. Benesty G. W. Elko Microphone arrays for video camera steering. Acoustic Signal Processing for Telecommunication 11 2000 Kluwer Academic Boston, Mass, USA 239 259
48. C. H. Knapp G. C. Carter The generalized correlation method for estimation of time delay. IEEE Transactions on Acoustics, Speech, and Signal Processing 24 1976 4 320 327
49. H. Krim M. Viberg Two decades of array signal processing research: the parametric approach. IEEE Signal Processing Magazine 13 4 1996 67 94
50. R. O. Schmidt Multiple emitter location and signal parameter estimation. IEEE Transactions on Antennas and Propagation 34 3 1986 276 280
51. J. C. Chen jcchen@ee.uda.edu K. Yao yao@ee.ucla.edu R. E. Hudson ralph@ee.ucla.edu Acoustic source localization and beamforming: theory and practice. EURASIP Journal on Applied Signal Processing 2003 4 2003 359 370
52. J. H. DiBiase H. F. Silverman M. S. Branstein Microphone Arrays, Signal Processing Techniques and Applications. Springer New York, NY, USA 2001 8
53. B. Mungamuru P. Aarabi parham@ecf.utoronto.ca Enhanced sound localization. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 34 3 2004 1526 1540
54. J. Chen jingdong@research.bell-labs.com J. Benesty benesty@emt.inrs.ca Y. (Arden) Huang arden@research.bell-labs.com Time delay estimation in room acoustic environments: an overview. EURASIP Journal on Applied Signal Processing 2006 2006 26503 19 pages
55. D. V. Rabinkin R. J. Renomeron J. C. French J. L. Flanagan Estimation of wavefront arrival delay using the cross-power spectrum phase technique. 132nd Meeting of the Acoustical Society of America Honolulu, Hawaii, USA 1996
56. J. Chen jingdong@research.bell-labs.com J. Benesty benesty@inrs-emt. uquebec.ca Y. (Arden) Huang arden@research.bell-labs.com Performance of GCC- and AMDF-based time-delay estimation in practical reverberant environments. EURASIP Journal on Applied Signal Processing 2005 1 2005 25 36
57. Y. Rui D. Florencio New direct approaches to robust sound source localization. Proceedings of International Conference on Multimedia and Expo (ICME '03) Baltimore, Md, USA 1 2003 737 740
58. T. Ajdler thibaut.ajdler@epfl.ch I. Kozintsev R. Lienhart M. Vetterli Acoustic source localization in distributed sensor networks. Proceedings of the 38th Asilomar Conference on Signals, Systems and Computers Pacific Grove, Calif, USA 2 2004 1328 1332
59. H. Samet The Design and Analysis of Spatial Data Structures. Addison-Wesley Reading, Mass, USA 1990
60. N. Tsingos Nicolas.Tsingos@sophia.inria.fr E. Gallo G. Drettakis Perceptual audio rendering of complex virtual environments. ACM Transactions on Graphics 23 3 2004 249 258 Proceedings of SIGGRAPH 2004
61. R. E. Kalman A new approach to linear filtering and prediction problems. Transactions of the ASME - Journal of Basic Engineering 82 1960 35 45
62. D. G. Malham Spherical harmonic coding of sound objects - the ambisonic O format. Proceedings of the 19th AES International Conference, Surround Sound - Techniques, Technology, and Perception Schloss Elmau, Germany 2001 54 57
63. N. Tsingos J.-D. Gascuel Fast rendering of sound occlusion and diffraction effects for virtual acoustic environments. Proceedings of the 104th Audio Engineering Society Convention Amsterdam, The Netherlands 1998 preprint 4699
64. A. Baskind O. Warusfel Methods for blind computational estimation of perceptual attributes of room acoustics. Proceedings of the AES 22nd International Conference on Virtual, Synthetic and Entertainment Audio Espoo, Finland 2002 402 411
65. S. Rickard O. Yilmaz On the approximate W-disjoint orthogonality of speech. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '02) Orlando, Fla, USA 1 2002 529 532
66. M. S. Lewicki T. J. Sejnowski Learning overcomplete representations. Neural Computation 12 2 2000 337 365
67. S. G. Mallat Z. Zhang Matching pursuits with time-frequency dictionaries. IEEE Transactions on Signal Processing 41 12 1993 3397 3415
68. M. Slaney M. Covell B. Lassiter Automatic audio morphing. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '96) Atlanta, Ga, USA 2 1996 1001 1004
69. C. Faller cfaller@agere.com J. Merimaa Source localization in complex listening situations: selection of binaural cues based on interaural coherence. Journal of the Acoustical Society of America 116 5 2004 3075 3089
70. Y. Ephraim D. Malah Speech enhancement using a minimum mean-square error short-time spectral amplitude estimator. IEEE Transactions on Acoustics, Speech, and Signal Processing 32 6 1984 1109 1121
71. G. Huang redforce@sohu.com L. Yang lxyang@seu.edu.cn Z. He zyhe@seu.edu.cn Multiple acoustic sources location based on blind source separation. Proceedings of the 1st International Conference on Natural Computation (ICNC '05) Changsha, China 2005 683 687
72. H. Saruwatari sawatari@is.aist-nara.ac.jp S. Kurita K. Takeda takeda@nuee.nagoya-u.ac.jp F. Itakura itakura@nuee.nagoya-u.ac.jp T. Nishikawa tsuyo-ni@is.aist-nara.ac.jp K. Shikano shikano@is.aist-nara.ac.jp Blind source separation combining independent component analysis and beamforming. EURASIP Journal on Applied Signal Processing 2003 11 2003 1135 1146
73. K. W. Wilson T. Darell Learning a precedence effect-like weighting function for the generalized cross-correlation framework. IEEE Transactions on Audio, Speech and Language Processing 14 2006 6 2156 2164
74. L. Lu llu@microsoft.com L. Wenyin csliuwy@cityu.edu.hk H.-J. Zhang hjzhang@microsoft.com Audio textures: theory and applications. IEEE Transactions on Speech and Audio Processing 12 2 2004 156 167