Real time capture of audio images and their use with video

IEEE Workshop on Applications of Signal Processing to Audio and Acoustics

Volumn , Issue , 2007, Pages 10-13

  O'Donovan, Adam ^a   Duraiswami, Ramani ^a   Gumerov, Nail A ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO IMAGES; CAPTURED FRAMES; FRAME RATES; GRAPHICS PROCESSORS; HIGH FRAME RATE; JOINT ANALYSIS; JOINT PROCESSING; MICROPHONE ARRAYS; NOISE SOURCES; NOISE-SUPPRESSION; PROJECTION CAMERA; REAL TIME; REAL-TIME APPLICATIONS; SPATIAL DIFFERENCING; SPATIAL DIRECTIONS; SPHERICAL ARRAY; VIDEO CAMERAS; VIDEO IMAGING; VISUAL IDENTIFICATION;

ACOUSTICS; CAMERAS; DATA ACQUISITION; IMAGE CODING; IMAGE ENHANCEMENT; SIGNAL PROCESSING;

AUDIO ACOUSTICS;

EID: 50249088826     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ASPAA.2007.4393037     Document Type: Conference Paper

References (16)

1. T. Abhayapala & D. Ward, 2002. Theory and Design of High Order Sound Field Microphones Using Spherical Microphone array, IEEE ICASSP 2002, vol. 2, pp. 1949-1952.
2. R. Duraiswami, D.N. Zotkin, Z. Li, E. Grassi, N.A. Gumerov, L.S. Davis, System for capturing of high-order spatial audio using spherical microphone array and binaural head-tracked playback over headphones with head related transfer function cues, Proc. 119th convention AES, 2005.
3. R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, 2000.
4. Z. Li. R. Duraiswami, E. Grassi and L.S. Davis, Flexible layout and optimal cancellation of the orthonormality error for spherical microphone arrays, ICASSP2004, IV:41-44, 2004.
5. Z. Li and R. Duraiswami, "Hemispherical microphone arrays for sound capture and beamforming," Proceedings IEEE WASPAA, 106-109, 2005.
6. Z. Li and R. Duraiswami, "Flexible and Optimal Design of Spherical Microphone Arrays for Beamforming," IEEE Transactions on Audio, Speech and Language Processing, 15:702-714, 2007
7. Z. Li, The Capture and Recreation of 3D Auditory Scenes, Ph.D. Thesis, Department of Computer Science, University of Maryland, 2005.
8. R. Lienhart, L. Liang, and A. Kuranov. "A detector tree of boosted classifiers for real-time object detection and tracking," Proceedings IEEE ICME, 2:277-280, 2003.
9. J. Meyer & G. Elko, 2002. A Highly Scalable Spherical Microphone Array Based on an Orthonormal Decomposition of the Soundfield, IEEE ICASSP 2002, vol. 2, pp. 1781-1784.
10. J. Meyer & G. Elko, "Spherical Microphone Arrays for 3D Sound Recording", in Audio Signal Processing, ed. by Y. Huang and J. Benesty, Kluwer Academic Publishers, 2004
11. A. O'Donovan, R. Duraiswami, and J. Neumann. Microphone Arrays as Generalized Cameras for Integrated Audio Visual Processing. To appear: Proc. IEEE CVPR, 2007.
12. C. Choi, D. Kong, S. Lee, K. Park, S. Hong, H. Lee, S. Bang; Y. Lee, S. Kim, "Real-time audio-visual localization of user using microphone array and vision camera," Proc. IEEE/RSJ IROS. 1935-1940, 2005.
13. S. Whalen, Audio and the Graphics Processing Unit. IEEE tutorial GPGPU, Vis 2004.
14. E Gallo and N. Tsingos. Efficient 3D Audio Processing with the GPU. http://www-sop.inria.fr/reves/Nicolas.Tsingos/publis/posterfinal.pdf
15. B. Rafaely, 2005. Analysis and Design of Spherical Microphone Arrays, IEEE Trans. Speech Audio Proc., vol. 13(1), pp. 135-143.
16. B. Rafaely, 2004. Plane-Wave Decomposition of the Sound Field on a Sphere by Spherical Convolution, J. Acoust. Soc. Am., vol. 116(4), pp. 2149-2157.