Spectrum restoration from multiscale auditory phase singularities by generalized projections

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 4, 2006, Pages 1179-1192

  Chi, Taishih ^a,b   Shamma, Shihab A ^a,c  

^a IEEE   (Taiwan)

^b NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

^c UNIVERSITY OF MARYLAND   (United States)

Author keywords

Auditory model; Convex projection; Phase singularity; Spectrum restoration

Indexed keywords

AUDITORY MODELS; CONVEX PROJECTION; PHASE SINGULARITY; SPECTRUM RESTORATION;

ALGORITHMS; APPROXIMATION THEORY; PHYSIOLOGICAL MODELS; PHYSIOLOGY; SPEECH CODING; WAVELET TRANSFORMS;

SPEECH PROCESSING;

EID: 34047256082     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2005.860828     Document Type: Article

References (63)

1. D. Marr, Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. San Francisco, CA: Freeman, 1982.
2. J. Canny, "A computational approach to edge detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-8, no. 6, pp. 679-698, Jun. 1986.
3. G. J. Brown, "Computational auditory scene analysis: A representational approach," Ph.D. dissertation, Univ. Sheffield, Sheffield, U.K., 1992.
4. L. S. Smith, "Onset-based sound segmentation," in Advances in Neural Information Processing Systems, D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, Eds. Cambridge, MA: MIT Press, 1996, vol. 8, pp. 729-735.
5. D. M. Harris and P. Dallos, "Forward masking of auditory nerve fiber responses," J. Neurophysiol, vol. 42, pp. 1083-1107, 1979.
6. B. Girod, "The information theoretical significance of spatial and temporal masking in video signals," Proc. SPIE, vol. 1077, pp. 178-187, 1989.
7. S. Mallat and S. Zhong, "Characterization of signals from multiscale edges," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 7, pp. 710-732, Jul. 1992.
8. D. Marr and T. Poggio, "A computational theory of human stereo vision," Proc. R. Soc. Lond. B, vol. 204, pp. 301-328, 1979.
9. D. Marr and E. Hildreth, "Theory of edge detection," Proc. R. Soc. Lond. B, vol. 207, pp. 187-217, 1980.
10. M. R. M. Jenkin and A. D. Jepson, "The measurement of binocular disparity," in Computational Processes in Human Vision : An Interdisciplinary Perspective, Z. W. Pylyshyn, Ed. Westport, CT: Ablex, 1988.
11. A. Witkin, "Scale space filtering," in Proc. Int. Joint Conf. Artificial Intell., 1983.
12. S. Mallat, "Zero-crossings of a wavelet transform," IEEE Trans. Inform. Theory, vol. 37, no. 4, pp. 1019-1033, Jul. 1991.
13. T. Sanger, "Stereo disparity computation using gabor filters," Biol. Cybern., vol. 59, pp. 405-418, 1988.
14. D. J. Fleet, A. D. Jepson, and M. R. M. Jenkin, "Phase-based disparity measurement," GVGIP: Image Understand., vol. 53, no. 2, pp. 198-210, 1991.
15. C.-J. Westelius, H. Knutsson, J. Wiklund, and C.-F. Westin, "Phase-based disparity estimation," in Vision as Process: Basic Research on Computer Vision Systems, J. L. Crowley and H. I. Christensen, Eds. New York: Springer-Verlag, 1995, pp. 157-178.
16. D. Depireux, J. Simon, D. Klein, and S. Shamma, "Spectro-temporal response field characterization with dynamic ripples in ferret primary auditory cortex," J. Neurophysiol., vol. 85, no. 3, pp. 1220-1234, 2001.
17. T. Chi, P. Ru, and S. A. Shamma, "Multiresolution spectrotemporal analysis of complex sounds," J. Acoust. Soc. Amer., vol. 118, no. 2, pp. 887-906, 2005.
18. J. Simon, D. A. Depireux, and S. A. Shamma, "Representation of complex spectra in auditory cortex," in Proc. 11th Int. Symp. Hearing, A. R. Palmer, A. Ress, A. Q. Summerfield, and R. Meddis, Eds., London, U.K., 1998, pp. 513-520.
19. H. Versnel and S. A. Shamma, "Ripple analysis in the ferret auditory cortex: III. Topographic and columnar distribution of ripple response parameters," J. Aud. Neurosci., vol. 1, no. 2, pp. 271-285, 1995.
20. T. Chi, Y. Gao, C. G. Guyton, P. Ru, and S. Shamma, "Spectro- temporal modulation transfer functions and speech intelligibility," J. Acoust. Soc. Amer., vol. 106, no. 5, pp. 2719-2732, 1999.
21. M. Elhilali, T. Chi, and S. A. Shamma, "A spectro-temporal modulation index (stmi) for assessment of speech intelligibility," Speech Commun., vol. 41, no. 2-3, pp. 331-348, 2003.
22. R. Carlyon and S. Shamma, "An account of monaural phase sensitivity," J. Acoust. Soc. Amer., vol. 114, no. 1, pp. 333-348, 2003.
23. K. Wang and S. A. Shamma, "Spectral shape analysis in the central auditory system," IEEE Trans. Speech Audio Process., vol. 3, no. 5, pp. 382-395, Sep. 1995.
24. A. Levi and H. Stark, "Image restoration by the method of generalized projections with application to restoration from magnitude," J. Opt. Soc. Amer. A, vol. 1, no. 9, pp. 932-943, 1984.
25. M. H. Hayes, "The reconstruction of a multidimensional sequence from the phase or magnitude of its Fourier transform," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-30, no. 2, pp. 140-154, Apr. 1982.
26. J. R. Fienup and C. C. Wackerman, "Phase-retrieval stagnation problems and solutions," J. Opt. Soc. Amer. A, vol. 3, no. 11, pp. 1897-1907, 1987.
27. S. A. Shamma, J. W. Fleshman, P. R. Wiser, and H. Versnal, "Organization of the response areas in ferret primary auditory cortex," J. Neurophysiol., vol. 69, no. 2, pp. 367-383, 1993.
28. S. A. Shamma, H. Versnel, and N. Kowalski, "Ripple analysis in the ferret auditory cortex: I. Response characteristics of single units to sinusoidally rippled spectra," J. Aud. Neurosci., vol. 1, no. 2, pp. 233-254, 1995.
29. S. A. Shamma and H. Versnel, "Ripple analysis in the ferret auditory cortex: II. Prediction of unit response to arbitrary profiles," J. And. Neurosci., vol. 1, no. 2, pp. 255-270, 1995.
30. P. Ru and S. A. Shamma, "Presentation of musical timbre in the auditory cortex," J. New Music Res., vol. 26, no. 2, pp. 154-169, 1997.
31. D. N. Zotkin, S. A. Shamma, P. Ru, R. Duraiswami, and L. S. Davis, "Pitch and timbre manipulations using cortical representation of sound," in Proc. ICASSP, 2003, pp. 517-520.
32. A. Papoulis, The Fourier Integral and Its Applications. New York: McGraw-Hill, 1962.
33. R. Hummel and R. Moniot, "Reconstructions from zero crossings in scale space," IEEE Trans. Acoust., Speech, Signal Process., vol. 37, no. 12, pp. 2111-2130, Dec. 1989.
34. S. Mallat and W. L. Hwang, "Singularity detection and processing with wavelets," IEEE Trans. Inform. Theory, vol. 38, no. 3, pp. 617-643, Mar. 1992.
35. A. L. Yuille and T. A. Poggio, "Scaling theorems for zero crossings," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-8, no. 1, pp. 15-25, Jan. 1986.
36. S. Curtis, S. Shitz, and A. Oppenheim, "Reconstructions of non-periodic two-dimensional signals from zero crossings," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-35, no. 6, pp. 890-893, Jun. 1987.
37. Z. Berman, "The Uniqueness Question of Discrete Wavelet Maxima Representation," Inst. Syst. Res, Univ. Maryland, TR 91-48, 1991.
38. A. L. Yuille and T. A. Poggio, "Fingerprints theorems," Proc. Amer. Assoc. Artif. Intell., pp. 362-365, 1984.
39. J. J. Koenderink, "The structure of images," Biol. Cybern., vol. 50, pp. 363-370, 1984.
40. A. Papoulis, "A new algorithm in spectral analysis and band-limited extrapolation," IEEE Trans. Circuits Syst., vol. CAS-22, no. 9, pp. 735-742, Sep. 1975.
41. R. W. Gerchberg and W. O. Saxton, "A practical algorithm for the determination of phase from image and diffraction plane pictures," Optik, vol. 35, pp. 237-246, 1972.
42. J. R. Fienup, "Phase retrieval algorithms: A comparison," Appl. Opt., vol. 21, pp. 2758-2769, 1982.
43. R. H. T. Bates, "Uniqueness of solutions to two-dimensional Fourier phase problems for localized and positive images," Comput. Vis., Graph., Image Process., vol. 25, pp. 205-217, 1984.
44. M. H. Hayes, "The unique reconstruction of multidimensional sequences from Fourier transform magnitude or phase," in Image Recovery: Theory and Application, H. Stark, Ed. New York: Academic, 1987, pp. 195-230.
45. J. H. Seldin and J. R. Fienup, "Numerical investigation of the uniqueness of phase retrieval," J. Opt. Soc. Amer. A, vol. 7, no. 3, pp. 412-427, 1990.
46. Z. Mou-yan and R. Unbehauen, "Methods for reconstruction of 2-D sequences from Fourier transform magnitude," IEEE Trans. Image Process., vol. 6, no. 2, pp. 222-233, Feb. 1997.
47. T. Irino and H. Kawahara, "Signal reconstruction from modified auditory wavelet transform," IEEE Trans. Signal Process., vol. 41, no. 12, pp. 3549-3554, Dec. 1993.
48. X. Yang, K. Wang, and S. A. Shamma, "Auditory representations of acoustic signals," IEEE Trans. Inform. Theory, vol. 38, no. 3, pp. 824-839, Mar. 1992.
49. "Perceptual Evaluation of Speech Quality (PESQ): An Objective Method for end-to-end Speech Quality Assessment of Narrow-Band Telephone Networks and Speech Codecs," ITU-T, ITU-T Recommend. P. 862, 2001.
50. M. Delprat, A. Urie, and C. Evci, "Speech coding requirements from the perspective of the future mobile systems," in Proc. IEEE Workshop on Speech Coding for Telecommunications, 1993, pp. 89-90.
51. B. Logan, "Information in the zero crossings of bandpass signals," Bell Syst. Tech. J., vol. 56, no. 4, pp. 487-510, 1977.
52. S. A. Zahorian and A. J. Jagharghi, "Spectral shape features versus formants as acoustic correlates for vowel," J. Acoust. Soc. Amer., vol. 94, no. 4, pp. 1966-1982, 1993.
53. J. Hillenbrand, L. A. Getty, M. J. Clark, and K. Wheeler, "Acoustic characteristics of american english vowels," J. Acoust. Soc. Amer., vol. 97, no. 5, pp. 3099-3111, 1995.
54. G. E. Peterson and H. L. Barney, "Control methods used in a study of the vowels," J. Acoust. Soc. Amer., vol. 24, no. 2, pp. 175-1849, 1952.
55. L. R. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
56. D. A. Reynolds and R. C. Rose, "Robust text-independent speaker identification using Gaussian mixture speaker models," IEEE Trans. Speech Audio Process., vol. 3, no. 1, pp. 72-83, Jan. 1995.
57. N. M. Blachman, 'The shape of low minima of the envelope of narrow-band Gaussian noise," IEEE Trans. Inform. Theory, vol. 42, no. 5, pp. 1007-1009, May 1996.
58. P. Ru, T. Chi, and S. Shamma, "The synergy between speech production and perception," J. Acoust. Soc. Amer., vol. 113, no. 1, pp. 498-515, 2003.
59. B. S. Atal, "Automatic speaker recognition based on pitch contours," J. Acoust. Soc. Amer., vol. 52, no. 6, pp. 1687-1697, 1972.
60. _, "Automatic recognition of speakers from their voices," Proc. IEEE, vol. 64, no. 4, pp. 460-475, Apr. 1976.
61. C. R. J. Jr, T. F. Quatieri, and D. A. Reynolds, "Measuring fine structure in speech: Application to speaker identification," in Proc. ICASSP, 1995, pp. 325-328.
62. F. Farahani, P. G. Georgiou, and S. S. Narayanan, "Speaker identification using supra-segmental pitch pattern dynamics," in Proc. ICASSP, 2004, pp. 89-92.
63. H. Ezzaidi, J. Rouat, and D. O'Shaughnessy, "Toward combining pitch and mfcc for speaker identification systems," in Proc. Eurospeech, 2001, pp. 2825-2828.