Time-Frequency Analysis and Auditory Modeling for Automatic Recognition of Speech

Proceedings of the IEEE

Volumn 84, Issue 9, 1996, Pages 1199-1215

  Pitton, James W ^a,c   Wang, Kuansan ^b   Juang, Biing Hwang ^a  

^a Parametric Technology Corporation   (United States)

^b VERIZON   (United States)

^c LUCENT TECHNOLOGIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FREQUENCY DOMAIN ANALYSIS; PHYSIOLOGICAL MODELS; SPEECH CODING; SPEECH INTELLIGIBILITY; SPEECH PROCESSING; SPEECH TRANSMISSION; SPURIOUS SIGNAL NOISE; STATISTICAL METHODS; TIME DOMAIN ANALYSIS;

AUDITORY MODELS; SPEECH WAVEFORM; TIME FREQUENCY ANALYSIS;

SPEECH RECOGNITION;

EID: 0030244273     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/5.535241     Document Type: Article

References (115)

1. J. Allen, Cochlear modeling, IEEE ASSP Mag., Jan. 1985.
2. T. Applebaum and B. Hanson, "Perceptually-based dynamic spectrograms," in Visual Representations of Speech Signals, M. Cooke and S. Beet, Eds. London: Wiley, 1993, pp. 153-160.
3. P. Assmann and D. Paschall, "Autocorrelogram models of the segregation of competing voices," in Proc. 15th Winter ARO Meet., St. Petersburg, FL, Feb. 1992.
4. P. Assmann and Q. Summerfield, "Modeling the perception of concurrent vowels: vowels with the same fundamental frequency," J. Acoust. Soc. Amer., vol. 85, no. 1, pp. 327-338, 1989.
5. "Modeling the perception of concurrent vowels: vowels with different fundamental frequencies," J. Acoust. Soc. Amer., vol. 88, no. 2, pp. 680-697, 1990.
6. L. Atlas, W. Kooiman, P. Loughlin, and R. Cole, "New nonstationary techniques for the analysis and display of speech transients," in Proc. ICASSP'90, pp. 385-388.
7. L. Atlas, P. Loughlin, and J. Pitton, 'Truly nonstationary techniques for the analysis and display of voiced speech," in Proc. ICASSP'91, pp. 433-436.
8. B. Bakkum, R. Plomp, and L. Pols, "Objective analysis versus subjective assessment of vowels pronounced by native, nonnative and deaf male speakers of Dutch," J. Acoust. Soc. Amer., vol. 94, no. 10, pp. 1989-2004, 1993.
9. R. Baraniuk and D. Jones, "A signal-dependent time-frequency representation: optimal kernel design," IEEE Trans. Signal Process., vol. 41, no. 4, pp. 1589-1602, 1993.
10. J. Barnett and B. Kedem, "Zero-crossing rates of functions of gaussian processes," IEEE Trans. Inform. Theory, vol. 37, pp. 1188-1194, Apr. 1991.
11. W. Bialek, "Optimal real-time signal processing in the nervous system," in Neural Systems: Analysis and Modeling, F. H. Eeckman, Ed. Amsterdam: Kluwer, 1993, pp. 5-28.
12. S. Blumstein and K. Stevens, "Acoustic invariance in speech production: evidence from measurements of the spectral characteristics of stop consonants," J. Acoust. Soc. Amer., vol. 66, no. 4, pp. 1001-1017, 1979.
13. A. Bregman, Auditory Scene Analysis: The Perceptual Organization of Sound. Cambridge, MA: MIT Press, 1990.
14. W. Byrne, J. Robinson, and S. Shamma, "The auditory processing and recognition of speech," in Proc. Speech and Natural Lang. Workshop, 1989, pp. 325-331.
15. L. Camey, "A model for the responses of low-frequency auditory nerve fibers in cats," J. Acoust. Soc. Amer., vol. 93, no. 1, pp. 401-4117, 1993.
16. F. Casacuberta and E. Vidai, "A nonstationary model for the analysis of transient speech signals," IEEE Trans. Acoust. Speech Signal Process., vol. 35, pp. 226-228, Feb. 1987.
17. S. Cheung and J. Lim, "Combined multi-resolution (wideband/narrowband) spectrogram," in IEEE Proc. ICASSP'91, pp. 457-460.
18. H. Choi and W. Williams, "Improved time-frequency representation of multi-component signals using exponential kernels," IEEE Trans. Acoust. Speech Signal Process., vol. 37, pp. 862-871, June 1989.
19. L. Cohen, "Generalized phase-space distribution functions," J. Math. Phys., vol. 7, no. 5, pp. 781-786, 1966.
20. Time-Frequency Analysis. New York: Prentice-Hall, 1995.
21. L. Cohen and C. Lee, "Instantaneous frequency, its standard deviation and multicomponent signals," SPIE Advanced Algs. Archs. Sig. Proc. Ill, vol. 975, pp. 186-208, 1988.
22. M. Cooke, S. Beet, and M. Crawford, Visual Representations of Speech Signais. New York: Wiley, 1993.
23. S. Davis and P. Mermelstein, "Comparison of parametric representation for monosyllable word recognition in continuously spoken sentences," IEEE Trans. Acoust. Speech Signal Process., vol. ASSP-28, pp. 357-366, Apr. 1980.
24. P. Delattre, A. Liberman, and F. Cooper, "Acoustic loci and transitional cues for consonants," J. Acoust. Soc. Amer., vol. 27, no. 4, pp. 769-773, 1955.
25. L. Deng, "A generalized hidden Markov model with stateconditioned trend functions of time for the speech signal," Signal Process., vol. 27, pp. 65-78, 1992.
26. L. Deng, M. Aksmanovic, X. Sun, and C. Wu, "Speech recognition using hidden Markov models with polynomial regression functions as nonstationary states," IEEE Trans. Speech Audio Process., vol. 2, no. 4, pp. 507-520, 1994.
27. L. Deng, C. Geisler, and S. Greenberg, "A composite model of the auditory periphery for the processing of speech," J. Phonetics, vol. 16, no. 1, p. 93, 1988.
28. V. Digilakis, J. Rohlicek, and M. Ostendorf, "ML estimation of a stochastic linear system with the EM algorithm and its application to speech recognition," IEEE Trans. Speech. Audio Process., vol. 1, no. 4, pp. 431-442, 1993.
29. G. Dogil and W. Wokurek, "Wigner distribution analysis of stop consonant release transients: labials, velars, and labio-velars," in Proc. Int. Conf. Speech Res. '89, Budapest, pp. 1-4.
30. "Wigner time-frequency analysis for major places of articulation in stop consonants," in Proc. 12th Int. Cong. Phon. Sci., 1991, vol. 3, pp. 390-393.
31. V. Duggirala, G. Studebaker, C. Pavlovic, and R. Sherbecoe, "Frequency importance function for a feature recognition test material," J. Acoust. Soc. Amer., vol. 83, no. 6, pp. 2372-2382, 1988.
32. H. Dünn, "Methods of measuring vowel formant bandwidths," J. Acoust. Soc. Amer., vol. 33, no. 12, pp. 1737-1746, 1961.
33. J. Eggermont, "Peripheral auditory adaptation and fatigue," Hearing Res., vol. 18, pp. 57-71, 1985.
34. G. Fant, Acoustic Theory of Speech Production, 2nd ed. New York: Mouton, 1970.
35. J. Flanagan, Speech Analysis, Synthesis, and Perception. New York: Springer-Verlag, 1965.
36. S. Furui, "Speaker-independent isolated word recognition using dynamic features of speech spectrum," IEEE Trans. Acoust. Speech Signal Process., vol. ASSP-34, pp. 52-59, Jan. 1986.
37. "On the role of spectral transition for speech perception," J. Acoust. Soc. Amer., vol. 80, no. 4, pp. 1016-1025, 1986.
38. H. Garudadri, J, Gilbert, A. Benguerel, and M. Beddoes, "Invariant acoustic cues in stop consonants: a cross-language study using the Wigner distribution," J. Acoust. Soc. Amer., vol. 82, no. S55, 1987.
39. O. Ghitza, "Auditory nerve representation as a front end for speech recognition in a noisy environment," Computer Speech and Lang., vol. 1, pp. 109-130, 1986.
40. O. Ghitza and M. M. Sondhi, "Hidden Markov models with templates as nonstationary states: An application to speech recognition," Computer Speech and Lang., vol. 7, no. 2, pp. 101-119, 1993.
41. D. Green, Profile Analysis: Auditory Intensity Discrimination. New York: Oxford, 1988.
42. Y. Grenier, "Time-dependent ARMA modeling of nonstationary signals," IEEE Trans. Acoust. Speech Signal Process., vol. 31, pp. 899-911, Apr. 1983.
43. J. Harrington, "The contribution of the murmur and vowel to the place of articulation distinction in nasal consonants," J. Acoust. Soc. Amer., vol. 96, no. 1, pp. 19-32, 1994.
44. M. Hedrick and R. Ohde, "Effect of relative amplitude of frication on perception of place of articulations," J. Acoust. Soc. Amer., vol. 94, no. 4, pp. 2005-2026, 1993.
45. H. Hermansky, "Perceptual linear predictive (PLP) analysis for speech," J. Acoust. Soc. Amer., vol. 87, no. 4, pp. 1738-1752, 1990.
46. H. Hermansky and N. Morgan, "RASTA processing of speech," IEEE Trans. Speech Audio Process., vol. 2, no. 4, pp. 578-589, 1994.
47. A. Holbrook and G. Fairbanks, "Diphthong formants and their movements," J. Speech Hearing Res., vol. 5, no. 1, pp. 38-58, 1962.
48. C. Jankowski, T. Quatieri, and D. Reynolds, "Measuring fine structure in speech: application to speaker identification," in Proc. ICASSP'95, pp. 325-328.
49. N. Jayant, J. Johnston, and R. Safranek, "Signal compression based on models of human perception," Proc. IEEE, vol. 81, pp. 1385-1422, Oct. 1993.
50. J. Jenkins, W. Strange, and S. Miranda, "Vowel identification in mixed-speaker silent-center syllables," J. Aconst. Soc. Amer., vol. 9, no. 2, pp. 1030-1041, 1994.
51. B. H. Juang, "Maximum likelihood estimation for mixture multivariate stochastic observations of Markov chains," AT&T Tech. J., vol. 64, no. 6, pp. 1235-1249, 1985.
52. O. Kakusho and M. Yanagida, "Hierarchical AR model for time varying speech signals," in Proc. ICASSP'82, pp. 1295-1298.
53. B. Kedem, "Spectral analysis and discrimination by zerocrossings," Proc. IEEE, vol. PROC-74, pp. 1477-1493, Nov. 1986.
54. D. Kewley-Port, 'Time-varying features as correlates of place of articulation in stop consonants," J. Aconst. Soc. Amer., vol. 73, no. 1, pp. 322-335, 1983.
55. W. Koenig, H. Dunn, and L. Lacy, "The sound spectrograph," J. Aconst. Soc. Amer., vol. 18, no. 1, pp. 19-49, 1946.
56. J. Licklider, "A duplex theory of pitch perception," Experienlia, vol. 7, pp. 128-133, 1951.
57. P. Lieberman, "Perturbations in vocal pitch," J. Aconst. Soc. Amer., vol. 33, no. 5, pp. 597-603, 1961.
58. L. Liporace, "Linear estimation of nonstationary signals," J. Acoust. Soc. Amer., vol. 58, no. 6, pp. 1288-1295, 1975.
59. P. Loughlin, L. Atlas, and J. Pitton, "Advanced time-frequency representations for speech processing," Visual Representations of Speech Signals, M. Cooke and S. Beet, Eds. London, U.K.: Wiley, 1993, pp. 27-53.
60. "Bilinear time-frequency representations: new insights and properties," IEEE Trans. Signal Process., vol. 41, pp. 750-767, Feb. 1993.
61. "Construction of positive time-frequency distributions," IEEE Trans. Signal Process., vol. 42, pp. 2697-2705, Oct. 1994.
62. P. Loughlin, J. Pitton, and B. Hannaford, "Approximating time-frequency density functions via optimal combinations of spectrograms," IEEE Signal Process. Lett., vol. 1, pp. 199-202, Dec. 1994.
63. R. Lyon, "Computational models of neural auditory processing," Proc. ICASSP'84, 1984.
64. P. Maragos, J. Kaiser, and T. Quatieri, "Energy separation in signal modulations with application to speech analysis," IEEE Trans. Signal Process., vol. 41, pp. 3024-3051, Oct. 1993.
65. J. Markel and A. Gray, Linear Prediction of Speech. New York: Kluwer, 1989.
66. R. Meddis and M. Hewitt, "Modeling the identification of concurrent vowels with different fundamental frequencies," J. Aconst. Soc. Amer., vol. 91, no. 1, pp. 233-245, 1992.
67. P. Milenkovic, "Voice source model for continuous control of pitch period," J. Aconst. Soc. Amer., vol. 93, no. 2, pp. 1087-1096, 1993.
68. Y. Miyanaga, N. Miki, and N. Nagai, "Adaptive identification of a time-varying ARMA speech model," IEEE Trans. Aconst. Speech, Signal Process., vol. ASSP-34, pp. 423-433, Mar. 1986.
69. B. Moore, An Introduction to the Psychology of Hearing, 3rd ed. New York: Academic, 1989.
70. D. Morgan, E. George, L. Lee, and S. Kay, "Co-channel speaker separation," in Proc. ICASSP'95, vol. 1, pp. 828-831.
71. N. Morgan et al., "Stochastic perceptual models of speech," Proc. ICASSP'95, vol. 1, pp. 397-400.
72. C. Nadeau, P. Paches-Leal, and B. H. Juang, "Filtering the time sequence of spectral parameters for speaker-independent CDHMM word recognition," Eurospeech95, Sept. 1995.
73. S. Nandkumar and J. Hansen, "Speech enhancement based on a new set of auditory constrained parameters," in Proc. ICASSP'94, pp. 1-4.
74. K. Nathan, Y. Lee, and H. Silverman, "A time-varying analysis method for rapid transitions in speech," IEEE Trans. Signal Process., vol. 39, pp. 815-824, Apr. 1991.
75. K. Nathan and H. Silverman, "Time-varying feature selection and classification of unvoiced stop consonants," IEEE Trans. Speech Audio Process., vol. 2, no. 3, pp. 395-405, 1994.
76. C. Neti, "Neuromorphic speech processing for noisy environments," in Proc. ICNN-94, Orlando, FL, June 1994, pp. 4425-4430.
77. R. D. Patterson et al., "Complex Sounds and auditory images," in Auditory Physiology and Perception, Y. Gazais, L. Demany, and K. Honer, Eds. London: Pergamon, 1992, pp. 429-446.
78. A. Papoulis, Probability, Random Variables, and Stochastic Processes. New York: McGraw-Hill, 1984.
79. G. Peterson and H. Barney, "Control methods used in a study of vowels," J. Acoust. Soc. Amer., vol. 24, no. 2, pp. 175-184, 1952.
80. J. Pickles, An Introduction to the Physiology of Hearing. New York: Academic, 1988.
81. J. Pitton, L. Atlas, and P. Loughlin, "Applications of positive time-frequency distributions to speech processing," IEEE Trans. Speech Audio. Process, vol. 2, no. 4, pp. 554-566, 1994.
82. M. Pont and R. Damper, "A computational model of afferent neural activity from the cochlea to the dorsal acoustic stria," J. Acoust. Soc. Amer., vol. 89, no. 3, pp. 1213-1228, 1991.
83. R. Potter, G. Kopp, and H. Green, Visible Speech. New York: Van Nostrand, 1947.
84. L. Rabiner and B. H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
85. M. Rahim, C. H. Lee, and B. H. Juang, "Robust utterance verification for connected digits recognition," in Proc. ICASSP'95, vol. 1, pp. 285-288.
86. B. Repp and H. Lin, "Acoustic properties and perception of consonant release transients," J. Acoust. Soc. Amer., vol. 85, no. 1, pp. 379-396, 1989.
87. J. Rice, E. Young, and G. Spirou, "Auditory-nerve encoding of pinna-based spectral cues: rate representation of high-frequency stimuli," J. Acoust. Soc. Amer., vol. 97, no. 3, pp. 1764-1776, 1995.
88. M. Riley, Speech Tune-Frequency Representations. New York: Kluwer, 1989.
89. S. Rosen and A. Fourcin, "Frequency selectivity and the perception of speech," in Frequency Selectivity in Hearing, B. Moore, Ed. New York: Academic, 1986, pp. 373-487.
90. M. Sachs, H. Voigt, and E. Young, "Auditory nerve representation of vowels in background noise," J. Neurophys., vol. 50, pp. 27-45, 1983.
91. M. Sachs and E. Young, "Encoding of steady-state vowels in the auditory nerve: representation in terms of discharge rate," J. Acoust. Soc. Amer., vol. 66, no. 1, pp. 470-479, 1979.
92. S. Sandhu and O. Ghitza, "A comparative study of mel cepstra and EIH for phone classification under adverse conditions," in Proc. ICASSP'95, vol. 1, pp. 409-412.
93. S. Seneff, "A joint synchrony/mean-rate model of auditory processing," J. Phonetics, vol. 85, no. 1, pp. 55-76, 1988.
94. S. Shamma, "Speech processing in the auditory system II: lateral inhibition and the central processing of speech evoked activity in the auditory nerve," J. Acoust. Soc. Amer., vol. 78, no. 5, pp. 1622-1632, 1985.
95. "The acoustic features of speech sounds in a model of auditory processing: vowels and voiceless fricatives," J. Phonetics, vol. 16, pp. 77-91, 1988.
96. D. Sinex and C. Geisler, "Responses of auditory-nerve fibers to consonant-vowel syllables," J. Acoust. Soc. Amer., vol. 73, no. 2, pp. 602-615, 1983.
97. "Comparison of the responses of auditory-nerve fibers to consonant-vowel syllables with predictions from linear models," J. Acoust. Soc. Amer., vol. 76, no. 1, pp. 116-121, 1984.
98. M. Slaney and R. Lyon, "On the importance of time-a temporal representation of sound," in Visual Representations of Speech Signals, M. Cooke, S. Beet, and M. Crawford, Eds. New York: Wiley, 1993, pp. 95-116.
99. R. Smits, "Accuracy of quasistationary analysis of highly dynamic speech signals," J. Acoitst. Soc. Amer., vol. 96, no. 6, pp. 3401-3415, 1994.
100. M. M. Sondhi, personal communication.
101. K. Stevens and S. Blumstein, "Invariant cues for place of articulation in stop consonants," J. Acoust. Soc. Amer., vol. 64, no. 5, pp. 1358-1368, 1978.
102. W. Strange, J. Jenkins, and T. Johnson, "Dynamic specification of coarticulated vowels," J. Acoust. Soc. Amer., vol. 74, no. 3, pp. 695-705, 1983.
103. Q. Summerfield and P. Assmann, "Perception of concurrent vowels: effects of harmonic misalignment and pitch-period asynchrony," J. Acoust. Soc. Amer., vol. 89, no. 3, pp. 1364-1377, 1991.
104. E. Velez and R. Abshcr, 'Transient analysis of speech signals using the Wigner time-frequency representation," in Proc. ICASSP'89, pp. 2242-2245.
105. J. Ville, "Theorie et applications de la notion de signal analytique," Cables et Transmissions, vol. 2A, no. 1, pp. 61-74, 1948;
106. I. Selin, transi., "Theory and applications of the notion of complex signal," Tech. Rep. T-92, RAND Corp., Santa Monica, CA, 1958.
107. N. Virag, "Speech enhancement based on masking properties of the auditory system," in Proc. ICASSP'95, vol. 1, pp. 796-799.
108. K. Wang and S. Shamma, "Self-normalization and noiserobustness in early auditory representations," IEEE Trans. Speech Audio Process., vol. 2, pp. 421-435, 1994.
109. L. Westerman and R. Smith, "A diffusion model of the transient response of the cochlear inner hair cell synapse," J. Acoust. Soc. Amer., vol. 93, no. 1, pp. 401-417, 1993.
110. "Rapid and short term adaptation in auditory nerve responses," Hearing Res., vol. 15, pp. 249-260, 1985.
111. E. Wigner, "On the quantum correction for thermodynamic equilibrium," Phys. Rev., vol. 40, pp. 749-759, 1932.
112. D. Wong, J. Markel, and A. Gray, "Least squares glottal inverse filtering from the acoustic speech waveform," IEEE Trans. Acoust. Speech Signal Process., vol. 27, no. 4, pp. 350-355, 1979.
113. E. Young and M. Sachs, "Representation of steady-state vowels in the temporal aspects of the discharge patterns of populations of auditory-nerve fibers," J. Acoust. Soc. Amer., vol. 66, no. 3, pp. 1381-1403, 1979.
114. S. Zahorian and A. Jagharghi, "Spectral-shape features versus formants as acoustic correlates for vowels," J. Acoust. Soc. Amer., vol. 94, no. 4, pp. 1966-1982, 1993.
115. Y. Zhao, L. Atlas, and R. Marks, "The use of cone-shaped kernels for generalized time-frequency representations of nonstationary signals," IEEE Trans. Acoust. Speech Signal Process., vol. 38, no. 7, pp. 1084-1091, 1990.