Short-time phase spectrum in speech processing: A review and some experimental results

Digital Signal Processing: A Review Journal

Volumn 17, Issue 3, 2007, Pages 578-616

  Alsteris, Leigh D ^a   Paliwal, Kuldip K ^a  

^a GRIFFITH UNIVERSITY   (Australia)

Author keywords

Automatic speech recognition; Magnitude spectrum; Overlap add procedure; Phase spectrum; Short time Fourier transform; Speech perception

Indexed keywords

FOURIER TRANSFORMS; INTELLIGENT CONTROL; SPECTRUM ANALYSIS; SPEECH RECOGNITION; SPEECH SYNTHESIS;

AUTOMATIC SPEECH RECOGNITION; MAGNITUDE SPECTRUM; OVERLAP ADD PROCEDURE; PHASE SPECTRUM; SHORT TIME FOURIER TRANSFORM; SPEECH PERCEPTION;

SPEECH PROCESSING;

EID: 34047258851     PISSN: 10512004     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dsp.2006.06.007     Document Type: Article

References (71)

1. Lim J.S., and Oppenheim A.V. Enhancement and bandwidth compression of noisy speech. Proc. IEEE 67 12 (1979) 1586-1604
2. Wang D.L., and Lim J.S. The unimportance of phase in speech enhancement. IEEE Trans. Acoust. Speech Signal Process. ASSP-30 4 (1982) 679-681
3. Picone J.W. Signal modeling techniques in speech recognition. Proc. IEEE 81 9 (1993) 1215-1247
4. Schroeder M.R. Models of hearing. Proc. IEEE 63 (1975) 1332-1350
5. Oppenheim A.V., and Lim J.S. The importance of phase in signals. Proc. IEEE 69 (1981) 529-541
6. Liu L., He J., and Palm G. Effects of phase on the perception of intervocalic stop consonants. Speech Commun. 22 4 (1997) 403-417
7. Flanagan J.L., and Golden R.M. Phase vocoder. Bell Syst. Tech. J. 45 (1966) 1493-1509
8. Portnoff M.R. Implementation of the digital phase vocoder using the fast Fourier transform. IEEE Trans. Acoust. Speech Signal Process. ASSP-24 3 (1976) 243-248
9. H. Pobloth, W.B. Kleijn, On phase perception in speech, in: Proc. International Conf. Acoustics, Speech, Signal Processing, 1999, pp. 29-32
10. D.S. Kim, Perceptual phase redundancy in speech, in: Proc. International Conf. Acoustics, Speech, Signal Processing, 2000, pp. 1383-1386
11. Banno H., Takeda K., and Itakura F. The effect of group delay spectrum on timbre. Acoust. Sci. Tech. 23 (2002) 1-9
12. Kawahara H., Katsuse I.M., and Cheveigne A.D. Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous frequency based F0 extraction: Possible role of a repetitive structure in sounds. Speech Commun. 27 (1999) 187-207
13. Murthy H.A., Murthy K.V.M., and Yegnanarayana B. Formant extraction from phase using weighted group delay function. Electron. Lett. 25 23 (1989) 1609-1611
14. Yegnanarayana B., and Murthy H.A. Significance of group delay functions in spectrum estimation. IEEE Trans. Signal Process. 40 9 (1992) 2281-2289
15. Ohm G.S. Uber die Definition des Tones, nebst daran geknupfter Theorie der Sirene und ahnlicher tonbildender Vorrichtungen. Ann. Phys. Chem. 59 (1843) 513-565
16. von Helmholtz H.L.F. On the Sensations of Tone. (English translation by A.J. Ellis) (1912), Longmans, Green and Co., London (original work published 1875)
17. de Boer E. A note on phase distortion in hearing. Acoustica 11 (1961) 182
18. Paliwal K.K., and Alsteris L.D. On the usefulness of STFT phase spectrum in human listening tests. Speech Commun. 45 2 (2005) 153-170
19. H.A. Murthy, V. Gadde, The modified group delay function and its application to phoneme recognition, in: Proc. International Conf. Acoustics, Speech, Signal Processing, April 2003, pp. 68-71
20. Allen J.B., and Rabiner L.R. A unified approach to short-time Fourier analysis and synthesis. Proc. IEEE 65 11 (1977) 1558-1564
21. Allen J.B. Short-term spectral analysis, synthesis, and modification by discrete Fourier transform. IEEE Trans. Acoust. Speech Signal Process. ASSP-25 3 (1977) 235-238
22. Crochiere R.E. A weighted overlap-add method of short-time Fourier analysis/synthesis. IEEE Trans. Acoust. Speech Signal Process. ASSP-28 1 (1980) 99-102
23. Griffin D.W., and Lim J.S. Signal estimation from modified short-time Fourier transform. IEEE Trans. Acoust. Speech Signal Process. ASSP-32 2 (1984) 236-243
24. Lim J.S., and Oppenheim A.V. Advanced Topics in Signal Processing (1988), Prentice Hall, Englewood Cliffs, NJ
25. M.R. Portnoff, Magnitude-phase relationships for short-time Fourier transforms based on Gaussian analysis windows, in: Proc. International Conf. Acoustics, Speech, Signal Processing, April 1979, pp. 186-189
26. Portnoff M.R. Time-frequency representation of digital signals and systems based on short-time Fourier analysis. IEEE Trans. Acoust. Speech Signal Process. ASSP-28 1 (1980) 55-69
27. Portnoff M.R. Short-time Fourier analysis of sampled speech. IEEE Trans. Acoust. Speech Signal Process. ASSP-29 3 (1981) 364-373
28. Portnoff M.R. Time-scale modification of speech based on short-time Fourier analysis. IEEE Trans. Acoust. Speech Signal Process. ASSP-29 3 (1981) 374-390
29. Quatieri T.F. Discrete-Time Speech Signal Processing (2002), Prentice Hall, Upper Saddle River, NJ
30. Rabiner L.R., and Schafer R.W. Discrete-Time Speech Signal Processing, Principles and Practice (1978), Prentice Hall, Englewood Cliffs, NJ
31. Schafer R.W., and Rabiner L.R. Design and simulation of a speech analysis-synthesis system based on short-time Fourier analysis. IEEE Trans. Audio Electroacoust. AU-21 (1973) 165-174
32. Oppenheim A.V., and Schafer R.W. Discrete-Time Signal Processing. second ed. (1999), Prentice Hall, Upper Saddle River, NJ
33. Oppenheim A.V., and Schafer R.W. Digital Signal Processing (1975), Prentice Hall, Englewood Cliffs, NJ
34. Tribolet J.M. A new phase unwrapping algorithm. IEEE Trans. Acoust. Speech Signal Process. ASSP-25 2 (1977) 170-177
35. Ghiglia D.C., and Pritt M.D. Two-Dimensional Phase Unwrapping. Theory, Algorithms and Software (1998), Wiley, New York
36. Nico G., and Fortuny J. Using the matrix pencil method to solve phase unwrapping. IEEE Trans. Signal Process. 51 3 (2003)
37. L.D. Alsteris, K.K. Paliwal, ASR on speech reconstructed from short-time Fourier phase spectra, in: Proc. International Conf. Spoken Language Processing, October 2004
38. Potamianos A., and Maragos P. Time-frequency distributions for automatic speech recognition. IEEE Trans. Speech Audio Process. 9 (2001) 196-200
39. D. Dimitriadis, P. Maragos, Robust energy demodulation based on continuous models with application to speech recognition, in: Proc. European Conf. Speech Communication and Technology, September 2003, pp. 2853-2856
40. K.K. Paliwal, B.S. Atal, Frequency-related representation of speech, in: Proc. European Conf. Speech Communication and Technology, September 2003, pp. 65-68
41. Y. Wang, J. Hansen, G.K. Allu, R. Kumaresan, Average instantaneous frequency and average log envelopes for ASR with the aurora 2 database, in: Proc. European Conf. Speech Communication and Technology, September 2003, pp. 25-28
42. T. Abe, T. Kobayashi, S. Imai, Harmonics tracking and pitch extraction based on instantaneous frequency, in: Proc. International Conf. Acoustics, Speech, Signal Processing, May 1995, pp. 756-759
43. F.J. Charpentier, Pitch detection using the short-term phase spectrum, in: Proc. International Conf. Acoustics, Speech, Signal Processing, April 1986, pp. 113-116
44. 0 estimation, in: Proc. European Conf. Speech Communication and Technology, September 2003, pp. 2313-2316
45. Smits R., and Yegnanarayana B. Determination of instants of significant excitation in speech using group delay function. IEEE Trans. Speech Audio Process. 3 5 (1995) 325-333
46. Murthy P.S., and Yegnanarayana B. Robustness of group-delay based method for extraction of significant instants of excitation from speech signals. IEEE Trans. Speech Audio Process. 7 6 (1999) 609-619
47. H.A. Murthy, K.V.M. Murthy, B. Yegnanarayana, Formant extraction from Fourier transform phase, in: Proc. International Conf. Acoustics, Speech, Signal Processing, May 1989, pp. 484-487
48. G. Duncan, B. Yegnanarayana, H.A. Murthy, A nonparametric method of formant estimation using group delay spectra, in: Proc. International Conf. Acoustics, Speech, Signal Processing, May 1989, pp. 572-575
49. Potamianos A., and Maragos P. Speech formant frequency and bandwidth tracking using multiband energy demodulation. J. Acoust. Soc. Amer. 99 6 (1996) 3795-3806
50. D.H. Friedman, Instantaneous-frequency distribution vs time: An interpretation of the phase structure of speech, in: Proc. International Conf. Acoustics, Speech, Signal Processing, March 1985, pp. 1121-1124
51. Rabiner L.R., Cheng M.J., Rosenberg A.E., and McGonegal C.A. A comparative performance study of several pitch detection algorithms. IEEE Trans. Acoust. Speech Signal Process. 24 (1976) 399-418
52. Hess W. Pitch Determination of Speech Signals (1983), Springer-Verlag, Berlin
53. Nelson D.J. Cross-spectral methods for processing speech. J. Acoust. Soc. Amer. 110 5 (2001) 2575-2592
54. D.J. Nelson, Cross-spectral based formant estimation and alignment, in: Proc. International Conf. Acoustics, Speech, Signal Processing, May 2004, pp. 621-624
55. B. Yegnanarayana, R. Smits, A robust method for determining instants of major excitations in voiced speech, in: Proc. International Conf. Acoustics, Speech, Signal Processing, May 1995, pp. 776-779
56. L.D. Alsteris, K.K. Paliwal, Intelligibility of speech from phase spectrum, in: Proc. Microelectronic Engineering Research Conf., November 2003
57. L.D. Alsteris, K.K. Paliwal, Importance of window shape for phase-only reconstruction of speech, in: Proc. International Conf. Acoustics, Speech, Signal Processing, May 2004, pp. 573-576
58. L.D. Alsteris, K.K. Paliwal, Further intelligibility results from human listening tests using the short-time phase spectrum, Speech Commun., in press
59. Reddy N.S., and Swamy M.N.S. Derivative of phase spectrum of truncated autoregressive signals. IEEE Trans. Circuits Syst. CAS-32 6 (1985) 2575-2592
60. Davis S.B., and Mermelstein P. Comparison of parametric representations for mono-syllabic word recognition in continuously spoken utterances. IEEE Trans. Acoust. Speech Signal Process. 28 4 (1980) 357-366
61. Young S. The HTK Book (2001), Cambridge University Engineering Department, Cambridge, UK
62. L.D. Alsteris, K.K. Paliwal, Evaluation of the modified group delay feature for isolated word recognition, in: Int. Symposium on Signal Processing and Its Applications, August 2005, pp. 715-718
63. B. Bozkurt, B. Doval, C. D'Alessandro, T. Dutoit, Zeros of z-transform (ZZT) decomposition of speech for source-tract separation, in: Proc. International Conf. Speech, Language Processing, October 2004
64. B. Bozkurt, B. Doval, C. D'Alessandro, T. Dutoit, Appropriate windowing for group delay analysis and roots of z-transform of speech signals, in: European Signal Processing Conf., 2004
65. K.K. Paliwal, Decorrelated and liftered filter-bank energies for robust speech recognition, in: Proc. European Conf. Speech Communication and Technology, September 1999, pp. 85-88
66. Huang X., Acero A., and Hon H. Spoken Language Processing (2001), Prentice Hall, NJ
67. Fukunaga K. Introduction to Statistical Pattern Recognition (1990), Academic Press, San Diego
68. G. Rigoll, D. Willett, A NN/HMM hybrid for continuous speech recognition with a discriminant nonlinear feature extraction, in: Proc. International Conf. Acoustics, Speech, Signal Processing, May 1998, pp. 9-12
69. H. Hermansky, D.P.W. Ellis, S. Sharma, Tandem connectionist feature extraction for conventional HMM systems, in: Proc. International Conf. Acoustics, Speech, Signal Processing, June 2000, pp. 1635-1638
70. D.P.W. Ellis, R. Singh, S. Sivadas, Tandem acoustic modeling in large-vocabulary recognition, in: Proc. International Conf. Acoustics, Speech, Signal Processing, May 2001, pp. 517-520
71. B. Yegnanarayana, K.S. Reddy, S.P. Kishore, Source and system features for speaker recognition using AANN model, in: Proc. International Conf. Acoustics, Speech, Signal Processing, May 2001, pp. 409-412