The STFT, Sinusoidal Models, and Speech Modification

Springer Handbooks

Volumn , Issue , 2008, Pages 229-258

  Goodwin, Michael M ^a  

^a Creative Advanced Technology Center   (United States)

Author keywords

Discrete Fourier Transform; Filter Bank; Perfect Reconstruction; Sinusoidal Model; Speech Signal

Indexed keywords

EID: 76949090744     PISSN: 25228692     EISSN: 25228706     Source Type: Book Series    
DOI: 10.1007/978-3-540-49127-9_12     Document Type: Chapter

References (83)

1. L.R. Rabiner, R.W. Schafer: Digital Processing of Speech Signals (Prentice-Hall, Englewood Cliffs 1978)
2. D. Gabor: Theory of communication, J. IEE 93(III-26), 429–457 (1946)
3. D. Gabor: Acoustical quanta and the theory of hearing, Nature 159(4044), 591–594 (1947)
4. M. Vetterli, J. Kovačević: Wavelets and Subband Coding (Prentice-Hall, Englewood Cliffs 1995)
5. P.P. Vaidyanathan: Multirate Systems and Filter Banks (Prentice-Hall, Englewood Cliffs 1993)
6. T.F. Quatieri: Discrete-Time Speech Signal Processing (Prentice-Hall, Upper Saddle River 2002)
7. J. Cooley, J. Tukey: An algorithm for the machine calculation of complex Fourier series, Math. Comput. 19(90), 297–301 (1965)
8. P. Duhamel, M. Vetterli: Fast Fourier transforms: a tutorial review and a state of the art, Signal Process. 4(19), 259–299 (1990)
9. R. Schafer, L. Rabiner: Design and simulation of a speech analysis-synthesis system based on short-time Fourier analysis, IEEE Trans. Audio Electroacoust. AU-21(3), 165–174 (1973)
10. M.R. Portnoff: Implementation of the digital phase vocoder using the fast Fourier transform, IEEE Trans. Acoust. Speech 24(3), 243–248 (1976)
11. J. Allen: Short term spectral analysis, synthesis, and modification by discrete Fourier transform, IEEE Trans. Acoust. Speech 25(3), 235–238 (1977)
12. J. Allen, L. Rabiner: A unified approach to short-time Fourier analysis and synthesis, Proc. IEEE 65(11), 1558–1564 (1977)
13. J.O. Smith: Mathematics of the Discrete Fourier Transform (DFT), 2nd edn. (Booksurge, Seattle 2007), http://ccrma.stanford.edu/jos/mdft/
14. M.R. Portnoff: Time-frequency representation of digital signals and systems based on short-time Fourier analysis, IEEE Trans. Acoust. Speech 28(1), 55–69 (1980)
15. R. Crochiere: A weighted overlap-add method of short-time Fourier analysis/synthesis, IEEE Trans. Acoust. Speech 28(1), 99–102 (1980)
16. F.J. Harris: On the use of windows for harmonic analysis with the discrete Fourier transform, Proc. IEEE 66(1), 51–83 (1978)
17. A.H. Nuttall: Some windows with very good side-lobe behavior, IEEE Trans. Acoust. Speech 29(1), 84–91 (1981)
18. X. Rodet, P. Depalle: Spectral envelopes and inverse FFT synthesis, Proc. 93rd Conv. of the Audio Eng. Soc. (1992), Preprint 3393
19. M. Goodwin: Adaptive Signal Models: Theory, Algorithms, and Audio Applications (Kluwer Academic, Boston 1998)
20. D. Griffin, J. Lim: Signal estimation from modified short-time Fourier transform, IEEE Trans. Acoust. Speech 32(2), 236–243 (1984)
21. H.S. Malvar: Signal Processing with Lapped Transforms (Artech House, Boston 1992)
22. Z. Czetkovic: Overcomplete Expansions for Digital Signal Processing (Univ. California, Berkeley 1995), PhD Dissertation
23. Z. Czetkovic, M. Vetterli: Oversampled filter banks, IEEE Trans. Signal Process. 46(5), 1245–1255 (1998)
24. H. Bölcskei, F. Hlawatsch: Oversampled filter banks: Optimal noise shaping, design freedom, and noise analysis, IEEE ICASSP, Vol. 3 (1997) pp. 2453–2456
25. F. Léonard: Referencing the phase to the centre of the spectral window. Why?, Mech. Syst. Signal Process. 2(1), 75–90 (1997)
26. M. Bosi, R. Goldberg: Introduction to Digital Audio Coding and Standards (Kluwer Academic, Boston 2003)
27. J.P. Princen, A.B. Bradley: Analysis/synthesis filter bank design based on time domain aliasing cancellation, IEEE Trans. Acoust. Speech 34(5), 1153–1161 (1986)
28. H.S. Malvar, D.H. Staelin: The LOT: Transform coding without blocking effects, IEEE Trans. Acoust. Speech 37(4), 553–559 (1989)
29. H. Dudley: The vocoder, Bell Lab. Rec. 18, 122–126 (1939)
30. J.L. Flanagan, R.M. Golden: Phase vocoder, Bell Syst. Tech. J. 45(9), 1493–1509 (1966)
31. E. Moulines, J. Laroche: Non-parametric techniques for pitch-scale and time-scale modification of speech, Speech Commun. 16(2), 175–205 (1995)
32. J.A. Moorer: The use of the phase vocoder in computer music applications, J. Audio Eng. Soc. 26(1–2), 42–45 (1978)
33. M. Dolson: The phase vocoder: A tutorial, Comput. Music J. 10(4), 14–27 (1986)
34. J. Laroche, M. Dolson: Improved phase vocoder time-scale modification of audio, IEEE Trans. Speech Audio Process. 7(3), 323–332 (1999)
35. J. Laroche, M. Dolson: New phase-vocoder techniques for real-time pitch shifting, chorusing, harmonizing, and other exotic audio modifications, J. Audio Eng. Soc. 47(11), 928–936 (1999)
36. J. Laroche, M. Dolson: About this phasiness business, Proc. IEEE Workshop on Applications of Signal Process. to Audio and Acoust. (1997)
37. R.J. McAulay, T.F. Quatieri: Speech analysis/synthesis based on a sinusoidal representation, IEEE Trans. Acoust. Speech 34(4), 744–754 (1986)
38. X. Serra, J. Smith: Spectral modeling synthesis: A sound analysis/synthesis system based on a deterministic plus stochastic decomposition, Comput. Music J. 14(4), 12–24 (1990)
39. E.B. George, M.J.T. Smith: Analysis-by-synthesis/ overlap-add sinusoidal modeling applied to the analysis and synthesis of musical tones, J. Audio Eng. Soc. 40(6), 497–516 (1992)
40. P. Depalle, G. Garcia, X. Rodet: Tracking of partials for additive sound synthesis using hidden Markov models, IEEE ICASSP, Vol. 1 (1993) pp. 225–228
41. S. Levine, J.O. Smith: A sines+transients+noise audio representation for data compression and time/pitch scale modifications, 105th Audio Eng. Soc. Conv. (1998), Preprint 4781.
42. M. Lagrange, S. Marchand, J.-B. Rault: Using linear prediction to enhance the tracking of partials, IEEE ICASSP, Vol. 4 (2004) pp. 241–244
43. E.B. George, M.J.T. Smith: Speech analysis/synthesis and modification using an analysis-by-synthesis/overlap-add sinusoidal model, IEEE Trans. Speech Audio Process. 5(5), 389–406 (1997)
44. R.J. McAulay, T.F. Quatieri: Computationally efficient sine-wave synthesis and its application to sinusoidal transform coding, IEEE ICASSP, Vol. 1 (1988) pp. 370–373
45. S. Mallat, Z. Zhang: Matching pursuits with time-frequency dictionaries, IEEE Trans. Signal Process. 41(12), 3397–3415 (1993)
46. M. Goodwin, M. Vetterli: Matching pursuit and atomic signal models based on recursive filter banks, IEEE Trans. Signal Process. 47(7), 1890–1902 (1999)
47. G. Davis: Adaptive Nonlinear Approximations (New York University, New York 1994), PhD Dissertation
48. Y. Pati, R. Rezaiifar, P. Krishnaprasad: Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition, Conf. Record of the Twenty-Seventh Asilomar Conf. on Signals, Systems, and Comput., Vol. 1 (1993) pp. 40–44
49. S. Chen, J. Wigger: Fast orthogonal least squares algorithm for efficient subset model selection, IEEE Trans. Signal Process. 43(7), 1713–1715 (1995)
50. B. Natarajan: Sparse approximate solutions to linear systems, SIAM J. Comput. 24(2), 227–234 (1995)
51. S. Singhal, B. Atal: Amplitude optimization and pitch prediction in multipulse coders, IEEE Trans. Acoust. Speech 37(3), 317–327 (1989)
52. J. Adler, B. Rao, K. Kreutz-Delgado: Comparison of basis selection methods, Conf. Record of the Thirtieth Asilomar Conf. on Signals, Systems, and Comput., Vol. 1 (1996) pp. 252–257
53. L. Rebollo-Neira, D. Lowe: Optimized orthogonal matching pursuit approach, IEEE Signal Proc. Let. 9(4), 137–140 (2002)
54. G. Davis, S. Mallat, Z. Zhang: Adaptive time-frequency decompositions with matching pursuit, Opt. Eng. 33(7), 2183–2191 (1994)
55. M. Goodwin: Multiscale overlap-add sinusoidal modeling using matching pursuit and refinements, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (2001) pp. 207–210
56. H. Purnhagen, N. Meine, B. Edler: Speeding up HILN – MPEG-4 parametric audio coding with reduced complexity, 109th Audio Eng. Soc. Conv. (2000), Preprint 5177
57. K. Vos, R. Vafin, R. Heusdens, W. Kleijn: High-quality consistent analysis-synthesis in sinusoidal coding, 17th Audio Eng. Soc. Int. Conf. (1999) pp. 244–250
58. C. Etemoglu, V. Cuperman: Matching pursuits sinusoidal speech coding, IEEE Trans. Speech Audio Process. 11(5), 413–424 (2003)
59. T.S. Verma, T. Meng: Sinusoidal modeling using frame-based perceptually weighted matching pursuits, IEEE ICASSP (1998)
60. R. Heusdens, R. Vafin, W.B. Kleijn: Sinusoidal modeling using psychoacoustic-adaptive matching pursuits, IEEE Signal Proc. Lett. 9(8), 262–265 (2002)
61. J. Laroche, Y. Stylianou, E. Moulines: HNM: A simple, efficient harmonic + noise model for speech, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (1993) pp. 169–172
62. M. Goodwin: Residual modeling in music analysis-synthesis, IEEE ICASSP, Vol. 2 (1996) pp. 1005–1008
63. K. Hamdy, M. Ali, A. Tewfik: Low bit rate high quality audio coding with combined harmonic and wavelet representations, IEEE ICASSP, Vol. 2 (1996) pp. 1045–1048
64. A. Oomen, A. Den Brinker: Sinusoids plus noise modeling for audio signals, 17th Audio Eng. Soc. Int. Conf. (1999) pp. 226–232
65. S. Levine, T. Verma, J. Smith: Alias-free, mul-tiresolution sinusoidal modeling for polyphonic wideband audio, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (1997)
66. M. Goodwin, C. Avendano: Frequency-domain algorithms for audio signal enhancement based on transient modification, J. Audio Eng. Soc. 54(9), 827–840 (2006)
67. A.V. Oppenheim, R.W. Schafer: Discrete-Time Signal Processing (Prentice-Hall, Englewood Cliffs 1989)
68. M. Goodwin, M. Wolters, R. Sridharan: Postprocessing and computation in parametric and transform audio coders, AES 22nd Int. Conf.: Virtual, Synthetic, and Entertainment Audio (2002) pp. 149–158
69. S.F. Boll: Suppression of acoustic noise in speech using spectral subtraction, IEEE Trans. Acoust. Speech 27(2), 113–120 (1979)
70. D.L. Donoho: De-noising by soft-thresholding, IEEE Trans. Inform. Theory 41(3), 613–627 (1995)
71. S. Mallat, D. Donoho, A. Willsky: Best basis algorithm for signal enhancement, IEEE ICASSP, Vol. 3 (1995) pp. 1561–1564
72. J.M. Kates: Speech enhancement based on a sinusoidal model, J. Speech Hear. Res. 37(2), 449–464 (1994)
73. T.F. Quatieri, R.J. McAulay: Speech transformations based on a sinusoidal representation, IEEE Trans. Acoust. Speech 34(6), 1449–1464 (1986)
74. T.F. Quatieri, R.J. McAulay: Shape invariant time-scale and pitch modification of speech, IEEE Trans. Signal Process. 40(3), 497–510 (1992)
75. D.L. Jones, T.W. Parks: Generation and combination of grains for music synthesis, Comput. Music J. 12(2), 27–34 (1988)
76. C.A. Rodbro, M.G. Christensen, S.H. Jensen, S.V. Andersen: Compressed domain packet loss concealment of sinusoidally coded speech, IEEE ICASSP, Vol. 1 (2003) pp. 104–107
77. G. Wolberg: Recent advances in image morphing, Proc. of Comput. Graph. Int. (1996) pp. 64–71
78. M. Slaney, M. Covell, B. Lassiter: Automatic audio morphing, IEEE ICASSP, Vol. 2 (1996) pp. 1001–1004
79. H. Purnhagen, B. Edler, C. Ferekidis: Object-based analysis/synthesis audio coder for very low bit rates, 104th Audio Eng. Soc. Conv. (1998), Preprint 4747
80. M. Goodwin, C. Avendano: Parametric coding and frequency-domain processing for multichannel audio applications, AES 24th Int. Conf.: Multichannel Audio (2003) pp. 280–285
81. M.G. Christensen: Estimation and modeling problems in parametric audio coding. Ph.D. Thesis (Aalborg University, Aalborg 2005)
82. R.J. McAulay, T.F. Quatieri: Multirate sinusoidal transform coding at rates from 2.4 kbps to 8 kbps, IEEE ICASSP, Vol. 3 (1987) pp. 1645–1648
83. S. Ahmadi: New techniques for sinusoidal coding of speech at 2400 bps, Conf. Record of the Thirtieth Asilomar Conf. on Signals, Systems, and Comput., Vol. 1 (1996) pp. 770–774