Perceptual long-term variable-rate sinusoidal modeling of speech

IEEE Transactions on Audio, Speech and Language Processing

Volumn 15, Issue 3, 2007, Pages 851-861

  Girin, Laurent ^a   Firouzmand, Mohammad ^a   Marchand, Sylvain ^b  

^a GRENOBLE INSTITUTE OF TECHNOLOGY   (France)

^b UNIVERSITÉ BORDEAUX 1   (France)

Author keywords

Perceptual models; Sinusoidal model; Speech modeling; Speech processing; Variable rate

Indexed keywords

A-FRAMES; DISCRETE COSINE FUNCTIONS; FIRST HARMONICS; ITERATIVE ALGORITHMS; LT MODELS; MODELING ACCURACIES; OPTIMAL FITTINGS; PERCEPTUAL MODELS; PHASE MODELING; PHASE PARAMETERS; SINUSOIDAL COMPONENTS; SINUSOIDAL MODEL; SINUSOIDAL MODELING; SPEECH MODELING; SPEECH WATERMARKING; SYNTHESIS PROCESS; VARIABLE RATE; VOICED SPEECH;

SPEECH ANALYSIS; SPEECH CODING; SPEECH PROCESSING;

DATA COMPRESSION;

EID: 51449108696     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2006.885928     Document Type: Article

References (40)

1. J. A. Moorer, "Signal processing aspects of computer music-A survey," Comput. Music J., vol. 1, no. 1, pp. 4-37, 1977.
2. -, "The use of the phase vocoder in computer music applications," J. Audio Eng. Soc., vol. 26, no. 1/2, pp. 42-45, 1978.
3. M. R. Portnoff, "Time-frequency representation of digital signals and systems based on short-time Fourier transform," IEEE Trans. Acoust. Speech, Signal Process., vol. ASSP-28, no. 1, pp. 55-69, Feb. 1980.
4. M. B. Dolson, "The phase vocoder: A tutorial," Comput. Music J., vol. 10, no. 4, pp. 14-27, 1986.
5. J. B. Allen, "Short-term spectral analysis, synthesis, and modification by the discrete Fourier transform," IEEE Trans. Acoust. Speech, Signal Process., vol. ASSP-25, no. 3, pp. 235-238, Jun. 1977.
6. J.-C. Risset and M. V. Mathews, "Analysis of musical instrument tones," Phys. Today, vol. 22, no. 2, pp. 23-30, 1969.
7. R. J. McAulay and T. F. Quatieri, "Speech analysis/synthesis based on a sinusoidal representation," IEEE Trans. Acoust. Speech, Signal Process., vol. ASSP-34, no. 4, pp. 744-754, Aug. 1986.
8. X. Serra and J. O. Smith, "Spectral modeling synthesis: A sound analysis/ synthesis system based on a deterministic plus stochastic dec-omposition," Comput. Music J., vol. 14, no. 4, pp. 12-24, 1990.
9. quot;AudioSculpt User's Manual," 2nd ed. IRCAM, Paris, France, 1996.
10. K. Fitz and L. Haken, "Sinusoidal modeling and manipulation using lemur," Comput. Music J., vol. 20, no. 4, pp. 44-59, 1996.
11. J. O. Smith and X. Serra, "PARSHL: An analysis/synthesis program for non-harmonic sounds based on a sinusoidal representation," in Proc. Int. Comput. Music Conf., San Francisco, CA, 1987, pp. 290-297.
12. X. Serra, Musical Signal Processing. Lisse, The Netherlands: Swets & Zeitlinger, 1997, ch. Musical Sound Modeling with Sinusoids plus Noise, pp. 91-122.
13. S. Marchand and R. Strandh, "InSpect and respect: Spectral modeling, analysis and real-time synthesis software tools for researchers and composers," in Proc. Int. Comput. Music Conf. (ICMC'99), Beijing, China, 1999, pp. 341-344.
14. A. Freed, X. Rodet, and P. Depalle, "Performance, synthesis and control of additive synthesis on a desktop computer using FFT-1," in Proc. Int. Computer Music Conf. (ICMC'93), Tokyo, Japan, 1993, pp. 98-101.
15. J. W. Gordon and J. O. Smith, "A sine generation algorithm for VLSI applications," in Proc. Int. Comput. Music Conf. (ICMC'85), Vancouver, BC, Canada, 1985, pp. 165-168.
16. J. O. Smith and P. R. Cook, "The second-order digital waveguide oscillator," in Proc. Int. Comput. Music Conf. (ICMC'92), San Jose, CA, 1992, pp. 150-153.
17. R. J. McAulay and T. F. Quatieri, "Sinusoidal coding," in Speech Coding and Synthesis, W. B. Kleijin and K. K. Paliwal, Eds. New York: Elsevier, 1995, ch. 4.
18. T. F. Quatieri and R. J. McAulay, "Shape invariant time-scale and pitch modification of speech," IEEE Trans. Signal Process., vol. 40, no. 3, pp. 497-510, Mar. 1992.
19. E. B. George and M. J. T. Smith, "Speech analysis/ synthesis and modification using an analysis-by-synthesis/overlap-add sinusoidal model," IEEE Trans. Speech Audio Process., vol. 5, no. 5, pp. 389-406, Sep. 1997.
20. J. M. Grey, "An exploration of musical timbre," Ph.D. dissertation, Dept. Music, Stanford Univ., Stanford, CA, 1975.
21. Y. Ding and X. Qian, "Processing of musical tones using a combined quadratic polynomial phase sinusoid and residual signal model," J. Audio Eng. Soc., vol. 45, no. 7/8, pp. 571-585, 1997.
22. L. Girin, S. Marchand, J. di Martino, A. Röbel, and G. Peeters, "Comparing the order of a polynomial phase model for the synthesis of quasiharmonic audio signals," in Proc. IEEE Workshop Applications Signal Process. Audio Acoust. (WASPAA), New Paltz, NY, 2003, pp. 193-196.
23. G. Richard and C. d'Alessandro, "Analysis/synthesis and modification of the speech aperiodic component," Speech Commun., vol. 19, pp. 221-244, 1996.
24. D. W. Griffin and J. S. Lim, "Multiband-excitation vocoder," IEEE Trans. Acoust., Speech, Signal Process., vol. 36, no. 2, pp. 236-243, Apr. 1988.
25. M. W. Macon and M. A. Clements, "Sinusoidal modeling and modification of unvoiced speech," IEEE Trans. Speech Audio Process., vol. 5, no. 6, pp. 557-560, Nov. 1997.
26. S. Dusan, J. Flanagan, A. Karve, and M. Balaraman, "Speech coding using trajectory compression and multiple sensors," in Proc. Int. Conf. Speech Lang. Process., Jeju, Korea, 2004, CD-ROM.
27. L. Girin, M. Firouzmand, and S. Marchand, "Long term modeling of phase trajectories within the speech sinusoidal model framework," in Proc. Int. Conf. on Speech & Language Proc., Jeju, Korea, 2004, CD-ROM.
28. T. Galas and X. Rodet, "An improved cepstral method for deconvolution of source-filter systems with discrete spectra: Application to musical sound signals," in Proc. Int. Comput. Music Conf. (ICMC), Glasgow, U.K., 1990, pp. 82-84.
29. O. Cappé, J. Laroche, and E. Moulines, "Regularized estimation of cepstrum envelope from discrete frequency points," in Proc. IEEE Workshop Applications Signal Process. Audio Acoust. (WASPAA), 1995, pp. 213-216.
30. Information Technology-Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to About 1.5 Mbits/s, Part 3: Audio, ISO/IEC JTC1/SC29/WG11 MPEG, IS11172-3, 1992.
31. T. Painter and A. Spanias, "Perceptual coding of digital audio," Proc. IEEE, vol. 88, no. 4, pp. 451-513, Apr. 2000.
32. E. Zwicker and R. Feldtkeller, "Psychoacoustique: L'oreille récepteur d'information (French version of Das Ohr als Nachrichtenempfänger)," Masson, Paris, France, 1981.
33. E. Zwicker and U. Zwicker, Psychoacoustics Facts and Models. Berlin, Germany: Springer-Verlag, 1990.
34. H. Pobloth and W. B. Kleijn, "Squared error as a measure of perceived phase distortion," J. Acoust. Soc. Amer., vol. 114, no. 2, pp. 1081-1094, 2003.
35. D. S. Kim, "On the perceptually irrelevant phase information in sinusoidal representation of speech," IEEE Trans. Speech Audio Process., vol. 9, no. 8, pp. 900-905, Nov. 2001.
36. -, "Perceptual phase quantization of speech," IEEE Trans. Speech Audio Process., vol. 11, no. 4, pp. 355-364, Jul. 2003.
37. O. Gottesman, "Dispersion phase vector quantization for enhancement of waveform interpolative coder," in Proc. IEEE Int. Conf. Acoust. Speech, Signal Process., Phoenix, AZ, 1999, pp. 269-272.
38. L. Demany and C. Semal, "Detection thresholds for sinusoidal frequency modulation," J. Acoust. Soc. Amer., vol. 85, no. 3, pp. 1295-1301, 1989.
39. L. Girin and L. S. Marchand, "Watermarking of speech signals using the sinusoidal model and frequency modulation of the partials," in Proc. IEEE Int. Conf. Acoust. Speech, Signal Process., Montréal, QC, Canada, 2004, pp. 633-636.
40. H. J. Kim, "Audio watermarking techniques," in Proc. Pacific Rim Workshop on Digital Steganography, Kitakyushu, Japan, 2003.