The Deterministic plus Stochastic model of the residual signal and its applications

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 3, 2012, Pages 968-981

  Drugman, Thomas ^a   Dutoit, Thierry ^a  

^a UNIVERSITY OF MONS   (Belgium)

Author keywords

excitation modeling; glottal flow; speaker recognition; Speech analysis; speech synthesis

Indexed keywords

COMPUTATIONAL PROPERTIES; DATA SETS; EXCITATION MODELS; GLOTTAL FLOW; HIGH-FREQUENCY NOISE; HMM-BASED SPEECH SYNTHESIS; LOW FREQUENCY; ORTHONORMAL; PARAMETERIZING; PROCESSING APPLICATIONS; PULSE EXCITATION; RECOGNITION RATES; RESIDUAL SIGNALS; SPEAKER IDENTIFICATION; SPEAKER RECOGNITION; SPECTRAL BAND; SPEECH PRODUCTION; STOCHASTIC COMPONENT;

SPEECH ANALYSIS; SPEECH PROCESSING; SPEECH RECOGNITION; SPEECH SYNTHESIS; STOCHASTIC SYSTEMS;

STOCHASTIC MODELS;

EID: 84856248602     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2011.2169787     Document Type: Article

References (47)

1. T. Quatieri, Discrete-Time Speech Signal Processing: Principles and Practice. Upper Saddle River, NJ: Prentice-Hall, 2002.
2. T. Drugman, B. Bozkurt, and T. Dutoit, "Comparative study of glottal source estimation techniques," Comput. Speech Lang., vol. 26, no. 1, pp. 20-34, Jan. 2012.
3. K. Tokuda, T. Kobayashi, T. Masuko, and S. Imai, "Mel generalized cepstral analysis a unified approach to speech spectral estimation," in Proc. ICSLP, 1994.
4. M. Schroeder and B. Atal, "Code-excited linear prediction (CELP): High-quality speech at very low bit rates," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 1985, vol. 10, pp. 937-940. (Pubitemid 16511503)
5. R. Maia, T. Toda, H. Zen, Y. Nankaku, and K. Tokuda, "A trainable excitation model for HMM-based speech synthesis," in Proc. Interspeech Conf., 2007, pp. 1909-1912.
6. H. Yang, S. Koh, and P. Sivaprakasapillai, "Enhancement of multiband excitation (MBE) by pitch-cycle waveform coding," Electron. Lett., vol. 30, no. 20, pp. 1645-1646, 1994.
7. W. Lin, S. Koh, and X. Lin, "Mixed excitation linear prediction coding of wideband speech at 8 kbps," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2000, vol. 2, pp. 1137-1140.
8. T. Yoshimura, K. Tokuda, T. Masuko, and T. Kitamura, "Mixed- excitation for HMM-based speech synthesis," in Proc. Eurospeech, 2001, pp. 2259-2262.
9. R. Maia, T. Toda, H. Zen, Y. Nankaku, and K. Tokuda, "An excitation model for HMM-based speech synthesis based on residual modeling," in Proc. ISCA SSW6, 2007.
10. S.-J. Kim, J.-J. Kim, and M. Hahn, "HMM-based korean speech synthesis system for hand-held devices," IEEE Trans. Consumer Electron., vol. 58, no. 4, pp. 1384-1390, Apr. 2006. (Pubitemid 46231653)
11. H. Kawahara, I. Masuda-Katsuse, and A. de Cheveigne, "Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based f0 extraction: Possible role of a repetitive structure in sounds," Speech Commun., vol. 27, pp. 187-207, 2001.
12. T. Raitio, A. Suni, J. Yamagishi, H. Pulakka, J. Nurminen, M. Vainio, and P. Alku, "HMM-based speech synthesis utilizing glottal inverse filtering," IEEE Trans. Audio, Speech, Lang. Process., vol. 19, no. 1, pp. 153-165, Jan. 2011.
13. G. Fant and J. L. Q. Lin, "A four parameter model of glottal flow," in Proc. STL-QPSR4, 1985, pp. 1-13.
14. J. Cabral, S. Renals, K. Richmond, and J. Yamagishi, "Towards an improved modeling of the glottal source in statistical parametric speech synthesis," in Proc. 6th ISCA Workshop Speech Synth., 2007.
15. M. D. Plumpe, T. F. Quatieri, and D. A. Reynolds, "Modeling of the glottal flow derivative waveform with application to speaker identification," IEEE Trans. Speech Audio Process., vol. 7, no. 5, pp. 569-576, Sep. 1999.
16. J. Gudnason and M. Brookes, "Voice source cepstrum coefficients for speaker identification," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2008, pp. 4821-4824.
17. P. Thevenaz and H. Hugli, "Usefulness of the LPC-residue intext-inde-pendent speaker verification," Speech Commun., vol. 17, pp. 145-157, 1995.
18. S. Murty and B. Yegnanarayana, "Combining evidence from residual phase and MFCC features for speaker recognition," IEEE Signal Process. Lett., vol. 13, no. 1, pp. 52-55, Jan. 2006. (Pubitemid 43072461)
19. T. Drugman, G. Wilfart, and T. Dutoit, "A deterministic plus stochastic model of the residual signal for improved parametric speech synthesis," in Proc. Interspeech Conf., 2009.
20. T. Drugman and T. Dutoit, "On the potential of glottal signatures for speaker recognition," in Proc. Interspeech Conf., 2010.
21. Y. Stylianou, "Applying the harmonic plus noise model in concatenative speech synthesis," IEEE Trans. Speech Audio Process., vol. 9, no. 1, pp. 21-29, Jan. 2001. (Pubitemid 32130684)
22. D. Vincent, O. Rosec, and T. Chonavel, "A new method for speech synthesis and transformation based on an ARX-LF source-filter decomposition and HNM modeling," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2007, pp. 525-528.
23. Y. Agiomyrgiannakis and O. Rosec, "ARX-LF-based source-filter methods for voice modification and transformation," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2009, pp.3589-3592.
24. T. Drugman and T. Dutoit, "Glottal closure and opening instant detection from speech signals," in Proc. Interspeech Conf., 2009.
25. H. Zen, T. Toda, and K. Tokuda, "The Nitech-NAIST HMM-based speech synthesais system for the Blizzard challenge 2006," IEICE Trans. Inf. Syst., 2006.
26. S. Han, S. Jeong, and M. Hahn, "Optimum MVF estimation-based two-band excitation for HMM-based speech synthesis," ETRI J., vol. 31, no. 4, pp. 457-459, 2009.
27. M. Schroeder and M. Grice, "Expressing vocal effort in concatenative synthesis," in Proc. 15th Int. Conf. Phon. Sci., 2003, pp. 2589-2592.
28. Y. Stylianou, "Harmonic plus noise models for speech, combined with statistical methods, for speech and speaker modification," Ph.D. dissertation, Ecole Nationale Superieure des Telecommunications, Paris, France, 1996.
29. Y. Pantazis and Y. Stylianou, "Improving the modeling of the noise part in the harmonic plus noise model of speech," in Proc. IEEE ICASSP, 2008, pp. 4609-1612.
30. T. Drugman and T. Dutoit, "A comparative evaluation of pitch modification techniques," in Proc. Eur. Signal Process. Conf., 2010, pp. 756-760.
31. I. Jolliffe, Principal Component Analysis, ser. Statistics. New York: Springer, 2002.
32. M. R. P. Thomas, J. Gudnason, and P. A. Naylor, "Data-driven voice source waveform modelling," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2009, pp. 3965-3968.
33. "CMU ARCTIC speech synthesis databases,' [Online]. Available: http://festvox.org/cmu-arctic/
34. B. Bozkurt and T. Dutoit, "Mixed-phase speech modeling and formant estimation, using differential phase spectrums,' in Proc. ISCA ITRW VOQUAL03, 2003, pp. 21-24.
35. T. Fukada, K. Tokuda, T. Kobayashi, and S. Imai, "An adaptive algorithm for Mel-cepstral analysis of speech," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 1992, vol. 1, pp. 137-140.
36. A. W. Black, H. Zen, and K. Tokuda, "Statistical parametric speech synthesis," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2007, pp. 1229-1232.
37. K. Tokuda, T. Masuko, N. Myiazaki, and T. Kobayashi, 'Multi-space probability distribution HMM," IEICE Trans. Inf. Syst., vol. E85-D, pp. 455-464, 2002. (Pubitemid 35353984)
38. K. Tokuda, T. Masuko, T. Yamada, T. Kobayashi, and S. Imai, "An algorithm for speech parameter generation from continuous mixture HMMs with dynamic features," in Proc. Eurospeech, 1995.
39. "HMM-based speech synthesis system (HTS)," [Online]. Available: http://hts.sp.nitech.ac.jp/
40. T. Toda and K. Tokuda, "A speech parameter generation algorithm considering global variance for HMM-based speech synthesis," IEICE Trans. Inf. Syst., vol. 90, no. 5, pp. 816-824, 2007.
41. J. Cabral, "HMM-based speech synthesis using an acoustic glottal source model," Ph.D. disseration, School of Informatics, Univ. of Edinburgh, Edinburgh, U.K., 2010.
42. V. Grancharov and W. Kleijn, "Speech quality assessment," in Handbook of Speech Processing. New York: Springer, 2007.
43. D. Reynolds, "An overview of automatic speaker recognition technology," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2002, vol. 4, pp. 4072-4075.
44. S. Prasanna, C. Gupta, and B. Yegnanarayana, "Extraction of speaker-specific information from linear prediction residual of speech," IEEE Trans. Pattern Anal. Mach. Intell., vol. 48, no. 10, pp. 1243-1261, Oct. 2006. (Pubitemid 44353818)
45. J. Kittler, M. Hatef, R. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 3, pp. 226-239, Mar. 1993. (Pubitemid 128741312)
46. W. Fisher, G. Doddington, and K. Goudie-Marshall, "The DARPA speech recognition research database: Specifications and status," in Proc. DARPA Workshop Speech Recognit., 1986, pp. 93-99.
47. J. Campbell, "Testing with the YOHO CD-ROM voice verification corpus," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 1995, pp. 341-344.