Emotion conversion based on prosodic unit selection

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 5, 2010, Pages 974-983

  Erro, Daniel ^a   Navas, Eva ^a   Hernáez, Inma ^a   Saratxaga, Ibon ^a  

^a UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

Author keywords

Emotional speech synthesis; Intonation; Prosody; Unit selection; Voice conversion

Indexed keywords

CONVERSION METHODS; CURRENT SYSTEM; EMOTION CONVERSION; EMOTIONAL SPEECH; EMOTIONAL SPEECH SYNTHESIS; ONE STEP; SPEAKING STYLES; SUBJECTIVE TESTS; UNIT SELECTION; VOICE CONVERSION;

SPEECH ANALYSIS; SPEECH SYNTHESIS; WAVELET TRANSFORMS;

SPEECH PROCESSING;

EID: 77953699919     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2009.2038658     Document Type: Article

References (40)

1. L. M. Arslan and D. Talkin, "Speaker transformation using sentence HMM based alignments and detailed prosody modification," in Proc. ICASSP, 1998, vol.1, pp. 289-292.
2. M. Abe, S. Nakamura, K. Shikano, and H. Kuwabara, "Voice conversion through vector quantization," in Proc. ICASSP, 1988, pp. 655-658.
3. H. Valbret, E. Moulines, and J. P. Tubach, "Voice transformation using PSOLA technique," in Speech Commun., 1992, vol.1, pp. 145-148.
4. N. Iwahashi and Y. Sagisaka, "Speech spectrum transformation by speaker interpolation," in Proc. ICASSP, 1994, vol.1, pp. 461-464.
5. M. Narendranath, H. A. Murthy, S. Rajendran, and B. Yegnanarayana, "Transformation of formants for voice conversion using artificial neural networks," Speech Commun., vol.16, no.2, pp. 207-216, 1995.
6. Y. Stylianou, O. Cappé, and E. Moulines, "Continuous probabilistic transform for voice conversion," in Proc. ICASSP, 1998, vol. 6, no. 2, pp. 131-142.
7. A. Kain, "High resolution voice transformation," Ph.D. dissertation, OGI School of Sci. and Eng., Beaverton, OR, 2001.
8. T. Toda, A. W. Black, and K. Tokuda, "Spectral conversion based on maximum likelihood estimation considering global variance of converted parameter," in Proc. ICASSP, 2005, vol.1, pp. 9-12.
9. D. Erro and A. Moreno, "Weighted frequency warping for voice conversion," in Proc. Interspeech, 2007, pp. 1965-1968.
10. D. T. Chappell and J. H. L. Hansen, "Speaker specific pitch contour modeling and modification," in Proc. ICASSP, 1998, vol.2, pp. 885-888.
11. O. Turk and L. M. Arslan, "Voice conversion methods for vocal tract and pitch contour modification," in Proc. Eurospeech, 2003, pp. 2845-2848.
12. Z. Inanoglu, "Transforming pitch in a voice conversion framework," M.S. thesis, Univ. of Cambridge, Cambridge, MA, 2003.
13. T. Ceyssens, W. Verhelst, and P. Wambacq, "On the construction of a pitch conversion system," in Proc. Eusipco, 2002, vol.1, pp. 423-426.
14. B. Gillett and S. King, "Transforming f0 contours," in Proc. Eurospeech, 2003, pp. 101-104.
15. D. Rentzos, S. Vaseghi, Q. Yan, and C. H. Ho, "Voice conversion through transformation of spectral and intonation features," in Proc. ICASSP, 2004, vol.1, pp. 21-24.
16. T. En-Najjary, O. Rosec, and T. Chonavel, "A voice conversion method based on joint pitch and spectral envelope transformation," in Proc. ICSLP, 2004, pp. 1225-1228.
17. E. E. Helander and J. Nurminen, "A novel method for prosody prediction in voice conversion," in Proc. ICASSP, 2007, vol.4, pp. 509-512.
18. D. Lolive, N. Barbot, and O. Boeffard, "Pitch and duration transformation with non-parallel data," Speech Prosody, pp. 111-114, 2008.
19. C. C. Hsia, C. H. Wu, and J. Q. Wu, "Conversion function clustering and selection using linguistic and spectral information for emotional voice conversion," IEEE Trans. Comput., vol.56, no.9, pp. 1245-1254, Sep. 2007.
20. J. Tao, Y. Kang, and A. Li, "Prosody conversion from neutral speech to emotional speech," IEEE Trans. Audio, Speech, Lang. Process., vol.14, no.4, pp. 1145-1154, Jul. 2006.
21. Z. Inanoglu and S. Young, "Data-driven emotion conversion in spoken English," Speech Commun., vol.51, no.3, pp. 268-283, 2009.
22. A. Raux and A. Black, "A unit selection approach to F0 modeling and its application to emphasis," in Proc. ASRU, 2003, pp. 700-705.
23. A. Hunt and A. Black, "Unit selection in a concatenative speech synthesis system using a large speech database," in Proc. ICASSP, 1996, vol.1, pp. 373-376.
24. B. Möbius, M. Pätzold, and W. Hess, "Analysis and synthesis of German F0 contours by means of Fujisaki's model," Speech Commun., vol.13, pp. 53-61, 1993.
25. D. Escudero, "Modelado estadístico de entonación con funciones de bézier: Aplicaciones a la conversión texto-voz en Español," Ph.D. dissertation, Universidad de Valladolid, Valladolid, Spain, 2002.
26. E. Navas, "Standard basque prosodic modeling for text to speech conversion," Ph.D. dissertation, Univ. of the Basque Country, Bilbao, Spain, 2003.
27. P. D. Agüero, J. Adell, and A. Bonafonte, "Prosody generation for speech-to-speech translation," in Proc. ICASSP, 2006, pp. 557-560.
28. F. Campillo and E. R. Banga, "A method for combining intonation modelling and speech unit selection in corpus-based speech synthesis systems," in Speech Commun., 2005, vol.48, pp. 941-956.
29. E. Navas, I. Hernáez, and J. Sánchez, "Predicting segmental durations for Basque using CARTs," in Proc. 15th ICPhS, 2003, pp. 2083-2086.
30. R. Barra, J. M. Montero, J. Macías-Guarasa, J. Gutiérrez-Arriola, J. Ferreiros, and J. M. Pardo, "On the limitations of voice conversion techniques in emotion identification tasks," in Proc. Interspeech, 2007, pp. 2233-2236.
31. A. del Pozo and S. Young, "The linear transformation of LF glottal waveforms for voice conversion," in Proc. Interspeech, 2008, pp. 1457-1460.
32. D. Sündermann, H. Höge, A. Bonafonte, and H. Duxans, "Residual prediction," in Proc. 5th IEEE ISSPIT, 2005, pp. 512-516.
33. H. Ye and S. Young, "Quality-enhanced voice morphing using maximum likelihood transformations," IEEE Trans. Audio, Speech, Lang. Process., vol.14, no.4, pp. 1301-1312, Jul. 2006.
34. A. Sluyter and V. Van Heuven, "Spectral balance as an acoustic correlate of linguistic stress," J. Acoust. Soc. Amer., vol.100, pp. 2471-2485, 1996.
35. B. Doval, C. d'Alessandro, and N. Henrich, "The spectrum of glottal flow models," Acta Acustica, vol.92, pp. 1026-1046, 2006.
36. D. Erro, A. Moreno, and A. Bonafonte, "Flexible harmonic/stochastic speech synthesis," in Proc. 6th ISCA Workshop Speech Synth., 2007, pp. 194-199.
37. J. Laroche, Y. Stylianou, and E. Moulines, "HNS: Speech modification based on a harmonic+noise model," in Proc. ICASSP, 1993, vol.2, pp. 550-553.
38. I. Luengo, I. Saratxaga, E. Navas, I. Hernáez, J. Sanchez, and I. Sainz, "Evaluation of pitch detection algorithms under real conditions," in Proc. ICASSP, 2007, pp. 1057-1060.
39. I. Sainz, I. Saratxaga, E. Navas, I. Hernáez, J. Sanchez, I. Luengo, and I. Odriozola, "Subjective evaluation of an emotional speech database for Basque," in Proc. 6th LREC, 2008, Paper 437.
40. I. Sainz, E. Navas, and I. Hernáez, "The AHOLAB blizzard challenge 2008 entry," in Proc. Blizzard Challenge Workshop, 2008.