Voice conversion technology and its development

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Volumn 32, Issue 7, 2004, Pages 1165-1172

  Zuo, Guo Yu ^a,b   Liu, Wen Ju ^a   Ruan, Xiao Gang ^b  

^a INSTITUTE OF AUTOMATION   (China)

^b BEIJING UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Artificial neural network; Codebook mapping; Gaussian mixture model; Glottal excitation; Hidden Markov model; Pitch contour; Speech spectrum; Voice conversion

Indexed keywords

ALGORITHMS; MARKOV PROCESSES; MATHEMATICAL MODELS; NEURAL NETWORKS; SPEECH CODING;

CODEBOOK MAPPING; GAUSSIAN MIXTURE MODELS; GLOTTAL EXCITATION; HIDDEN MARKOV MODELS; PITCH CONTOUR; SPEECH SPECTRUM; VOICE CONVERSION;

SPEECH RECOGNITION;

EID: 5444260705     PISSN: 03722112     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (56)

1. E Moulines and Y Sagisaka. Voice conversion: state of the art and perspectives [J]. Speech Communication. 1995, 16(2): 125-126.
2. M Tamura, et al. Adaptation of pitch and spectrum for HMM-based speech synthesis using MLLR [A]. Proc ICASSP [C]. Salt Lake City, USA: IEEE, May 2001. 805-808.
3. Y Chen, M Chu, et al. Voice Conversion with Smoothed GMM and MAP Adaptation [A]. Proc Eurospeech [C]. Geneva, Switzerland: ISCA, Sept. 2003: 2413-2416.
4. I Karlsson. Glottal waveform parameters for different speakers types [A]. Proc Speech'88, 7th FASE Symp [C]. Edinburgh, Scotland: IOA, 1988. 225-231.
5. B S Atal. Automatic recognition of speaker from their voices [J]. Proceedings of the IEEE, April 1976, 64(4): 460-475.
6. B S Atal, S L Hanauer. Speech analysis and synthesis by linear prediction of the speech wave [J]. J Acoust Soc Am, 1971, 50(2): 637-655.
7. S Seneff. System to independently modify excitation and/or spectrum of speech waveform without explicit pitch extraction [J]. IEEE Trans Acoust Speech Sig, 30(4), 1982: 566-578.
8. D G Childers, et al. Factors in voice quality: Acoustic features related to gender [A]. Proc ICASSP [C]. New York, USA: IEEE, 1987. 293-296.
9. D G Childers, et al. Voice Conversion [J]. Speech Communication, 1989, 8(2): 147-158.
10. M Abe, et al. Voice Conversion through Vector Quantization [A]. Proc ICASSP [C]. New York, USA: IEEE, 1988(1). 655-658.
11. N Iwahashi, et al. Speech spectrum conversion based on speaker interpolation and multi-functional representation with weighting by radial basis function networks [J]. Speech Communication. 1995, 16(2): 139-151.
12. A Rinscheid. Voice conversion based on topological feature maps and time-variant filtering [A]. Proc ICSLP [C]. Philadelphia, USA: ESCA, Oct. 1996.1445-1448.
13. H Valbret, et al. Voice transformation using PSOLA technique [J]. Speech Communication, 1992,11(2-3): 175-187.
14. M Narendranath, et al. Transformation of formants for voice conversion using artificial neural networks [J]. Speech Communication, 1995, 16(2): 207-216.
15. T Watanabe, et al. Transformation of spectral envelope for voice conversion based on radial basis function networks [A]. Proc ICSLP'2002 [C]. Denver, USA: ISCA, Sept. 2002.285-288.
16. Y Stylianou, et al. Continuous probabilistic transform for voice conversion [J]. IEEE Transactions on Speech and Audio Processing. March 1998, 6(2): 131-142.
17. A Kain, M Macon. Spectral voice conversion for text-to-speech synthesis [A]. Proc ICASSP [C]. Seattle, USA: IEEE, May 1998 (1). 285-288.
18. T Toda, et al. STRAIGHT-based voice conversion algorithm based on Gaussian mixture model [A]. Proc ICSLP [C]. Beijing, China: ESCA, Oct. 2000.279-282.
19. E K Kim, et al. Hidden markov model based voice conversion using dynamic characteristics of speaker [A]. Proc Eurospeech [C]. Rhodes, Greece: ESCA, 1997.2519-2522.
20. W Zhang, et al. Voice conversion based on acoustic feature transformation [A]. Proc NCMMSC [C]. Shenzhen, China, 2001.189-192.
21. R Carlson, et al. Experiments with voice modeling in speech synthesis [J]. Speech Communication. 1991, 16(5-6): 481-489.
22. M Abe. A segment-based approach to voice conversion [A]. Proc ICASSP [C]. Toronto, Canada: IEEE, May 1991.765-768.
23. A Schmidt-Nielson, D P Brock. Speaker recognizability testing for voice coders [A]. Proc ICASSP [C]. Atlanta, USA: IEEE, May 1996.1149-1152.
24. H Kuwabara and Y Sagisaka. Acoustic characteristics of speaker individuality: control and conversion [J]. Speech Communication. 1995, 16(2): 165-173.
25. D Klatt and L C Klatt. Analysis, synthesis, and perception of voice quality variations among female and male talkers [J]. J Acoust Soc Am, 1990, 87(2): 820-857.
26. P H Milenkovic. Voice source model for continuous control of pitch period [J]. J Acoust Soc Am, 1993, 93(2): 1087-1096.
27. H Matsumoto, et al. Multidimensional representation of personal quality of vowels and its acoustical correlates [J]. IEEE Trans Audio and Electroacoustics, 1973, 21(5): 428-436.
28. S Furui. Research on individuality features in speech waves and automatic speaker recognition techniques [J]. Speech Communication, 1986, 5(2): 183-197.
29. K S Lee, et al. A new voice transformation based on both linear and nonlinear prediction [A]. Proc ICSLP [C]. Philadelphia, USA: ESCA, 1996.1401-1404.
30. L M Arslan. Speaker transformation algorithm using segmental code-books (STASC) [I]. Speech Communication, 1999, 28(3): 211-226.
31. H Mizuno and M Abe. Voice conversion algorithm based on piecewise linear conversion rules of formant frequency and spectrum tilt [J]. Speech Communication. 1995, 16(2): 165-173.
32. J Gutirrez, et al. A new multi-speaker formant synthesizer that applies voice conversion techniques [A]. Proc Eurospeech [C]. Aalborg, Denmark: ESCA, 2001:357-360.
33. T Yoshimura, et al. Speaker interpolation in HMM-based speech synthesis system [A]. Proc. Eurospeech [C]. Rhodes, Greece: ESCA, 1997.2523-2526.
34. D G Childers. Glottal source modeling for voice conversion [J]. Speech Communication. 1995, 16(2): 127-138.
35. A Kain, M Macon. Design and evaluation of a voice conversion algorithm based on spectral envelope mapping and residual prediction [A]. Proc ICASSP [C]. Salt Lake City, USA: IEEE, June 2001.813-816.
36. A Kain. High resolution voice transformation [D]. Portland, USA: Oregon Health and Science University, Oct.2001.
37. L M Arslan, D Talkin. Voice Conversion by Codebook Mapping of Line Spectral Frequencies and Excitation Spectrum [A]. Proc Eurospeech [C]. Rhodes, Greece: ESCA, 1997(3).481-489.
38. K Shikano, et al. Speaker adaptation through vector quantization [A]. Proc ICASSP [C]. Tokyo, Japan: IEEE, 1986.2643-2646.
39. S Nakamura, K Shikano. Spectrogram normalization using fuzzy vector quantization [J]. J Acoust Soc Japan, 1989, 45(2): 107-114.
40. M I Savic, I H Nam. Voice personality transformation [J]. Digital Signal Processing Journal. 1991, 1(2): 107-110.
41. M Hashimoto, N Higuchi. Spectral mapping for voice conversion using speaker selection and vector field smoothing [A]. Proc Eurospeech [C]. Madrid, Spain: ESCA, 1995: 431-434.
42. N Kambhatla. Local Models and Gaussian Mixture Models for Statistical Data Processing [D]. Portland, USA: Oregon Graduate of Institute of Science and Technology, 1996.
43. C J Leggetter, P C Woodland. Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models [J]. Computer Speech and Language, 1995, 9(2): 171-185.
44. Lee Chin-Hui, et al. A study on speaker adaptation of the parameters of continuous density hidden markov models [J]. IEEE Trans on Signal Processing, 1991, 39(4): 806-814.
45. K Ohjura, et al. Speaker adaptation based on transfer vector field smoothing with continuous mixture density HMMs [A]. Proc ICSLP [C]. Banff, Canada: ESCA, Oct. 1992.369-372.
46. K S Lee, et al. Voice personality transformation using an orthogonal vector space conversion [A]. Proc Eurospeech [C]. Madrid, Spain: ESCA, 1995 (1). 427-430.
47. Y Stylianou, et al. Statistical methods for voice quality transformation [A]. Proc Eurospeech [C]. Madrid Spain: ESCA, 1995.447-450
48. T Ceyssens, et al. On the Construction of a Pitch Conversion System [A]. Proc EUSIPCO [C]. Toulouse, France: EUSIP, 2002. 1301-1304.
49. B Gillett, S King. Transforming voice quality [A]. Proc Eurospeech [C]. Geneva, Switzerland: ISCA, 2003.1713-1716.
50. D Chappell, J Hansen. Speaker-specific pitch contour modeling and modification [A]. Proc ICASSP [C]. Seattle, USA: IEEE, May 1998. 885-888.
51. O Turk. New Methods for Voice Conversion [D]. Istanbul, Turkey: Bog azici University, 2003.
52. A Kain, Y Stylianou. Stochastic modeling of spectral adjustment for high quality pitch modification [A]. Proc ICASSP [C]. Istanbul, Turkey: IEEE, June 2000. 949-952.
53. L M Arslan, et al. Speaker transformation using sentence HMM based alignments and detailed prosody modification [A]. Proc ICASSP [C]. Seattle, USA: IEEE, May 1998.289-292.
54. D Klatt. Review of text-to-speech conversion for English [J]. J Acoust Soc Am. 1987, 82(3): 737-793.
55. A Mariniak. A global framework for the assessment of synthetic speech without subjects [A]. Proc Eurospeech [C]. Berlin, Germany: ESCA, 1993(3): 1683-1686.
56. M Schroder. Emotional speech synthesis-A review [A]. Proc Eurospeech [C]. Aalborg, Denmark: ISCA, 2001(1): 561-564.