Supervisory data alignment for text-independent voice conversion

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 5, 2010, Pages 932-943

  Tao, Jianhua ^a   Zhang, Meng ^a   Nurminen, Jani ^b   Tian, Jilei ^c   Wang, Xia ^c  

^a INSTITUTE OF AUTOMATION   (China)

^b MICROSOFT   (United States)

^c NOKIA RESEARCH CENTER   (United States)

Author keywords

Data alignment; Self organized learning; Supervisory phonetic restriction; Text independent voice conversion

Indexed keywords

ALIGNMENT ACCURACY; CROSS-LINGUAL; DATA ALIGNMENTS; EVALUATION RESULTS; LINEAR ALIGNMENTS; NON-LINEAR METHODS; PARALLEL TRAINING; PARAMETER SPACES; PHONETIC INFORMATION; SELF ORGANIZED LEARNING; SELF-ORGANIZING LEARNING; SOURCE DATA; SOURCE PARAMETERS; TARGET SPACE; TARGET SPEAKER; TOPOLOGICAL STRUCTURE; TOPOLOGY PRESERVATION; VOICE CONVERSION;

LEARNING ALGORITHMS; LINGUISTICS; SPEECH PROCESSING; TARGETS; THREE TERM CONTROL SYSTEMS; TOPOLOGY; VECTOR SPACES;

ALIGNMENT;

EID: 77953724495     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2010.2041688     Document Type: Article

References (41)

1. M. Abe, S. Nakamura, K. Shikano, and H. Kuwabara, "Voice conversion through vector quantization," J. Acoust. Soc. Jpn.(E), vol.11, no.2, pp. 71-76, 1990.
2. S. Nakamura and K. Shikano, "Speaker adaptation applied to HMM and neural networks," in Proc. ICASSP, Glasgow, U.K., May 1989, pp. 89-92.
3. L. M. Arslan and D. Talkin, "Voice conversion by codebook mapping of line spectral frequencies and excitation spectrum," in Proc. Eurospeech' 97, Rhodes, Greece, 1997.
4. Y. Stylianou, O. Cappé, and E. Moulines, "Continuous probabilistic transform for voice conversion," IEEE Trans. Speech Audio Process., vol.6, no.2, pp. 131-142, Mar. 1998.
5. A. Kain and M. W. Macon, "Spectral voice conversion for text-to-speech synthesis," in Proc. ICASSP, Seattle, WA, May 1998, pp. 285-288.
6. T. Toda, H. Saruwatari, and K. Shikao, "Voice conversion algorithm based on Gaussian mixture model with dynamic frequency warping of straight spectrum," in Proc. ICASSP, 2001, pp. 841-944.
7. T. Toda, A. W. Black, and K. Tokuda, "Voice conversion based on maximum likelihood estimation of spectral parameter trajectory," IEEE Trans. Audio, Speech, Lang. Process., vol.15, no.8, pp. 2222-2235, Nov. 2007.
8. H. Valbret, E. Moulines, and J. P. Tubach, "Voice transformation using PSOLA technique," Speech Commun., vol.11, no.2-3, pp. 175-187, 1992.
9. M. Narendranath, H. A. Murthy, S. Rajendran, and B. Yegnanarayana, "Transformation of formants for voice conversion using artificial neural networks," Speech Commun., vol.16, no.2, pp. 207-216, 1995.
10. N. Iwahashi and Y. Sagisaka, "Speech spectrum conversion based on speaker interpolation and multi-functional representation with weighting by radial basis function networks," Speech Commun., vol.16, no.2, pp. 139-151, 1995.
11. D. Suendermann, H. Ney, and H. Hoege, "VTLN-Based cross-language voice conversion," in Proc. ASRU'03, Virgin Islands, 2003.
12. D. Suendermann, H. Hoege, A. Bonafonte, H. Ney, A. Black, and S. Narayanan, "Text-independent voice conversion based on unit selection," in Proc. ICASSP'06, 2006.
13. H. Ye and S. J. Young, "Voice conversion for unknown speakers," in Proc. ICSLP'04.
14. L. M. Arslan, "Speaker transformation algorithm using segmental codebooks," Speech Commun., vol.28, pp. 211-226, 1999.
15. D. Sündermann, H. Höge, A. Bonafonte, H. Ney, and J. Hirschberg, "Text-independent cross-language voice conversion," in Proc. ICSLP, 2006.
16. M. Zhang, J. Tao, J. Tian, and X. Wang, "Text-independent voice conversion based on state mapped codebook," in Proc. ICASSP'08, 2008.
17. P. Ladefoged, Preliminaries to Linguistic Phonetics. Chicago, IL: Univ. of Chicago Press, 1971.
18. W. Labov, Principles of Linguistic Change: Vol.II: Social Factors. Oxford, U.K.: Blackwell, 2001.
19. C. Essner, "Recherche sur la structure des voyelles orales," Archives Néerlandaises de Phonétique Expérimentale, vol.20, pp. 40-77, 1947.
20. M. Joos, "Acoustic phonetics," Language, vol.24, pp. 1-136, 1948.
21. "Handbook of the International Phonetic Association,". Cambridge, U.K..
22. R. Laroia, N. Phamdo, and N. Farvardin, "Robust and efficient quantization of speech LSF parameters using structured vector quantizers," in Proc. ICASSP'91, 1991.
23. J. Takahashi and S. Sagayama, "Vector-field-smoothed Bayesian learning for incremental speaker adaptation," in Proc. ICASSP'95, 1995, vol.1, pp. 696-699.
24. J.-I. Takahashi and S. Sagayama, "Vector-field-smoothed Bayesian learning for incremental speaker adaptation," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. Conf.,May 1995, vol.1, pp. 696-699.
25. J. M. Lee, Introduction to Topological Manifolds. New York: Springer, 2000, vol.202, Graduate Texts in Mathematics.
26. J. A. Costa and A. O. Hero, "Manifold learning using euclidean K-nearest neighbor graphs," in Proc. ICASSP, 2004.
27. T. Kohonen, Self-Organizing Maps. Berlin/Heidelberg, Germany: Springer, 1995, vol.30.
28. C. Bouton and G. Pagès, "Convergence in distribution of the onedimensionalKohonen algorithms when the stimuli are not uniform," Adv. Appl. Probab., vol.26, no.1, pp. 80-103, 1994.
29. J. C. Fort and G. Pagès, "On the a.s. convergence of the Kohonen algorithm with a general neighborhood function," Ann. Appl. Probab., vol.5, no.4, pp. 1177-1216, 1995.
30. L. Knohl and A. Rinscheid, "Speaker normalization and adaptation based on feature-map projection," in Proc. Eurospeech'93, 3rd Eur. Conf. Speech, Commun. Technol., 1993, pp. 367-370.
31. L. Knohl and A. Rinscheid, "Speaker normalization with self-organizing feature maps," in Proc. IJNN'93-Nagoya, Int. Joint Conf. Neural Netw., 1993, pp. 243-246.
32. R. Ansgar, "Voice conversion based on topological feature maps and time-variant filtering," in Proc. ICSLP'96, pp. 1445-1448.
33. E. Uchino, K. Yano, and T. Azetsu, "A self-organizing map with twin units capable of describing a nonlinear input-output relation applied to speech code vector mapping," Inf. Sci.: Int. J., vol.177, no.21, pp. 4634-4644, Nov. 2007.
34. S. Xiang, F. Nie, Y. Song, C. Zhang, and C. Zhang, "Embedding new data points for manifold learning via coordinate propagation," in Proc. PAKDD'07, 2007, Long version: Knowledge and Information Systems Journal.
35. Y. Bengio, J. Paiement, and P. Vincent, "Out-of-sample extensions for LLE, Isomap, MDS, Eigenmaps and spectral clustering," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2004, vol.16.
36. M. Law and A. K. Jain, "Incremental nonlinear dimensionality reduction by manifold learning," IEEE Trans. Pattern Anal. Mach. Intell., vol.28, no.3, pp. 377-391, Mar. 2006.
37. O. Kouropteva, O. Okun, and M. Pietikaeinen, "Incremental locally linear embedding," Pattern Recognition, vol.38, no.10, pp. 1764-1767, 2005.
38. M. Zhang, J. Tao, J. Nurminen, J. Tian, and X.Wang, "Phonetic Anchor based state mapping for text-independent voice conversion," in Proc. ICSP'08, 2008.
39. H. Kawahara, I. Masuda-Katsuse, and A. deCheveigne, "Restructuring speech representations using pitch-adaptive time frequency smoothing and instanta-neous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds," Speech Commun., vol.27, pp. 187-207, 1999.
40. K. Kiviluoto, "Topology preservation in self-organizing maps," in Proc. Int. Conf. Neural Netw. (ICNN'96), 1996, pp. 294-299.
41. K. Paliwal and B. Atal, "Efficient vector quantization of LPC parameters at 24 bits/frame," IEEE Trans. Speech Audio Process., vol.1, no.1, pp. 3-14, Jan. 1993.