Foreign accent conversion through concatenative synthesis in the articulatory domain

IEEE Transactions on Audio, Speech and Language Processing

Volumn 20, Issue 8, 2012, Pages 2301-2312

  Felps, Daniel ^a   Geng, Christian ^b   Gutierrez Osuna, Ricardo ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Accent conversion; speaker recognition; speech perception; speech synthesis

Indexed keywords

ACOUSTIC FEATURES; ARTICULATORY FEATURES; ELECTROMAGNETIC ARTICULOGRAPHY; LISTENING TESTS; MEL-FREQUENCY CEPSTRAL COEFFICIENTS; NON-NATIVE SPEAKERS; SPEAKER DEPENDENTS; SPEAKER RECOGNITION; SPEECH PERCEPTION; STRONG COUPLING; VOCAL TRACT LENGTHS;

SPEECH RECOGNITION; SPEECH SYNTHESIS;

SPEECH PROCESSING;

EID: 84865392230     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2012.2201474     Document Type: Article

References (43)

1. T. Scovel, A Time to Speak: A Psycholinguistic Inquiry Into the Critical Period for Human Speech. Cambridge, U.K.: Newbury House, 1988.
2. M. Eisenstein, "Native reactions to non-native speech: A review of empirical research," Studies in Second Lang. Acquisit., vol. 5, no. 02, pp. 160-176, 1983.
3. M. Eskenazi, "An overview of spoken language technology for education," Speech Commun., vol. 51, no. 10, pp. 832-844, 2009.
4. A. Neri, C. Cucchiarini, and H. Strik et al., "The pedagogy-technology interface in computer assisted pronunciation training," Comput. Assist. Lang. Learn., vol. 15, no. 5, pp. 441-467, 2002.
5. A. Neri, C. Cucchiarini, and H. Strik, "Automatic speech recognition for second language learning: How and why it actually works," in Proc. Int. Congr. Phon. Sci., 2003, pp. 1157-1160.
6. K. A. Wachowicz and B. Scott, "Software that listens: It's not a question of whether, it's a question of how," CALICO J., vol. 16, no. 3, pp. 253-276, 1999.
7. R. Lyster, "Negotiation of form, recasts, and explicit correction in relation to error types and learner repair in immersion classrooms," Lang. Learn., vol. 51, no. s1, pp. 265-301, 2001. (Pubitemid 33281959)
8. K. Nagano and K. Ozawa, "English speech training using voice conversion," in Proc. ICSLP, 1990, pp. 1169-1172.
9. M. P. Bissiri, H. R. Pfitzinger, and H. G. Tillmann, "Lexical stress training of German compounds for Italian speakers by means of resynthesis and emphasis," in Proc. Austral. Int. Conf. Speech Sci. Tech., 2006, pp. 24-29.
10. K. Probst, Y. Ke, and M. Eskenazi, "Enhancing foreign language tutors -In search of the golden speaker," Speech Commun., vol. 37, no. 3-4, pp. 161-173, 2002. (Pubitemid 34524837)
11. D. Felps, H. Bortfeld, and R. Gutierrez-Osuna, "Foreign accent conversion in computer assisted pronunciation training," Speech Commun., vol. 51, no. 10, pp. 920-932, 2009.
12. D. J. Broad and H. Hermansky, "The front-cavity/F2[prime] hypothesis tested by data on tongue movements," J. Acoust. Soc. Amer., vol. 86, no. S1, pp. S113-S114, 1989.
13. A. Toth and A. Black, "Using articulatory position data in voice transformation," in Proc. ISCA Speech Synth.Workshop, 2007, pp. 182-185.
14. D. Markham, "Listeners and disguised voices: The imitation and perception of dialectal accent," Forensic Linguist., vol. 6, no. 2, pp. 290-299, 1999.
15. I. Piller, "Passing for a native speaker: Identity and success in second language learning," J. Sociolinguist., vol. 6, no. 2, pp. 179-208, 2002.
16. N. Campbell, "Foreign-language speech synthesis," in Proc. ISCA Speech Synth. Workshop, 1998, pp. 117-180.
17. M. Huckvale and K. Yanagisawa, "Spoken language conversion with accent morphing," in Proc. ISCA Speech Synth. Workshop, 2007, pp. 64-70.
18. Q. Yan, S. Vaseghi, and D. Rentzos et al., "Analysis and synthesis of formant spaces of british, australian, and american accents," IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 2, pp. 676-689, 2007.
19. L. R. Yanguas, T. F. Quatieri, and F. Goodman, "Implications of glottal source for speaker and dialect identification," in Proc. ICASSP, Phoenix, AZ, 1999, pp. 813-816.
20. A. Wrench, MOCHA-TIMIT. [Online]. Available: http://www.cstr.ed.ac.uk/ research/projects/artic/mocha.html
21. J. R. Westbury, "X-ray microbeam speech production database tech. report," Univ. of Wisconsin, Madison, WI, 1994.
22. P. Hoole, A. Zierdt, and C. Geng, "Beyond 2D in articulatory data acquisition and analysis," in Proc. Int. Conf. Phon. Sci., 2003, pp. 265-268.
23. P. Hoole and A. Zierdt, "Five-dimensional articulography," Speech Motor Control, pp. 331-349, 2010.
24. Z. Al Bawab, R. Bhiksha, and R. M. Stern, "Analysis-by-synthesis features for speech recognition," in Proc. ICASSP, 2008, pp. 4185-4188.
25. S. Maeda, "An articulatory model of the tongue based on a statistical analysis," J. Acoust. Soc. Amer., vol. 65, p. S22, 1979.
26. H. Kawahara, "Speech representation and transformation using adaptive interpolation of weighted spectrum: Vocoder revisited," in Proc. ICASSP, 1997, pp. 1303-1306.
27. O. Viikki and K. Laurila, "Cepstral domain segmental feature vector normalization for noise robust speech recognition," Speech Commun., vol. 25, no. 1-3, pp. 133-147, 1998. (Pubitemid 128413638)
28. K. Vertanen, "Baseline WSJ acoustic models for HTK and Sphinx: Training recipes and recognition experiments," Univ. of Cambridge, U.K., 2006, Tech. Rep.
29. E. Martínez-Celdrán, A. M. Fernández-Planas, and J. Carrera-Sabaté, "Castilian Spanish," J. Int. Phon. Assoc., vol. 33, no. 02, pp. 255-259, 2003.
30. A. J. Hunt and A. W. Black, "Unit selection in a concatenative speech synthesis system using a large speech database," in Proc. ICASSP, 1996, pp. 373-376.
31. R. A. J. Clark, K. Richmond, and S. King, "Multisyn: Open-domain unit selection for the festival speech synthesis system," Speech Commun., vol. 49, no. 4, pp. 317-330, 2007. (Pubitemid 46517714)
32. A. Conkie and S. Isard, "Optimal coupling of diphones," Progress in Speech Synth., pp. 293-304, 1997.
33. D. T. Chappell and J. H. L. Hansen, "A comparison of spectral smoothing methods for segment concatenation based speech synthesis," Speech Commun., vol. 36, no. 3-4, pp. 343-373, 2002.
34. Y. Shiga, "Pulse density representation of spectrum for statistical speech processing," in Proc. Interspeech, 2009, pp. 1771-1774.
35. M. Munro and T. Derwing, "Evaluations of foreign accent in extemporaneous and read material," Lang. Testing, vol. 11, pp. 253-266, 1994.
36. L. Lee and R. Rose, "A frequencywarping approach to speaker normalization," IEEE Trans. Speech Audio Process., vol. 6, no. 1, pp. 49-60, Jan. 1998.
37. K. N. Stevens, "On the quantal nature of speech," Phonetics, vol. 17, no. 1, pp. 3-45, 1989.
38. J. H. L. Hansen, S. S. Gray, and W. Kim, "Automatic voice onset time detection for unvoiced stops (/p/,/t/,/k/) with application to accent classification," Speech Commun., vol. 52, no. 10, pp. 777-789, 2010.
39. S. R. Hertz, "Integration of rule-based formant synthesis and waveform concatenation: A hybrid approach to text-to-speech synthesis," in Proc. IEEE Workshop Speech Synth., 2002, pp. 87-90.
40. M. Mashimo, T. Toda, and H. Kawanami et al., "Evaluation of cross-language voice conversion using bilingual and non-bilingual databases," in Proc. Interspeech, 2002.
41. K. Johnson, P. Ladefoged, and M. Lindau, "Individual differences in vowel production," J. Acoust. Soc. Amer., vol. 94, no. 2, pp. 701-714, 1993. (Pubitemid 23236850)
42. M. Á. Carreira-Perpiñán and C. Qin, "A comparison of acoustic features for articulatory inversion," in Proc. Interspeech, 2007, pp. 2469-2472.
43. C. Qin and M. A. Carreira-Perpinán, "Estimating missing data sequences in X-ray microbeam recordings," in Proc. Interspeech, Makuhari, Japan, 2010, pp. 1592-1595.