Developing objective measures of foreign-accent conversion

IEEE Transactions on Audio, Speech and Language Processing

Volumn 18, Issue 5, 2010, Pages 1030-1040

  Felps, Daniel ^a   Gutierrez Osuna, Ricardo ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Accent conversion; Foreign accent recognition; Speaker recognition; Voice conversion

Indexed keywords

ACCENTED SPEECH; ACOUSTIC QUALITY; ACOUSTIC VECTORS; AUTOMATIC SPEECH RECOGNIZERS; CEPSTRAL; COMPUTER ASSISTED; CONVERSION METHODS; DEGREE OF CORRELATIONS; LINEAR DISCRIMINANTS; LISTENING TESTS; MATCH SCORE; NARROW BANDS; OBJECTIVE MEASURE; PERCEPTUAL TEST; SINGLE-ENDED; SPEAKER RECOGNITION; SPECTRAL DISTORTIONS; SPEECH QUALITY; SPEECH SIGNALS; SUBJECTIVE RATING; TARGET SPEAKER; VOICE CONVERSION;

SPEECH PROCESSING; WAVELET TRANSFORMS;

SPEECH RECOGNITION;

EID: 77953714655     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2009.2038818     Document Type: Article

References (69)

1. C. Watson and D. Kewley-Port, "Advances in computer-based speech training: Aids for the profoundly hearing impaired," Volta-Rev., vol.91, pp. 29-45, 1989.
2. M. Jilka and G. Möhler, "Intonational foreign accent: Speech technology and foreign language teaching," in Proc. ESCA Workshop Speech Tech. Lang. Learn., 1998, pp. 115-118.
3. R. C. Major, Foreign Accent: The Ontogeny and Phylogeny of Second Language Phonology. Mahwah, NJ: Erlbaum, 2001.
4. Y. Stylianou, O. Cappe, and E. Moulines, "Continuous probabilistic transform for voice conversion," IEEE Trans. Speech Audio Process., vol.6, no.2, pp. 131-142, Mar. 1998.
5. A. Kain and M. Macon, "Design and evaluation of a voice conversion algorithm based on spectral envelope mapping and residual prediction," in Proc. ICASSP 2001, Salt Lake City, UT, 2001, pp. 813-816.
6. A. Ikeno and J. H. L. Hansen, "The effect of listener accent background on accent perception and comprehension," EURASIP J. Audio, Speech, Music Process., vol.2007, pp. 1-8, 2007.
7. A. Neri, C. Cucchiarini, and H. Strik, "Feedback in computer assisted pronunciation training: Technology push or demand pull?," in Proc. CALL Conf., 2002, pp. 179-188.
8. T. K. Hansen, "Computer assisted pronunciation training: The four 'K's of feedback," in Proc. 4rth Int. Conf. Multimedia Inf. Technol. in Education, 2006, pp. 342-346.
9. T. van Els and K. de Bot, "The role of intonation in foreign accent," Modern Lang. J., vol.71, pp. 147-155, 1987.
10. U. Gut, "Foreign accent," in Speaker Classification I: Fundamentals, Features, and Methods, J. G. Carbonell and J. Siekmann, Eds. New York: Springer, 2007, pp. 75-87.
11. L. M. Arslan and J. H. L. Hansen, "A study of temporal features and frequency characteristics in American english foreign accent," JASA, vol.102, pp. 28-40, 1997.
12. M. Munro, "Non-segmental factors in foreign accent: Ratings of filtered speech," Studies in Second Lang. Acquisition, vol.17, pp. 17-34, 1995.
13. E. Moulines and J. Laroche, "Non-parametric techniques for pitchscale and time-scale modification of speech," Speech Commun., vol.16, pp. 175-205, 1995.
14. K. Tajima, R. Port, and J. Dalby, "Effects of temporal correction on intelligibility of foreign-accented English," J. Phon., vol.25, pp. 1-24, 1997.
15. K. Cho and J. G. Harris, "Towards an automatic foreign accent reduction tool," in Proc. 3rd Int. Conf. Speech Prosody, 2006.
16. E. Moulines and F. Charpentier, "Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones," Speech Commun., vol.9, pp. 453-467, 1990.
17. K. Nagano and K. Ozawa, "English speech training using voice conversion," in Proc. ICSLP, 1990, pp. 1169-1172.
18. M. P. Bissiri, H. R. Pfitzinger, and H. G. Tillmann, "Lexical stress training of German compounds for Italian speakers by means of resynthesis and emphasis," in Proc 11th Australian Int. Conf. Speech Sci. Technol., 2006, pp. 24-29.
19. Q. Yan, S. Vaseghi, D. Rentzos, and C.-H. Ho, "Analysis by synthesis of acoustic correlates of British, Australian and American accents," in Proc. ICASSP, 2004, pp. 637-640.
20. T. Kamiyama, "Perception of foreign accentedness in L2 prosody and segments: L1 Japanese speakers learning L2 French," in Proc. Speech Prosody: ISCA, 2004.
21. T. Dutoit, V. Pagel, N. Pierret, F. Bataille, and O. v. d. Vreken, "The MBROLA project: Towards a set of high-quality speech synthesizers free of use for non-commercial purposes," in Proc. ICSLP, 1996, vol.3, pp. 1393-1396.
22. P. Boersma and D. Weenink, Praat: Doing Phonetics by Computer (Version 4.5.15) Institute of Phonetics Sciences, Universiteit van Amsterdam, 2007.
23. M. Huckvale and K. Yanagisawa, "Spoken language conversion with accent morphing," in Proc. ISCA Speech Synth. Workshop, 2007, pp. 64-70.
24. D. Felps, H. Bortfeld, and R. Gutierrez-Osuna, "Foreign accent conversion in computer assisted pronunciation training," Speech Commun., vol.51, pp. 920-932, 2009.
25. M. Munro and T. Derwing, "Foreign accent, comprehensibility, and intelligibility in the speech of second language learners," Lang. Learn. Technol., vol.45, pp. 73-97, 1995.
26. L. Jin and R. Kubichek, "Output-based objective speech quality," in Proc. IEEE Veh. Technol. Conf., 1994, pp. 1719-1723.
27. L. Malfait, J. Berger, and M. Kastner, "P.563-the ITU-T standard for single-ended speech quality assessment," IEEE Trans. Audio, Speech, Lang. Process., vol.14, no.6, pp. 1924-1934, Nov. 2006.
28. P. Gray, M. P. Hollier, and R. E. Massara, "Non-intrusive speechquality assessment using vocal-tract models," IEE Proc. Vis, Image, Signal Process., vol.147, pp. 493-501, 2000.
29. K. Doh-Suk and A. Tarraf, "Perceptual model for non-intrusive speech quality assessment," in Proc. ICASSP, 2004, pp. 1060-1063.
30. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," Comput. Speech Lang., vol.9, pp. 171-185, 1995.
31. C. Huang, T. Chen, and E. Chang, "Accent issues in large vocabulary continuous speech recognition," Int. J. Speech Technol., vol.7, pp. 141-153, 2004.
32. M. Huckvale, "ACCDIST: A metric for comparing speakers' accents," in Proc. ICSLP, 2004.
33. Q. Yan, S. Vaseghi, D. Rentzos, and C. H. Ho, "Analysis and synthesis of formant spaces of British, Australian, and American accents," IEEE Trans. Audio, Speech, Lang. Process., vol.15, no.2, pp. 676-689, Feb. 2007.
34. S. Deshpande, S. Chikkerur, and V. Govindaraju, "Accent classification in speech," in Proc. 4th IEEEWorkshop Autom. Identification Adv. Technol., 2005, pp. 139-143.
35. T. Chen, C. Huang, E. Chang, and J. Wang, "Automatic accent identification using Gaussian mixture models," in Proc. ASRU, 2001.
36. L. M. Arslan and J. H. L. Hansen, "Language accent classification in American english," Speech Commun., vol.18, pp. 353-367, 1996.
37. Q. Yan and S. Vaseghi, "A comparative analysis of UK and US English accents in recognition and synthesis," in Proc. ICASSP, 2002, pp. 413-416.
38. W. Barry, C. Hoequist, and F. Nolan, "An approach to the problem of regional accent in automatic speech recognition," Comput. Speech, Lang., vol.3, pp. 355-366, 1989.
39. N. Minematsu and S. Nakagawa, "Visualization of pronunciation habits based upon abstract representation of acoustic observations," in Proc. Integration Speech Technol. Into Learn., 2000, pp. 130-137.
40. H. Kuwabara and T. Takagi, "Acoustic parameters of voice individuality and voice-quality control by analysis-synthesis method," Speech Commun., vol.10, pp. 491-495, 1991.
41. H. Matsumoto, S. Hiki, T. Sone, and T. Nimura, "Multidimensional representation of personal quality of vowels and its acoustical correlates," IEEE Trans. Audio Electroacoust., vol.AE-21, no.5, pp. 428-436, Oct. 1973.
42. N. Malayath, H. Hermansky, and A. Kain, "Towards decomposing the sources of variability in speech," in Proc. Eurospeech, 1997, pp. 497-500.
43. Y. Lavner, I. Gath, and J. Rosenhouse, "The effects of acoustic modifications on the identification of familiar voices speaking isolated vowels," Speech Commun., vol.30, pp. 9-26, 2000.
44. F. Bimbot, "A tutorial on text-independent speaker verification," EURASIP J. Appl. Signal Process., vol.2004, pp. 430-451, 2004.
45. L. M. Arslan, "Speaker Transformation Algorithm using Segmental Codebooks (STASC)," Speech Commun., vol.28, pp. 211-226, 1999.
46. H. Traunmüller, "Conventional, biological and environmental factors in speech communication: A modulation theory," Phonetica, vol.51, pp. 170-183, 1994.
47. G. Fant, Acoustic Theory of Speech Production. s'Gravenhage, The Netherlands: Mouton, 1960.
48. S. J. Young, The HTK Hidden Markov Model Toolkit: Design and Philosophy. Cambridge, U.K.: Dept. of Eng., Cambridge Univ., 1993.
49. M. Sambur, "Selection of acoustic features for speaker identification," IEEE Trans. Acoust., Speech, Signal Process., vol.ASSP-23, no.2, pp. 176-182, Apr. 1975.
50. B. Vieru-Dimulescu and P. B. d. Mareüil, "Contribution of prosody to the perception of a foreign accent: A study based on Spanish/Italian modified speech," in Proc. ISCA Workshop Plasticity in Speech Perception, London, U.K., 2005, pp. 66-68.
51. D. Paul, "The spectral envelope estimation vocoder," IEEE Trans. Acoustics, Speech, and Signal Processing, vol.29, pp. 786-794, 1981.
52. D. Sundermann, H. Ney, and H. Hoge, "VTLN-based cross-language voice conversion," in Proc. ASRU, 2003, pp. 676-681.
53. D. Griffin and J. Lim, "Signal estimation from modified short-time Fourier transform," IEEE Trans. Acoust., Speech, Signal Process., vol.ASSP-32, no.2, pp. 236-243, Apr. 1984. (Pubitemid 14608418)
54. A. Kain and M. W. Macon, "Spectral voice conversion for text-tospeech synthesis," in Proc. ICASSP, 1998, pp. 285-288.
55. M. Munro and T. Derwing, "Evaluations of foreign accent in extemporaneous and read material," Lang. Testing, vol.11, pp. 253-266, 1994.
56. B. Pelham and H. Blanton, Conducting Research in Psychology, Measuring the Weight of Smoke, 3rd ed. Belmont, CA: Thomson Higher Education, 2007.
57. J. Kreiman and G. Papcun, "Comparing discrimination and recognition of unfamiliar voices," Speech Commun., vol.10, pp. 265-275, 1991.
58. S. M. Sheffert, D. B. Pisoni, J. M. Fellowes, and R. E. Remez, "Learning to recognize talkers from natural, sinewave, and reversed speech samples," J. Exp. Psychol. Hum. Percept. Perform., vol.28, pp. 1447-1469, 2002.
59. K. Vertanen, Baseline WSJ Acoustic Models for HTK and Sphinx: Training Recipes and Recognition Experiments. Cambridge, U.K.: Univ. of Cambridge, 2006.
60. R. Weide, The CMU Pronunciation Dictionary, Release 0.6. Pittsburgh, PA: Carnegie Mellon Univ., 1998.
61. S. Young, G. Evermann, D. Kershaw, G. Moore, J. Odell, D. Ollason, V. Valtchev, and P. Woodland, The HTK Book. Cambridge, U.K.: Cambridge Univ., 1995, vol.1996.
62. P. Meier and S. Muller, "IDEA: International dialects of English archive," [Online]. Available: http://web.ku.edu/∼idea/index.htm 2009
63. S. Boll, "Suppression of acoustic noise in speech using spectral subtraction," IEEE Trans. Acoust., Speech, Signal Process., vol.ASSP-27, no.2, pp. 113-120, Apr. 1979. (Pubitemid 9467471)
64. J. Kominek and A. Black, CMU ARCTIC Databases for Speech Synthesis. Pittsburgh, PA: Carnegie Mellon Univ. Lang. Technol. Inst., 2003.
65. C. M. Bishop, Pattern Recognition and Machine Learning. New York: Springer, 2006.
66. O. P. Kenny, D. J. Nelson, J. S. Bodenschatz, and H. A. McMonagle, "Separation of non-spontaneous and spontaneous speech," in Proc. ICASSP, 1998, vol.1, pp. 573-576.
67. J. B. Tenenbaum, V. d. Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol.290, pp. 2319-2323, 2000.
68. O. Turk and L. M. Arslan, "Donor selection for voice conversion," in Proc. EUSIPCO, 2005.
69. A. Harrison, W. Lau, H. Meng, and L.Wang, "Improving mispronunciation detection and diagnosis of learners' speech with context-sensitive phonological rules based on language transfer," in Proc. Interspeech, Brisbane, Australia, 2008, pp. 2787-2790.