Building personalized synthetic voices for individuals with dysarthria using the HTS toolkit

Computer Synthesized Speech Technologies: Tools for Aiding Impairment

Volumn , Issue , 2010, Pages 92-115

  Creer, Sarah ^a   Green, Phil ^a   Cunningham, Stuart ^a   Yamagishi, Junichi ^b  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77953693885     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-61520-725-1.ch006     Document Type: Chapter

References (52)

1. Allen, J. (2005). Designing desirability in an augmentative and alternative communication device. Universal Access in the Information Society, 4, 135-145. doi:10.1007/s10209-005-0117-2
2. Angelo, D. H., Kokosa, S. M., & Jones, S. D. (1996). Family perspective on augmentative and alternative communication: families of adolescents and young adults. Augmentative and Alternative Communication, 12(1), 13-20. doi:10.1080/07434619612331277438
3. Bennett, C. L. (2005). Large scale evaluation of corpus-based synthesizers: results and lessons from the Blizzard challenge 2005. In Proceedings of the 9th European Conference on Speech Communication and Technology (Interspeech-2005/ Eurospeech) (pp. 105-108), Lisbon, Portugal.
4. Black, A. W., & Lenzo, K. A. (2007). Building synthetic voices. Retrieved February 2, 2007, from http://festvox.org/festvox/festvox_toc.html
5. Bloch, S., & Wilkinson, R. (2004). The under-standability of AAC: a conversation analysis study of acquired dysarthria. Augmentative and Alternative Communication, 20(4), 272-282. doi:10.1080/07434610400005614
6. Chambers, J. K. (1995). Sociolinguistic theory. Oxford: Blackwell.
7. Clark, R. A., Richmond, K., & King, S. (2004). Festival 2 - build your own general purpose unit selection speech synthesizer. In Proceedings of the 5th International Speech Communication Association Speech Synthesis Workshop (SSW5) (pp. 173-178), Pittsburgh, PA.
8. Coulston, R., Oviatt, S., & Darves, C. (2002). Amplitude convergence in children's conversational speech with animated personas. In Proceedings of the 7th International Conference on Spoken Language Processing (pp. 2689-2692), Boulder, CO.
9. Crabtree, M., Mirenda, P., & Beukelman, D. R. (1990). Age and gender preferences for synthetic and natural speech. Augmentative and Alternative Communication, 6(4), 256-261. doi:10.1080/07434619012331275544
10. Creer, S. M., Cunningham, S. P., Green, P. D., & Fatema, K. (in press). Personalizing synthetic voices for people with progressive speech disorders: judging voice similarity. In Proceedings of Interspeech 2009.
11. Darves, C., & Oviatt, S. (2002). Adaptation of users' spoken dialogue patterns in a conversational interface. In Proceedings of the 7th International Conference on Spoken Language Processing (pp. 561-564), Boulder, CO.
12. nd ed.). St Louis, MO: Elsevier Mosby.
13. Fant, G. (Ed.). (1960). Acoustic theory of speech production. The Hague, Netherlands: Mouton.
14. Fukada, T., Tokuda, K., Kobayashi, T., & Imai, S. (1992). An adaptive algorithm for mel-cepstral analysis of speech. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (pp. 137-140), San Francisco, CA.
15. Gorenflo, D. W., & Gorenflo, C. W. (1991). The effects of information and augmentative communication technique on attitudes toward non-speaking individuals. Journal of Speech and Hearing Research, 34, 19-26.
16. Hetzroni, O. E., & Harris, O. L. (1996). Cultural aspects in the development of AAC users. Augmentative and Alternative Communication, 12(1), 52-58. doi:10.1080/07434619612331277488
17. Huckvale, M. (2004) SCRIBE manual version 1.0. Retrieved January 7, 2009, from http://www.phon.ucl.ac.uk/resource/scribe/scribe-manual.htm
18. Kawahara, H., Masuda-Katsuse, I., & de Cheveigné, A. (1999). Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: possible role of a repetitive structure in sounds. Speech Communication, 27, 187-207. doi:10.1016/S0167-6393(98)00085-5
19. Kemp, B. (1999). Quality of life while ageing with a disability. Assistive Technology, 11, 158-163.
20. Kent, R., Weismer, G., Kent, J., & Rosenbek, J. (1989). Toward phonetic intelligibility testing in dysarthria. The Journal of Speech and Hearing Disorders, 54, 482-499.
21. Kominek, J., & Black, A. W. (2003). CMU Arctic databases for speech synthesis. Retrieved April 20, 2006, from http://festvox.org/cmuarctic/cmuarcticreport.pdf
22. Light, J. (1988). Interaction involving individuals using augmentative and alternative communication systems: state of the art and future directions. Augmentative and Alternative Communication, 4(2), 66-82. doi:10.1080/07434618812331274657
23. Light, J., Page, R., Curran, J., & Pitkin, L. (2007). Children's ideas for the design of AAC assistive technologies for young children with complex communication needs. Augmentative and Alternative Communication, 23(4), 274-287. doi:10.1080/07434610701390475
24. Lilienfeld, M., & Alant, E. (2002). Attitudes of children toward an unfamiliar peer using an AAC device with and without voice output. Augmentative and Alternative Communication, 18(2), 91-101. doi:10.1080/07434610212331281191
25. Locke, J. L. (1998). Where did all the gossip go?: Casual conversation in the information age. The Magazine of the American Speech-Language--Hearing Association, 40(3), 26-31.
26. Miller, N., Noble, E., Jones, D., & Burn, D. (2006). Life with communication changes in Parkinson's disease. Age and Ageing, 35, 235-239. doi:10.1093/ageing/afj053
27. Moore, R., & Morris, A. (1992). Experiences collecting genuine spoken enquiries using WOZ techniques. In Proceedings of DARPA Speech and Natural Language Workshop (pp. 61-63), New York.
28. Moulines, E., & Charpentier, F. (1990). Pitch-synchronous waveform processing techniques for text-to-speech synthesis using diphones. Speech Communication, 9, 453-467. doi:10.1016/0167-6393(90)90021-Z
29. Murphy, J. (2004). 'I prefer contact this close': perceptions of AAC by people with motor neurone disease and their communication partners. Augmentative and Alternative Communication, 20(4), 259-271. doi:10.1080/07434610400005663
30. Nass, C., Moon, Y., & Green, N. (1997). Are machines gender neutral? Gender-stereotypic responses to computers with voices. Journal of Applied Social Psychology, 27, 864-876. doi:10.1111/j.1559-1816.1997.tb00275.x
31. O'Keefe, B. M., Brown, L., & Schuller, R. (1998). Identification and rankings of communication aid features by five groups. Augmentative and Alternative Communication, 14(1), 37-50. doi:10.1080/07434619812331278186
32. Parette, P., & Huer, M. B. (2002). Working with Asian American families whose children have augmentative and alternative communication needs. Journal of Special Education Technology E-Journal, 17(4). Retrieved January 4, 2009, from http://jset.unlv.edu/17.4T/parette/first.html
33. Rabiner, L. R. (1989). A tutorial on HMM and selected applications in speech recognition. Proceedings of the IEEE, 77(2), 257-286. doi:10.1109/5.18626
34. Smith, M. M. (2005). The dual challenges of aided communication and adolescence. Augmentative and Alternative Communication, 21(1), 76-79. doi:10.1080/10428190400006625
35. Stern, S. E. (2008). Computer synthesized speech and perceptions of the social influence of disabled users. Journal of Language and Social Psychology, 27(3), 254-265. doi:10.1177/0261927X08318035
36. Stern, S. E., Mullennix, J. W., Dyson, C.-L., & Wilson, S. J. (1999). The persuasiveness of synthetic speech versus human speech. Human Factors, 41, 588-595. doi:10.1518/001872099779656680
37. Stern, S. E., Mullennix, J. W., & Wilson, S. J. (2002). Effects of perceived disability on persuasiveness of computer synthesized speech. The Journal of Applied Psychology, 87, 411-417. doi:10.1037/0021-9010.87.2.411
38. Stern, S. E., Mullennix, J. W., & Yaroslavsky, I. (2006). Persuasion and social perception of human vs. synthetic voice across person as source and computer as source conditions. International Journal of Human-Computer Studies, 64, 43-52. doi:10.1016/j.ijhcs.2005.07.002
39. Street, R. L., & Giles, H. (1982). Speech accommodation theory: a social cognitive approach to language and speech. In M. Roloff, & C. R. Berger, (Eds.), Social cognition and communication (pp. 193-226). Beverly Hills, CA: Sage.
40. Taylor, P., Black, A. W., & Caley, R. (1998). The architecture of the Festival speech synthesis system. In Proceedings of the 3rd ESCA Workshop in Speech Synthesis (pp. 147-151), Jenolan Caves, Australia.
41. Toda, T., & Tokuda, K. (2007). A speech parameter generation algorithm considering global variance for HMM-based speech synthesis. IEICE Transactions on Information and Systems. E (Norwalk, Conn.), 90-D(5), 816-824.
42. Tokuda, K., Zen, H., Yamagishi, J., Masuko, T., Sako, S., Black, A., & Nose, T. (2008) The HMM-based speech synthesis system (HTS) Version 2.1. Retrieved June 27, 2008, from http://hts.sp.nitech.ac.jp/.
43. Wells, J. C. (1982). Accents of English: an introduction. Cambridge, UK: Cambridge Univ. Press.
44. Yamagishi, J., & Kobayashi, T. (2007). Average-voice-based speech synthesis using HSMM-based speaker adaptation and adaptive training. IEICE Transactions on Information and Systems. E (Norwalk, Conn.), 90-D(2), 533-543.
45. Yamagishi, J., Kobayashi, T., Nakano, Y., Ogata, K., & Isogai, J. (2009). Analysis of speaker adaptation algorithms for HMM-based speech synthesis and a constrained SMAPLR adaptation algorithm. IEEE Transactions on Audio. Speech and Language Processing, 17(1), 66-83. doi:10.1109/TASL.2008.2006647
46. Yamagishi, J., Nose, T., Zen, H., Ling, Z., Toda, T., & Tokuda, K. (2009). A robust speaker-adaptive HMM-based text-to-speech synthesis. IEEE Transactions on Audio. Speech and Language Processing, 17(6), 1208-1230. doi:10.1109/TASL.2009.2016394
47. Yamagishi, J., Zen, H., Toda, T., & Tokuda, K. (2007). Speaker-independent HMM-based speech synthesis system - HTS-2007 for the Blizzard challenge 2007. In Proceedings of the Blizzard Challenge 2007 (paper 008), Bonn, Germany.
48. Yamagishi, J., Zen, H., Wu, Y.-J., Toda, T., & Tokuda, K. (2008). The HTS-2008 system: yet another evaluation of the speaker-adaptive HMMbased speech synthesis system in the 2008 Blizzard challenge. In Proceedings of the Blizzard Challenge 2008, Brisbane, Australia. Retrieved March 2, 2009, from http://festvox.org/blizzard/bc2008/hts_Blizzard2008.pdf.
49. Yarrington, D., Pennington, C., Gray, J., & Bunnell, H. T. (2005). A system for creating personalized synthetic voices. In [Baltimore.]. Proceedings of ASSETS, 2005, 196-197.
50. Zen, H., Nose, T., Yamagishi, J., Sako, S., & Tokuda, K. (2007a). The HMM-based speech synthesis system (HTS) version 2.0. In Proceedings of the 6th International Speech Communication Association Speech Synthesis Workshop (SSW6) (pp. 294-299), Bonn, Germany.
51. Zen, H., Toda, T., Nakamura, M., & Tokuda, K. (2007b). Details of the Nitech HMM-based speech synthesis system for the Blizzard challenge 2005. IEICE Transactions on Information and Systems. E (Norwalk, Conn.), 90-D(1), 325-333.
52. Zen, H., Tokuda, K., Masuko, T., Kobayashi, T., & Kitamura, T. (2007c). A hidden semi-Markov model-based speech synthesis system. IEICE Transactions on Information and Systems. E (Norwalk, Conn.), 90-D(5), 825-834.