Designing the user interface of the computer-based speech training system ARTUR based on early user tests

Behaviour and Information Technology

Volumn 25, Issue 4, 2006, Pages 353-365

  Engwall, Olov ^a   Bälter, Olle ^a   Öster, Anne Marie ^a   Kjellström, Hedvig ^a  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

Computer based speech training system; Participatory design; User interface; Wizard of Oz test

Indexed keywords

EID: 84894560828     PISSN: 0144929X     EISSN: 13623001     Source Type: Journal    
DOI: 10.1080/01449290600636702     Document Type: Article

References (44)

1. Adams, F. R., Crepy, H., Jameson, D., and Thatcher, J., 1989. IBM Products for Persons with Disabilities. Global Telecommunications Conference and Exhibition. ‘Communications Technology for the 1990s and Beyond’, GLOBECOM ’89 Vol. 2, 980–984. IEEE
2. Barker, J., and Berthommier, F., 1999. “ Evidence of correlation between acoustic and visual features of speech ”. In Proceedings of the 14th International Congress of Phonetic Sciences, 199–202. Berkeley:University of California. 1–8 August 1999, San Francisco, CA
3. Beskow, J., 2003. “ Talking heads—models and applications for multimodal speech synthesis ”. Sweden:KTH. Ph.D. Thesis
4. Bunnell, H. T., Yarrington, D. M., and Polikoff, J. B., 2000. “ STAR:articulation training for young children ”. In Proceedings of the 6th International Conference on Spoken Language Processing, Vol. 4, 85–88. Beijing:China Military Friendship Publish. 16–20 October 2000, Beijing, China
5. Cohen, M. M., and Massaro, D. W., 1993. “ Modelling coarticulation in synthetic visual speech ”. In Speechreading by Humans and Machines:Animation, Edited by:Magneat-Thalmann, N., and Hennecke, M. E., 139–156. Tokyo:Springer Verlag.
6. Deroo, O., Ris, C., Gielen, S., and Vanparys, J., 2000. “ Automatic detection of mispronounced phonemes for language learning tools ”. In Proceedings of the 6th International Conference on Spoken Language Processing, Vol. 1, 681–684. Beijing:China Military Friendship Publish. 16–20 October 2000, Beijing, China
7. Dodd, B., 1974. “ The acquisition of phonological skills in normal, severely subnormal and deaf children ”. University of London. Doctoral dissertation
8. Engwall, O., 2003. Combining MRI, EMA and EPG measurements in a three-dimensional tongue model. Speech Communication, 41:303–329.
9. Engwall, O., 2004a. “ From real-time MRI to 3D tongue movements ”. In Proceedings of the 8th International Conference on Spoken Language Processing, 1109–1112. Korea:Sunjin Printing Co. 4–8 October 2005, Jeju Island, Korea
10. Engwall, O., 2004b. “ Speaker adaptation of a three-dimensional tongue model ”. In Proceedings of the 8th international Conference on Spoken Language Processing, 465–468. Korea:Sunjin Printing Co. 4–8 October 2005, Jeju Island, Korea
11. Engwall, O., 2005. “ Introducing visual cues in acoustic-to-articulatory inversion ”. In Proceedings of Interspeech, 3205–3208. Rundle Mall, Australia:Casual Productions Pty Ltd. 5–9 September 2005, Lisbon, Portugal
12. Engwall, O., Wik, P., Beskow, J., and Granström, B., 2004. “ Design strategies for a virtual language tutor ”. In Proceedings of the 8th International Conference on Spoken Language Processing, 1693–1696. Korea:Sunjin Printing Co. 4–8 October 2005, Jeju Island, Korea
13. Erber, N. P., 1974. Visual perception of speech by deaf children:recent developments and continuing needs. Journal of Speech and Hearing Disorders, 39:178–185.
14. Eriksson, E., Bälter, O., Engwall, O., Öster, A -M., and Kjellström, H., 2005. “ Design recommendations for a computer-based speech training system based on end-user interviews ”. In Proceedings of the 10th International Conference on Speech and Computer, 483–486. Moscow:Moscow State Linguistics University. 17–19 October 2005, Patras, Greece
15. IPA. 1999. Handbook of the International Phonetic Association:A Guide to the Use of the International Phonetic Alphabet, Cambridge:Cambridge University Press.
16. Jo, C -H., Kawahara, T., Doshita, S., and Dantsujiy, M., 1998. “ Automatic pronunciation error detection and guidance for foreign language learning ”. In Proceedings of the 5th International Conference on Spoken Language Processing, 289–292. Rundle Mall, Australia:Casual Productions Pty Ltd. 30 November–5 December 1998, Sydney, Australia
17. Laprie, Y., and Ouni, S., 2002. “ Introduction of constraints in an acoustic-to-articulatory inversion method based on a hypercubic articulation table ”. In Proceedings of the 7th International Conference on Spoken Language Processing, 211–214. Rundle Mall, Australia:Casual Productions Pty Ltd. 16–20 September 2002, Denver, CO
18. Levitt, H., and Geffner, D., 1987. Communication skills of young hearing-impaired children. ASHA Monographs, 26:123–158.
19. Ling, D., 1976. Speech and the Hearing-impaired Child:Theory and Practice, Washington, D.C.:The A.G. Bell Association for the Deaf, Inc.
20. Markides, A., 1989. Lipreading:theory and practice. Journal of British Association of Teachers of the Deaf, 13:29–47.
21. Massaro, D., 1987. Speech Perception by Ear and Eye:A Paradigm for Psychological Inquiry, Hillsdale:Lawrence Earlbaum Associates.
22. Massaro, D. W., and Light, J., 2003. “ Read my tongue movements:bimodal learning to perceive and produce non-native speech /r/ and /l/ ”. In Proceedings of the 8th European Conference on Speech Communication and Technology, 2249–2252. Rundle Mall, Australia:Casual Productions Pty Ltd. 1–4 September 2003, Geneva, Switzerland
23. Massaro, D. W., and Light, J., 2004. Using visible speech to train perception and production of speech for individuals with hearing loss. Journal of Speech, Language and Hearing Research, 47:304–320.
24. McGurk, H., and MacDonald, J., 1976. Hearing lips and seeing voices. Nature, 264:746–748.
25. Mostow, J., Roth, S., Hauptmann, A., and Kane, M., 1994. “ A prototype reading coach that listens ”. In Proceedings of the Twelfth National Conference on Artificial Intelligence (AAAI-94), 785–792. Seattle, WA:American Association for Artificial Intelligence.
26. Muller, M. J., Haslwanter, J. H., and Dayton, T., 1997. “ Participatory practices in the software lifecycle ”. In Handbook of Human–computer Interaction, Edited by:Helander, M. D., Landauer, T. K., and Prabhu, P. V., 255–297. Amsterdam:Elsevier Science.
27. Neri, A., Cucchiarini, C., and Strik, H., 2002a. “ Feedback in computer assisted pronunciation training:when technology meets pedagogy ”. In Proceedings of CALL Conference CALL professionals and the future of CALL research, 179–188. Antwerp:University of Antwerp Press. 18–20 August 2002, Antwerp, Belgium
28. Neri, A., Cucchiarini, C., Strik, H., and Boves, L., 2002b. The pedagogy–technology interface in Computer Assisted Pronunciation Training. Computer Assisted Language Learning, 15:441–467.
29. Neti, C., Potamianos, G., Luettin, J., Matthews, I., Glotin, H., Vergyri, D., Sison, J., Mashari, A., and Zhou, J., 2000. “ Audio-visual speech recognition ”. Baltimore, MD Final report from Workshop 2000 Audio-Visual Speech Recognition, 12 October
30. Oller, K., 2000. The Emergence of the Speech Capacity, Mahwah:Lawrence Erlbaum.
31. OLP. 2003. Available online at:http://www.xanthi.ilsp.gr/olp/default.htm (accessed 24 November 2004)
32. Ouni, S., and Laprie, Y., 2003. “ A study of the French vowels through the main constriction of the vocal tract using an acoustic-to-articulatory inversion method ”. In Proceedings of the 15th International Congress of Phonetic Sciences, 2901–2904. Rundle Mall, Australia:Casual Productions Pty Ltd. 3–9 August 2003, Barcelona, Spain
33. Osberger, M. J., Moeller, M. P., and Kroese, J. M., 1981. Computer-assisted speech training for the hearing impaired. Journal of the Academy of Rehabilitative Audiologists, 14:145–158.
34. Öster, A -M., 1992. “ The speech of deaf children—phonological assessment as a basis for speech-training ”. University of Stockholm. Thesis work for the Licentiate Philosophy degree in Phonetics, 22 April 1992
35. Öster, A. -M., 1996. “ Clinical applications of computer-based speech training for children with hearing-impairment ”. In Proceedings of the 4th International Conference on Spoken Language Processing, 157–160. New Castle, Delaware:Citations Delaware. 3–6 October 1996, Philadelphia, PA
36. Öster, A -M., House, D., Hatziz, A., and Green, P., 2003. “ Testing a new method for training fricatives using visual maps in the Ortho-Logo-Pedia project (OLP) ”. In Proceedings of Fonetik 2003, Phonum 9, 89–92. Sweden:Umeå University. Reports in Phonetics
37. Parke, F. I., 1982. Parameterized models for facial animation. IEEE Computer Graphics, 2:61–68.
38. Reeves, B., and Nass, C., 1996. The Media Equation:How People Treat Computers, Television, and New Media like Real People and Places, Chicago:University of Chicago Press.
39. Rubin, J., 1994. Handbook of Usability Testing, New York:John Wiley & Sons Inc.
40. Soleymani, A. J.A., McCutcheon, M. J., and Southwood, M. H., 1997. “ Design of speech mentor (SIM) for teaching speech to the hearing impaired ”. In Proceedings of the Sixteenth Southern Biomedical Engineering Conference, 425–428. Piscataway, NJ:IEEE Engineering in Medicine and Biology Society. 4–6 April 1997, Biloxi, MS
41. Summerfield, Q., 1987. “ Some preliminaries to a comprehensive account of audio-visual speech perception ”. In Hearing by Eye:The Psychology of Lip-reading, Edited by:Dodd, B., and Campbell, R., 3–52. Hillsdale:Lawrence Erlbaum Associates.
42. Vicsi, K., Roach, P., Öster, A -M., Kacic, Z., Barczikay, Tantoa, A., Csatári, F., Bakcsi, Z., and Sfakianaki, A., 2000. A multilingual teaching and training system for children with speech disorders. International Journal of Speech technology, 3:289–300.
43. Watson, C., Reed, D., Kewley-Port, D., and Maki, D., 1989. The Indiana speech training aid (ISTRA). Comparisons between human and computer-based evaluation of speech quality. Journal of Speech and Hearing Research, 32:245–251.
44. Wiepert, S. L., and Mercer, V. S., 2002. Effects of an increased number of practice trials on Peabody developmental gross motor scale scores in children of preschool age with typical development. Pediatric Physical Therapy, 14:22–28.