Visualization of speech and audio for hearing impaired persons

Technology and Disability

Volumn 20, Issue 2, 2008, Pages 97-107

  Granström , Bj̈orn ^a   Beskow, Jonas ^a   Engwall, Olov ^a   Nordqvist, Peter ^a   Wik, Preben ^a  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

Communication support; Hearing impairment; Sound classification; Speech processing; Speech reading; Speech training; Talking heads

Indexed keywords

ARTICLE; ASSOCIATION; AUDIOVISUAL EQUIPMENT; AUDITORY STIMULATION; AUTOMATIC SPEECH RECOGNITION; COMMUNICATION AID; COMPUTER PROGRAM; HEARING IMPAIRMENT; HUMAN; HUMAN COMPUTER INTERACTION; INTERPERSONAL COMMUNICATION; PHONEME; SIGNAL PROCESSING; SPEECH ANALYSIS; SPEECH ARTICULATION; SPEECH DISCRIMINATION; TELECOMMUNICATION; TELEPHONE; VIDEORECORDING; VISUAL STIMULATION;

EID: 47949118506     PISSN: 10554181     EISSN: None     Source Type: Journal    
DOI: 10.3233/tad-2008-20205     Document Type: Article

References (31)

1. E. Agelfors, J. Beskow, I. Karlsson, J. Kewley, G. Salvi and N. Thomas, User Evaluation of the SYNFACE Talking Head Telephone. in ICCHP 2006, LNCS 4061, K. Miesenberger et al., eds, 2006, pp. 579-586.
2. E. Aglefors, J. Beskow, M. Dahlquist, B. Granström, M. Lundeberg, K.-E. Spens and T. Öhman, Synthetic faces as a lipreading support, Proceedings of the 5th International Conference on Spoken Language Processing (ICSLP'98), Sydney, Australia, 1998, 3047-3050.
3. J. Beskow, Animation of Talking Agents, Proceedings of AVSP'97, 1997, 149-152.
4. J. Beskow, O. Engwall and B. Granström, Resynthesis of Facial and Intraoral Articulation from Simultaneous Measurements. In: Proceedings of the 15th ICPhS, M.J. Solé, D.R. and J. Romero, eds, 2003, pp. 431-434.
5. J. Beskow, M. Dahlquist, B. Granström, M. Lundeberg, K.-E. Spens and T. Öhman, The Teleface project: Multimodal speech communication for the hearing impaired, Proceedings of the 5th European Conference on Speech Communication and Technology (EUROSPEECH'97), Rhodos, Greece, 1997.
6. P. Branderud, Movetrack - a movement tracking system, Proc of the French-Swedish Symposium on Speech, Grenoble, 1985, 113-122.
7. M.M. Cohen, R.L. Walker and D.W. Massaro, Perception of Synthetic Visual Speech, in: Speechreading by Humans and Machines: Models, Systems and Applications, D.G. Stork and M.E. Hennecke, eds, Berlin: Springer, 1996, pp. 153-168.
8. O. Cornett and M.E. Daisey, The Cued Speech Resource Book for Parents of Deaf Children, National Cued Speech Association, 1992.
9. O. Engwall, Combining MRI, EMA & EPG in a three-dimensional tongue model, Speech Communication 41(2-3) (2003), 303-329.
10. O. Engwall, O. Bälter, A.-M. Öster and H. Kjellström, Designing the user interface of the computer-based speech training system ARTUR based on early user tests, Journal of Behavioural and Information Technology 25(4) (2006), 353-365.
11. O. Engwall, Evaluation of speech inversion using an articulatory classifier, in: Proceedings of the Seventh International Seminar on Speech Production, H. Yehia, D. Demolin and R. Laboissière, eds, Ubatuba, Sao Paolo, Brazil, 2006, pp. 469-476.
12. O. Engwall and O. Bälter, Feedback from real and virtual teachers in pronunciation training. To appear in Journal of Computer Assisted Language Learning (in press).
13. O. Engwall, O. Bälter, A.-M. Öster and H. Kjellström, Feedback management in the pronunciation training system ARTUR, Proceedings of the International Conference on Human Factors in Computing Systems, CHI, 2006, 231-234.
14. N.P. Erber, Interaction of audition and vision in the recognition of speech stimuli, Journal of Speech and Hearing Research 12 (1969), 423-425.
15. E. Eriksson, O. Bälter, O. Engwall, A.-M. Öster and H. Kjellström, Design Recommendations for a Computer-Based Speech Training System Based on End-User Interviews. In: Proceedings of the Tenth International Conference on Speech and Computers, Patras, Greece, 2005, 483-486.
16. M. Johansson, M. Blomberg, K. Elenius, L.-E. Hoffsten and A. Torberger, A phoneme recognizer for the hearing impaired. In: Proc. Of ICSLP'2002, Denver, Colorado, USA, 2002, 433-436.
17. J.M. Kates, Classification of background noises for hearing-aid applications, J Acoust Soc Am 97 (1995), 461-470.
18. H. Kjellström, O. Engwall, S. Abdou and O. Bälter, Audio-visual phoneme classification for pronunciation training applications. In: Proceedings of Interspeech, 2007.
19. H. Kjellström, O. Engwall and O. Bälter, Reconstructing Tongue Movements from Audio and Video. In: Proceedings of Interspeech, 2006.
20. B. Le Goff, Automatic Modeling of Coarticulation in Text-to-Visual Speech Synthesis. Proceedings of the 5th European Conference on Speech Communication and Technology (EUROSPEECH'97), Rhodos, Greece, 1997, 1667-1670.
21. D. Massaro, Speech Reading by Ear and Eye, Erlaub, Hillsdale, 1987.
22. L. Ma, D. Smith and B. Milner, Context Awareness using Environmental Noise Classification, in: Eurospeech (Geneva), 2003, 2237-2240.
23. P. Nordqvist, Sound Classification in Hearing Instruments, PhD Thesis, 2004.
24. P. Nordqvist and A. Leijon, An efficient robust sound classification algorithm for hearing aids, J Acoust Soc Am 115 (2004), 3033-3041.
25. P. Nordqvist and D. Huanping, Automatic classification of the telephone-listening environment in a hearing aid, J Acoust Soc Am 109 (2001), 2491.
26. S. Oberle and A. Kaelin, Recognition of acoustical alarm signals for the profoundly deaf using hidden Markov models, in: IEEE International symposium on Circuits and Systems (Hong Kong), 1995, 2285-2288.
27. G. Salvi, Truncation error and dynamics in very low latency phonetic recognition. In: ISCA workshop on Nonlinear Speech Processing, 2003.
28. G. Salvi, Dynamic behaviour of connectionist speech recognition with strong latency constraints, Speech Communication 48(7) (2006), 802-818.
29. W.H. Sumby and I. Pollack, Visual Contribution to Speech Intelligibility in Noise, J Acoust Soc Am 26 (1954), 212-215.
30. C. Siciliano, G. Williams, J. Beskow and A. Faulkner, Evaluation of a multilingual synthetic talking face as a communication aid for the hearing impaired. In: Proc. of ICPhS, 2003, 131-134.
31. J. Tchorz and B. Kollmeier, Using amplitude modulation information for sound classification, in: Psycophysics, Physiology, and Models of Hearing, T. Dau, V. Hohmann and B. Kollmeier, eds, World Scientific, Oldenburg, 1998, pp. 275-278.