Computational aspects of visual speech: Machines that can speechread and simulate talking faces

Hearing Eye II: Advances in the Psychology of Speechreading and Auditory-Visual Speech

Volumn , Issue , 2013, Pages 109-122

  Brooke, N Michael ^a  

^a University of Bath   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0039891027     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203098752-13     Document Type: Chapter

References (37)

1. Adjoudani, A. & Benoît, C. (1996). On the integration of auditory and visual parameters in an HMM-based ASR. In D.G. Stork & M.E. Hennecke (Eds), Speechreading by Humans and Machines. Berlin: Springer, 461-72.
2. Benoît, C, Lallouache, T., Mohamadi, T., & Abry, C. (1992). A set of French visemes for speech synthesis. In G. Bailly, C. Benoit, & T.R. Sawallis (Eds.), Talking machines: Theories, models and designs (pp. 485-504). Amsterdam: Elsevier.
3. Blake, A. & Isard, M. (1994). 3D position, attitude and shape input using video tracking of hands and lips. Computer Graphics Proceedings, Annual Conference Series (ACM), 185-92.
4. Bregler, C. & Omohundro, S. (1994). Surface learning with applications to lip reading. International Computer Science Institute Report TR-94-001. Berkeley, California.
5. Brooke, N.M. (1992a). Computer graphics animations of speech production. Advances in Language, Speech and Hearing, Volume 2. London: JA1 Press, 87-134.
6. Brooke, N.M. (1992b). Computer graphics synthesis of talking faces. In Bailly, G., Benoit, C. & Sawallis, T.R. (Eds), Talking Machines: Theories, Models and Designs. Amsterdam: Elsevier, 504-22.
7. Brooke, N.M. (1996). Talking heads and speech recognisers that can see: the computer processing of visual speech signals. In D.G. Stork & M.E. Hennecke (Eds), Speechreading by Humans and Machines. Berlin: Springer, 351-73
8. Brooke, N.M. & Scott, S.D. (1994a). Animated computer graphics of talking faces based on stochastic models. Proceedings of the International Symposium on Speech, Image-processing and Neural Networks, Hong Kong (IEEE), 73-6.
9. Brooke, N.M. & Scott, S.D. (1994b). PCA image coding schemes and visual speech intelligibility. Proceedings of the Institute of Acoustics (Autumn Meeting, Windermere), 16(5), 123-9.
10. Brooke, N.M. & Summerfield, A.Q. (1983). Analysis, synthesis and perception of visible articulatory movements. Journal of Phonetics, 11, 63-76.
11. Brooke, N.M. & Templeton, P.D. (1990). Visual speech intelligibility of digitally processed facial images. Proceedings of the Institute of Acoustics (Autumn Meeting, Windermere), 12(10), 483-90.
12. Brooke, N.M., Tomlinson, M.J. & Moore, R.K. (1994). Automatic speech recognition that includes visual speech cues. Proceedings of the Institute of Acoustics (Autumn Meeting, Windermere), 16(5), 15-22.
13. Chatfield, C. & Collins, A.J. (1980). Introduction to Multivariate Analysis. London: Chapman & Hall.
14. Cohen, M.M. & Massaro, D.W. (1993). Modeling coarticulation in synthetic visual speech. In Thalmann, N.M. & Thalmann, D. (Eds), Computer Animation, 93, Tokyo: Springer-Verlag, Berlin, 139-56.
15. Ekman, P. (1979). About brows: emotional and conversational signals. In von Cranach, M., Foppa, K., Lepenies, W. & Ploog, D. (Eds), Human Ethology. Cambridge: Cambridge University Press, 169-202.
16. Elman, J.L. & Zipser, D. (1986). Learning the hidden structure of speech. Journal of the Acoustical Society of America, 83, 1615-26.
17. Finn, K.I. (1986). An investigation of visible lip information to be used in automatic speech recognition. PhD. Thesis. Washington D.C.: Georgetown University.
18. Hennecke, M.E., Stork, D.G. & Prasad, K.V. (1996). Visionary Speech: looking ahead to practical speechreading systems. In D.G. Stork & M.E. Hennecke (Eds), Speechreading by Humans and Machines. Berlin: Springer, 331-50.
19. Lavagetto, F. & Lavagetto, P. (1996). Time delay neural networks for articulatory estimation from speech: suitable subjective evaluation protocols. In D.G. Stork & M.E. Hennecke (Eds), Speechreading by Humans and Machines. Berlin: Springer, 437-44.
20. MacLeod, A. & Summerfield, A.Q. (1987). Quantifying the contribution of vision to speech perception in noise. British Journal of Audiology, 21, 131-41.
21. Massaro, D.W. (1996). Bimodal speech perception: a progress report. In D.G. Stork & M.E. Hennecke (Eds), Speechreading by Humans and Machines. Berlin: Springer, 79-102.
22. Movellan, J.R. (1995). Visual speech recognition with stochastic networks. In Tesauro, G., Touretzky, D. & Leen, T. (Eds,), Advances in neural information processing systems, (7). Cambridge, Mass.: MIT Press, 851-8.
23. Nishida, S. (1986). Speech recognition enhancement by lip information. Proceedings of CHI86 (ACM), 198-204.
24. Parke, F.I. (1975). Parametrized models for facial animation. IEEE Computer Graphics and Applications, 2, 61-8.
25. Peeling, S.M., Moore R.K. & Tomlinson, M.J. (1986). The multilayer perceptron as a tool for speech pattern processing research. Proceedings of the Institute of Acoustics (Autumn Meeting, Windermere), 8(7), 307-14.
26. Petajan, E.D. (1984). Automatic lipreading to enhance speech recognition. Proceedings of the Global Telecommunications Conference, Atlanta, Georgia (IEEE Communication Society), 265-72
27. Rabiner, L.R. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77, 257-86.
28. Robert-Ribes, J., Piquemal, M., Schwartz, J-L. & Escudier, P. (1996). Exploiting sensor fusion architectures and stimuli complementarity in AV speech recognition. In D.G. Stork & M.E. Hennecke (Eds), Speechreading by Humans and Machines. Berlin: Springer, 193-210.
29. Sejnowski, T.J., Yuhas, B P., Goldstein, M.H. & Jenkins, R E. (1990). Combining visual and acoustic speech signals with a neural network improves intelligibility. In Touretzky, D.S. (Ed.), Advances in Neural Information Processing Systems (2). San Mateo, California: Morgan-Kaufman Publishers.
30. Simons, A.D. & Cox, S.J. (1990). Generation of mouthshapes for a synthetic talking head. Proceedings of the Institute of Acoustics (Autumn Meeting, Windermere), 12(10), 475-82.
31. Stork, D.G. & Hennecke, M.E. (Eds) (1996). Speechreading by Humans and Machines. Berlin: Springer.
32. Stork, D.G., Wolff, G. & Levine, E. (1992). Neural network lipreading system for improved speech recognition. Proceedings of the International Joint Conference on Neural Networks, Baltimore (IEEE), 2, 285-95.
33. Summerfield, A.Q. (1987). Some preliminaries to a comprehensive account of audio-visual speech perception. In Campbell, R. & Dodd, B. (Eds), Hearing by Eye: The Psychology of Lipreading. Hove, UK: Lawrence Erlbaum Associates Ltd.
34. Summerfield, A.Q. (1991). Visual perception of phonetic gestures. In Mattingley, I.G. & Studdert-Kennedy, M. (Eds), Modularity and the Motor Theory of Speech Perception. Hillsdale, NJ: Lawrence Erlbaum Associates, 117-38.
35. Terzopoulos, D. & Waters, K. (1990). Physically-based facial modelling, analysis and animation. Journal of Visualisation and Computer Animation, I, 73-80.
36. Tomlinson, M.J., Russell, M.J. & Brooke, N.M. (1996). Integrating audio and visual information to provide highly robust speech recognition. Proceedings of ICASSP, Atlanta, Georgia (IEEE), 821-1.
37. Turk, M. & Pentland, A. (1991). Eigenfaces for recognition. Journal of Cognitive Neuroscience, 3, 71-86.