Lip-reading enhancement for law enforcement

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 6402, Issue , 2006, Pages

  Theobald, Barry J ^a   Harvey, Richard ^a   Cox, Stephen J ^a   Lewis, Colin ^b   Owen, Gari P ^b  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^b MINISTRY OF DEFENCE   (United Kingdom)

Author keywords

Appearance models; Computer vision; Law enforcement; Lip reading

Indexed keywords

BIT ERROR RATE; COMPUTER VISION; IMAGE ENHANCEMENT; LAW ENFORCEMENT; MATHEMATICAL MODELS; MILITARY APPLICATIONS; VIDEO SIGNAL PROCESSING;

APPEARANCE MODELS; COUNTER-TERRORISM; LIP-READING; VISUAL MODELLING;

SPEECH RECOGNITION;

EID: 33846996385     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.689960     Document Type: Conference Paper

References (21)

1. H. McGurk and J. MacDonald, "Hearing lips and seeing voices," Nature 264, pp. 746-748, 1976.
2. C. Benoît, T. Guiard-Marigny, B. Le Goff, and A. Adjoudani, "Which components of the face do humans and machines best speechread," in Speechreading by Humans and Machines: Models, Systems and Applications, D. Stork and M. Hennecke, eds., NATO ASI Series F: Computer and Systems Sciences 150, pp. 315-328, Springer-Verlag, Berlin, 1996.
3. N. Erber, "Auditory-visual perception of speech," Journal of Speech and Hearing Disorders 40, pp. 481-492, 1975.
4. A. MacLeod and Q. Summerfield, "Quantifying the contribution of vision to speech perception in noise," British Journal of Audiology 21, pp. 131-141, 1987.
5. K. Neely, "Effect of visual factors on the intelligibility of speech," Journal of the Acoustical Society of America 28, pp. 1275-1277, November 1956.
6. J. O'Neill, "Contributions of the visual components of oral symbols to speech comprehension," Journal of Speech and Hearing Disorders 19, pp. 429-439, 1954.
7. W. Sumby and I. Pollack, "Visual contribution to speech intelligibility in noise," Journal of the Acoustical Society of America 26, pp. 212-215, March 1954.
8. D. Reisberg, J. McLean, and A. Goldfield, "Easy to hear but hard to understand: A lip-reading advantage with intact auditory stimuli," pp. 97-113, Lawrence Erlbaum Associates Ltd., London, 1987.
9. R. Kent and F. Minifie, "Coarticulation in recent speech production," Journal of Phonetics 5, pp. 115-133, 1977.
10. P. Ladefoged, A Course in Phonetics, Harcourt Brace Jovanovish Publishers, 1982.
11. M. McGrath, Q. Summerfield, and M. Brooke, "Roles of the lips in lipreading vowels," Proceedings of the Institute of Acoustics 6, pp. 401-408, 1984.
12. P. Bull, "Body movement and emphasis in speech," Journal of Nonverbal Behavior 9(3), pp. 169-187, 1985.
13. J. Cassell, H. Vihjalmsson, and T. Bickmore, "BEAT: The behavior expression animation toolkit," in Proceedings of SIGGRAPH, pp. 477-486, (Los Angeles, California), 2001.
14. H. Graf, E. Cosatto, V. Strom, and F. Huang, "Visual prosody: Facial movements accompanying speech," in Proceedings International Conference on Automatic Face and Gesture Recognition, 2002.
15. T. Kuratate, K. Munhall, P. Rubin, E. Vatikiotis-Bateson, and H. Yehia, "Audio-visual synthesis of talking faces from speech production correlates," in Proceedings of Euro speech, 3, pp. 1279-1282, (Budapest, Hungary), 1999.
16. C. Pelachaud, Communication and Coarticulation in Facial Animation. PhD thesis, The Institute for Research in Cognitive Science, University of Pennsylania, 1991.
17. P. Ekman, Emotions in the Human Face, Pergamon Press Inc., 1972.
18. T. Cootes, G. Edwards, and C. Taylor, "Active appearance models," IEEE Transactions on Pattern Analysis and Machine Intelligence 23, pp. 681-685, June 2001.
19. I. Matthews and S. Baker, "Active appearance models revisited," International Journal of Computer Vision 60, pp. 135-164, November 2004.
20. A. Boothroyd and S. Nittrouer, "Mathematical treatment of context effects in phoneme and word recognition.," J Acoust Soc Am 84(1), pp. 101-14, 1988.
21. B. Theobald, Visual Speech Synthesis Using Shape and Appearance Models. PhD thesis, University of East Anglia, Norwich, UK, 2003.