A comparison of active shape model and scale decomposition based features for visual speech recognition

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 1407, Issue , 1998, Pages 514-528

  Matthews, Iain ^a   Bangham, Andrew ^a   Harvey, Richard ^a   Cox, Stephen ^a  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; MATHEMATICAL MORPHOLOGY; MEDIAN FILTERS;

ACTIVE SHAPE MODEL; ACTIVE SHAPE MODELS; IMAGE DATA; LIPREADING; MEDIAN FILTERING; RECOGNITION ACCURACY; SPATIAL ANALYSIS; VISUAL SPEECH RECOGNITION;

SPEECH RECOGNITION;

EID: 84957810405     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/BFb0054762     Document Type: Conference Paper

References (42)

1. A. Adjoudani and C. Benoît. On the Integration of Auditory and Visual Parameters in an HMM-based ASR, pages 461-471. In Stork and Hennecke [38], 1996.
2. J. A. Bangham, T. G. Campbell, and R. V. Aldridge. Multiscale median and morphological filters used for 2d pattern recognition. Signal Processing, 38:387-415, 1994.
3. J. A. Bangham, P. Chardaire, C. J. Pye, and P. Ling. Mulitscale nonlinear decomposition: The sieve decomposition theorem. IEEE Trans. Pattern Analysis and Machine Intelligence, 18(5):529-539, 1996.
4. J. A. Bangham, R. Harvey, P. Ling, and R. V. Aldridge. Morphological scalespace preserving transforms in many dimensions. Journal of Electronic Imaging, 5(3):283-299, July 1996.
5. J. A. Bangham, R. Harvey, P. Ling, and R. V. Aldridge. Nonlinear scale-space from n-dimensional sieves. Proc. European Conference on Computer Vision, 1:189-198, 1996.
6. J. A. Bangham, P. Ling, and R. Young. Mulitscale recursive medians, scale-space and transforms with applications to image processing. IEEE Trans. Image Processing, 5(6):1043-1048, 1996.
7. C. Benoît and R. Campbell, editors. Proceedings of the ESCA Workshop on Audio- Visual Speech Processing, Rhodes, Sept. 1997.
8. A. Bosson, R. Harvey, and J. A. Bangham. Robustness of scale space filters. In BMVC, volume 1, pages 11-21, 1997.
9. C. Bregler and S. M. Omohundro. Learning visual models for lipreading. In M. Shah and R. Jain, editors, Motion-Based Recognition, volume 9 of Computational Imaging and Vision, chapter 13, pages 301-320. Kluwer Academic, 1997.
10. C. Bregler, S. M. Omohundro, and J. Shi. Towards a Robust Speechreading Dialog System, pages 409-423. In Stork and Hennecke [38], 1996.
11. N. M. Brooke, M. J. Tomlinson, and R. K. Moore. Automatic speech recognition that includes visual speech cues. Proc. Institute of Acoustics, 16(5):15-22, 1994.
12. C. C. Chibelushi, S. Gandon, J. S. D. Mason, F. Deravi, and R. D. Johnston. Desing issues for a digital audio-visual integrated database. In IEE Colloquium on Integrated Audio-Visual Processing, number 1996/213, pages 7/1-7/7, Savoy Place, London, Nov. 1996.
13. T. Coianiz, L. Torresani, and B. Caprile. 2D Deformable Models for Visual Speech Analysis, pages 391-398. In Stork and Hennecke [38], 1996.
14. T. F. Cootes, A. Hill, C. J. Taylor, and J. Haslam. The use of active shape models for locating structures in medical images. Image and Vision Computing, 12(6):355-366, 1994.
15. P. Cosi and E. M. Caldognetto. Lips and Jaw Movements for Vowels and Consonants: Spatio- Temporal Characteristics and Bimodal Recognition Applications, pages 291-313. In Stork and Hennecke [38], 1996.
16. S. Cox, I. Matthews, and A. Bangham. Combining noise compensation with visual information in speech recognition. In Benoît and Campbell [7], pages 53-56.
17. N. P. Erber. Interaction of audition and vision in the recognition of oral speech stimuli. Journal of Speech and Hearing Research, 12:423-425, 1969.
18. A. J. Goldschen. Continuous Automatic Speech Recognition by Lipreading. PhD thesis, George Washington University, 1993.
19. R. Harvey, I. Matthews, J. A. Bangham, and S. Cox. Lip reading from scale-space measurements. In Proc. Computer Vision and Pattern Recognition, pages 582-587, Puerto Rico, June 1997. IEEE.
20. H. J. A. M. Heijmans, P. Nacken, A. Toet, and L. Vincent. Graph morphology. Journal of Visual Computing and Image Representation, 3(1):24-38, March 1992.
21. M. E. Hennecke, D. G. Stork, and K. V. Prasad. Visionary Speech: Looking Ahead to Practical Speechreading Systems, pages 331-349. In Stork and Hennecke [38], 1996.
22. A. Hill and C. J. Taylor. Automatic landmark generation for point distribution models. In Proc. British Machine Vision Conference, 1994.
23. R. Kaucic, B. Dalton, and A. Blake. Real-time lip tracking for audio-visual speech recognition applications. In Proc. European Conference on Computer Vision, volume II, pages 376-387, 1996.
24. P. K. Kuhl and A. N. Meltzoff. The bimodal perception of speech in infancy. Science, 218:1138-1141, Dec. 1982.
25. S. E. Levinson, L. R. Rabiner, and M. M. Sondhi. An introduction to the application of the theory of probabilistic functions of a markov process to automatic speech recognition. The Bell System Technical Journal, 62(4):1035-1074, Apr. 1983.
26. J. Luettin. Towards speaker independent continuous speechreading. In Proc. of the European Conference on Speech Communication and Technology, 1997.
27. J. Luettin. Visual Speech and Speaker Recognition. PhD thesis, University of Sheffield, May 1997.
28. K. Mase and A. Pentland. Automatic lipreading by optical-flow analysis. Systems and Computers in Japan, 22(6):67-75, 1991.
29. I. Matthews, J. A. Bangham, and S. Cox. Scale based features for audiovisual speech recognition. In IEE Colloquium on Integrated Audio-Visual Processing, number 1996/213, pages 8/1-8/7, Savoy Place, London, Nov. 1996.
30. H. McGurk and J. McDonald. Hearing lips and seeing voices. Nature, 264:746-748, Dec. 1976.
31. U. Meier, R. Stiefelhagen, and J. Yang. Preprocessing of visual speech under real world conditions. In Benoît and Campbell [7], pages 113-116.
32. J. R. Movellan. Visual speech recognition with stochastic networks. In G. Tesauro, D. Touretzky, and T. Leen, editors, Advances in Neural Information Processing Systems, volume 7, 1995.
33. K. K. Neely. Effect of visual factors on the intelligibility of speech. Journal of the Acoustical Society of America, 28(6):1275-1277, Nov. 1956.
34. J. A. Nelder and R. Mead. A simplex method for function minimisation. Computing Journal, 7(4):308-313, 1965.
35. E. D. Petajan. Automatic Lipreading to Enhance Speech Recognition. PhD thesis, University of Illinois, Urbana-Champaign, 1984.
36. G. Potamianos, Cosatto, H. P. Graf, and D. B. Roe. Speaker independent audiovisual database for bimodal ASR. In Benoît and Campbell [7], pages 65-68.
37. P. L. Silsbee. Computer Lipreading for Improved Accuracy in Automatic Speech Recognition. PhD thesis, The University of Texas, Austin, Dec. 1993.
38. D. G. Stork and M. E. Hennecke, editors. Speechreading by Humans and Machines: Models, Systems and Applications. NATO ASI Series F: Computer and Systems Sciences. Springer-Verlag, Berlin, 1996.
39. W. H. Sumby and I. Pollack. Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26(2):212-215, Mar. 1954.
40. Q. Summerfield. Some preliminaries to a comprehensive account of andio-visual speech perception. In B. Dodd and R. Campbell, editors, Hearing by Eye: The Psychology of Lip-reading, pages 3-51. Lawrence Erlbaum Associates, London, 1987.
41. S. Young, J. Jansen, J. Odell, D. Ollason, and P. Woodland. The HTK Book. Cambridge University, 1996.
42. B. P. Yuhas, M. H. Goldstein Jr., and T. J. Sejnowski. Integration of acoustic and visual speech signals using neural networks. IEEE Communications Magazine, 27:65-71, 1989.