What can visual speech synthesis tell visual speech recognition?

Conference Record - Asilomar Conference on Signals, Systems and Computers

Volumn 1, Issue , 1994, Pages 566-571

  Cohen, Michael M ^a   Massaro, Dominic W ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH SYNTHESIS;

AUTOMATIC SPEECH RECOGNITION; HUMAN SPEECH PERCEPTION; PRODUCTION MODELS; SYNTHESIS TECHNIQUES; SYNTHETIC SPEECH; VISUAL SPEECH; VISUAL SPEECH RECOGNITION; VISUAL SPEECH SYNTHESIS;

SPEECH RECOGNITION;

EID: 33747294606     PISSN: 10586393     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACSSC.1994.471516     Document Type: Conference Paper

References (35)

1. J. Allen, M.S.HuMicutt & D.H. Klatt. From text to speech: The MlTalk system Cambridge, MA: Cam-bridgeUniversityPress, 1987.
2. C.G. Bell, H.Fuji&, J.M. Heinz t KN. Stevens. Reduction of speech spectra by analysis-by-synthesis techniques. Journal of the Acoustical Society of America, 33, S15. 1725-1736,1961.
3. C. Bregler, S. Omohundro, Y.Konig & N. Morgan. Using surfacelearning with to improve speech recognition with lipreading Proceedings of the 1994 Asi-lomar CoMerence on Signals, Systems and Computers.
4. J.S. Bridle & MP. Ralls. An approach to speech recognition using synthesis by rule. In F. Fallside and W.A. Woods@as.) ComputerSpeechProcessing London: Rentice/HallInternatid 277-292,1985.
5. HA.Bourland & N. Morgan. Connectionist Speech Recognition: A Hybrid Approach Boston: Kluwer Academic Publishers, 1994.
6. M.M.Cohen & D.W. Massaro. Modeling coarticulution In synthetic visual speech. In N.Thalmann & D. Thalmann (Eds.) Models and techniquesin computer animation,Tokyo:Springer-Verlag,139-156.1993.
7. J.S. Denton & C.R. Taylor. Final Report on Speech Recognition Research, December 1984 to April 1990 Camegie Mellon University: School of Computer Science, 1990.
8. P. Eckman & W.V. Friesen. Manualfor the Facial Action CodingSystemPaloAlto:ConsultingPsycholo-gistsPress,1977.
9. N.P.Erber & C.L. De Filippo. Voice-mouth synthesis of /pa, ba, ma/. Journal of the Acoustical Sociefy of America, 64,1015-1019.1978.
10. G. Fant. TheAcoustic Theory of Speech Production. The Hague: Mouton & CO,1960.
11. G. Fant 8t I. Martony. Instrumentation for parametric synthesis (OVE-II). KTH Speech Transmission Laboratory: Quarterly Progress and StatusReport,2/3,18-19.1962.
12. K.E.Finn. An Investigation of Visiblet i p Information to be Used in Automated Speech Recognition Ph.D. thesis, Georgetown University, 1986.
13. JL. Flanagan, K. bhizaka & KL. Shipley. Synthesis of speech from a dynamic model of the vocal cords and vocal tract. Bell System TechnologyJour-nal.54.485-506.1975.
14. AJ. Goldschen. Continuous Automatic Speech Recognition by Lipreading, Ph.D. thesis, George WashingtonUniversity, 1993.
15. D.H. Klatt. Softwarefor a cascade/parallel formant synthesizer. Journal 4 the Acoustical Society of America,67,971-995.1980
16. D.H. Klatt. Review of text-bspeech conversion for english. Journal of the Acoustical Society of America, 82,737-793,1987.
17. D.H. matt. Review of selected models of speech perception. In W. MarslewWilson (Ed.) Lexical Representation and Process, Cambridge, MA: MIT Press, 169-226,1989.
18. A.M. Liberman & I.G. Mattingly. The motor theory of speech perception revised. Cognition, 21, 1-36, 1986.
19. A. Liifqvist. Speech as audible gestures. In WJ. Hardcastle and A. Marchal (Eds.) Speech Production and Speech Modeling. Dordmht: Kluwer Academic Publishers,289-322.1990.
20. D.W. Massaro. Speech Perception by Ear and Eye: A Paradigmfor Psychological Inquiry, Hillsdale, NJ: Lawrence Erlbaum Associates,1987.
21. D.W.Massaro & M.M. Cohen. Categorical or continuous speech perception: A new test. Speech Communication,2.15-35,1983.
22. A.A. Montgomery. Development of a model for generating synthetic animated lip shapes. Journal of the Acoustical Sociefy of America, 68, S58 (abstract), 1980.
23. 1231 A. Newell. Harpy, production systems, and human cognition. In R. Cole (Ed.) Perception and Production of Fluent Speech, Hillsdale, NJ: Lawrence Earlbaum Associates, 1979.
24. K.K. Paliwal& P.S.V. Rao. Synthais-based recognition of continuousspeech. Journal of the Acoustical Society ofAmerica, 71.1016-1024,1982.
25. F.I. Parke. A parametric model for human faces, Tech. Report UTEC-CSc-75-047 Salt Lake City: University of Utah, 1974.
26. A. Pearce. B. Wyvill, G. Wyvill. & D. Hill. Speech and expression: A computer solution to face animation. GraphicsInterface '86,1986.
27. J. Perkell. Models, theory, and data in speech production. Proc. of the 12th In?. Congress of Phonetic Sciences, Aix-en-Provence, France, 19-24 August, 1991.
28. S.M. Platt & N.I. Badlet. Animating Facial EXPRS-sions. Computer Graphics,15(3), 245-252,1981.
29. K.N. Stevens. Toward a model for speech recognition. Journal of the Acoustical Sociery of America, 32, s15. 47-55,"
30. KN. Stevens. Speech synthesismethods: Homage to Dennis Klatt. In G. Bailly, C.Benoit, & TR. Sawallis, @Is.) Talking machines: Theories, Models, and Dedgns Amsterdam: North Holland,485504,1992.
31. KN. Stevens & M.W e . Remarks on analysis by synthesisand distinctivefeatures. In W. Wathen-Dunn (Ed) Proceedings of the AFCRL Symposium on Modelsfor the Perception of Speech and VisualForm, Cambridge, MA: MIT Press, 1964.
32. D.Tempoulous & K. Waters.Techniquesfor realistic facial modeling and animation. in N.M.Thalmann and D.Thalmann (Eds.) Computer Animation '91Tokyo:Springer-Verlag,1991.
33. K. Waters & D. Taopoulous. A physical model of facial tissue and muscle articulation. SIGGRAPH Facial Animation CourseNotes, 130-145.1990.
34. B.P. Yuhas, M.H. Goldstein, & T.J. Sejnowski. Integration of acoustic and visual speech signals using n e d networks, IEEE CommunicationsMagazine, 65 - 71,1989.
35. V. Zue. Models of speech recognition IE The role of analysis by synthesis in phonetic recognition. In P. Mermelstein (Ed.) Proceedings of the Montreal Satellite S y " on Speech Recognition (Tweyth International Conferenceon Acoustics), 1986.