Perceptually motivated guidelines for voice synchronization in film

ACM Transactions on Applied Perception

Volumn 7, Issue 4, 2010, Pages

  Carte, Relizabeth J ^a   Sharan, Lavanya ^b   Trutoiu, Laura ^a   Matthews, Iain ^b   Hodgins, Jessica K ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b DISNEY RESEARCH   (United States)

Author keywords

Auditory perceptual research; Human perception and performance; Multisensory perception and integration; Visual psychophysics

Indexed keywords

HUMAN PERCEPTION; MULTISENSORY; MULTISENSORY PERCEPTION AND INTEGRATION; VISUAL PSYCHOPHYSICS;

CUSTOMER SATISFACTION; MOTION PICTURE THEATERS; PHYSICS; PSYCHOPHYSIOLOGY; TOTAL QUALITY MANAGEMENT; VISUAL COMMUNICATION;

SYNCHRONIZATION;

EID: 77955210600     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/1823738.1823741     Document Type: Conference Paper

References (24)

1. ABELIN, A. 2007. Emotional McGurk effect-An experiment. In Proceedings of the 7th International Conference on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems.
2. BRAINARD, D. H. 1997. The psychophysics toolbox. Spatial Vis. 10, 433-436.
3. CHION, M. 1994. Audio-Vision: Sound on Screen. Columbia University Press.
4. DIXON, N. F. AND SPITZ, L. 1980. The detection of auditory visual desynchrony. Percep. 9, 719-721.
5. EKMAN, P., FRIESEN, W. V., AND ELLSWORTH, P. 1972. Emotion in the Human Face: Guidelines for Research and an Integration ofFindings. Pergamon Press.
6. GAROFOLO, J., LAMEL, L., FISHER, W., FISCUS, F., PALLETT, D., AND DAHLGREN, N. 1993. Darpa timit acoustic-phonetic continuous speech corpus. Published on CD-ROM: NIST Speech Disc 1-1.1, Oct. 1990 NISTIR 4930, National Institute of Standards and Technology, Gaithersburg, MD.
7. GRANT, K. W. AND GREENBERG, S. 2001. Speech intelligibility derived from asynchronous processing of auditory-visual information. In Proceedings of the Auditory-Visual Speech Processing Conference.
8. GRANT, K. W., VAN WASSENHOVE, V., AND POEPPEL, D. 2003. Discriminatory of auditory-visual synchrony. In Proceedings of the Auditory-Visual Speech Processing Conference.
9. HUANG, E., SISK, J., KIRK, T., CORYELL, G., AND STEWART, J. 2007. Searching for an ideal live video streaming technology. http://www.iupui.edu/- nmstream/live/introduction.php.
10. LASS, N. J. AND HARVEY, L. A. 1976. An investigation of speaker photograph identification. J. Acoust. Soc. Amer. 59, 1232-1236.
11. MASON, A. AND SALMON, R. 2008. Factors affecting perception of audio-video synchronization in television. In Proceedings of the Audio Engineering Society Convention. Audio Engineering Society.
12. MCGURK, H. AND MACDONALD, J. 1976. Hearing lips and seeing voices. Nature 264, 746-748.
13. MUNHALL, K. G., GRIBBLE, P., SACCO, L., AND WARD, M. 1996. Temporal constraints on the McGurk effect. Percept. Psychophys. 58, 351-362.
14. PELLI, D. G. 1997. The videotoolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vis. 10, 437-442.
15. PHILLIPS, G. 2010. Personal communication.
16. SAKAMOTO, S., TANAKA, A., TSUMURA, K., AND SUZUKI, Y. 2007. Effect of speed difference between time-expanded speech and talker's moving image on word or sentence intelligibility. In Proceedings of the Auditory-Visual Speech Processing Conference.
17. SPILL, H. 2010. Personal communication.
18. SUMBY, W. H. AND POLLACK, I. 1954. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Amer. 26, 212-215.
19. SUMMERFIELD, Q. 1987. Some Preliminaries to a Comprehensive Account of Audio-Visual Speech Perception.Lawrence Erlbaum Associates, London.
20. SUMMERFIELD, Q. 1992. Lip reading and audio-visual speech perception. Philosoph. Trans. Biol. Sci. 335, 1273, 71-78.
21. THEOBALD, B.-J., BANGHAM, A., MATTHEWS, I., AND CAWLEY, G. 2003. Evaluation of a talking head based on appearance models. In Proceedings of the 7th International Conference on Audio Visual Speech Processing.
22. TINWELL, A. AND GRIMSHAW, M. 2009. Survival horror games: An uncanny modality. In Thinking After Dark.
23. TUCKMAN, J., CHRISAFIS, A., HOOPER, J., WATTS, J., SMEE, J., AND RAMESH, R. 2006. To dub you have to be as good an actor. Or better. http://www.guardian. co.uk/film/2006/nov/03/3.
24. VAN WASSENHOVE, V., GRANT, K. W., AND POEPPEL, D. 2007. Temporal window of integration in bimodal speech. Neuropsychologica 45, 3, 598-607.