Evaluating the influence of frame rate on the temporal aspects of audiovisual speech perception

Neuroscience Letters

Volumn 405, Issue 1-2, 2006, Pages 132-136

  Vatakis, Argiro ^a   Spence, Charles ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Audition; Frame rate; Speech; Temporal perception; Video quality; Vision

Indexed keywords

ACCURACY; ADULT; ARTICLE; AUDITORY STIMULATION; COGNITION; CONTROLLED STUDY; DECISION MAKING; FEMALE; FUNCTIONAL ASSESSMENT; HEARING; HUMAN; HUMAN EXPERIMENT; MALE; MEDICAL RESEARCH; NEUROSCIENCE; NORMAL HUMAN; PRIORITY JOURNAL; SIGNAL DETECTION; SPEECH PERCEPTION; TIME PERCEPTION; VIDEORECORDING; VISION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; FEMALE; HUMANS; JUDGMENT; MALE; PHOTIC STIMULATION; SPEECH PERCEPTION; TIME PERCEPTION; VISUAL PERCEPTION;

EID: 33746580460     PISSN: 03043940     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neulet.2006.06.041     Document Type: Article

References (35)

1. Abstract Worlds Ltd. (2006). The StrangeMaze 3D v1.1 benchmark. Retrieved on January 25th, 2006, from http://www.abstractworlds.com/Strangemaze/index. php?id=bench.
2. Anderson A., Smallwood L., MacDonald R., Mullin J., Fleming A., and O'Malley O. Video data and video links in mediated communication: what do users value?. Int. J. Hum. Comput. Stud. 52 (2000) 165-187
3. Apteker R.T., Fisher J.A., Kisimov V.S., and Neishlos H. Video acceptability and frame rate. IEEE Multimedia 2 (1995) 32-40
4. Basil M.D. Multiple resource theory. I. Application to television viewing. Commun. Res. 21 (1994) 177-207
5. Beerends J.G., and de Caluwe F.E. The influence of video quality on perceived audio quality and vice versa. J. Audio Eng. Soc. 47 (1999) 355-362
6. D. Bergmann, C. Spence, H.J. Heinze, T. Noesselt, Neural correlates of synchrony perception using audiovisual speech stimuli, 7th Annual International Multisensory Research Forum. Dublin, Ireland 17-21 June, 2006.
7. Blokland A., and Anderson A.H. Effect of low frame rate on intelligibility of speech. Speech Commun. 26 (1998) 97-103
8. Calvert G.A., Bullmore E.T., Brammer M.J., Campbell R., Williams S.C., McGuire P.K., Woodruff P.W., Iversen S.D., and David A.S. Activation of auditory cortex during silent lipreading. Science 276 (1997) 593-596
9. Conrey B.L., and Pisoni D.B. Lipreading and auditory-visual asynchrony detection. Abstracts Psychon. Soc. 9 (2004) 89
10. Coren S., Ward L.M., and Enns J.T. Sensation & Perception. sixth ed. (2004), Harcourt Brace, Fort Worth
11. Daly-Jones O., Monk A., and Watts L. Some advantages of video conferencing over high-quality audio conferencing: fluency and awareness of attentional focus. Int. J. Hum. Comput. Stud. 49 (1998) 21-58
12. de Paula H., Yehia H.C., Shiller D., Jozan G., Munhall K.G., and Vatikiotis-Bateson E. Linking production and percpetion through spatial and temporal filtering of visible speech information. Proceedings of the 6th International Seminar on Speech Production. Sydney, Australia, 7-10 December 2003 (2003) 37-42
13. R. Finger, A.W. Davis (2001), Measuring video quality in videoconferencing systems. Report SN187-D.
14. Finney D.J. Probit Analysis: Statistical Treatment of the Sigmoid Response Curve (1964), Cambridge University Press, London
15. Ghinea G., and Thomas J.P. QoS Impact on user perception and understanding of multimedia video clips. Proceedings of ACM Multimedia 1998. Bristol, UK, 13-16 September (1998) 49-54
16. Ghinea G., and Thomas J.P. Quality of perception: user quality of service in multimedia presentations. IEEE Trans. Multimedia 7 (2005) 786-789
17. Inazumi Y., Yoshida T., Sakai Y., and Horita Y. Estimation of the optimal frame rate for video communications under bit-rate constraints. Electron. Commun. Jpn. 86 (2003) 54-67
18. ITU-R BT.1359-1 (1998), Relative timing of sound and vision for broadcasting (Question ITU-R 35/11).
19. Jackson M., Anderson A.H., McEwan R., and Mullin J. Impact of video frame rate on communicative behaviour in two and four party groups. Proceedings of CSCW 2000. Philadelphia, PA, 2-6 December (2000) 11-20
20. Knoche H., de Meer H., and Kirsh D. Compensating for low frame rates. Proceedings of the Conference on Human Factors in Computing Systems (CHI 2005). Portland, Oregon, USA, 2-7 April (2005) 1553-1556
21. Macaluso E., George N., Dolan R., Spence C., and Driver J. Spatial and temporal factors during processing of audiovisual speech perception: a PET study. Neuroimage 21 (2004) 725-732
22. Mastoropoulou G., and Chalmers A. The effect of music on the perception of display rate and duration of animated sequences: an experimental study. Proceedings of Theory and Practice of Computer Graphics (TPCG 2004) (2004) 128-134
23. Nakazono K. Frame rate as a QoS parameter and its influence on speech perception. Multimedia Syst. 6 (1998) 359-366
24. Pappas T.N., and Hinds R.O. On video and audio data integration for conferencing. Proceedings SPIE: Human Vision, Visual Processing, and Digital Display VI, Vol. 2411. San Jose, CA, 6-8 February (1995) 120-127
25. Rihs S. The influence of audio on perceived picture quality and subjective audio-visual delay tolerance. In: Hamberg R., and de Ridder H. (Eds). Proceedings of the MOSAIC Workshop: Advanced Methods for the Evaluation of Television Picture Quality. Eindhoven, 18-19 September (1995) 133-137
26. Spence C., Shore D.I., and Klein R.M. Multisensory prior entry. Journal of Exp. Psychol.: Gen. 130 (2001) 799-832
27. Steinmetz R. Human perception of jitter and media synchronization. IEEE J. Selected Areas Commun. 14 (1996) 61-72
28. Tang J.C., and Isaacs E. Why do users like video? Studies of multi-media supported collaboration. Comput. Supported Cooperative Work 1 (1992) 19-34
29. Van de Par S., and Kohlrausch A. Sensitivity to auditory-visual asynchrony and to jitter in auditory-visual timing. Proceedings of SPIE conference: Human Vision and Electronic Imaging V, SPIE conference volume 3959 (2000) 234-242
30. Van Wassenhove V., Grant K.W., and Poeppel D. Visual speech speeds up the neural processing of auditory speech. Proc. Nat. Acad. Sci. 102 (2005) 1181-1186
31. Vatakis A., and Spence C. Audiovisual synchrony perception for speech and music using a temporal order judgment task. Neurosci. Lett. 393 (2006) 40-44
32. A. Vatakis, C. Spence, Crossmodal binding: evaluating the 'unity assumption' using audiovisual speech stimuli, submitted for publication.
33. Vitkovitch M., and Barber P. Effect of video frame rate on subject's ability to shadow one of two competing verbal passages. J. Speech Hear. Res. 37 (1994) 1204-1210
34. Wilson G., and Sasse M.A. Investigating the impact of audio degradations on users: subjective vs. objective assessment methods. In: Paris C., Ozkan N., Howard S., and Lu S. (Eds). Proceedings of OZCHI 2000: Interfacing Reality in the New Millenium (2000) 135-142
35. Wilson G., and Sasse M.A. Do users always know what's good for them? Utilizing physiological responses to assess media quality. In: McDonald S., Waern Y., and Cockton G. (Eds). Proceedings of HCI 2000: People and Computer XIV-Usability or else!. Sunderland, UK, 5-8 September (2000) 327-339