Audiovisual synchrony perception for speech and music assessed using a temporal order judgment task

Neuroscience Letters

Volumn 393, Issue 1, 2006, Pages 40-44

  Vatakis, Argiro ^a   Spence, Charles ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Audition; Music; Speech; Synchrony perception; TOJ; Vision

Indexed keywords

ARTICLE; AUDIOVISUAL EQUIPMENT; AUDITORY STIMULATION; HEARING; HUMAN; MUSIC; PRIORITY JOURNAL; SPEECH; TASK PERFORMANCE; VISION;

ACOUSTIC STIMULATION; ADULT; ANALYSIS OF VARIANCE; ATTENTION; AUDITORY PERCEPTION; FEMALE; HUMANS; JUDGMENT; MALE; MUSIC; PHOTIC STIMULATION; REACTION TIME; SPEECH; TIME FACTORS; VISUAL PERCEPTION;

EID: 28544442085     PISSN: 03043940     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neulet.2005.09.032     Document Type: Article

References (32)

1. A.P. Baader, O. Kazennikov, and M. Wiesendanger Coordination of bowing and fingering in violin playing Cogn. Brain Res. 23 2005 436 443
2. L.E. Bernstein, E.T. Auer, and J.K. Moore Audiovisual speech binding: convergence or association? G.A. Calvert C. Spence B.E. Stein The Handbook of Multisensory Processing 2004 MIT Press Cambridge, MA 203 223
3. G.A. Calvert C. Spence B.E. Stein The Handbook of Multisensory Processing 2004 MIT Press Cambridge, MA
4. S. Coren, L.M. Ward, and J.T. Enns Sensation & Perception sixth ed. 2004 Harcourt Brace Fort Worth
5. N.F. Dixon, and L. Spitz The detection of auditory visual desynchrony Perception 9 1980 719 721
6. D.J. Finney Probit Analysis: Statistical Treatment of the Sigmoid Response Curve 1964 Cambridge University Press London, UK
7. K.W. Grant, V. van Wassenhove, and D. Poeppel Detection of auditory (cross-spectral) and auditory-visual (cross-modal) synchrony J. Acoust. Soc. Am. 108 2004 1197 1208
8. I.J. Hirsh, and C.E. Sherrick Jr. Perceived order in different sense modalities J. Exp. Psychol. 62 1961 424 432
9. M.P. Hollier, A.N. Rimell, An experimental investigation into multi-modal synchronisation sensitivity for perceptual model development, 105th AES Convention, 1998, Preprint No. 4790.
10. ITU-R BT.1359-1, Relative timing of sound and vision for broadcasting (Question ITU-R 35/11), 1998.
11. P. Jaśkowski Temporal-order judgement and reaction time to stimuli of different rise times Perception 22 1993 963 970
12. R.D. Kent The Speech Sciences 1997 Singular San Diego, CA
13. A.J. King Multisensory integration: strategies for synchronization Curr. Biol. 15 2005 R339 R341
14. D.W. Massaro From multisensory integration to talking heads and language learning G.A. Calvert C. Spence B.E. Stein The Handbook of Multisensory Processing 2004 MIT Press Cambridge, MA 153 176
15. V. van Wassenhove, K.W. Grant, D. Poeppel, Temporal window of integration in bimodal speech perception, J. Cogn. Neurosci., submitted for publication.
16. M.M. Murray, S. Molholm, C.M. Michel, D.J. Heslenteld, W. Ritter, D.C. Javitt, C.E. Schroeder, and J.J. Foxe Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment Cereb. Cortex 15 2005 963 974
17. J. Navarra, A. Vatakis, M. Zampini, W. Humphreys, S. Soto-Faraco, C. Spence, Exposure to asynchronous audiovisual speech extends the temporal window for audiovisual integration. Cogn. Brain Res., in press.
18. B. Reeves, D. Voelker, Effects of audio-video asynchrony on viewer's memory, evaluation of content and detection ability. Research report prepared for Pixel Instruments. Los Gatos, California, 1993.
19. S. Rihs, The influence of audio on perceived picture quality and subjective audio-visual delay tolerance, in: R. Hamberg, H. de Ridder (Eds.), Proceedings of the MOSAIC Workshop: Advanced Methods for the Evaluation of Television Picture Quality, vol. 133-137, Eindhoven, 18-19 September 1995.
20. H.M. Saldaña, and L.D. Rosenblum Visual influences on auditory pluck and bow judgments Percept. Psychophys. 54 1993 406 416
21. C. Spence, D.I. Shore, and R.M. Klein Multisensory prior entry J. Exp. Psychol.: Gen. 130 2001 799 832
22. C. Spence, and S.B. Squire Multisensory integration: maintaining the perception of synchrony Curr. Biol. 13 2003 R519 R521
23. Q. Summerfield Some preliminaries to a comprehensive account of audio-visual speech perception B. Dodd R. Campbell Hearing by Eye: The Psychology of Lip-reading 1987 LEA London 3 51
24. Q. Summerfield Lipreading and audio-visual speech perception Philos. Trans. R. Soc. Lond. B 335 1992 71 78
25. S.M. Thomas, and T.R. Jordan Contributions of oral and extraoral facial movement to visual and audiovisual speech perception J. Exp. Psychol.: Hum. Percept. Perform. 30 2004 873 888
26. J. Tuomainen, T.S. Andersen, K. Tiippana, and M. Sams Audio-visual speech is special Cognition 96 2005 B13 B22
27. K.E. Watkins, A.P. Strafella, and T. Paus Seeing and hearing speech excites the motor system involved in speech production Neuropsychologia 41 2003 989 994
28. M. Zampini, S. Guest, D.I. Shore, and C. Spence Audio-visual simultaneity judgments Percept. Psychophys. 67 2005 531 544
29. M. Zampini, D.I. Shore, and C. Spence Multisensory temporal order judgements: the role of hemispheric redundancy Int. J. Psychophys. 50 2003 165 180
30. R.J. Zatorre Neural specializations for tonal processing Ann. N. Y. Acad. Sci. 930 2001 193 210
31. R.J. Zatorre, P. Belin, and V.B. Penhune Structure and function of auditory cortex: music and speech Trends Cogn. Sci. 6 2002 37 46
32. K. Munhall, and E. Vatikiotis-Bateson Spatial and temporal constraints on audiovisual speech perception G.A. Calvert C. Spence B.E. Stein The Handbook of Multisensory Processing 2004 MIT Press Cambridge 177 188