A Psychophysical Investigation of Differences between Synchrony and Temporal Order Judgments

PLoS ONE

Volumn 8, Issue 1, 2013, Pages

  Love, Scott A ^a,b   Petrini, Karin ^c   Cheng, Adam ^a   Pollick, Frank E ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

^b INDIANA UNIVERSITY   (United States)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; AUDITORY DISCRIMINATION; AUDITORY STIMULATION; CUE ONSET ASYNCHRONY; DECISION MAKING; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; MENTAL FUNCTION; NORMAL HUMAN; PSYCHOPHYSIOLOGY; SENSORIMOTOR INTEGRATION; STIMULUS RESPONSE; SYNCHRONY JUDGMENT; TASK PERFORMANCE; TEMPORAL ORDER JUDGMENT; VIDEORECORDING; VISUAL DISCRIMINATION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ADULT; AUDITORY PERCEPTION; CUES; FEMALE; HUMANS; JUDGMENT; MALE; PHOTIC STIMULATION; TIME FACTORS; TIME PERCEPTION; VISUAL PERCEPTION; YOUNG ADULT;

EID: 84872665215     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0054798     Document Type: Article

References (47)

1. Stein BE, Meredith MA (1993) The Merging of the Senses. Cambridge, MA: MIT Press. 224 p.
2. Van Eijk RLJ, Kohlrausch A, Juola JF, Van De Par S, (2008) Audiovisual synchrony and temporal order judgments: effects of experimental method and stimulus type. Perception & psychophysics 70: 955-68 doi:10.3758/PP.70.6.955.
3. Fujisaki W, Nishida S, (2009) Audio-tactile superiority over visuo-tactile and audio-visual combinations in the temporal resolution of synchrony perception. Experimental brain research 198: 245-59 doi:10.1007/s00221-009-1870-x.
4. Fujisaki W, Nishida S, (2007) Feature-based processing of audio-visual synchrony perception revealed by random pulse trains. Vision research 47: 1075-93 doi:10.1016/j.visres.2007.01.021.
5. Hirsh IJ, (1959) Auditory Perception of Temporal Order. The Journal of the Acoustical Society of America 31: 759 doi:10.1121/1.1907782.
6. Allan LG, (1975) The relationship between judgments of successiveness and judgments of order. Perception & Psychophysics 18: 29-36 doi:10.3758/BF03199363.
7. Maier JX, Luca M Di, Noppeney U, (2011) Audiovisual asynchrony detection in human speech. Journal of experimental psychology. Human perception and performance 37: 245-256 doi:10.1037/a0019952.
8. Petrini K, Holt SP, Pollick FE, (2010) Expertise with multisensory events eliminates the effect of biological motion rotation on audiovisual synchrony perception. Journal of Vision 10(5): 1-14 doi:10.1167/10.5.2.
9. Vatakis A, Navarra J, Soto-Faraco S, Spence C, (2008) Audiovisual temporal adaptation of speech: temporal order versus simultaneity judgments. Experimental brain research 185: 521-9 doi:10.1007/s00221-007-1168-9.
10. Vroomen J, Stekelenburg JJ, (2011) Perception of intersensory synchrony in audiovisual speech: not that special. Cognition 118: 75-83 doi:10.1016/j.cognition.2010.10.002.
11. Chandrasekaran C, Trubanova A, Stillittano S, Caplier A, Ghazanfar AA, (2009) The natural statistics of audiovisual speech. PLoS computational biology 5: e1000436 doi:10.1371/journal.pcbi.1000436.
12. Sams M, Aulanko R, Hämäläinen M, Hari R, Lounasmaa OV, et al. (1991) Seeing speech: visual information from lip movements modifies activity in the human auditory cortex. Neuroscience letters 127: 141-5.
13. Schroeder CE, Lakatos P, Kajikawa Y, Partan S, Puce A, (2008) Neuronal oscillations and visual amplification of speech. Trends in cognitive sciences 12: 106-13 doi:10.1016/j.tics.2008.01.002.
14. Van Wassenhove V, Grant KW, Poeppel D, (2005) Visual speech speeds up the neural processing of auditory speech. Proceedings of the National Academy of Sciences of the United States of America 102: 1181-6 doi:10.1073/pnas.0408949102.
15. Dixon NF, Spitz L, (1980) The detection of auditory visual desynchrony. Perception 9: 719-21.
16. Vatakis A, Spence C, (2006) Audiovisual synchrony perception for music, speech, and object actions. Brain research 1111: 134-42 doi:10.1016/j.brainres.2006.05.078.
17. Soto-Faraco S, Alsius A, (2009) Deconstructing the McGurk-MacDonald illusion. Journal of experimental psychology. Human perception and performance 35: 580-7 doi:10.1037/a0013483.
18. Soto-Faraco S, Alsius A, (2007) Conscious access to the unisensory components of a cross-modal illusion. Neuroreport 18: 347-50 doi:10.1097/WNR.0b013e32801776f9.
19. Bertelson P, Aschersleben G, (2003) Temporal ventriloquism: crossmodal interaction on the time dimension 1. Evidence from auditory-visual temporal order judgment. International Journal of Psychophysiology 50: 147-155 doi:10.1016/S0167-8760(03)00130-2.
20. Boenke LT, Deliano M, Ohl FW, (2009) Stimulus duration influences perceived simultaneity in audiovisual temporal-order judgment. Experimental brain research 198: 233-44 doi:10.1007/s00221-009-1917-z.
21. Koppen C, Spence C, (2007) Audiovisual asynchrony modulates the Colavita visual dominance effect. Brain research 1186: 224-32 doi:10.1016/j.brainres.2007.09.076.
22. Santangelo V, Spence C, (2009) Crossmodal exogenous orienting improves the accuracy of temporal order judgments. Experimental brain research 194: 577-86 doi:10.1007/s00221-009-1734-4.
23. Van der Burg E, Olivers CNL, Bronkhorst AW, Theeuwes J, (2008) Audiovisual events capture attention: evidence from temporal order judgments. Journal of vision 8: 1-10 doi:10.1167/8.5.2.
24. Zampini M, Shore DI, Spence C, (2003) Multisensory temporal order judgments: the role of hemispheric redundancy. International Journal of Psychophysiology 50: 165-180 doi:10.1016/S0167-8760(03)00132-6.
25. Zampini M, Shore DI, Spence C, (2003) Audiovisual temporal order judgments. Experimental brain research 152: 198-210 doi:10.1007/s00221-003-1536-z.
26. Vatakis A, Bayliss L, Zampini M, Spence C, (2007) The influence of synchronous audiovisual distractors on audiovisual temporal order judgments. Perception & psychophysics 69: 298-309.
27. Spence C, Shore DI, Klein RM, (2001) Multisensory prior entry. Journal of Experimental Psychology: General 130: 799-832 doi:10.1037/0096-3445.130.4.799.
28. Alais D, Cass J, (2010) Multisensory Perceptual Learning of Temporal Order: Audiovisual Learning Transfers to Vision but Not Audition. PLoS ONE 5: e11283 doi:10.1371/journal.pone.0011283.
29. Stone JV, Hunkin NM, Porrill J, Wood R, Keeler V, et al. (2001) When is now? Perception of simultaneity. Proceedings. Biological sciences/The Royal Society 268: 31-38 doi:10.1098/rspb.2000.1326.
30. Van Wassenhove V, Grant KW, Poeppel D, (2007) Temporal window of integration in auditory-visual speech perception. Neuropsychologia 45: 598-607 doi:10.1016/j.neuropsychologia.2006.01.001.
31. Conrey B, Pisoni DB, (2006) Auditory-visual speech perception and synchrony detection for speech and nonspeech signals. The Journal of the Acoustical Society of America 119: 4065 doi:10.1121/1.2195091.
32. Petrini K, Dahl S, Rocchesso D, Waadeland CH, Avanzini F, et al. (2009) Multisensory integration of drumming actions: musical expertise affects perceived audiovisual asynchrony. Experimental brain research 198: 339-52 doi:10.1007/s00221-009-1817-2.
33. Petrini K, Russell M, Pollick FE, (2009) When knowing can replace seeing in audiovisual integration of actions. Cognition 110: 432-9 doi:10.1016/j.cognition.2008.11.015.
34. Stevenson RA, Altieri NA, Kim S, Pisoni DB, James TW, (2010) Neural processing of asynchronous audiovisual speech perception. NeuroImage 49: 3308-18 doi:10.1016/j.neuroimage.2009.12.001.
35. Arrighi R, Alais D, Burr D, (2006) Perceptual synchrony of audiovisual streams for natural and artificial motion sequences. Journal of vision 6: 260-8 doi:10.1167/6.3.6.
36. Brainard DH, (1989) Calibration of a computer controlled color monitor. Color Research & Application 14: 23-34 doi:10.1002/col.5080140107.
37. Pelli D, (1997) The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spatial Vision 10: 437-442.
38. Vatakis A, Spence C, (2006) Audiovisual synchrony perception for speech and music assessed using a temporal order judgment task. Neuroscience letters 393: 40-4 doi:10.1016/j.neulet.2005.09.032.
39. Wilcox RR (2005) Introduction to Robust Estimation and Hypothesis Testing. 2nd Editio. San Diago, CA: Academic Press. 608 p.
40. Johansson G, (1973) Visual perception of biological motion and a model for its analysis. Perception & Psychophysics 14: 201-211.
41. Mossbridge JA, Fitzgerald MB, O'Connor ES, Wright BA, (2006) Perceptual-learning evidence for separate processing of asynchrony and order tasks. The Journal of neuroscience 26: 12708-16 doi:10.1523/JNEUROSCI.2254-06.2006.
42. Lewald J, Guski R, (2003) Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli. Cognitive brain research 16: 468-78.
43. Grant KW, Van Wassenhove V, Poeppel D, (2004) Detection of auditory (cross-spectral) and auditory-visual (cross-modal) synchrony. Speech Communication 44: 43-53 doi:10.1016/j.specom.2004.06.004.
44. Miller LM, D'Esposito M, (2005) Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. The Journal of neuroscience 25: 5884-93 doi:10.1523/JNEUROSCI.0896-05.2005.
45. Noesselt T, Rieger JW, Schoenfeld MA, Kanowski M, Hinrichs H, et al. (2007) Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. The Journal of neuroscience 27: 11431-41 doi:10.1523/JNEUROSCI.2252-07.2007.
46. Lewis R, Noppeney U, (2010) Audiovisual synchrony improves motion discrimination via enhanced connectivity between early visual and auditory areas. The Journal of neuroscience 30: 12329-39 doi:10.1523/JNEUROSCI.5745-09.2010.
47. Petrini K, Pollick FE, Dahl S, McAleer P, McKay L, et al. (2011) Action expertise reduces brain activity for audiovisual matching actions: An fmri study with expert drummers. NeuroImage 56: 1480-1492 doi:10.1016/j.neuroimage.2011.03.009.