Motor-sensory recalibration modulates perceived simultaneity of cross-modal events at different distances

Frontiers in Psychology

Volumn 4, Issue FEB, 2013, Pages

  Parsons, Brent D ^a   Novich, Scott D ^a   Eagleman, David M ^a  

^a BAYLOR COLLEGE OF MEDICINE   (United States)

Author keywords

Intentional binding; Motor sensory recalibration; Simultaneity; Temporal order; Time perception

Indexed keywords

EID: 84878770674     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2013.00046     Document Type: Article

References (138)

1. Ahrens, M. B., and Sahani, M. (2011). Observers exploit stochastic models of sensory change to help judge the passage of time. Curr. Biol. 21, 200-206.
2. Alais, D., and Burr, D. (2004). The ventriloquist effect results from near-optimal bimodal integration. Curr. Biol. 14, 257-262.
3. Alais, D., and Carlile, S. (2005). Synchronizing to real events: subjective audiovisual alignment scales with perceived auditory depth and speed of sound. Proc. Natl. Acad. Sci. U.S.A 102, 2244-2247.
4. Alais, D., and Cass, J. (2010). Multisensory perceptual learning of temporal order: audiovisual learning transfers to vision but not audition. PLoS ONE 5:e11283. doi:10.1371/journal.pone.0011283
5. Alison, T., Wood, C., and Goff, W. (1983). Brain stem auditory, pattern-reversal visual and short latency somatosensory evoked potentials: latencies in relation to age, sex and brain and body type. Electroencephalogr. Clin. Neurophysiol. 55, 619-636.
6. Allan, L. G., and Kristofferson, A. B. (1974). Psychophysical theories of duration discrimination. Atten. Percept. Psychophys. 16, 26-34.
7. Allison, T., Matsumiya, Y., Goff, G. D., and Goff, W. R. (1977). The scalp topography of human visual evoked potentials. Electroencephalogr. Clin. Neurophysiol. 42, 185-197.
8. Andreassi, J. L., and Greco, J. R. (1975). Effects of bisensory stimulation on reaction time and the evoked cortical potential. Physiol. Psychol. 3, 189-194.
9. Arnold, D. H., Johnston, A., and Nishida, S. (2005). Timing sight and sound. Vision Res. 45, 1275-1284.
10. Arnold, D. H., Nancarrow, K., and Yarrow, K. (2012). The critical events for motor-sensory temporal recalibration. Front. Hum. Neurosci. 6:235. doi:10.3389/fnhum.2012.00235
11. Arnold, D. H., and Yarrow, K. (2011). Temporal recalibration of vision. Proc. Biol. Sci. 278, 535-558.
12. Bedford, F. L. (1999). Keeping perception accurate. Trends Cogn. Sci. (Regul. Ed.) 3, 4-11.
13. Bertelson, P., and Aschersleben, G. (2003). Temporal ventriloquism: Cross-modal interaction on the time dimension: 1 Evidence from auditory-visual temporal order judgment. Int. J. Psychophysiol. 50, 147-155.
14. Bertelson, P., and de Gelder, B. (2004). "The psychology of multimodal perception," in Crossmodal Space and Crossmodal Attention, eds C. Spence and J. Driver (Oxford: Oxford University Press), 151-177.
15. Blakemore, S. J., Frith, C. D., and Wolpert, D. M. (1999). Spatio-temporal prediction modulates the perception of self-produced stimuli. J. Cogn. Neurosci. 11, 551-559.
16. Blakemore, S.-J., Wolpert, D. M., and Frith, C. D. (2000). Why can't you tickle yourself? Neuroreport 11, 16.
17. Buehner, J. (2010). "Temporal Binding," in Attention and Time, eds K. Nobre and J. Coull (Oxford: Oxford University Press), 201-211.
18. Buehner, M. J. (2012). Understanding the past, predicting the future: causation, not intentional action, is the root of temporal binding. Psychol. Sci. 23, 1490-1497.
19. Buehner, M. J., and Cheng, P. W. (1997). "Causal induction: the power pc theory versus the Rescorla-Wagner model," in Proceedings of the Nineteenth Annual Conference of the Cognitive Science Society (Hillsdale, NJ: Erlbaum), 55-60.
20. Buehner, M. J., and Humphreys, G. R. (2009). Causal binding of actions to their effects. Psychol. Sci. 20, 1221-1228.
21. Buehner, M. J., and Humphreys, G. R. (2010). Causal contraction: spatial binding in the perception of collision events. Psychol. Sci. 21, 44-48.
22. Buhusi, C. V., and Meck, W. H. (2009). Relativity theory and time perception: single or multiple clocks? PLoS ONE 4:e6268. doi:10.1371/journal.pone.0006268
23. Buonomano, D. V., and Maass, W. (2009). State-dependent computations: spatiotemporal processing in cortical networks. Nat. Rev. Neurosci. 10, 113-125.
24. Burr, D., Tozzi, A., and Morrone, M. C. (2007). Neural mechanisms for timing visual events are spatially selective in real-world coordinates. Nat. Neurosci. 10, 423.
25. Cai, M., Stetson, C. A., and Eagleman, D. M. (2012). A neural model for temporal order judgments and their active recalibration: proposing a common mechanism for space and time. Front. Psychol. 3:470. doi:10.3389/fpsyg.2012.00470
26. Campbell, W. W., Ward, L. C., and Swift, T. R. (1981). Nerve conduction velocity varies inversely with height. Muscle Nerve 4, 520-523.
27. Choi, H., and Scholl, B. J. (2006). Perceiving causality after the fact: postdiction in the temporal dynamics of causal perception. Perception 35, 385-399.
28. Cravo, A. M., Claessens, P. M., and Baldo, M. V. (2009). Voluntary action and causality in temporal binding. Exp. Brain Res. 199, 95-99.
29. Cravo, A. M., Claessens, P. M., and Baldo, M. V. (2011). The relation between action, predictability and temporal contiguity in temporal binding. Acta Psychol. (Amst.) 136, 157-166.
30. Creelman, C. D. (1962). Human discrimination of auditory duration. J. Acoust. Soc. Am. 34, 528-593.
31. Cunningham, D. W., Billock, V. A., and Tsou, B. H. (2001). Sensorimotor adaptation to violations of temporal contiguity. Psychol. Sci. 12, 532-535.
32. Dennett, D. C., and Kinsbourne, M. (1992). Time and the observer: the where and when of consciousness in the brain. Behav. Brain Sci. 15, 183-201.
33. Dixon, N. F., and Spitz, L. (1980). The detection of auditory visual desynchrony. Perception 9, 719-721.
34. Eagleman, D. M. (2008). Human time perception and its illusions. Curr. Opin. Neurobiol. 18, 131-136.
35. Eagleman, D. M., and Holcombe, A. O. (2002). Causality and the perception of time. Trends Cogn. Sci. (Regul. Ed.) 6, 323-325.
36. Eagleman, D. M., and Pariyadath, V. (2009). Is subjective duration a signature of coding efficiency? Philos. Trans. R. Soc. Lond. B Biol. Sci 364, 1841-1851.
37. Eagleman, D. M., and Sejnowski, T. J. (2000). Motion integration and postdiction in visual awareness. Science 287, 2036-2038.
38. Engbert, K., and Wohlschläger, A. (2007). Intentions and expectations in temporal binding. Conscious. Cogn. 16, 255-264.
39. Engbert, K., Wohlschläger, A., and Haggard, P. (2008). Who is causing what? The sense of agency is relational and efferent-triggered. Cognition 107, 693-704.
40. Engbert, K., Wohlschläger, A., Thomas, R., and Haggard, P. (2007). Agency, subjective time, and other minds. J. Exp. Psychol. Hum. Percept. Perform. 33, 1261-1268.
41. Engel, G. R., and Dougherty, W. G. (1971). Visual-auditory distance constancy. Nature 234, 308.
42. Frith, C. (1992). The Cognitive Neuropsychology of Schizophrenia. Hove: Lawrence Erlbaum Associates.
43. Fujisaki, W., Shimojo, S., Kashino, M., and Nishida, S. (2004). Recalibration of audiovisual simultaneity. Nat. Neurosci. 7, 773-778.
44. Gepshtein, S., Burge, J., Ernst, M. O., and Banks, M. S. (2005). The combination of vision and touch depends on spatial proximity. J. Vis. 5, 1013-1023.
45. Gibbon, J., Church, R. M., and Meck, W. H. (1984). Scalar timing in memory. Ann. N. Y. Acad. Sci. 423, 52-77.
46. Gregory, R. L. (1963). Distortion of visual space as inappropriate constancy scaling. Nature 199, 678-680.
47. Griffiths, T. L., and Tenenbaum, J. B. (2005). Structure and strength in causal induction. Cogn. Psychol. 51, 334-384.
48. Guski, R., and Troje, N. F. (2003). Audiovisual phenomenal causality. Percept. Psychophys. 65, 789-800.
49. Haggard, P., and Clark, S. (2003). Intentional action: conscious experience and neural prediction. Conscious. Cogn. 12, 695-707.
50. Haggard, P., Clark, S., and Kalogeras, J. (2002). Voluntary action and conscious awareness. Nat. Neurosci. 5, 382-385.
51. Hairston, W. D., Wallace, M. T., Vaughan, J. W., Stein, B. E., Norris, J. L., and Schirillo, J. A. (2003). Visual localization ability influences cross-modal bias. J. Cogn. Neurosci. 15, 20-29.
52. Hanson, J. V., Heron, J., and Whitaker, D. (2008). Recalibration of perceived time across sensory modalities. Exp. Brain Res. 185, 347-352.
53. Harrar, V., and Harris, L. R. (2005). Simultaneity constancy: detecting events with touch and vision. Exp. Brain Res. 166, 465-473.
54. Harris, L. R., Harrar, V., Jaekl, P., and Kopinska, A. (2010). "Mechanisms of simultaneity constancy," in Space and Time in Perception and Action, eds R. Nijhawan and B. Khurana (Cambridge: Cambridge University Press), 232-253.
55. Heron, J., Hanson, J. V., and Whitaker, D. (2009). Effect before cause: supramodal recalibration of sensorimotor timing. PLoS ONE 4:e7681. doi:10.1371/journal.pone.0007681
56. Heron, J., Roach, N. W., Hanson, J. V., McGraw, P. V., and Whitaker, D. (2012). Audiovisual time perception is spatially specific. Exp. Brain Res. 218, 477-485.
57. Heron, J., Whitaker, D., McGraw, P. V., and Horoshenkov, K. V. (2007). Adaptation minimizes distance-related audiovisual delays. J. Vis. 7, 1-8.
58. Hirsh, I. J., and Sherrick, C. E. (1961). Perceived order in different sense modalities. J. Exp. Psychol. 62, 423-432.
59. Hodinott-Hill, I., Thilo, K. V., Cowey, A., and Walsh, V. (2002). Auditory chronostasis: hanging on the telephone. Curr. Biol. 12, 1779-1781.
60. Hume, D. (1748). Enquiry Concerning Human Understanding. New York, NY: PF Collier and Son.
61. Humphreys, G. R., and Buehner, M. J. (2009). Magnitude estimation reveals temporal binding at super-second intervals. J. Exp. Psychol. Hum. Percept. Perform. 35, 1542-1549.
62. Ivry, R. B. (1996). The representation of temporal information in perception and motor control. Curr. Opin. Neurobiol. 6, 851-857.
63. Ivry, R. B., and Richardson, T. C. (2002). Temporal control and coordination: the multiple timer model. Brain Cogn. 48, 117-132.
64. Ivry, R. B., and Schlerf, J. E. (2008). Dedicated and intrinsic models of time perception. Trends Cogn. Sci. (Regul. Ed.) 12, 273-280.
65. Jeannerod, M. (1997). The Cognitive Neuroscience of Action. Oxford: Blackwell.
66. Johnston, A. (2010). "Modulation of time perception by visual adaptation," in Attention and Time, eds K. Nobre and J. Coull (Oxford: Oxford University Press), 187.
67. Johnston, A., Arnold, D. H., and Nishida, S. (2006). Spatially localized distortions of event time. Curr. Biol. 16, 472-479.
68. Jordan, M. I., and Rumelhart, D. E. (1992). Forward models: supervised learning with a distal teacher. Cogn. Sci. 16, 307-354.
69. Kanai, R., Paffen, C. L., Hogendoorn, H., and Verstraten, F. A. (2006). Time dilation in dynamic visual display. J. Vis. 6, 1421-1430.
70. Keetels, M., and Vroomen, J. (2008). Temporal recalibration to tactile-visual asynchronous stimuli. Neurosci. Lett. 430, 130-134.
71. Kennedy, J. S., Buehner, M. J., and Rushton, S. K. (2009). Adaptation to sensory-motor temporal misalignment: instrumental or perceptual learning? Q. J. Exp. Psychol. (Hove) 62, 453-69.
72. King, A. J. (2005). Multisensory integration: strategies for synchronization. Curr. Biol. 15, R339-R341.
73. King, A. J., and Palmer, A. R. (1985). Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus. Exp. Brain Res. 60, 492-500.
74. Kinsler, L., Frey, A., and Coppens, A. (2000). Fundamentals of Acoustics. New York: Wiley.
75. Kohler, I. (1951). Formation and transformation of the perceptual world. Psychol. Issues 3, 1-173.
76. Kopinska, A., and Harris, L. R. (2004). Simultaneity constancy. Perception 33, 1049-1060.
77. Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., and Shams, L. (2007). Causal inference in multisensory perception. PLoS ONE 2:e943. doi:10.1371/journal.pone.0000943
78. Lewald, J., and Guski, R. (2004). Auditory-visual temporal integration as a function of distance: no compensation for sound-transmission time in human perception. Neurosci. Lett. 357, 119-122.
79. Liverence, B. M., and Scholl, B. J. (2012). Discrete events as units of perceived time. J. Exp. Psychol. Hum. Percept. Perform. 38, 549-554.
80. Marinovic, W., and Arnold, D. H. (2012). Separable temporal metrics for time perception and anticipatory actions. Proc. Biol. Sci. 279, 854-859.
81. Matteson, H. H. (1971). Effects of surround luminance on perceptual latency in the fovea. J. Opt. Soc. Am. 61, 1169-1172.
82. Meredith, M. A., Nemitz, J. W., and Stein, B. E. (1987). Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J. Neurosci. 7, 3215-3229.
83. Michotte, A. (1963). The Perception of Causality. Oxford: Basic Books.
84. Moore, J., and Haggard, P. (2008). Awareness of action: inference and prediction. Conscious. Cogn. 17, 136-144.
85. Moore, J. W., Lagnado, D., Deal, D. C., and Haggard, P. (2009). Feelings of control: contingency determines experience of action. Cognition 110, 279-283.
86. Moore, J. W., and Obhi, S. S. (2012). Intentional binding and the sense of agency: a review. Conscious. Cogn. 21, 546-561.
87. Morrone, M. C., Ross, J., and Burr, D. (2005). Saccadic eye-movements cause relativistic compression of time as well as space. Nature 1-13.
88. Navarra, J., Hartcher-O'Brien, J., Piazza, E., and Spence, C. (2009). Adaptation to audiovisual synchrony modulates the speeded detection of sound. Proc. Natl. Acad. Sci. U.S.A. 106, 9123-9124.
89. Navarra, J., Soto-Faraco, S., and Spence, C. (2007). Adaptation to audiotactile asynchrony. Neurosci. Lett. 413, 72-76.
90. New, J. J., and Scholl, B. J. (2009). Subjective time dilation: spatially local, object-based, or a global visual experience? J. Vis. 9, 1-11.
91. Obhi, S. S., and Hall, P. (2011). Sense of agency and intentional binding in joint action. Exp. Brain Res. 211, 655-662.
92. O'Regan, J. K., and Noe, A. (2001). A sensorimotor account of vision and visual consciousness. Behav. Brain Sci. 24, 939-973; discussion 973-1031.
93. Pacer, M., and Griffiths, L. (2012). Elements of a rational framework for continuous-time causal induction. Proc. Annu. Conf. Cogn. Sci. Soc. 1, 833-838.
94. Palmer, S. E. (1999). Vision Science: Photons to Phenomenology. Cambridge, MA: Bradford Books/MIT Press.
95. Pearl, J. (2000). Causality: Models, Reasoning, and Inference, 2nd Edn. New York: Cambridge University Press.
96. Purpura, K., Tranchina, D., Kaplan, E., and Shapley, R. M. (1990). Light adaptation in the primate retina: analysis of changes in gain and dynamics of monkey retinal ganglion cells. Vis. Neurosci. 4, 75-93.
97. Redding, G. M., Rader, S. D., and Lucas, D. R. (1992). Cognitive load and prism adaptation. J. Mot. Behav. 24, 238-246.
98. Redding, G. M., Rossetti, Y., and Wallace, B. (2005). Applications of prism adaptation: a tutorial in theory and method. Neurosci. Biobehav. Rev. 29, 431-444.
99. Redding, G. M., and Wallace, B. (1993). Adaptive coordination and alignment of eye and hand. J. Mot. Behav. 25, 75-88.
100. Redding, G. M., and Wallace, B. (2002). Strategic calibration and spatial alignment: a model from prism adaptation. J. Mot. Behav. 34, 126-138.
101. Scholl, B. J., and Tremoulet, P. D. (2000). Perceptual causality and animacy. Trends Cogn. Sci. (Regul. Ed.) 4, 299-309.
102. Schulz, L., and Gopnik, A. (2004). Causal learning across domains. Dev. Psychol. 40, 162-176.
103. Shams, L., and Beierholm, U. R. (2010). Causal inference in perception. Trends Cogn. Sci. (Regul. Ed.) 14, 425-432.
104. Sloman, S. A. (2005). Causal Models: How We Think About the World and its Alternatives. New York: Oxford University Press.
105. Spence, C. (2010). "Prior entry: attention and temporal perception," in Attention and Time, eds A. C. Nobre and J. T. Coull (Oxford: Oxford University Press), 89-104.
106. Spence, C., Baddeley, R., Zampini, M., James, R., and Shore, D. I. (2003). Multisensory temporal order judgments: when two locations are better than one. Percept. Psychophys. 65, 318-328.
107. Spence, C., and Squire, S. (2003). Multisensory integration: maintaining the perception of synchrony. Curr. Biol. 13, R519-R521.
108. Stetson, C., Cui, X., Montague, P. R., and Eagleman, D. M. (2006). Motor-sensory recalibration leads to an illusory reversal of action and sensation. Neuron 51, 651-659.
109. Stevenson, R. A., Fister, J. K., Barnett, Z. P., Nidiffer, A. R., and Wallace, M. T. (2012). Interactions between the spatial and temporal stimulus factors that influence multisensory integration in human performance. Exp. Brain Res. 219, 121-137.
110. Stone, J. V., Hunkin, N. M., Porrill, J., Wood, R., Keeler, V., Beanland, M., et al. (2001). When is now? Perception of simultaneity. Proc. Biol. Sci. 268, 31-38.
111. Strother, L., House, K. A., and Obhi, S. S. (2010). Subjective agency and awareness of shared actions. Conscious. Cogn. 19, 12-20.
112. Sugano, Y., Keetels, M., and Vroomen, J. (2010). Adaptation to motor-visual and motor-auditory temporal lags transfer across modalities. Exp. Brain Res. 201, 393-399.
113. Sugita, Y., and Suzuki, Y. (2003). Audiovisual perception: implicit estimation of sound-arrival time. Nature 421, 911.
114. Treisman, M. (1963). Temporal discrimination and the indifference interval. Implications for a model of the "internal clock." Psychol. Monogr. 77, 1-31.
115. Tse, P. U., Intriligator, J., Rivest, J., and Cavanagh, P. (2004). Attention and the subjective expansion of time. Percept. Psychophys. 66, 1171-1189.
116. van Eijk, R. L., Kohlrausch, A., Juola, J. F., and van de Par, S. (2008). Audiovisual synchrony and temporal order judgments: effects of experimental method and stimulus type. Percept. Psychophys. 70, 955-968.
117. van Wassenhove, V. (2009). Minding time in an amodal representational space. Philos. Trans. R. Soc. Lond. B Biol. Sci. 364, 1815-1830.
118. van Wassenhove, V., Buonomano, D. V., Shimojo, S., and Shams, L. (2008). Distortions of subjective time perception within and across senses. PLoS ONE 3:e1437. doi:10.1371/journal.pone.0001437
119. van Wassenhove, V., Grant, K. W., and Poeppel, D. (2007). Temporal window of integration in auditory-visual speech perception. Neuropsychologia 45, 598-601.
120. von Holst, E. (1954). Relations between the central nervous system and the peripheral organs. Br. J. Anim. Behav. 2, 89-86.
121. Vroomen, J., Keetels, M., de Gelder, B., and Bertelson, P. (2004). Recalibration of temporal order perception by exposure to audio-visual asynchrony. Brain Res. Cogn. Brain Res. 22, 32-35.
122. Waldmann, M. R., and Holyoak, K. J. (1992). Predictive and diagnostic learning within causal models: asymmetries in cue competition. J. Exp. Psychol. Gen. 121, 222-236.
123. Wearden, J. H. (2008). Slowing down an internal clock: implications for accounts of performance on four timing tasks. Q. J. Exp. Psychol. (Hove) 61, 263-274.
124. Weiskrantz, L., Elliott, J., and Darlington, C. (1971). Preliminary observations on tickling oneself. Nature 230, 598-599.
125. Welch, R. B. (1978). Perceptual Modification. New York: Academic Press.
126. Wencil, E. B., Coslett, H. B., Aguirre, G. K., and Chatterjee, A. (2010). Carving the clock at its component joints: neural bases for interval timing. J. Neurophysiol. 104, 160-168.
127. Wenke, D., and Haggard, P. (2009). How voluntary actions modulate time perception. Exp. Brain Res. 196, 311-318.
128. Wertheimer, M. (1912). Experimentelle studien über das sehen von behwegung. Z. Psychol. 61, 161-265.
129. Westheimer, G. (1999). Discrimination of short time intervals by the human observer. Exp. Brain Res. 129, 121-126.
130. Westheimer, G., and McKee, S. P. (1977). Perception of temporal order in adjacent visual stimuli. Vision Res. 17, 887-892.
131. Wittmann, M. (1999). Time perception and temporal processing levels of the brain. Chronobiol. Int. 16, 17-32.
132. Wohlschlager, A., Engbert, K., and Haggard, P. (2003). Intentionality as a constituting condition for the own self - and other selves. Conscious. Cogn. 12, 708-716.
133. Wolpert, D. M., and Ghahramani, Z. (2000). Computational principles of movement neuroscience. Nat. Neurosci. 3(Suppl.), 1212-1217.
134. Wozny, D. R., and Shams, L. (2011). Recalibration of auditory space following milliseconds of cross-modal discrepancy. J. Neurosci. 31, 4607-4612.
135. Wundt, W. (1874). Grundzuge der physiologischen Psychologie. Leipzig: W. Engelmann.
136. Yarrow, K., Johnson, H., Haggard, P., and Rothwell, J. C. (2004). Consistent chronostasis effects across saccade categories imply a subcortical efferent trigger. J. Cogn. Neurosci. 16, 839-847.
137. Zampini, M., Guest, S., Shore, D. I., and Spence, C. (2005). Audio-visual simultaneity judgments. Percept. Psychophys. 67, 531-544.
138. Zampini, M., Shore, D. I., and Spence, C. (2003). Audiovisual temporal order judgments. Exp. Brain Res. 152, 198-210.