Learning to integrate contradictory multisensory self-motion cue pairings

Journal of Vision

Volumn 15, Issue 1, 2015, Pages 1-15

  Kaliuzhna, Mariia ^a   Prsa, Mario ^a   Gale, Steven ^a   Lee, Stella J ^a,b   Blanke, Olaf ^a,c  

^a EPFL   (Switzerland)

^b HARVARD MIT DIVISION OF HEALTH SCIENCES AND TECHNOLOGY   (United States)

^c UNIVERSITY HOSPITAL   (Switzerland)

Author keywords

Multisensory conflict; Multisensory integration; Self motion; Vestibular

Indexed keywords

ADULT; ASSOCIATION; FEMALE; HUMAN; LEARNING; MOVEMENT PERCEPTION; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; VESTIBULAR LABYRINTH; VESTIBULOOCULAR REFLEX; YOUNG ADULT;

ADULT; CUES; FEMALE; HUMANS; LEARNING; MOTION PERCEPTION; PSYCHOMOTOR PERFORMANCE; REFLEX, VESTIBULO-OCULAR; VESTIBULE, LABYRINTH; YOUNG ADULT;

EID: 84921631253     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/15.1.10     Document Type: Article

References (62)

1. Akbarian, S., Berndl, K., Grusser, O. J., Guldin, W., Pause, M., & Schreiter, U. (1988). Responses of single neurons in the parietoinsular vestibular cortex of primates. Annals of the New York Academy of Sciences, 545, 187-202.
2. Arnoldussen, D. M., Goossens, J., & van den Berg, A. V. (2013). Visual perception of axes of head rotation. Frontiers in Behavioral Neuroscience, 7, 11,doi:10.3389/fnbeh.2013.00011.
3. Baker, J., Goldberg, J., Hermann, G., & Peterson, B. (1984). Spatial and temporal response properties of secondary neurons that receive convergent input in vestibular nuclei of alert cats. Brain Research, 294(1), 138-143.
4. Baker, J., Wickland, C., & Peterson, B. (1987). Dependence of cat vestibulo-ocular reflex direction adaptation on animal orientation during adaptation and rotation in darkness. Brain Research, 408(1), 339-343.
5. Bertelson, P., & Radeau, M. (1981). Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Perception & Psychophysics, 29(6), 578-584.
6. Blanke, O. (2012). Multisensory brain mechanisms of bodily self-consciousness. Nature Reviews Neuroscience, 13(8), 556-571.
7. Bockisch, C. J., Straumann, D., & Haslwanter, T. (2003). Eye movements during multi-axis wholebody rotations. Journal of Neurophysiology, 89(1), 355-366.
8. Bolton, P. S., Goto, T., Schor, R. H., Wilson, V. J., Yamagata, Y., & Yates, B.J. (1992). Response of pontomedullary reticulospinal neurons to vestibular stimuli in vertical planes: Role in vertical vestibulospinal reflexes of the decerebrate cat. Journal of Neurophysiology, 67(3), 639-647.
9. Bresciani, J.-P., Ernst, M. O., Drewing, K., Bouyer, G., Maury, V., & Kheddar, A. (2005). Feeling what you hear: Auditory signals can modulate tactile tap perception. Experimental Brain Research, 162(2), 172-180.
10. Butler, J. S., Campos, J. L., & Bülthoff, H. H. (2014). Optimal visual-vestibular integration under conditions of conflicting intersensory motion profiles. Experimental Brain Research, E-pub ahead of print, doi:10.1007/s00221-014-4136-1.
11. Butler, J. S., Smith, S. T., Campos, J. L., & Bülthoff, H. H. (2010). Bayesian integration of visual and vestibular signals for heading. Journal of Vision, 10(11):23, 1-13, http://www.journalofvision.org/content/10/11/23, doi:10.1167/10.11.23. [PubMed] [Article]
12. Büttner-Ennever, J. A. (1992). Patterns of connectivity in the vestibular nuclei. Annals of the New York Academy of Sciences, 656(1), 363-378.
13. Campos, J. L., Butler, J. S., & Bulthoff, H. H. (2009). Visual-vestibular cue combination during temporal asynchrony. IMRF, 10, 198.
14. Cho, Y. S., & Proctor, R. W. (2003). Stimulus and response representations underlying orthogonal stimulus-response compatibility effects. Psychonomic Bulletin & Review, 10(1), 45-73.
15. Duffy, C. J., & Wurtz, R. H. (1995). Response of monkey MST neurons to optic flow stimuli with shifted centers of motion. Journal of Neuroscience, 15(7), 5192-5208.
16. Endo, K., Thomson, D. B., Wilson, V. J., Yamaguchi, T., & Yates, B. J. (1995). Vertical vestibular input to and projections from the caudal parts of the vestibular nuclei of the decerebrate cat. Journal of Neurophysiology, 74, 428-436.
17. Ernst, M. O. (2007). Learning to integrate arbitrary signals from vision and touch. Journal of Vision, 7(5):7, 1-14, http://www.journalofvision.org/content/7/5/7, doi:10.1167/7.5.7. [PubMed] [Article]
18. Ernst, M. O., & Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415(6870), 429-433.
19. Fetsch, C. R., Turner, A. H., De Angelis, G. C., & Angelaki, D. E. (2009). Dynamic reweighting of visual and vestibular cues during self-motion perception. Journal of Neuroscience, 29(49), 15601-15612.
20. Gebhard, J. W., & Mowbray, G. H. (1959). On discriminating the rate of visual flicker and auditory flutter. American Journal of Psychology, 72(4), 521-529.
21. Gepshtein, S., Burge, J., Ernst, M. O., & Banks, M. S. (2005). The combination of vision and touch depends on spatial proximity. Journal of Vision, 5(11):7, 1-11, http://www.journalofvision.org/content/5/11/7, doi:10.1167/5.11.7. [PubMed] [Article]
22. Gibson, J. J. (1950). The perception of the visual world. Boston, MA: Houghton Mifflin.
23. Grüsser, O. J., Pause, M., & Schreiter, U. (1990). Vestibular neurones in the parieto-insular cortex of monkeys (Macaca fascicularis): Visual and neck receptor responses. Journal of Physiology, 430(1), 559-583.
24. Hartmann, M., Grabherr, L., & Mast, F. W. (2012). Moving along the mental number line: Interactionsbetween whole-body motion and numerical cognition. Journal of Experimental Psychology: Human Perception and Performance, 38(6), 1416-1427.
25. Highstein, S. M., & Holstein, G. R. (2006). The anatomy of the vestibular nuclei. Progress in Brain Research, 151, 157-203.
26. Ionta, S., Heydrich, L, Lenggenhager, B., Mouthon, M., Fornari, E., Chapuis, D., . . . Blanke, O. (2011). Multisensory mechanisms in temporo-parietal cortex support self-location and first-person perspective. Neuron, 70(2), 363-374.
27. Ishida, M., Fushiki, H., Nishida, H., & Watanabe, Y. (2008). Self-motion perception during conflicting visual-vestibular acceleration. Journal of Vestibular Research, 18(5), 267-272.
28. Jürgens, R., & Becker, W. (2006). Perception of angular displacement without landmarks: Evidence for Bayesian fusion of vestibular, optokinetic, podokinesthetic, and cognitive information. Experimental Brain Research, 174(3), 528-543.
29. Kapralos, B., Zikovitz, D., Jenkin, M. R., & Harris, L. R. (2004, Month). Auditory cues in the perception of self motion. Paper presented at the Audio Engineering Society Convention 116, May 8-11, 2004, Berlin, Germany.
30. Kasper, J., Schor, R. H., & Wilson, V. J. (1988). Response of vestibular neurons to head rotations in vertical planes. I: Response to vestibular stimulation. Journal of Neurophysiology, 60, 1753-1764.
31. Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007). Causal inference in multisensory perception. PLoS ONE, 2(9), e943. doi:10.1371/journal.pone.0000943
32. Kornblum, S., Hasbroucq, T., & Osman, A. (1990). Dimensional overlap: Cognitive basis for stimulusresponse compatibility-A model and taxonomy. Psychological Review, 97(2), 253-270.
33. Kosslyn, S. M. (1994). Image and brain: The resolution of the imagery debate. Cambridge, MA: MIT Press.
34. Li, Q., Nan, W., Wang, K., & Liu, X. (2014). Independent processing of stimulus-stimulus and stimulus-response conflicts. PLoS One, 9(2), e89249, doi:10.1371/journal.pone.0089249.
35. Loetscher, T., Schwarz, U., Schubiger, M., & Brugger, P. (2008). Head turns bias the brain's internal random generator. Current Biology, 18(2), R60-R62.
36. Lopez, C., Halje, P., & Blanke, O. (2008). Body ownership and embodiment: Vestibular and multisensory mechanisms. Neurophysiologie Clinique/Clinical Neurophysiology, 38(3), 149-161.
37. Lunghi, C., Morrone, M. C., & Alais, D. (2014). Auditory and tactile signals combine to influence vision during binocular rivalry. Journal of Neuroscience, 34(3), 784-792.
38. Murray, C. D., & Fox, J. (2005). Dissociational body experiences: Differences between respondents with and without prior out-of-body-experiences. British Journal of Psychology, 96(4), 441-456.
39. Naito, Y., Newman, A., Lee, W. S., Beykirch, K., & Honrubia, V. (1995). Projections of the individual vestibular end-organs in the brain stem of the squirrel monkey. Hearing Research, 87(1), 141-155.
40. Nicoletti, R., & Umiltà, C. (1984). Right-left prevalence in spatial compatibility. Perception & Psychophysics, 35(4), 333-343.
41. Nishimura, A., & Yokosawa, K. (2006). Orthogonal stimulus-response compatibility effects emerge even when the stimulus position is task irrelevant. Quarterly Journal of Experimental Psychology, 59(6), 1021-1032.
42. Occelli, V., Spence, C., & Zampini, M. (2009). Compatibility effects between sound frequency and tactile elevation. Neuroreport, 20(8), 793-797.
43. Ohmi, M. (1996). Egocentric perception through interaction among many sensory systems. Cognitive Brain Research, 5(1), 87-96.
44. Parise, C. V., Spence, C., & Ernst, M. O. (2012). When correlation implies causation in multisensory integration. Current Biology, 22(1), 46-49.
45. Pick, H. L., Warren, D. H., & Hay, J. C. (1969). Sensory conflict in judgments of spatial direction. Perception & Psychophysics, 6(4), 203-205.
46. Proctor, R. W., & Cho, Y. S. (2006). Polarity correspondence: A general principle for performance of speeded binary classification tasks. Psychological Bulletin, 132(3), 416-442.
47. Prsa, M., Gale, S., & Blanke, O. (2012). Self-motion leads to mandatory cue fusion across sensory modalities. Journal of Neurophysiology, 108(8), 2282-2291.
48. Recanzone, G. H. (2003). Auditory influences on visual temporal rate perception. Journal of Neurophysiology, 89(2), 1078-1093.
49. Roach, N. W., Heron, J., & McGraw, P. V. (2006). Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration. Proceedings of the Royal Society B: Biological Sciences, 273(1598), 2159-2168.
50. Schultheis, L. W., & Robinson, D. A. (1981). Directional plasticity of the vestibulo-ocular reflex in the cat. Annals of the New York Academy of Sciences, 374(1), 504-512.
51. Shams, L., & Beierholm, U. R. (2010). Causal inference in perception. Trends in Cognitive Sciences, 14(9), 425-432.
52. Trillenberg, P., Shelhamer, M., Roberts, D., & Zee, D. (2003). Cross-axis adaptation of torsional components in the yaw-axis vestibulo-ocular reflex. Experimental Brain Research, 148(2), 158-165.
53. Tweed, D., Sievering, D., Misslisch, H., Fetter, M., Zee, D., & Koenig, E. (1994). Rotational kinematics of the human vestibuloocular reflex. I: Gain matrices. Journal of Neurophysiology, 72(5), 2467-2479.
54. van Beers, R. J., Sittig, A. C., & Denier van der Gon, J. J. (1996). How humans combine simultaneous proprioceptive and visual position information. Experimental Brain Research, 111(2), 253-261.
55. Waespe, W., & Henn, V. (1978). Conflicting visualvestibular stimulation and vestibular nucleus activity in alert monkeys. Experimental Brain Research, 33(2), 203-211.
56. Wallace, M. T., Roberson, G. E., Hairston, W. D., Stein, B. E., Vaughan, W. J., & Schirillo, J. A. (2004). Unifying multisensory signals across time and space. Experimental Brain Research, 158(2), 252-258.
57. Warren, R., & Wertheim, A. H. (2014). Perception and control of self-motion. New York: Psychology Press.
58. Weeks, D. J., & Proctor, R. W. (1990). Salient-features coding in the translation between orthogonal stimulus and response dimensions. Journal of Experimental Psychology: General, 119(4), 355-366.
59. Welch, R. B., & Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychological Bulletin, 88(3), 638-667.
60. Wilson, V. J., Yamagata, Y., Yates, B. J., Schor, R. H., & Nonaka, S. (1990). Response of vestibular neurons to head rotations in vertical planes. III: Response of vestibulocollic neurons to vestibular and neck stimulation. Journal of Neurophysiology, 64(6), 1695-1703.
61. Wozny, D. R., & Shams, L. (2011). Recalibration of auditory space following milliseconds of crossmodal discrepancy. Journal of Neuroscience, 31(12), 4607-4612.
62. Wright, W. G., DiZio, P., & Lackner, J. R. (2005). Vertical linear self-motion perception during visual and inertial motion: More than weighted summation of sensory inputs. Journal of Vestibular Research, 15(4), 185-195.