A modular theory of multisensory integration for motor control

Frontiers in Computational Neuroscience

Volumn 8, Issue JAN, 2014, Pages

  Tagliabue, Michele ^a   McIntyre, Joseph ^a  

^a CNRS   (France)

Author keywords

Maximum likelihood; Motor control; Reference frames; Sensory integration

Indexed keywords

MAXIMUM LIKELIHOOD; MEDICAL COMPUTING; NEUROLOGY;

CONVENTIONAL MODELING; MOTOR CONTROL; MULTISENSORY INTEGRATION; REFERENCE FRAME; SENSORIMOTOR TRANSFORMATIONS; SENSORY INTEGRATION; SENSORY TRANSFORMATION; VISUAL REPRESENTATIONS;

INTEGRATION;

ARTICLE; COMPARATIVE STUDY; HAND MOVEMENT; HEAD TILTING; HUMAN; LINEAR SYSTEM; MATHEMATICAL MODEL; MEMORY; MOTOR CONTROL; OBJECT MANIPULATION; PROPRIOCEPTIVE FEEDBACK; SENSORIMOTOR INTEGRATION; SIGNAL NOISE RATIO; THEORETICAL MODEL; VISUAL FEEDBACK;

EID: 84936963200     PISSN: None     EISSN: 16625188     Source Type: Journal    
DOI: 10.3389/fncom.2014.00001     Document Type: Article

References (67)

1. Asch, S.E., and Witkin, H. A. (1948a). Studies in space orientation: I. Perception of the upright with displaced visual fields. J. Exp. Psychol. 38, 325-337. doi: 10.1037/h0057855
2. Asch, S. E., and Witkin, H. A. (1948b). Studies in space orientation. II. Perception of the upright with displaced visual fields and with body tilted. J. Exp. Psychol. 38, 455-477. doi: 10.1037/h0054121
3. Avillac, M., Deneve, S., Olivier, E., Pouget, A., and Duhamel, J.-R. (2005). Reference frames for representing visual and tactile locations in parietal cortex. Nat. Neurosci. 8, 941-949. doi: 10.1038/nn1480
4. Beurze, S. M., Toni, I., Pisella, L., and Medendorp, W. P. (2010). Reference frames for reach planning in human parietofrontal cortex. J. Neurophysiol. 104, 1736-1745. doi: 10.1152/jn.01044.2009
5. Bock, O. (1986). Contribution of retinal versus extraretinal signals towards visual localization in goal-directed movements. Exp. Brain Res. 64, 476-482. doi: 10.1007/BF00340484
6. Borghese, N., Bianchi, L., and Lacquaniti, F. (1996). Kinematic determinants of human locomotion. J. Physiol. 494, 863-879.
7. Buchholz, V. N., Jensen, O., and Medendorp, W. P. (2013). Parietal oscillations code nonvisual reach targets relative to gaze and body. J. Neurosci. 33, 3492-3499. doi: 10.1523/JNEUROSCI.3208-12.2013
8. Buneo, C. A., Jarvis, M. R., Batista, A. P., and Andersen, R. A. (2002). Direct visuomotor transformations for reaching. Nature 416, 632-636. doi: 10.1038/416632a
9. Burgess, N. (2006). Spatial memory: how egocentric and allocentric combine. Trends Cogn. Sci. 10, 551-557. doi: 10.1016/j.tics.2006.10.005
10. Burgess, N., Spiers, H. J., and Paleologou, E. (2004). Orientational manoeuvres in the dark: dissociating allocentric and egocentric influences on spatial memory. Cognition 94, 149-166. doi: 10.1016/j.cognition.2004.01.001
11. Burns, J. K., and Blohm, G. (2010). Multi-sensory weights depend on contextual noise in reference frame transformations. Front. Hum. Neurosci. 4:221. doi: 10.3389/fnhum.2010.00221
12. Byrne, P. A., Cappadocia, D. C., and Crawford, J. D. (2010). Interactions between gaze-centered and allocentric representations of reach target location in the presence of spatial updating. Vis. Res. 50, 2661-2670. doi: 10.1016/j.visres.2010.08.038
13. Carrozzo, M., and Lacquaniti, F. (1994). A hybrid frame of reference for visuo-manual coordination. Neuroreport 5, 453-456. doi: 10.1097/00001756-199401120-00021
14. Carrozzo, M., McIntyre, J., Zago, M., and Lacquaniti, F. (1999). Viewer-centered and body-centered frames of reference in direct visuomotor transformations. Exp. Brain Res. 129, 201-210. doi: 10.1007/s002210050890
15. Carrozzo, M., Stratta, F., McIntyre, J., and Lacquaniti, F. (2002). Cognitive allocentric representations of visual space shape pointing errors. Exp. Brain Res. 147, 426-436. doi: 10.1007/s00221-002-1232-4
16. Darling, W. G., and Gilchrist, L. (1991). Is there a preferred coordinate system for perception of hand orientation in three-dimensional space? Exp. Brain Res. 85, 405-416. doi: 10.1007/BF00229417
17. Darling, W. G., Viaene, A. N., Peterson, C. R., and Schmiedeler, J. P. (2008). Perception of hand motion direction uses a gravitational reference. Exp. Brain Res. 186, 237-248. doi: 10.1007/s00221-007-1227-2
18. Dean, H. L., and Platt, M. L. (2006). Allocentric spatial referencing of neuronal activity in macaque posterior cingulate cortex. J. Neurosci. 26, 1117-1127. doi: 10.1523/JNEUROSCI.2497-05.2006
19. Droulez, J., and Berthoz, A. (1992). "The dynamic memory model and the final oculomotor and cephalomotor integrators, " in Vestibular and Brain Stem Control of Eye, Head and Body Movements, eds H. Shimazu and Y. Shinoda (Tokyo: Japan Scientific Societies Press), 221-239.
20. Droulez, J., and Cornilleau-Peres, V. (1993). "Application of the coherence scheme to the multisensory fusion problem, " in Multisensory Control of Movement, ed A. Berthoz (Oxford: Oxford University Press), 485-501.
21. Duhamel, J. R., Colby, C. L., and Goldberg, M. E. (1992). The updating of the representation of visual space in parietal cortex by intended eye movements. Science 255, 90-92. doi: 10.1126/science.1553535
22. Enright, J. T. (1995). The non-visual impact of eye orientation on eye-hand coordination. Vis. Res. 35, 1611-1618. doi: 10.1016/0042-6989(94)00260-S
23. Ernst, M. O., and Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429-433. doi: 10.1038/415429a
24. Ghahramani, Z., Wolpert, D. M., and Jordan, M. I. (1997). "Computational models of sensorimotor integration, " inSelf-Organization, Computational Maps, and Motor Control. Advances in Psychology, Vol. 119, eds P. Morasso and V. Sanguineti (Oxford: Elsevier), 117-147. doi: 10.1016/S0166-4115(97)80006-4
25. Guerraz, M., Poquin, D., and Ohlmann, T. (1998). The role of head-centric spatial reference with a static and kinetic visual disturbance. Percept. Psychophys. 60, 287-295. doi: 10.3758/BF03206037
26. Henriques, D. Y., Klier, E. M., Smith, M. A., Lowy, D., and Crawford, J. D. (1998). Gaze-centered remapping of remembered visual space in an open-loop pointing task. J. Neurosci. 18, 1583-1594.
27. Homer (VIII century BC). Odissey. Indiana: Ex fontibus company.
28. Hospedales, T., and Vijayakumar, S. (2009). Multisensory oddity detection as bayesian inference. PLoS ONE4:e4205. doi: 10.1371/journal.pone.0004205
29. Jones, S. A. H., and Henriques, D. Y. P. (2010). Memory for proprioceptive and multisensory targets is partially coded relative to gaze. Neuropsychologia 48, 3782-3792. doi: 10.1016/j.neuropsychologia.2010.10.001
30. Kersten, D., Mamassian, P., and Yuille, A. (2004). Object perception as bayesian inference. Annu. Rev. Psychol. 55, 271-304. doi: 10.1146/annurev.psych.55.090902.142005
31. Knill, D. C. (2007). Robust cue integration: a bayesian model and evidence from cue-conflict studies with stereoscopic and figure cues to slant. J. Vis. 7, 5.1-5.24. doi: 10.1167/7.7.5
32. Kording, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., and Shams, L. (2007). Causal inference in multisensory perception. PLoS ONE 2:e943. doi: 10.1371/journal.pone.0000943
33. Landy, M. S., Maloney, L. T., Johnston, E. B., and Young, M. (1995). Measurement and modeling of depth cue combination: in defense of weak fusion. Vis. Res. 35, 389-412. doi: 10.1016/0042-6989(94)00176-M
34. Luyat, M., and Gentaz, E. (2002). Body tilt effect on the reproduction of orientations: studies on the visual oblique effect and subjective orientations. J. Exp. Psychol. Hum. Percept. Perform. 28, 1002-1011. doi: 10.1037/0096-1523.28.4.1002
35. Luyat, M., Gentaz, E., Corte, T. R., and Guerraz, M. (2001). Reference frames and haptic perception of orientation: body and head tilt effects on the oblique effect. Percept. Psychophys. 63, 541-554. doi: 10.3758/BF03194419
36. Makin, J. G., Fellows, M. R., and Sabes, P. N. (2013). Learning multisensory integration and coordinate transformation via density estimation. PLoS Comput. Biol. 9:e1003035. doi: 10.1371/journal.pcbi.1003035
37. Maule, F., Barchiesi, G., Brochier, T., and Cattaneo, L. (2013). Haptic working memory for grasping: the role of the parietal operculum. Cereb Cortex. doi: 10.1093/cercor/bht252. [Epub ahead of print].
38. McGuire, L. M. M., and Sabes, P. N. (2009). Sensory transformations and the use of multiple reference frames for reach planning. Nat. Neurosci. 12, 1056-1061. doi: 10.1038/nn.2357
39. McGuire, L. M. M., and Sabes, P. N. (2011). Heterogeneous representations in the superior parietal lobule are common across reaches to visual and proprioceptive targets. J. Neurosci. 31, 6661-6673. doi: 10.1523/JNEUROSCI.2921-10.2011
40. McIntyre, J., and Lipshits, M. (2008). Central processes amplify and transform anisotropies of the visual system in a test of visual-haptic coordination. J. Neurosci. 28, 1246-1261. doi: 10.1523/JNEUROSCI.2066-07.2008
41. McIntyre, J., Stratta, F., and Lacquaniti, F. (1997). Viewer-centered frame of reference for pointing to memorized targets in three-dimensional space. J. Neurophysiol. 78, 1601-1618. PV.
42. McIntyre, J., Stratta, F., and Lacquaniti, F. (1998). Short-term memory for reaching to visual targets: psychophysical evidence for body-centered reference frames. J. Neurosci. 18, 8423-8435.
43. Medendorp, W. P., Beurze, S. M., Pelt, S. V., and Werf, J. V. D. (2008). Behavioral and cortical mechanisms for spatial coding and action planning. Cortex 44, 587-597. doi: 10.1016/j.cortex.2007.06.001
44. Neely, K. A., Tessmer, A., Binsted, G., and Heath, M. (2008). Goal-directed reaching: movement strategies influence the weighting of allocentric and egocentric visual cues. Exp. Brain Res. 186, 375-384. doi: 10.1007/s00221-007-1238-z
45. Obhi, S. S., and Goodale, M. A. (2005). The effects of landmarks on the performance of delayed and real-time pointing movements. Exp. Brain Res. 167, 335-344. doi: 10.1007/s00221-005-0055-5
46. Pouget, A., Deneve, S., and Duhamel, J.-R. (2002a). A computational perspective on the neural basis of multisensory spatial representations. Nat. Rev. Neurosci. 3, 741-747. doi: 10.1038/nrn914
47. Pouget, A., Ducom, J. C., Torri, J., and Bavelier, D. (2002b). Multisensory spatial representations in eye-centered coordinates for reaching. Cognition 83, B1-B11. doi: 10.1016/S0010-0277(01)00163-9
48. Reichenbach, A., Thielscher, A., Peer, A., Bülthoff, H. H., and Bresciani, J.-P. (2014). A key region in the human parietal cortex for processing proprioceptive hand feedback during reaching movements. Neuroimage 84, 615-625. doi: 10.1016/j.neuroimage.2013.09.024
49. Roach, N. W., Heron, J., and McGraw, P. V. (2006). Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration. Proc. Biol. Sci. 273, 2159-2168. doi: 10.1098/rspb.2006.3578
50. Sarlegna, F. R., and Sainburg, R. L. (2007). The effect of target modality on visual and proprioceptive contributions to the control of movement distance. Exp. Brain Res. 176, 267-280. doi: 10.1007/s00221-006-0613-5
51. Schlicht, E. J., and Schrater, P. R. (2007). Impact of coordinate transformation uncertainty on human sensorimotor control. J. Neurophysiol. 97, 4203-4214. doi: 10.1152/jn.00160.2007
52. Smeets, J. B. J., van den Dobbelsteen, J. J., de Grave, D. D. J., van Beers, R. J., and Brenner, E. (2006). Sensory integration does not lead to sensory calibration. Proc. Natl. Acad. Sci. U.S.A. 103, 18781-18786. doi: 10.1073/pnas.0607687103
53. Sober, S. J., and Sabes, P. N. (2003). Multisensory integration during motor planning. J. Neurosci. 23, 6982-6992.
54. Sober, S. J., and Sabes, P. N. (2005). Flexible strategies for sensory integration during motor planning. Nat. Neurosci. 8, 490-497. doi: 10.1038/nn1427
55. Soechting, J. F., and Flanders, M. (1989). Errors in pointing are due to approximations in sensorimotor transformations. J. Neurophysiol. 62, 595-608. PV.
56. Soechting, J. F., and Ross, B. (1984). Psychophysical determination of coordinate representation of human arm orientation. Neuroscience 13, 595-604. doi: 10.1016/0306-4522(84)90252-5
57. Tagliabue, M., Arnoux, L., and McIntyre, J. (2013). Keep your head on straight: facilitating sensori-motor transformations for eye-hand coordination. Neuroscience 248, 88-94. doi: 10.1016/j.neuroscience.2013.05.051
58. Tagliabue, M., and McIntyre, J. (2008). Multiple and Multimodal Reference Frames for Eye-Hand Coordination. Neuroscience Meeting Planner. Washington, DC: Society for Neuroscience.
59. Tagliabue, M., and McIntyre, J. (2011). Necessity is the mother of invention: Reconstructing missing sensory information in multiple, concurrent reference frames for eye-hand coordination. J. Neurosci. 31, 1397-1409. doi: 10.1523/JNEUROSCI.0623-10.2011
60. Tagliabue, M., and McIntyre, J. (2012). Eye-hand coordination when the body moves: dynamic egocentric and exocentric sensory encoding. Neurosci. Lett. 513, 78-83. doi: 10.1016/j.neulet.2012.02.011
61. Tagliabue, M., and McIntyre, J. (2013). When kinesthesia becomes visual: a theoretical justification for executing motor tasks in visual space. PLoS ONE 8:e68438. doi: 10.1371/journal.pone.0068438
62. Tillery, S. I., Flanders, M., and Soechting, J. F. (1991). A coordinate system for the synthesis of visual and kinesthetic information. J. Neurosci. 11, 770-778.
63. van Beers, R. J., Sittig, A. C., and Denier van der Gon, J. J. (1996). How humans combine simultaneous proprioceptive and visual position information. Exp. Brain Res. 111, 253-261. doi: 10.1007/BF00227302
64. van Beers, R. J., Sittig, A. C., and Gon, J. J. (1999). Integration of proprioceptive and visual position-information: an experimentally supported model. J. Neurophysiol. 81, 1355-1364.
65. Vidal, M., Amorim, M.-A., and Berthoz, A. (2004). Navigating in a virtual three-dimensional maze: how do egocentric and allocentric reference frames interact? Brain Res. Cogn. Brain Res. 19, 244-258. doi: 10.1016/j.cogbrainres.2003.12.006
66. Wallace, M. T., Roberson, G. E., Hairston, W. D., Stein, B. E., Vaughan, J. W., and Schirillo, J. A. (2004). Unifying multisensory signals across time and space. Exp. Brain Res. 158, 252-258. doi: 10.1007/s00221-004-1899-9
67. Zaehle, T., Jordan, K., Wÿstenberg, T., Baudewig, J., Dechent, P., and Mast, F. W. (2007). The neural basis of the egocentric and allocentric spatial frame of reference. Brain Res. 1137, 92-103. doi: 10.1016/j.brainres.2006.12.044