A learning-based approach to artificial sensory feedback leads to optimal integration

Nature Neuroscience

Volumn 18, Issue 1, 2015, Pages 138-144

  Dadarlat, Maria C ^a   O'Doherty, Joseph E ^a   Sabes, Philip N ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANIMAL EXPERIMENT; ARTICLE; ARTIFICIAL SENSORY FEEDBACK; ASSOCIATION; BRAIN COMPUTER INTERFACE; CONTROLLED STUDY; HAND; MACHINE LEARNING; MALE; NONHUMAN; PATTERN STIMULATION; PRIMARY SOMATOSENSORY CORTEX; PRIORITY JOURNAL; PROPRIOCEPTION; RHESUS MONKEY; SENSORIMOTOR INTEGRATION; SENSORY FEEDBACK; SIGNAL TRANSDUCTION; TASK PERFORMANCE; TIME; VIRTUAL REALITY; VISION; VISUAL FEEDBACK; ADAPTIVE BEHAVIOR; ANIMAL; ANIMAL BEHAVIOR; INSTRUMENTAL CONDITIONING; LEARNING; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; SENSATION; SOMATOSENSORY CORTEX;

ANIMALS; BEHAVIOR, ANIMAL; BRAIN-COMPUTER INTERFACES; CONDITIONING, OPERANT; FEEDBACK, PSYCHOLOGICAL; LEARNING; MACACA MULATTA; MALE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; SENSATION; SOMATOSENSORY CORTEX; VISUAL PERCEPTION;

EID: 84926228503     PISSN: 10976256     EISSN: 15461726     Source Type: Journal    
DOI: 10.1038/nn.3883     Document Type: Article

References (48)

1. Sober, S.J. & Sabes, P.N. Multisensory integration during motor planning. J. Neurosci. 23, 6982-6992 (2003).
2. Sober, S.J. & Sabes, P.N. Flexible strategies for sensory integration during motor planning. Nat. Neurosci. 8, 490-497 (2005).
3. van Beers, R.J., Sittig, A.C. & Gon, J.J. Integration of proprioceptive and visual position-information: an experimentally supported model. J. Neurophysiol. 81, 1355-1364 (1999).
4. Ernst, M.O. & Banks, M.S. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429-433 (2002).
5. Morgan, M.L., Deangelis, G.C. & Angelaki, D.E. Multisensory integration in macaque visual cortex depends on cue reliability. Neuron 59, 662-673 (2008).
6. McGuire, L.M. & Sabes, P.N. Sensory transformations and the use of multiple reference frames for reach planning. Nat. Neurosci. 12, 1056-1061 (2009).
7. Sainburg, R.L., Poizner, H. & Ghez, C. Loss of proprioception produces defcits in interjoint coordination. J. Neurophysiol. 70, 2136-2147 (1993).
8. Sainburg, R.L., Ghilardi, M.F., Poizner, H. & Ghez, C. Control of limb dynamics in normal subjects and patients without proprioception. J. Neurophysiol. 73, 820-835 (1995).
9. Suminski, A.J., Tkach, D.C., Fagg, A.H. & Hatsopoulos, N.G. Incorporating feedback from multiple sensory modalities enhances brain-machine interface control. J. Neurosci. 30, 16777-16787 (2010).
10. Fagg, A.H. et al. Biomimetic brain machine interfaces for the control of movement. J. Neurosci. 27, 11842-11846 (2007).
11. Choi, J.S., DiStasio, M.M., Brockmeier, A.J. & Francis, J.T. An electric feld model for prediction of somatosensory (S1) cortical feld potentials induced by ventral posterior lateral (VPL) thalamic microstimulation. IEEE Trans. Neural Syst. Rehabil. Eng. 20, 161-169 (2012).
12. Daly, J., Liu, J., Aghagolzadeh, M. & Oweiss, K. Optimal space-time precoding of artifcial sensory feedback through mutichannel microstimulation in bi-directional brain-machine interfaces. J. Neural Eng. 9, 065004 (2012).
13. Weber, D.J., Friesen, R. & Miller, L.E. Interfacing the somatosensory system to restore touch and proprioception: essential considerations. J. Mot. Behav. 44, 403-418 (2012).
14. Tabot, G.A. et al. Restoring the sense of touch with a prosthetic hand through a brain interface. Proc. Natl. Acad. Sci. USA 110, 18279-18284 (2013).
15. Held, R. & Hein, A. Movement-produced stimulation in the development of visually guided behavior. J. Comp. Physiol. Psychol. 56, 872-876 (1963).
16. Xu, J., Yu, L., Rowland, B.A., Stanford, T.R. & Stein, B.E. Incorporating cross-modal statistics in the development and maintenance of multisensory integration. J. Neurosci. 32, 2287-2298 (2012).
17. Burge, J., Ernst, M.O. & Banks, M.S. The statistical determinants of adaptation rate in human reaching. J. Vis. 8, 1-19 (2008).
18. Simani, M.C., McGuire, L.M. & Sabes, P.N. Visual-shift adaptation is composed of separable sensory and task-dependent effects. J. Neurophysiol. 98, 2827-2841 (2007).
19. Zaidel, A., Turner, A.H. & Angelaki, D.E. Multisensory calibration is independent of cue reliability. J. Neurosci. 31, 13949-13962 (2011).
20. Makin, J.G., Fellows, M.R. & Sabes, P.N. Learning multisensory integration and coordinate transformation via density estimation. PLoS Comput. Biol. 9, e1003035 (2013).
21. Kalaska, J.F. The representation of arm movements in postcentral and parietal cortex. Can. J. Physiol. Pharmacol. 66, 455-463 (1988).
22. Kalaska, J.F. Parietal cortex area 5 and visuomotor behavior. Can. J. Physiol. Pharmacol. 74, 483-498 (1996).
23. Block, H.J. & Bastian, A.J. Sensory reweighting in targeted reaching: effects of conscious effort, error history, and target salience. J. Neurophysiol. 103, 206-217 (2010).
24. Cheng, S. & Sabes, P.N. Calibration of visually-guided reaching is driven by error corrective learning and internal dynamics. J. Neurophysiol. 97, 3057-3069 (2007).
25. Izawa, J. & Shadmehr, R. Learning from sensory and reward prediction errors during motor adaptation. PLoS Comput. Biol. 7, e1002012 (2011).
26. Kalaska, J.F., Cohen, D.A., Prud'homme, M. & Hyde, M.L. Parietal area 5 neuronal activity encodes movement kinematics, not movement dynamics. Exp. Brain Res. 80, 351-364 (1990).
27. Batista, A.P., Buneo, C.A., Snyder, L.H. & Andersen, R.A. Reach plans in eye-centered coordinates. Science 285, 257-260 (1999).
28. Battaglia-Mayer, A. et al. Early coding of reaching in the parietooccipital cortex. J. Neurophysiol. 83, 2374-2391 (2000).
29. Graziano, M.S., Cooke, D.F. & Taylor, C.S. Coding the location of the arm by sight. Science 290, 1782-1786 (2000).
30. Bremner, L.R. & Andersen, R.A. Coding of the reach vector in parietal area 5d. Neuron 75, 342-351 (2012).
31. Deneve, S., Latham, P.E. & Pouget, A. Effcient computation and cue integration with noisy population codes. Nat. Neurosci. 4, 826-831 (2001).
32. Ma, W.J., Beck, J.M., Latham, P.E. & Pouget, A. Bayesian inference with probabilistic population codes. Nat. Neurosci. 9, 1432-1438 (2006).
33. Chang, S.W. & Snyder, L.H. Idiosyncratic and systematic aspects of spatial representations in the macaque parietal cortex. Proc. Natl. Acad. Sci. USA 107, 7951-7956 (2010).
34. Marzocchi, N., Breveglieri, R., Galletti, C. & Fattori, P. Reaching activity in parietal area V6A of macaque: eye infuence on arm activity or retinocentric coding of reaching movements? Eur. J. Neurosci. 27, 775-789 (2008).
35. McGuire, L.M. & Sabes, P.N. Heterogeneous representations in the superior parietal lobule are common across reaches to visual and proprioceptive targets. J. Neurosci. 31, 6661-6673 (2011).
36. Wise, S.P., Boussaoud, D., Johnson, P.B. & Caminiti, R. Premotor and parietal cortex: corticocortical connectivity and combinatorial computations. Annu. Rev. Neurosci. 20, 25-42 (1997).
37. Andersen, R.A. & Buneo, C.A. Intentional maps in posterior parietal cortex. Annu. Rev. Neurosci. 25, 189-220 (2002).
38. Battaglia-Mayer, A., Caminiti, R., Lacquaniti, F. & Zago, M. Multiple levels of representation of reaching in the parieto-frontal network. Cereb. Cortex 13, 1009-1022 (2003).
39. Sabes, P.N. Sensory integration for reaching: models of optimality in the context of behavior and the underlying neural circuits. Prog. Brain Res. 191, 195-209 (2011).
40. Yttri, E.A., Liu, Y. & Snyder, L.H. Lesions of cortical area LIP affect reach onset only when the reach is accompanied by a saccade, revealing an active eye-hand coordination circuit. Proc. Natl. Acad. Sci. USA 110, 2371-2376 (2013).
41. Levy, I., Schluppeck, D., Heeger, D.J. & Glimcher, P.W. Specifcity of human cortical areas for reaches and saccades. J. Neurosci. 27, 4687-4696 (2007).
42. Pearson, R.C. & Powell, T.P. The cortico-cortical connections to area 5 of the parietal lobe from the primary somatic sensory cortex of the monkey. Proc. R. Soc. Lond. B Biol. Sci. 200, 103-108 (1978).
43. Lewis, J.W. & Van Essen, D.C. Corticocortical connections of visual, sensorimotor, and multimodal processing areas in the parietal lobe of the macaque monkey. J. Comp. Neurol. 428, 112-137 (2000).
44. Redding, G.M. & Wallace, B. Strategic calibration and spatial alignment: a model from prism adaptation. J. Mot. Behav. 34, 126-138 (2002).
45. van Beers, R.J., Sittig, A.C. & Denier van der Gon, J.J. How humans combine simultaneous proprioceptive and visual position information. Exp. Brain Res. 111, 253-261 (1996).
46. Ghez, C. & Sainburg, R. Proprioceptive control of interjoint coordination. Can. J. Physiol. Pharmacol. 73, 273-284 (1995).
47. Novak, K.E., Miller, L.E. & Houk, J.C. The use of overlapping submovements in the control of rapid hand movements. Exp. Brain Res. 144, 351-364 (2002).
48. Efron, B. & Tibshirani, R.J. An Introduction to the Bootstrap (Chapman & Hall, 1993).