Modification of saccadic gain by reinforcement

Journal of Neurophysiology

Volumn 106, Issue 1, 2011, Pages 219-232

  Madelain, Laurent ^a   Paeye, Céline ^a   Wallman, Josh ^b  

^a Univ Lille   (France)

^b CITY COLLEGE OF NEW YORK   (United States)

Author keywords

Adaptation; Eye movements; Plasticity; Reinforcement learning; Saccade

Indexed keywords

AMPLITUDE MODULATION; ARTICLE; EYE POSITION; HEARING; HUMAN; HUMAN EXPERIMENT; NORMAL HUMAN; PRIORITY JOURNAL; REINFORCEMENT; RETINA FOVEA; SACCADIC EYE MOVEMENT; VISION; VISUAL ADAPTATION; VISUAL STIMULATION;

ADAPTATION, PHYSIOLOGICAL; FEMALE; HUMANS; MALE; REINFORCEMENT (PSYCHOLOGY); SACCADES;

EID: 79959932893     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.01094.2009     Document Type: Article

References (60)

1. Abel LA, Schmidt D, Dell'Osso LF, Daroff RB. Saccadic system plasticity in humans. Ann Neurol 4: 313-318, 1978.
2. Alahyane N, Pelisson D. Eye position specificity of saccadic adaptation. Invest Ophthalmol Vis Sci 45: 123-130, 2004.
3. Alahyane N, Pelisson D. Long-lasting modifications of saccadic eye movements following adaptation induced in the double-step target paradigm. Learn Mem 12: 433-443, 2005.
4. Bahcall DO, Kowler E. The control of saccadic adaptation: implications for the scanning of natural visual scenes. Vision Res 40: 2779-2796, 2000.
5. Bayer HM, Glimcher PW. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47: 129-141, 2005.
6. Becker W. The neurobiology of saccadic eye movements. Metrics Rev Oculomot Res 3: 13-67, 1989.
7. Brainard DH. The psychophysics toolbox. Spat Vis 10: 433-436, 1997.
8. Chaturvedi V, van Gisbergen JA. Specificity of saccadic adaptation in three-dimensional space. Vision Res 37: 1367-1382, 1997.
9. Chen-Harris H, Joiner WM, Ethier V, Zee DS, Shadmehr R. Adaptive control of saccades via internal feedback. J Neurosci 28: 2804-2813, 2008.
10. Darcheville JC, Madelain L, Buquet C, Charlier J, Miossec Y. Operant conditioning of the visual smooth pursuit in young infants. Behav Processes 46: 131-139, 1999.
11. Deubel H. Separate adaptive mechanisms for the control of reactive, volitional, and memory guided saccadic eye movements. In: Attention and Performance. XVII. Cognitive Regulation of Performance: Interaction of Theory and Application, edited by Gopher D, Koriat A. Cambridge, MA: MIT Press, 1999, p. 697-721.
12. Donahoe JW, Burgos JE, Palmer DC. A selectionist approach to reinforcement. J Exp Anal Behav 60: 17-40, 1993.
13. Donahoe JW, Palmer DC. Learning and Complex Behavior. Boston, MA: Allyn & Bacon, 1994.
14. Ethier V, Zee DS, Shadmehr R. Spontaneous recovery of motor memory during saccade adaptation. J Neurophysiol 99: 2577-2583, 2008.
15. Fujita M, Amagai A, Minakawa F, Aoki M. Selective and delay adaptation of human saccades. Brain Res Cogn Brain Res 13: 41-52, 2002.
16. Galbicka G. Shaping in the 21st century: moving percentile schedules into applied settings. J Appl Behav Anal 27: 739-760, 1994.
17. Galbicka G, Kautz MA, Jagers T. Response acquisition under targeted percentile schedules: a continuing quandary for molar models of operant behavior. J Exp Anal Behav 60: 171-184, 1993.
18. Harris CM. Does saccadic undershoot minimize saccadic flight-time? A Monte-Carlo study. Vision Res 35: 691-701, 1995.
19. Harwood MR, Madelain L, Krauzlis RJ, Wallman J. The spatial scale of attention strongly modulates saccade latencies. J Neurophysiol 99: 1743-1757, 2008.
20. Havermann K, Lappe M. The influence of the consistency of postsaccadic visual errors on saccadic adaptation. J Neurophysiol 103: 3302-3310, 2010.
21. Henson DB. Corrective saccades: effects of altering visual feedback. Vision Res 18: 63-67, 1978.
22. Herman JP, Harwood MR, Wallman J. Saccade adaptation specific to visual context. J Neurophysiol 101: 1713-1721, 2009.
23. Hernandez TD, Levitan CA, Banks MS, Schor CM. How does saccade adaptation affect visual perception? J Vis 8: 3 11713-16, 2008.
24. Hikosaka O, Nakamura K, Nakahara H. Basal ganglia orient eyes to reward. J Neurophysiol 95: 567-584, 2006.
25. Hopp JJ, Fuchs AF. The characteristics and neuronal substrate of saccadic eye movement plasticity. Prog Neurobiol 72: 27-53, 2004.
26. Hopp JJ, Fuchs AF. Identifying sites of saccade amplitude plasticity in humans: transfer of adaptation between different types of saccade. Exp Brain Res 202: 129-145, 2010.
27. Ikeda T, Hikosaka O. Reward-dependent gain and bias of visual responses in primate superior colliculus. Neuron 39: 693-700, 2003.
28. Kojima Y, Iwamoto Y, Yoshida K. Memory of learning facilitates saccadic adaptation in the monkey. J Neurosci 24: 7531-7539, 2004.
29. Kommerell G, Olivier D, Theopold H. Adaptive programming of phasic and tonic components in saccadic eye movements. Investigations of patients with abducens palsy. Invest Ophthalmol 15: 657-660, 1976.
30. Kording KP, Tenenbaum JB, Shadmehr R. The dynamics of memory as a consequence of optimal adaptation to a changing body. Nat Neurosci 10: 779-786, 2007.
31. Lauwereyns J, Watanabe K, Coe B, Hikosaka O. A neural correlate of response bias in monkey caudate nucleus. Nature 418: 413-417, 2002.
32. Lebedev S, Van Gelder P, Tsui WH. Square-root relations between main saccadic parameters. Invest Ophthalmol Vis Sci 37: 2750-2758, 1996.
33. Madelain L, Champrenaut L, Chauvin A. Control of sensorimotor variability by consequences. J Neurophysiol 98: 2255-2265, 2007.
34. Madelain L, Harwood MR, Herman JP, Wallman J. Saccade adaptation is unhampered by distractors. J Vision 10: 29, 2010.
35. Madelain L, Krauzlis RJ. Effects of learning on smooth pursuit during transient disappearance of a visual target. J Neurophysiol 90: 972-982, 2003.
36. Madelain L, Krauzlis RJ, Wallman J. Spatial deployment of attention influences both saccadic and pursuit tracking. Vision Res 45: 2685-2703, 2005.
37. Madelain L, Paeye C, Darcheville JC. Operant control of human eye movements. Behav Processes 87: 142-148, 2011.
38. McLaughlin SC. Parametric adjustment in saccadic eye movements. Percept Psychophys 2: 359-362, 1967.
39. Montagnini A, Chelazzi L. The urgency to look: prompt saccades to the benefit of perception. Vision Res 45: 3391-3401, 2005.
40. Nakamura K, Hikosaka O. Role of dopamine in the primate caudate nucleus in reward modulation of saccades. J Neurosci 26: 5360-5369, 2006.
41. Noto CT, Robinson FR. Visual error is the stimulus for saccade gain adaptation. Brain Res Cogn Brain Res 12: 301-305, 2001.
42. Noto CT, Watanabe S, Fuchs AF. Characteristics of simian adaptation fields produced by behavioral changes in saccade size and direction. J Neurophysiol 81: 2798-2813, 1999.
43. Paeye C, Madelain L. Reinforcing saccadic amplitude variability. J Exp Anal Behav 95: 149-162, 2011.
44. Pelisson D, Alahyane N, Panouilleres M, Tilikete C. Sensorimotor adaptation of saccadic eye movements. Neurosci Biobehav Rev 34: 1103-1120, 2010.
45. Pelli DG. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat Vis 10: 437-442, 1997.
46. Robinson FR, Noto CT, Bevans SE. Effect of visual error size on saccade adaptation in monkey. J Neurophysiol 90: 1235-1244, 2003.
47. Scudder CA, Batourina EY, Tunder GS. Comparison of two methods of producing adaptation of saccade size and implications for the site of plasticity. J Neurophysiol 79: 704-715, 1998.
48. Semmlow JL, Gauthier GM, Vercher JL. Mechanisms of short-term saccadic adaptation. J Exp Psychol Hum Percept Perform 15: 249-258, 1989.
49. Shafer JL, Noto CT, Fuchs AF. Temporal characteristics of error signals driving saccadic gain adaptation in the macaque monkey. J Neurophysiol 84: 88-95, 2000.
50. Shelhamer M, Clendaniel RA. Context-specific adaptation of saccade gain. Exp Brain Res 146: 441-450, 2002.
51. Skinner BF. Selection by consequences. Science 213: 501-504, 1981.
52. Straube A, Fuchs AF, Usher S, Robinson FR. Characteristics of saccadic gain adaptation in rhesus macaques. J Neurophysiol 77: 874-895, 1997.
53. Sugrue LP, Corrado GS, Newsome WT. Matching behavior and the representation of value in the parietal cortex. Science 304: 1782-1787, 2004.
54. Takikawa Y, Kawagoe R, Itoh H, Nakahara H, Hikosaka O. Modulation of saccadic eye movements by predicted reward outcome. Exp Brain Res 142: 284-291, 2002.
55. Wallman J, Fuchs AF. Saccadic gain modification: visual error drives motor adaptation. J Neurophysiol 80: 2405-2416, 1998.
56. Watanabe K, Lauwereyns J, Hikosaka O. Effects of motivational conflicts on visually elicited saccades in monkeys. Exp Brain Res 152: 361-367, 2003a.
57. Watanabe K, Lauwereyns J, Hikosaka O. Neural correlates of rewarded and unrewarded eye movements in the primate caudate nucleus. J Neurosci 23: 10052-10057, 2003b.
58. Wolpert DM, Ghahramani Z, Jordan MI. An internal model for sensorimotor integration. Science 269: 1880-1882, 1995.
59. Wong AL, Shelhamer M. Sensorimotor adaptation error signals are derived from realistic predictions of movement outcomes. J Neurophysiol 105: 1130-1140, 2011.
60. Xu-Wilson M, Zee DS, Shadmehr R. The intrinsic value of visual information affects saccade velocities. Exp Brain Res 196: 475-481, 2009.