Operant control of human eye movements

Behavioural Processes

Volumn 87, Issue 1, 2011, Pages 142-148

  Madelain, Laurent ^a   Paeye, Céline ^a   Darcheville, Jean Claude ^a  

^a UNIV LILLE   (France)

Author keywords

Eye movements; Motor control; Reinforcement; Variability

Indexed keywords

EYE; HUMAN BEHAVIOR; MOVEMENT; PHYSIOLOGICAL RESPONSE; PRIMATE; VARIANCE ANALYSIS;

ADAPTATION; ARTICLE; GAZE; HUMAN; INSTRUMENTAL CONDITIONING; LATENT PERIOD; MOTOR CONTROL; NONHUMAN; REINFORCEMENT; SACCADIC EYE MOVEMENT; SMOOTH PURSUIT EYE MOVEMENT; VELOCITY; VISUAL ACUITY;

PRIMATES;

EID: 79954917716     PISSN: 03766357     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.beproc.2011.02.009     Document Type: Article

References (87)

1. Abel L.A., Schmidt D., Dell'Osso L.F., Daroff R.B. Saccadic system plasticity in humans. Ann. Neurol. 1978, 4:313-318.
2. Alahyane N., Pelisson D. Eye position specificity of saccadic adaptation. Invest. Ophthalmol. Vis. Sci. 2004, 45:123-130.
3. Alahyane N., Pelisson D. Long-lasting modifications of saccadic eye movements following adaptation induced in the double-step target paradigm. Learn. Mem. 2005, 12:433-443.
4. Aslin R. Development of smooth pursuit in human infants. Eye Movements: Cognition and Vision Perception 1981, Erlbaum, Hillsdale, NJ. D.F. Fischer, R.A. Monty, E.J. Senders (Eds.).
5. Badler J.B., Heinen S.J. Anticipatory movement timing using prediction and external cues. J. Neurosci. 2006, 26:4519-4525.
6. Bahill A.T., Clark M.R., Stark L. The main sequence, a tool for studying human eye movements. Math. Biosci. 1975, 24:191-204.
7. Barnes G.R., Asselman P.T. The mechanism of prediction in human smooth pursuit eye movements. J. Physiol. 1991, 439:439-461.
8. Barnes G.R., Donelan S.F. The remembered pursuit task: evidence for segregation of timing and velocity storage in predictive oculomotor control. Exp. Brain Res. 1999, 129:57-67.
9. Bayer H.M., Glimcher P.W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 2005, 47:129-141.
10. Becker W. The neurobiology of saccadic eye movements. Metrics. Rev. Oculomot. Res. 1989, 3:13-67.
11. Becker W., Fuchs A.F. Prediction in the oculomotor system: smooth pursuit during transient disappearance of a visual target. Exp. Brain Res. 1985, 57:562-575.
12. Bennett S.J., Barnes G.R. Combined smooth and saccadic ocular pursuit during the transient occlusion of a moving visual object. Exp. Brain Res. 2006, 168:313-321.
13. Beutter B.R., Stone L.S. Human motion perception and smooth eye movements show similar directional biases for elongated apertures. Vision Res. 1998, 38:1273-1286.
14. Beutter B.R., Stone L.S. Motion coherence affects human perception and pursuit similarly. Vis. Neurosci. 2000, 17:139-153.
15. Blough D.S. The reinforcement of least-frequent interresponse times. J. Exp. Anal. Behav. 1966, 9:581-591.
16. Darcheville J.-C., Madelain L., Buquet C., Charlier J., Miossec Y. Operant conditioning of the visual smooth pursuit in young infants. Behav. Process. 1999, 46:131-139.
17. Darwin C. On the Origin of Species by Means of Natural Selection or the Preservation of Favoured Races in the Struggle for Life 1859, John Murray, London, UK.
18. Deubel H., Schneider W.X. Saccade target selection and object recognition: evidence for a common attentional mechanism. Vision Res. 1996, 36:1827-1837.
19. Donahoe J.W., Burgos J.E., Palmer D.C. A selectionist approach to reinforcement. J. Exp. Anal. Behav. 1993, 60:17-40.
20. Donahoe J.W., Palmer D.C. Learning and complex Behavior 1994, Allyn & Bacon, Boston, MA.
21. Dube W.V., Balsamo L.M., Fowler T.R., Dickson C.A., Lombard K.M., Tomanari G.Y. Observing behavior topography in delayed matching to multiple samples. Psychol. Rec. 2006, 56:233-244.
22. Faisal A.A., Selen L.P., Wolpert D.M. Noise in the nervous system. Nat. Rev. Neurosci. 2008, 9:292-303.
23. Freyberg S., Ilg U.J. Anticipatory smooth-pursuit eye movements in man and monkey. Exp. Brain Res. 2008, 186:203-214.
24. Goldberg M.E., Wurtz R.H. Activity of superior colliculus in behaving monkey. I. Visual receptive fields of single neurons. J. Neurophysiol. 1972, 35:542-559.
25. Grunow A., Neuringer A. Learning to vary and varying to learn. Psychon. Bull. Rev. 2002, 9:250-258.
26. Hafed Z.M., Krauzlis R.J. Goal representations dominate superior colliculus activity during extrafoveal tracking. J. Neurosci. 2008, 28:9426-9439.
27. Herman J.P., Harwood M.R., Wallman J. Saccade adaptation specific to visual context. J. Neurophysiol. 2009, 101:1713-1721.
28. Hikosaka O., Nakamura K., Nakahara H. Basal ganglia orient eyes to reward. J. Neurophysiol. 2006, 95:567-584.
29. Holland J.G. Technique for behavioral analysis of human observing. Science 1957, 125:348-350.
30. Hopp J.J., Fuchs A.F. The characteristics and neuronal substrate of saccadic eye movement plasticity. Prog. Neurobiol. 2004, 72:27-53.
31. Ikeda T., Hikosaka O. Reward-dependent gain and bias of visual responses in primate superior colliculus. Neuron 2003, 39:693-700.
32. Ingvaldsen R.P., Whiting H.T.A. Modern views on motor skill learning are not 'representative'. Hum. Mov. Sci. 1997, 16:705-732.
33. Johnson M.H. Cortical maturation and the development of visual attention in early infancy. J. Cogn. Neurosci. 1990, 2:81-95.
34. Khurana B., Kowler E. Shared attentional control of smooth eye movement and perception. Vision Res. 1987, 27:1603-1618.
35. Kommerell G., Olivier D., Theopold H. Adaptive programming of phasic and tonic components in saccadic eye movements. Investigations of patients with abducens palsy. Invest. Ophthalmol. 1976, 15:657-660.
36. Kording K. Decision theory: what "should" the nervous system do?. Science 2007, 318:606-610.
37. Kowler E. Cognitive expectations, not habits, control anticipatory smooth oculomotor pursuit. Vision Res. 1989, 29:1049-1057.
38. Kowler E., Anderson E., Dosher B., Blaser E. The role of attention in the programming of saccades. Vision Res. 1995, 35:1897-1916.
39. Krauzlis R.J. Eye movements. Fundamental Neuroscience 2008, Elesevier, Amsterdam, NL. 3rd ed. L.R. Squire, D. Berg (Eds.).
40. Krauzlis R.J., Adler S.A. Effects of directional expectations on motion perception and pursuit eye movements. Vis. Neurosci. 2001, 18:365-376.
41. Land M.F., Nilsson D.-E. Animal Eyes 2002, Oxford University Press, Oxford, UK.
42. Lauwereyns J., Watanabe K., Coe B., Hikosaka O. A neural correlate of response bias in monkey caudate nucleus. Nature 2002, 418:413-417.
43. Li X., Basso M.A. Preparing to move increases the sensitivity of superior colliculus neurons. J. Neurosci. 2008, 28:4561-4577.
44. Machado A. Operant conditioning of behavioral variability using a percentile reinforcement schedule. J. Exp. Anal. Behav. 1989, 52:155-166.
45. Madelain L., Champrenaut L., Chauvin A. Control of sensorimotor variability by consequences. J. Neurophysiol. 2007, 98:2255-2265.
46. Madelain L., Harwood M.R., Herman J.P., Wallman J. Saccade adaptation is unhampered by distractors. J. Vis. 2010, 10:29.
47. Madelain L., Krauzlis R.J. Pursuit of the ineffable: perceptual and motor reversals during the tracking of apparent motion. J. Vis. 2003, 3:642-653.
48. Madelain L., Krauzlis R.J. Effects of learning on smooth pursuit during transient disappearance of a visual target. J. Neurophysiol. 2003, 90:972-982.
49. Madelain L., Paeye C., Wallman J. Saccadic adaptation: reinforcement can drive motor adaptation. J. Vis. 2008, 8:919.
50. McLaughlin S.C. Parametric adjustment in saccadic eye movements. Percept. Psychophys. 1967, 2:359-362.
51. Montagnini A., Chelazzi L. The urgency to look: prompt saccades to the benefit of perception. Vision Res. 2005, 45:3391-3401.
52. Nakamura K., Hikosaka O. Role of dopamine in the primate caudate nucleus in reward modulation of saccades. J. Neurosci. 2006, 26:5360-5369.
53. Neuringer A. Operant variability: evidence, functions, and theory. Psychon. Bull. Rev. 2002, 9:672-705.
54. Neuringer A. Reinforced variability in animals and people: implications for adaptive action. Am. Psychol. 2004, 59:891-906.
55. Nilsson D.E. The evolution of eyes and visually guided behaviour. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2009, 364:2833-2847.
56. Noto C.T., Robinson F.R. Visual error is the stimulus for saccade gain adaptation. Brain Res. Cogn. Brain Res. 2001, 12:301-305.
57. Noto C.T., Watanabe S., Fuchs A.F. Characteristics of simian adaptation fields produced by behavioral changes in saccade size and direction. J. Neurophysiol. 1999, 81:2798-2813.
58. Optican L.M., Zee D.S., Chu F.C. Adaptive response to ocular muscle weakness in human pursuit and saccadic eye movements. J. Neurophysiol. 1985, 54:110-122.
59. Paeye C., Darcheville J.-C., Madelain L. Shaping induces long-term enhancements in pursuit-like-smooth movements under image-stabilization condition. Perception 2007, 36. ECVP Abstract Supplement.
60. Paeye C., Madelain L. Reinforcing saccadic amplitude variability. J. Exp. Anal. Behav. 2011, 95:149-162.
61. Pelisson D., Alahyane N., Panouilleres M., Tilikete C. Sensorimotor adaptation of saccadic eye movements. Neurosci. Biobehav. Rev. 2010, 34:1103-1120.
62. Posner M.I. Orienting of attention. Q. J. Exp. Psychol. 1980, 32:3-25.
63. Pryor K.W., Haag R., O'Reilly J. The creative porpoise: training for novel behavior. J. Exp. Anal. Behav. 1969, 12:653-661.
64. Ratcliff R. Putting noise into neurophysiological models of simple decision making. Nat. Neurosci. 2001, 4:336-337.
65. Reddi B.A., Carpenter R.H. The influence of urgency on decision time. Nat. Neurosci. 2000, 3:827-830.
66. Robinson D.A. The systems approach to the oculomotor system. Vision Res. 1986, 26:91-99.
67. Schroeder S.R., Holland J.G. Operant control of eye movements. J. Appl. Behav. Anal. 1968, 1:161-166.
68. Schroeder S.R., Holland J.G. Reinforcement of eye movement with concurrent schedules. J. Exp. Anal. Behav. 1969, 12:897-903.
69. Scudder C.A., Batourina E.Y., Tunder G.S. Comparison of two methods of producing adaptation of saccade size and implications for the site of plasticity. J. Neurophysiol. 1998, 79:704-715.
70. Shelhamer M., Clendaniel R.A. Context-specific adaptation of saccade gain. Exp. Brain Res. 2002, 146:441-450.
71. Steinbach M.J. Pursuing the perceptual rather than the retinal stimulus. Vision Res. 1976, 16:1371-1376.
72. Stone L.S., Beutter B.R., Lorenceau J. Visual motion integration for perception and pursuit. Perception 2000, 29:771-787.
73. Sugrue L.P., Corrado G.S., Newsome W.T. Matching behavior and the representation of value in the parietal cortex. Science 2004, 304:1782-1787.
74. Takikawa Y., Kawagoe R., Itoh H., Nakahara H., Hikosaka O. Modulation of saccadic eye movements by predicted reward outcome. Exp. Brain Res. 2002, 142:284-291.
75. Thiele A., Henning P., Kubischik M., Hoffmann K.P. Neural mechanisms of saccadic suppression. Science 2002, 295:2460-2462.
76. Tian J., Zee D.S. Context-specific saccadic adaptation in monkeys. Vision Res. 2010, 50:2403-2410.
77. Tomanari G.Y., Balsamo L.M., Fowler T.R., Lombard K.M., Farren K.M., Dube W.V. Manual and ocular observing behavior in human subjects. Eur. J. Behav. Anal. 2007, 8:29-40.
78. van Beers R.J. The sources of variability in saccadic eye movements. J. Neurosci. 2007, 27:8757-8770.
79. van den Berg A.V. Human smooth pursuit during transient perturbations of predictable and unpredictable target movement. Exp. Brain Res. 1988, 72:95-108.
80. Wagenmakers E.J., Brown S. On the linear relation between the mean and the standard deviation of a response time distribution. Psychol. Rev. 2007, 114:830-841.
81. Wallman J., Fuchs A.F. Saccadic gain modification: visual error drives motor adaptation. J. Neurophysiol. 1998, 80:2405-2416.
82. Walls G.L. The evolutionary history of eye movements. Vision Res. 1962, 2:69-80.
83. Watanabe K., Lauwereyns J., Hikosaka O. Neural correlates of rewarded and unrewarded eye movements in the primate caudate nucleus. J. Neurosci. 2003, 23:10052-10057.
84. Wells S.G., Barnes G.R. Predictive smooth pursuit eye movements during identification of moving acuity targets. Vision Res. 1999, 39:2767-2775.
85. Wolpert D.M., Ghahramani Z. Computational principles of movement neuroscience. Nat. Neurosci. 2000, 3(Suppl.):1212-1217.
86. Wolpert D.M., Ghahramani Z., Jordan M.I. An internal model for sensorimotor integration. Science 1995, 269:1880-1882.
87. Xu-Wilson M., Zee D.S., Shadmehr R. The intrinsic value of visual information affects saccade velocities. Exp. Brain Res. 2009, 196:475-481.