Reinforcing saccadic amplitude variability

Journal of the Experimental Analysis of Behavior

Volumn 95, Issue 2, 2011, Pages 149-162

  Paeye, Cé Line ^a   Madelain, Laurent ^a  

^a UNIV LILLE   (France)

Author keywords

Humans; Motor control; Ocular saccade; Operant; Selection; Shaping; Variability

Indexed keywords

ARTICLE; AUDITORY STIMULATION; HUMAN; INSTRUMENTAL CONDITIONING; REACTION TIME; REINFORCEMENT; SACCADIC EYE MOVEMENT; STATISTICS;

ACOUSTIC STIMULATION; CONDITIONING, OPERANT; HUMANS; REACTION TIME; REINFORCEMENT (PSYCHOLOGY); SACCADES; STOCHASTIC PROCESSES;

EID: 79954748973     PISSN: 00225002     EISSN: None     Source Type: Journal    
DOI: 10.1901/jeab.2011.95-149     Document Type: Article

References (74)

1. Abel, L. A., Schmidt, D., Dell'Osso, L. F., & Daroff, R. B. (1978). Saccadic system plasticity in humans. Annals of Neurology, 4, 313-18.
2. Abreu-Rodrigues, J., Lattal, K. A., dos Santos, C. V., & Matos, R. A. (2005). Variation, repetition, and choice. Journal of the Experimental Analysis of Behavior, 83, 147-168.
3. Aslin, R. N., & Salapatek, P. (1975). Saccadic localization of visual targets by the very young human infant. Perception & Psychophysics, 17, 293-302.
4. Bahcall, D. O., & Kowler, E. (2000). The control of saccadic adaptation: implications for the scanning of natural visual scenes. Vision Research, 40, 2779-2796.
5. Bahill, A. T., Clark, M. R., & Stark, L. (1975). The main sequence, a tool for studying human eye movements. Mathematical iosciences, 24, 191-204.
6. Bays, P. M., & Wolpert, D. M. (2007). Computational principles of sensorimotor control that minimize uncertainty and variability. The Journal of Physiology, 578, 387-396.
7. Blough, D. S. (1966). The reinforcement of least-frequent interresponse times. Journal of the Experimental Analysis of Behavior, 9, 581-91.
8. Chen-Harris, H., Joiner, W. M., Ethier, V., Zee, D. S., & Shadmehr, R. (2008). Adaptive control of saccades via internal feedback. Journal of Neuroscience, 28, 2804-2813.
9. Darcheville, J.-C., Madelain, L., Buquet, C., Charlier, J., & Miossec, Y. (1999). Operant conditioning of the visual smooth pursuit in young infants. Behavioural Processes, 46, 131-139.
10. Donahoe, J. W., Burgos, J. E., & Palmer, D. C. (1993). A selectionist approach to reinforcement. Journal of the Experimental Analysis of Behavior, 60, 17-40.
11. Efron, B., Jolivet, E., & Hordan, R. (1995). Le bootstrap et ses applications: Discrimination & régression. Saint-Mandé (France): ISIA.
12. Eisenberger, R., Armeli, S., & Pretz, J. (1998). Can the promise of reward increase creativity? Journal of Personality and Social sychology, 74, 704-714.
13. Faisal, A. A., Selen, L. P., & Wolpert, D.M. (2008). Noise in the nervous system. Nature Reviews Neuroscience, 9, 292-303.
14. Galbicka, G. (1994). Shaping in the 21st century: Moving percentile schedules into applied settings. Journal of Applied Behavior Analysis, 27, 739-760.
15. Galbicka, G., Kautz, M. A., & Jagers, T. (1993). Response acquisition under targeted percentile schedules: A continuing quandary for molar models of operant behavior. Journal of the Experimental Analysis of Behavior, 60, 171-184.
16. Glimcher, P. W. (2003). The neurobiology of visualsaccadic decision making. Annual Review of Neuroscience, 26, 133-179.
17. Goetz, E. M., & Baer, D. M. (1973). Social control of form diversity and the emergence of new forms in children's blockbuilding. Journal of Applied Behavior Analysis, 6, 209-217.
18. Grunow, A., & Neuringer, A. (2002). Learning to vary and varying to learn. Psychonomic Bulletin & Review, 9, 250-258.
19. Harris, C. M. (1995). Does saccadic undershoot minimize saccadic flight-time? A Monte-Carlo study. Vision Research, 35, 691-701.
20. Harris, C. M., & Wolpert, D. M. (1998). Signal-dependent noise determines motor planning. Nature, 394, 780-784.
21. Harris, C. M., & Wolpert, D. M. (2006). The main sequence of saccades optimizes speed-accuracy trade-off. Biological Cybernetics, 5, 21-29.
22. Havermann, K., & Lappe, M. (2010). The influence of the consistency of post-saccadic visual error on saccadic adaptation. Journal of Neurophysiology, 103, 3302-3310.
23. Henson, D. B. (1979). Investigation into corrective saccadic eye movements for refixation amplitudes of 10 degrees and below. Vision Research, 19, 57-61.
24. Hopkinson, J., & Neuringer, A. (2003). Modifying behavioral variability in moderately depressed students. Behavior Modification, 27, 51-264.
25. Hopp, J. J., & Fuchs, A. F. (2004). The characteristics and neuronal substrate of saccadic eye movement plasticity. Progress in Neurobiology, 72, 27-53.
26. Ikeda, T., & Hikosaka, O. (2003). Reward-dependent gain and bias of visual responses in primate superior colliculus. Neuron, 39, 93-700.
27. Ingvaldsen, R. P., & Whiting, H. T. (1997). Modern views on motor skill learning are not 'representative'! Human Movement Science, 6, 705-732.
28. Joyce, J. H., & Chase, P. N. (1990). Effects of response variability on the sensitivity of rule-governed behavior. Journal of the Experimental Analysis of Behavior, 54, 251-262.
29. Kommerell, G., Olivier, D., & Theopold, H. (1976). Adaptive programming of phasic and tonic components in saccadic eye movements. Investigations of patients with abducens palsy. Investigative Ophthalmology, 15, 657-660.
30. Lauwereyns, J., Watanabe, K., Coe, B., & Hikosaka, O. (2002). A neural correlate of response bias in monkey caudate nucleus. ature, 418, 413-417.
31. Lebedev, S., Van Gelder, P., & Tsui, W. H. (1996). Squareroot relations between main saccadic parameters. Investigative Ophthalmology & Visual Science, 37, 2750-2758.
32. Lee, R., Sturmey, P., & Fields, L. (2007). Schedule-induced and operant mechanisms that influence response variability: a review and implications for future investigations. The Psychological Record, 57, 429-455.
33. Machado, A. (1989). Operant conditioning of behavioral variability using a percentile reinforcement schedule. Journal of the Experimental Analysis of Behavior, 52, 155-166.
34. Machado, A. (1992). Behavioral variability and frequencydependent selection. Journal of the Experimental Analysis of Behavior, 58, 41-263.
35. Machado, A. (1997). Increasing the variability of response sequences in pigeons by adjusting the frequency of switching between two keys. Journal of the Experimental Analysis of Behavior, 68, 1-25.
36. Madelain, L., Champrenaut, L., & Chauvin, A. (2007). Control of sensorimotor variability by consequences. Journal of Neurophysiology, 98, 2255-2265.
37. Madelain, L., & Krauzlis, R. J. (2003). Effects of learning on smooth pursuit during transient disappearance of a visual target. Journal of Neurophysiology, 90, 972-982.
38. Madelain, L., Paeye, C., & Wallman, J. (2008). Saccadic adaptation: reinforcement can drive motor adaptation. Journal of Vision, 8(6), 19.
39. Maes, J. H. R., & Van der Goot, M. (2006). Human operant learning under concurrent reinforcement of response variability. Learning and Motivation, 37, 79-92.
40. Martinez, W. L., & Martinez, A. R. (2002). Computational Statistics Handbook with Matlab. Boca Raton, FL: Chapman and Hall.
41. McLaughlin, S. (1967). Parametric adjustment in saccadic eye movements. Perception & Psychophysics, 2, 359-362.
42. Miller, N., & Neuringer, A. (2000). Reinforcing variability in adolescents with autism. Journal of Applied Behavior Analysis, 33, 151-65.
43. Montagnini, A., & Chelazzi, L. (2005). The urgency to look: prompt saccades to the benefit of perception. Vision Research, 45, 3391-401.
44. Nakamura, K., & Hikosaka, O. (2006). Role of dopamine in the primate caudate nucleus in reward modulation of saccades. Journal of Neuroscience, 26, 5360-5369.
45. Neuringer, A. (1986). Can people behave "randomly?": the role of feedback. Journal of Experimental Psychology: General, 115, 62-75.
46. Neuringer, A. (1992). Choosing to vary and repeat. Psychological Science, 3, 246-250.
47. Neuringer, A. (1993). Reinforced variation and selection. Animal Learning & Behavior, 21(2), 83-91.
48. Neuringer, A. (2002). Operant variability: evidence, functions, and theory. Psychonomic Bulletin & Review, 9, 672-705.
49. Neuringer, A. (2009). Operant variability and the power of reinforcement. The Behavior Analyst Today, 10(2), 319-343.
50. Neuringer, A., Deiss, C., & Olson, G. (2000). Reinforced variability and operant learning. Journal of Experimental Psychology: Animal Behavior Processes, 26, 98-111.
51. Noto, C. T., & Robinson, F. R. (2001). Visual error is the stimulus for saccade gain adaptation. Cognitive Brain Research, 12, 301-05.
52. Optican, L. M., Zee, D. S., & Chu, F. C. (1985). Adaptive response to ocular muscle weakness in human pursuit and saccadic eye movements. Journal of Neurophysiology, 54, 110-122.
53. Page, S., & Neuringer, A. (1985). Variability is an operant. Journal of Experimental Psychology: Animal Behavior Processes, 11, 429-52.
54. Pelisson, D., Alahyane, N., Panouilleres, M., & Tilikete, C. (2010). Sensorimotor adaptation of saccadic eye movements. Neuroscience and Biobehavioral Reviews, 34, 1103-1120.
55. Pryor, K. W., Haag, R., & O'Reilly, J. (1969). The creative porpoise: training for novel behavior. Journal of the Experimental Analysis of Behavior, 12, 653-661.
56. Reddi, B. A., & Carpenter, R. H. (2000). The influence of urgency on decision time. Nature Neuroscience, 3, 827-830.
57. Robinson, F. R., Noto, C. T., & Bevans, S. E. (2003). Effect of visual error size on saccade adaptation in monkey. Journal of Neurophysiology, 90, 1235-1244.
58. Robinson, F. R., Soetedjo, R., & Noto, C. (2006). Distinct short-term and long-term adaptation to reduce saccade size in monkey. Journal of Neurophysiology, 96, 1030-1041.
59. Sato, M., & Hikosaka, O. (2002). Role of primate substantia nigra pars reticulata in reward-oriented saccadic eye movement. Journal of Neuroscience, 22, 2363-2373.
60. Schultz, W. (2000). Multiple reward signals in the brain. Nature Neuroscience, 1, 199-207.
61. Seeberger, T., Noto, C., & Robinson, F. (2002). Non-visual information does not drive saccade gain adaptation in monkeys. Brain Research, 956, 374-379.
62. Skinner, B. F. (1981). Selection by consequences. Science, 213, 501-504.
63. Stokes, P. D. (1995). Learned variability. Animal Learning & Behavior, 23, 164-176.
64. Stokes, P. D., & Balsam, P. (2001). An optimal period for setting sustained variability levels. Psychonomic Bulletin & Review, 8, 177-84.
65. Takikawa, Y., Kawagoe, R., Itoh, H., Nakahara, H., & Hikosaka, O. (2002). Modulation of saccadic eye movements by predicted reward outcome. Experimental Brain Research, 142, 284-291.
66. Todorov, E. (2004). Optimality principles in sensorimotor control (review). Nature Neuroscience, 7, 907-915.
67. Van Beers, R. J. (2007). The sources of variability in saccadic eye movements. Journal of Neuroscience, 27, 8757-8770.
68. Van Beers, R. J. (2008). Saccadic Eye Movements Minimize the Consequences of Motor Noise. PLoS ONE 3, e2070, Retrieved August 17, 2010, from http://www.plosone.org/article/
69. Wallman, J., & Fuchs, A. F. (1998). Saccadic gain modification: visual error drives motor adaptation. Journal of Neurophysiology, 80, 405-2416.
70. Watanabe, K., Lauwereyns, J., & Hikosaka, O. (2003). Neural correlates of rewarded and unrewarded eye movements in the primate caudate nucleus. Journal of Neuroscience, 23, 10052-10057.
71. Wolpert, D. M., & Ghahramani, Z. (2000). Computational principles of movement neuroscience. Nature Neuroscience, 3, 1212-1217.
72. Xu-Wilson, M., Zee, D. S., & Shadmehr, R. (2009). The intrinsic value of visual information affects saccade velocities. Experimental Brain Research, 196, 475-481.
73. Yuodelis, C., & Hendrickson, A. (1986). A qualitative and quantitative analysis of the human fovea during development. Vision Research, 26, 847-855.
74. Zee, D. S., Optican, L. M., Cook, J. D., Robinson, D. A., & Engel, W. K. (1976). Slow saccades in spinocerebellar degeneration. Archives of Neurology, 33, 243-251.