On the optimal control of behaviour: A stochastic perspective

Journal of Neuroscience Methods

Volumn 83, Issue 1, 1998, Pages 73-88

  Harris, Christopher M ^a  

^a GREAT ORMOND STREET HOSPITAL   (United Kingdom)

Author keywords

Adaptive control; Arm movements; Cerebellum; Infant development; Optimal control; Reaching; Reinforcement learning; Saccades

Indexed keywords

ARM MOVEMENT; ARTICLE; BEHAVIOR; CEREBELLUM; EVOLUTION; FEEDBACK SYSTEM; LEARNING; NERVOUS SYSTEM; PLANT; PRIORITY JOURNAL; REINFORCEMENT; SACCADIC EYE MOVEMENT; STOCHASTIC MODEL; SURVIVAL;

BEHAVIOR; CEREBELLUM; FEEDBACK; FOURIER ANALYSIS; HUMANS; INFANT; MODELS, NEUROLOGICAL; MOTOR ACTIVITY; MOVEMENT; PSYCHOMOTOR PERFORMANCE; SACCADES; STOCHASTIC PROCESSES;

EID: 0032585002     PISSN: 01650270     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0165-0270(98)00063-6     Document Type: Article

References (41)

1. Abrams R.A., Meyer D.E., Kornblum S. Speed and accuracy of saccadic eye movements: characteristics of impulse variability in the oculomotor system. J Exp Psychol Hum Percept Perf. 15:1989;529-543.
2. Aslin R, Salapatek P. Saccadic localization of visual targets by the very young human infant. Percept Psychophys 1975;17:293-302.
3. Bahill TA, Adler D, Stark L. Most naturally occurring human saccades have magnitudes of 15° or less. Invest Ophthalmol 1975a;14:468-469.
4. Bahill AT, Clark MR, Stark L. The main sequence, a tool for studying human eye movements. Math Biosci 1975b;24:191-204.
5. Barto AG. Reinforcement learning and adaptive critic methods. In: White DA, Sofge DA, editors. Handbook of Intelligent Control: Neural, Fuzzy and Adaptive Approaches. New York: Van Nostarnd Reinhold, 1992:469-491.
6. Becker W. Metrics. In: Wurtz RH, Goldberg ME, editors. The Neurobiology of Saccadic Eye Movements. Amsterdam: Elsevier, 1989:13-67.
7. Berthier NE Learning to reach: a mathamatical model. Dev Psychol. 32:1996;811-823.
8. Bloedel J.R. Functional heterogeneity with structural homogeneity: how does the cerebellum operate? Behav Brain Sci. 15:1992;666-678.
9. Bronstein A.M., Kennard C. Predictive eye saccades are different from visually triggered saccades. Vis Res. 27:1987;517-520.
10. Bryson AE, Ho Y. Applied Optimal Control: Optimization, Estimation, and Control. New York: Hemisphere, 1975.
11. Clark MR, Stark L. Time optimal behavior of human saccadic eye movement. IEEE Trans Automat Contr 1975;AC-20:345-348.
12. Collewijn H., Erkelens C.J., Steinman R.M. Binocular coordination of human horizontal saccadic eye movements. J Physiol (London). 404:1988;157-182.
13. Deubel H., Wolf W., Hauske G. Adaptive control of saccadic eye movements. Hum Neurobiol. 5:1986;245-253.
14. Enderle J.D., Wolfe J.W. Time-optimal control of saccadic eye movements. IEEE Trans Biomed Eng BME. 34:1987;43-55.
15. Flash T., Hogan N. The coordination of arm movements: an experimentally confirmed mathematical model. J Neurosci. 5:1985;1688-1703.
16. Fujita M. Adaptive filter model of the cerebellum. Biol Cybern. 45:1982;195-206.
17. Gellman R.S., Gibson A.R., Houk J.C. Inferior olivary neurones in the awake cat: Detection of contact and passive body displacement. J Neurophysiol. 54:1985;335-348.
18. Harris C.M., Wallman J., Scudder C. Fourier analysis of primate saccades. J Neurophysiol. 63:1990;877-886.
19. Harris C.M., Jacobs M., Shawkat F., Taylor D. The development of saccadic accuracy in the first 7 months. Clin Vis Sci. 8:1993;85-96.
20. Harris CM. On the reversibility of Markov scanning in free viewing. In: Brogan D, Gale A, Carr K, editors. Vision Search 2. London: Taylor and Francis, 1993:123-135.
21. Harris C.M. Does saccadic under-shoot minimize saccadic flight-time? a Monte-Carlo study. Vis Res. 35:1995;691-701.
22. Henson D.B. Corrective saccades: effects of altering visual feedback. Vis Res. 18:1978;63-67.
23. Hogan N. An organizing principle for a class of voluntary movements. J Neurosci. 4:1984;2745-2754.
24. Ito M. The cerebellum and neural control. New York: Raven, 1984.
25. Lehman S., Stark L. Simulation of linear and nonlinear eye movement models: sensitivity analyses and enumeration studies of time optimal control. J Cybern Inf Sci. 2:1979;21-43.
26. Lemij H.G., Colewijn H. Differences in accuracy of human saccades between stationary and jumping targets. Vis Res. 12:1989;1737-1748.
27. Llinas R., Baker R., Sotelo C. Electrotonic coupling between neurons in cat inferior olive. J Neurophysiol. 37:1974;541-549.
28. Meyer D.E., Abrams R.A., Kornblum S., Wright C.E., Smith J.E.K. Optimality in human motor performance: ideal control of rapid aimed movements. Psychol Rev. 98:1988;340-370.
29. Mezey L, Harris CM, Shawkat FS, Timms C, Kriss A, West P, Taylor DSI. Saccadic strategies in hemianopic children. Dev Med Child Neurol 1998; in press.
30. Optican L.M., Robinson D.A. Cerebellar-dependent adaptive control of primate saccadic system. J Neurophysiol. 44:1980;1058-1076.
31. Papoulis A. Probability, Random Variables and Stochastic Processes. 3rd ed. New York: McGraw-Hill, 1991.
32. Percival DB, Walden AT. Spectral Analysis for Physical Applications. Cambridge: Cambridge University Press, 1993.
33. Robinson D.A. The mechanics of human saccadic eye movements. J Physiol (London). 174:1964;245-264.
34. Slepian D. Some comments on Fourier analysis, uncertainty, and modeling. SIAM Rev. 25:1983;379-393.
35. Thrun SB. The role of exploration in learning control. In: White DA, Sofge DA, editors. Handbook of Intelligent Control: Neural, Fuzzy and Adaptive Approaches. New York: Van Nostrand Reinhold, 1992:527-559.
36. Toni I., Gentilucci M., Jeannerod M., Decety J. Differential influence of the visual framework on end point accuracy and trajectory specification of arm movements. Exp Brain Res. 111:1996;447-454.
37. Viviani P. Flash, T. (1995) Minimum-jerk, two-thirds power law, and isochrony: converging approaches to movement planning. J Exp Psychol. 21:1995;32-53.
38. Voltaire (1759) Candide and other stories. Translation by R. Pearson. Oxford: Oxford University Press, 1990.
39. von Hofsten C. Structuring of early reaching movements: a longitudinal study. J Motor Behav. 23:1991;280-292.
40. Werbos PJ. Approximate dynamic programming for real-time control and neural modeling. In: White DA, Sofge DA, editors. Handbook of Intelligent Control: Neural, Fuzzy and Adaptive Approaches. New York: Van Nostrand Reinhold, 1992:493-525.
41. Wiegner A.W., Wierzbicka M.M. Kinematic models of human elbow flexion movements: quantitative analysis. Exp Brain Res. 88:1992;665-673.