Self-tuning optimal regulation of respiratory motor output by Hebbian covariance learning

Neural Networks

Volumn 9, Issue 8, 1996, Pages 1367-1383

  Poon, Chi Sang ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

adaptive control; long term potentiation; operant conditioning; reinforcement learning; synaptic plasticity

Indexed keywords

ARTIFICIAL INTELLIGENCE; INTELLIGENT CONTROL; LEARNING SYSTEMS; MUSCULOSKELETAL SYSTEM; NEURAL NETWORKS; NEUROPHYSIOLOGY; PHYSIOLOGICAL MODELS; SELF TUNING CONTROL SYSTEMS;

COVARIANCE LEARNING RULE; HOMEOSTATIC REGULATION; NEURONAL SUBSTRATE;

RESPIRATORY MECHANICS;

N METHYL DEXTRO ASPARTIC ACID RECEPTOR;

BREATHING; COMPUTER MODEL; LEARNING; LONG TERM POTENTIATION; NERVE CELL EXCITABILITY; NERVE CELL PLASTICITY; OSCILLATION; PRIORITY JOURNAL; REVIEW;

EID: 0030297196     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(96)00022-6     Document Type: Article

References (72)

1. Åstrom K.J., Wittenmark B. On self-tuning regulators. Automatica. 9:1973;185-199.
2. Barahona M., Poon C.-S. Detection of nonlinear dynamics in short, noisy time series. Nature. 381:1996;215-217.
3. Barnes, C.A., Bindman, L.J., Dudai, Y., Frégnac, Y., Ito, M., Knöpfel, T., Lisberger, S.G., Morris, R.G.M., Moulins, M., Movshon, J.A., Singer, W., & Squire, L.R. (1994). Group Report: Relating activity-dependent modifications of neuronal function to changes in neural systems and behavior. In A.I. Selverston, & P. Ascher (Eds), Cellular and molecular mechanisms underlying higher neural functions (pp. 81-110). New York: John Wiley.
4. Barraco, R.C. (1994). Nucleus of the solitary tract. Boca Raton, FL: CRC Press.
5. Barto, A.G. (1992). Reinforcement learning and adaptive critic methods. In D.A. White, & D.A. Sofge (Eds), Handbook of intelligent control: Neural, fuzzy, and adaptive approaches (pp. 469-492). New York: Van Nostrand Reinhold.
6. Bassal M., Bianchi A.L. Inspiratory onset or termination induced by electrical stimulation of the brain. Respir. Physiol. 50:1982;23-40.
7. Bates J.H.T. The minimization of muscular energy expenditure during inspiration in linear models of the respiratory system. Biol. Cybern. 54:1986;195-200.
8. Baudry, M., Thompson, R.F., & Davis, J.L. (1993). Synaptic plasticity: molecular, cellular, and functional aspects. Cambridge, MA: MIT Press.
9. Bernard, C. (1878-79). Leçons sur les phénomènes de la vie communs aux animaux et aux végétaux, 2 Vols. Paris: Baillière.
10. Bliss T.V.P., Lømo T. Long-lasting potentiation of synaptic transmission in the dentate area of the anesthetized rabbit following stimulation of the perforant path. J. Physiol. (London). 232:1973;331-356.
11. Butler, H. (1992). Model reference adaptive control. New York: Prentice Hall.
12. Cannon, W.B. (1932). The wisdom of the body. New York: Norton.
13. Crick F., Koch C. Towards a neurobiological theory of consciousness. Seminar in Neurosci. 2:1990;263-275.
14. Donaldson G.C. The chaotic behavior of resting human respiration. Respir. Physiol. 88:1992;313-321.
15. Eldrige, F.L., & Millhorn, D.E. (1986). Oscillation, gating, and memory in the respiratory control system. In N.S. Cherniack, & J.G. Widdicombe (Eds.), Handbook of physiology, Sect. 3: The respiratory system, Vol. II, Control of breathing (pp. 93-114). Bethesda, MD: American Physiological Society.
16. England S.J., Melton J.E., Pace P., Neurbauer J.A. NMDA receptors mediate respiratory short-term potentiation in the nucleus tractus solitarius. FASEB J. 6:1992;A1826.
17. Flash T., Hogan N. The coordination of the arm movements: an experimentally confirmed mathematical model. J. Neurosci. 7:1985;1688-1703.
18. Forrest D., Yuzaki M., Soares L., Luk D.C., Sheng M., Stewart C.L., Morgan J.I., Connor J.A., Curran T. Targeted disruption of NMDA receptor 1 gene abolishes NMDA response and results in neonatal death. Neuron. 13:1994;325-338.
19. Freeman W.J. Role of chaotic dynamics in neural plasticity. Prog. Brain Research. 102:1994;319-333.
20. Fregosi R.F. Short-term potentiation of breathing in human. J. Appl. Physiol. 71:1991;892-899.
21. Gerdes V.G.J., Happee R. The use of an internal representation in fast goal-directed movements: a modelling approach. Biol. Cybern. 70:1994;513-524.
22. Gesell R., Hamilton M.A. Reflexogenic components of breathing. Am. J. Physiol. 133:1941;694-719.
23. Gesel R., Brassfield C.R., Hamilton M.A. An acid-neurohumoral mechanism of nerve cell activation. Am. J. Physiol. 136:1942;604-608.
24. Goldberger A.L., Rigney D.R., Mietus J., Antman E.M., Greenwald S. Nonlinear dynamics in sudden cardiac death syndrome: heart rate oscillations and bifurcations. Experientia. 4:1988;983-987.
25. Gray J.S. The multiple factor theory of the control of respiratory ventilation. Science. 103:1946;739-744.
26. Hämäläinen R., Viljanen A. Modeling the respiratory airflow pattern by optimization criteria. Biol. Cybern. 29:1978;143-149.
27. Harris R.B.S. Role of set-point theory in regulation of body weight. FASEB J. 4:1990;3310-3318.
28. Hebb, D.O. (1949). The organization of behavior. New York: John Wiley.
29. Ito, M. (1984). The cerebellum and neural control. New York: Raven Press.
30. Kao F.F., Schlig B.B., Brooks C.McC. Regulation of respiration during induced muscular work in decerebrate dogs. J. Appl. Physiol. 7:1955;379-386.
31. Kawato M., Furukawa K., Suzuki R. A hierarchical neural-network model for control and learning of voluntary movement. Biol. Cybern. 57:1987;169-185.
32. Kirkwood A., Dudek S.M., Gold J.T., Aizenman C.D., Bear M.F. Common forms of synaptic plasticity in hippocampus and neocortex in vitro. Science. 260:1993;1518-1521.
33. Klopf, A.H. (1972). Brain function and adaptive systems - a heterostatic theory. Air Force Cambridge Research Laboratories Special Report AFCRL-72-0164.
34. Li Y., Erzurumlu R.S., Chen C., Jhaveri S., Tonegawa S. Whisker-related neuronal patterns fail to develop in the trigeminal brainstem nuclei of NMDAR1 knockout mice. Cell. 76:1994;427-437.
35. Lumsden T. Observations on the respiratory centres in the cat. J. Physiol. (London). 57:1923;153-160.
36. Ma, B., Giat, Y., & Levine, W.S. (1994). The optimal control of a movement of the human upper extremity. In B.W. Patterson (Ed.), Modeling and control in biomedical systems (pp. 431-436). Madison, WI: Omnipress.
37. Mackey M.C., Glass L. Oscillation and chaos in physiological control systems. Science. 197:1977;287-289.
38. Milsum, J.H. (1966). Biological control systems analysis. New York: McGraw-Hill.
39. Narendra, K.S., & Annaswamy, A.M. (1989). Stable adaptive systems. Englewood Cliffs, NJ: Prentice Hall.
40. Paton J.F.R., Spyer K.M. Cerebellar cortical regulation of circulation. News in Physiol. Sci. 7:1992;124-129.
41. Poon, C.-S. (1983). Optimal control of ventilation in hypoxia, hypercapnia and exerciser. In B. J. Whipp, & D. M. Wiberg (Eds.), Modelling and control of breathing (pp. 189-196). New York: Elsevier.
42. Poon C.-S. Ventilatory control in hypercapnia and exercise: optimization hypothesis. J. Appl. Physiol. 62:1987;2447-2459.
43. Poon C.-S. Optimization character of brainstem respiratory neurons: a cerebral neural network model. Biol. Cybern. 66:1991;9-17.
44. Poon, C.-S. (1992a). Introduction: Optimization hypothesis in the control of breathing. In Y. Honda, Y. Miyamoto, K. Monno, & J.G. Widdicombe (Eds.), Control of breathing and its modeling perspective (pp. 371-384). New York: Plenum.
45. 2 and dead space loading. J. Appl. Physiol. 73:1992;591-595.
46. Poon C.-S. Adaptive neural network that subserves optimal homeostatic control of breathing. Annals of Biomed. Engr. 21:1993;501-508.
47. Poon, C.-S. (1994). Hebbian synaptic plasticity: A neural mechanisms of supervised learning and adaptive control. In B.W. Patterson (Ed.), Modeling and control in biomedical systems (pp. 497-500). Madison, WI: Omnipress.
48. Poon, C.-S. (1995a). Respiratory models and control. In J.D. Bronzino (Ed.), Biomedical engineering handbook (pp. 2404-2421). Boca Raton, FL: CRC Press.
49. Poon, C.-S. (1995b). Learning to optimize performance: Lessons from a neural control system. Preprints of the 6th IFAC/IFAP/IFORS/IEA Symposium on Analysis, Design and Evaluation of Man-Machine Systems, Cambridge, MA (pp. 499-504).
50. Poon, C.-S. (1996). Adaptive optimization by Hebbian covariance learning. Technical Report, MIT.
51. Poon C.-S., Lin S.L., Knudson O.B. Optimization character of inspiratory neural drive. J. Appl. Physiol. 72:1992;2005-2017.
52. Poon C.-S., Li Y., Li S.X., Tonegawa S. Respiratory rhythm is altered in neonatal mice with malfunctional NMDA receptors. FASEB J. 8:1994;A389.
53. Priban I.P., Fincham W.F. Self-adaptive control and the respiratory system. Nature (London). 208:1965;339-343.
54. Sammon M.P., Bruce E.N. Vagal afferent activity increases dynamical dimension of respiration in rats. J. Appl. Physiol. 70:1991;1748-1762.
55. Schmidt-Nielsen K. How are control systems controlled? Am. Scientist. 82:1994;38-44.
56. Sejnowski T.J. Storing covariance with nonlinearity interacting neurons. J. Math. Biol. 4:1977;303-321.
57. Sejnowski T.J. Statistical constraints on synaptic plasticity. J. Theor. Biol. 69:1977;385-389.
58. Shadmehr R., Mussa-Ivaldi F.A. Adaptive representation of dynamics during learning of a motor task. J. Neurosci. 14:1994;3208-3224.
59. Sherrington, C.S. (1906). The integrative action of the nervous system. New York: C. Scribner and Sons.
60. 2 breathing under inspiratory resistive load. J. Appl. Physiol. 78:1995;555-561.
61. Somjen G.G. The missing error signal - regulation beyond negative feedback. News in Physiol. Sci. 7:1992;184-185.
62. 2. Respir. Physiol. 29:1977;81-92.
63. Tobin M.J., Mador M.J., Guenther S.M., Lodato R.F., Sackner M.A. Variability of resting respiratory center drive and timing in healthy subjects. J. Appl. Physiol. 65:1988;309-317.
64. Uno Y., Kawato M., Suzuki R. Formation and control of optimal trajectory in human multijoint arm movement: minimum torque-change model. Biol. Cybern. 61:1989;89-101.
65. Wagner P.G., Eldridge F.L. Development of short-term potentiation of respiration. Respirat. Physiol. 83:1991;129-140.
66. Wasserman, K., Whipp, B.J., & Casaburi, R. (1986). Respiratory control during exercise. In N.S. Cherniack, & J.G. Widdicombe (Eds.), Handbook of physiology, Sect. 3, Vol. II (pp. 595-620). Bethesda, MD: American Physiological Society.
67. Watkins, C.J.C.H. (1989). Learning from delayed rewards. PhD thesis, Cambridge University.
68. Werbos P.J. Backpropagation through time: What it is and how to do it. Proc. IEEE. 78(10):1990;1550-1510.
69. 2. J. Appl. Physiol. 15:1960;215-219.
70. 2 inhalation and exercise. J. Appl. Physiol. 38:1975;702-709.
71. Zhou Z., Champagnat J., Poon C.-S. Synaptic short-term depression in nucleus tractus soliatarius (NTS) of rat brain stem in vitro. FASEB J. 9:1995;A3283.
72. Zhou, Z., Champagnat, J., & Poon, C.-S. (1995b). Intracellular calcium is required for the maintenance but not induction of long-term depression in nucleus tractus solitarius. Neurosci. Abstr. (in press).