The identification of nonlinear biological systems: Volterra kernel approaches

Annals of Biomedical Engineering

Volumn 24, Issue 2, 1996, Pages 250-268

  Korenberg, Michael J ^a   Hunter, Ian W ^b  

^a QUEEN S UNIVERSITY   (Canada)

^b Massachusetts Institute of Technology Cambridge   (United States)

Author keywords

Cascade Analysis; Functional expansions; Nonlinear systems; System identification; Volterra kernels; Volterra series

Indexed keywords

ALGORITHM; ARTICLE; COMPUTER SIMULATION; MATHEMATICAL ANALYSIS; MODEL; NONLINEAR SYSTEM; TECHNIQUE; WHITE NOISE; BIOLOGICAL MODEL; IMAGE PROCESSING; NORMAL DISTRIBUTION; STATISTICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; IMAGE PROCESSING, COMPUTER-ASSISTED; MODELS, BIOLOGICAL; MODELS, NEUROLOGICAL; NONLINEAR DYNAMICS; LINEAR MODELS; NORMAL DISTRIBUTION;

IDENTIFICATION (CONTROL SYSTEMS); MATHEMATICAL MODELS; NONLINEAR SYSTEMS;

CASCADE ANALYSIS; FUNCTIONAL EXPANSIONS; NONLINEAR BIOLOGICAL SYSTEMS; VOLTERRA KERNELS;

PHYSIOLOGICAL MODELS;

EID: 0029669428     PISSN: 00906964     EISSN: None     Source Type: Journal    
DOI: 10.1007/BF02667354     Document Type: Article

References (97)

1. Alper, P., and D. Poortvliet. On the use of Volterra series representation and higher order impulse responses for nonlinear systems. Elec. Lab. Rep. Tech. Univ. Delft, Netherlands, 1963.
2. Andronikou, A. M., G. A. Bekey, and S. F. Masri. Identification of nonlinear hysteretic systems using random search. IFAC Ident. Sys. Param. Est. 1:263-268, 1982.
3. Barrett, J. F. The use of functional in the analysis of nonlinear physical systems. J. Elect. Control 15:567-615, 1963.
4. Barrett, J. F. The use of Volterra series to find region of stability of a nonlinear differential equation. Int. J. Control 1:209-216, 1965.
5. Barrett, J. F. Functional series representation of nonlinear systems - some theoretical comments. 6th IFAC Symp. Ident. Sys. Param. Est. 1:251-256, 1982.
6. Billings, S. A., and W. S. F. Voon. Correlation based model validity tests for nonlinear models, Int. J. Control 44:235-244, 1986.
7. Bose, A. G. A theory of nonlinear systems. MIT Res. Lab. Elec. Tech. Rep. 309, 1956.
8. Boyd, S., and L. O. Chua. Fading memory and the problem of approximating non-linear operators with Volterra series. IEEE Trans. Cire. Sys. 32:1150-1160, 1985.
9. Boyd, S., Y. S. Tang, and L. O. Chua, Measuring Volterra kernels. IEEE Trans. Cire. Sys. 30:571-577, 1983.
10. Brilliant, M. B. Theory of the analysis of nonlinear systems. MIT Res. Lab. Elec. Tech. Rep. 345, 1958.
11. Bussgang, J. J. Crosscorrelation functions of amplitude distorted Gaussian signals. MIT Res. Lab. Elec. Tech. Rep. 216:1-14, 1952.
12. Chen, H. W., L. D. Jacobson, and J. P. Gaske. Structural classification of multi-input nonlinear systems. Biol. Cyber. 63:341-357, 1990.
13. Chon, K. H., N. H. Holstein-Rathlou, D. J. Marsh, and V. Z. Marmarelis. Parametric and nonparametric nonlinear modeling of renal autoregulation dynamics. In: Advanced Methods of Physiological System Modeling, vol. 3. edited by V. Z. Marmarelis. New York: Plenum Press, 1994, pp. 195-210.
14. Clynes, M. The non-linear biological dynamics of unidirectional rate sensitivity illustrated by analog computer analysis, pupillary reflex to light and sound, and heart rate behavior. Ann. NY Acad. Sci. X:98, 1962.
15. Ewen, E. J., and D. D. Weiner. Identification of weakly nonlinear systems using input and output measurements. IEEE Trans. Circ. Sys. 27:1255-1261, 1980.
16. Flake, P. Volterra series representation of nonlinear systems. AIEE Trans. 64:330-335, 1963.
17. Frechet, M. Sur les fonctionnelles continues. Annales Scientifiques de l'Ecole Normal Superieure 27:193-219, 1910.
18. Gardner, W. A., and T. L. Archer. Exploitation of cyclostationarity for identifying the Volterra kernels of nonlinear systems. IEEE Trans. Inform. Theory 39:535-542, 1993.
19. George, D. Continuous nonlinear systems. MIT Res. Lab. Elec. Tech. Rep. 335:246-281, 1959.
20. Goussard, Y., W. C. Krenz, and L. W. Stark. An improvement of the Lee and Schetzen cross-correlation method. IEEE Trans. Automat. Control 30:895-898, 1985.
21. Goussard, Y., W. C. Krenz, L. W. Stark, and G. Demoment. Practical identification of functional expansions of nonlinear systems submitted to non-Gaussian inputs. Ann. Biomed. Eng. 19:401-427.
22. Hung, G., and L. Stark. The kernel identification methods: review of theory, calculation, application, and interpretation. Math. Biosci. 37:135-170, 1977.
23. Hung, G. K., and L. W. Stark. The interpretation of kernels: an overview. Ann. Biomed. Eng. 19:509-519, 1991.
24. Hunter, I. W., and R. E. Kearney. Generation of random sequences with jointly specified probability density and autocorrelation functions. Biol. Cybern. 47:141-146, 1983.
25. Hunter, I. W., and R. E. Kearney. Two-sided linear filter identification. Med. & Biol. Eng. & Comput. 21:203-209, 1983.
26. Hunter, I. W., and M. J. Korenberg. The identification of nonlinear biological systems: Wiener and Hammerstein cascade models. Biol. Cybern. 55:135-144, 1986.
27. Klein, S. Interpreting nonlinear systems: the third order kernel of the eye movement control system. In: 10th Annual Pittsburgh Conference on Modeling and Simulation, edited by Vogt and Mickle. Pittsburgh, PA: University of Pittsburgh, 215-222, 1979.
28. Klein, S. A. Relationships between kernels measured with different stimuli. In: Advanced Methods of Physiological System Modeling, vol. I, edited by V. Z. Marmarelis. Los Angeles: Biomedical Simulations Resource, University of Southern California, 1987, pp. 278-288.
29. Klein, S., and S. Yasui. Nonlinear systems analysis with non-Gaussian white stimuli: general basis functionals and kernels. IEEE Trans. Inform. Theory 25:495-500, 1979.
30. Kolmogoroff, A. N., and S. V. Fomin, eds. Elements of the Theory of Functions and Functional Analysis. New York: Graylock Press, 1957.
31. Korenberg, M. J. Aspects of time-varying and nonlinear systems theory with biological applications. Montréal, Quebec Canada: McGill University, Ph.D. Thesis, 1972.
32. Korenberg, M. J. Identification of biological cascades of linear and static nonlinear systems. Proc. 16th Midwest Symp. Circ. Theory 18.2:1-9, 1973.
33. Korenberg, M. J. Cross-correlation analysis of neural cascades. Proc. 10th Ann. Rocky Mountain Bioeng. Symp. 1: 47-52, 1973.
34. Korenberg, M. J. Statistical identification of parallel cascades of linear and nonlinear systems. IFAC Symp. Ident. Sys. Param. Est. 1:580-585, 1982.
35. Korenberg, M. J. Statistical identification of Volterra kernels of high order systems. IEEE Int. Symp. Circ. Sys. 2:570-575, 1984.
36. Korenberg, M. J. Identifying noisy cascades of linear and static nonlinear systems. IFAC Symp. Ident. Sys. Param. Est. 1:421-426, 1985.
37. Korenberg, M. J. Functional expansions, parallel cascades, and nonlinear difference equations. In: Advanced Methods of Physiological System Modeling, vol. 1, edited by V. Z. Marmarelis. Los Angeles: Biomedical Simulations Resource, University of Southern California, 1987, pp. 221-240.
38. Korenberg, M. J. Identifying nonlinear difference equation and functional expansion representations: the fast orthogonal algorithm. Ann. Biomed. Eng. 16:123-142, 1988.
39. Korenberg, M. J. A fast orthogonal search method for biological time-series analysis and system identification. Proc. IEEE Int. Conf. Sys. Man. Cybern. Cambridge, MA: 1989, pp. 459-465.
40. Korenberg, M. J. A robust orthogonal algorithm for system identification and time-series analysis. Biol. Cybern. 60: 267-276, 1989.
41. Korenberg, M. J. A rapid and accurate method for estimating the kernels of a nonlinear system with lengthy memory. 15th Biennial Symposium Communication, Queen's University, Kingston, Ontario, Canada, 1990.
42. Korenberg, M. J. Some new approaches to nonlinear system identification and time-series analysis. Proc. 12th Annu. Int. Conf. IEEE Eng. Med. & Biol. Soc. 12(1):20-21, 1990.
43. Korenberg, M. J. Parallel cascade identification and kernel estimation for nonlinear systems. Ann. Biomed. Eng. 19: 429-455, 1991.
44. Korenberg, M. J., S. B. Bruder, M. Mancini, and P. J. McIlroy. Exact kernel estimation using a noise input: measuring invariant characteristics of cortical cells. Ninth International Conference on Noise in Physical Systems, edited by C. M. Van Vliet. Tea Neck, NJ: World Scientific Publishing Co., 1987, pp. 583-588.
45. Korenberg, M. J., S. B. Bruder, and P. J. Mcllroy. Exact orthogonal kernel estimation from finite data records: extending Wiener's identification of nonlinear systems. Ann. Biomed. Eng. 16:201-214, 1988.
46. Korenberg, M. J., and I. W. Hunter. The identification of nonlinear biological systems: LNL cascade models. Biol. Cybern. 55:125-134, 1986.
47. Korenberg, M. J. and I. W. Hunter. The identification of nonlinear biological systems: Wiener kernel approaches. Ann. Biomed. Eng. 18:629-654, 1990.
48. Korenberg, M. J., H. M. Sakai, and K.-I. Naka. Dissection of the neuron network in the catfish inner retina. III. Interpretation of spike kernels. J. Neurophysiol. 61:1110-1120, 1989.
49. Krenz, W. C., and L. W. Stark. The interpretation of functional series expansions. Ann. Biomed. Eng. 19:485-508, 1991.
50. Lee, Y. W. Contribution of Norbert Wiener to linear theory and nonlinear theory in engineering. In: Selected Papers of Norbert Wiener, SIAM, Cambridge, MA: MIT Press. 1964, pp. 17-33.
51. Lee, Y. W., and M. Schetzen. Measurement of the Wiener kernels of a non-linear system by crosscorrelation. Int. J. Contr. 2:237-254, 1965.
52. Litt, H. I. A Nonlinear Kernel Investigation of Magnetic Resonance Imaging and Computed Tomography. Buffalo, NY: State University of New York at Buffalo, Ph.D. Thesis, 1994.
53. LYSIS (Ver. 5) Software Program. Los Angeles: Biomedical Simulations Resource, University Southern California.
54. Marmarelis, P. Z., and K. I. Naka. White-noise analysis of a neuron chain: an application of the Wiener theory. Science 175:1276-1278, 1972.
55. Marmarelis, P. Z., and K. I. Naka. Nonlinear analysis and synthesis of receptive-field responses in the catfish retina. J. Neurophys. 36:605-648, 1973.
56. Marmaretis, P. Z., and V. Z. Marmarelis, eds. Analysis of Physiological Systems. New York: Plenum Press, 1978.
57. Marmarelis, V. Z. Identification of nonlinear biological systems using Laguerre expansions of kernels. Ann. Biomed. Eng. 21:573-589, 1993.
58. Marmarelis, V. Z., K. H. Chon, Y.-M. Chen, D. J. Marsh, and N.-H. Holstein-Rathlou. Nonlinear analysis of renal autoregulation under broadband forcing conditions. Ann. Biomed. Eng. 21:591-603, 1993.
59. Mohler, R. Nonlinear Systems: Vol. 1-Dynamics and Control and Vol. 2-Applications to Bilinear Control. Englewood Cliffs, NJ: Prentice-Hall, 1991.
60. Nabet, B., and R. B. Pinter. Multiplicative inhibition and Volterra series expansion. In: Nonlinear Vision: Determination of Neural Receptive Fields, Function, and Networks, edited by R. B. Pinter and B. Nabet. Boca Raton, FL: CRC Press, 1992, pp. 475-491.
61. Ogura, H. Estimation of Wiener kernels of a nonlinear system and fast algorithm using digital Laguerre filters. Proceedings of the 15th NIBB Conference on Information Processing in Neuron Network: White-Noise Analysis, edited by K-I. Naka and Y.-I. Ando. Okazaki, Japan: National Institute for Basic Biology, 1986, pp. 14-62.
62. Palm, G., and T. Poggio. Stochastic identification methods for nonlinear systems: an extension of the Weiner theory. J. Appl. Math. 34:524-534, 1978.
63. Pece, A. E. C., A. S. French, M. J. Korenberg, and J. E. Kuster. Nonlinear mechanisms for gain adaptation in locust photoreceptors. Biophys. J. 57:733-743, 1990.
64. Press, W. H., B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, eds. Numerical Recipes in C. New York: Cambridge University Press, 1988.
65. Rice, J. R. A theory of condition. J. Numer. Anal. 3:287-310, 1966.
66. Rugh, W. J., ed. Nonlinear System Theory: The Volterral Wiener Approach. Baltimore: Johns Hopkins University Press, 1981.
67. Sakai, H. M., and K.-I. Naka. Signal transmission in the catfish retina. IV. Transmission to ganglion cells. J. Neurophysiol. 58:1307-1328, 1987.
68. Sakai, H. M., and K.-I. Naka. Signal transmission in the catfish retina. V. Sensitivity and circuit. J. Neurophysiol. 58:1329-1350, 1987.
69. Sakai, H. M., and K.-I. Naka. Dissection of the neuron network in the catfish inner retina. I. Transmission to ganglion cells. J. Neurophysiol. 60:1549-1567, 1988.
70. Sakai, H. M., and K.-I. Naka. Dissection of the neuron network in the catfish inner retina. II. Interactions between ganglion cells. J. Neurophysiol. 60:1568-1583, 1988.
71. Sakai, H. M., and K.-I. Naka. Dissection of the neuron network in the catfish inner retina. IV. Bidirectional interactions between amacrine and ganglion cells. J. Neurophysiol. 63:105-119, 1990.
72. Sakai, H. M, and K.-I. Naka. Dissection of the neuron network in the catfish inner retina. V. Interactions between NA and NB amacrine cells. J. Neurophysiol. 63:120-130, 1990.
73. Sakai, H. M., K.-I., Naka, and M. J. Korenberg. White noise analysis in visual science. Vis. Neurosci. 1:287-296, 1988.
74. Sakuranaga, M., Y-J. Ando, and K-I. Naka. Dynamics of ganglion cell response in the catfish and frog retinas. J. Gen. Physiol. 90:229-259, 1987.
75. Sakuranaga, M., S. Sato, E. Hida, and K-I. Naka. Nonlinear analysis: mathematical theory and biological applications. CRC Crit. Rev. Biomed. Eng. 14:127-184, 1986.
76. Sandberg, I. W. Expansions for discrete-time nonlinear systems. Circuit Sys. Signal Process. 2:179-192, 1983.
77. Sandberg, A., and L. Stark. Wiener G-function analysis as an approach to nonlinear characteristics of human pupil light reflex. Brain Res. 11:194-211, 1968.
78. Schetzen, M. Measurement of the kernels of a nonlinear system of finite order. Int. J. Control 1:251-263, 1965.
79. Schetzen, M., ed. The Volterra and Wiener Theories of Nonlinear Systems (second edition). New York: John Wiley & Sons. 1980.
80. Schetzen, M. Nonlinear system modeling based on the Wiener theory. Proc. IEEE 69:1557-1573, 1981.
81. Shinners, S. M., ed. Modern Control System Theory and Application. Boston: Addison-Wesley, 1972.
82. Spekreijse, H., and H. Oosting. Linearizing: a method for analyzing and synthesizing nonlinear systems. Kybernetik 7:22-31, 1970.
83. Stark, L. W. Stability, oscillation, and noise in the human pupillary servo mechanism. Bol. del Inst, de Estudios Medicos y Biologicos 21:201-222, 1963.
84. Stark, L. W., ed. Neurological control systems: studies in bioengineering, New York: Plenum Press, 1968.
85. Stark, L. W. The pupillary control system: its nonlinear adaptive and stochastic engineering design characteristics. Automatica 5:655-676, 1969.
86. Stark, L. W., Y. Takahashi, and G. Zames. Nonlinear servoanalysis of human lens accommodation. IEEE Trans. Sys. Sci. Cyber. 1:75-83, 1965.
87. Strang, G., ed. Linear Algebra and its Applications. (second edition) New York: Academic Press, 1980.
88. Sunay, M. O., and M. M. Fahmy. An orthogonal approach to the spatial-domain design of 2-D recursive and nonrecursive nonlinear filters. IEEE Trans, Circ. Sys. 41:669-677, 1994.
89. Sutter, E. E. A practical non-stochastic approach to nonlinear time-domain analysis. In: Advanced Methods of Physiological System Modeling, vol. I., edited by V. Z. Marmarelis. Los Angeles: Biomedical Simulations Resource, University of Southern California, 1987, pp. 303-315.
90. Sutter, E. E. A deterministic approach to nonlinear systems analysis. In: Nonlinear Vision: Determination of Neural Receptive Fields, Function, and Networks, edited by R. B. Pinter and B. Nabet. Boca Raton, FL: CRC Press, 1992, pp. 171-220.
91. Sutter, E. E., and D. Tran. The field topography of ERG components in man. 1. The phototopic luminance response. Vis. Res. 32:443-446, 1992.
92. Victor, J. D. The fractal dimension of a test signal: implications for system identification procedures. Biol. Cybern. 57:421-426, 1987.
93. Victor, J. D., and B. W. Knight. Nonlinear analysis with an arbitrary stimulus ensemble. Q. Appl. Math. 37:113-136, 1979.
94. Volterra, V., ed. Leçons sur les Fonctions de Lignes. Paris: Gauthier-Villars, 1913.
95. Volterra, V., ed. Theory of Functionals and of Integral and Integro-Differential Equations. New York: Dover, 1959.
96. Watanabe, A., and L. Stark. Kernel method for nonlinear analysis: identification of a biological control system. Math. Biosci. 27:99-108, 1975.
97. Wiener, N., ed. Nonlinear Problems in Random Theory. Cambridge, MA: MIT Press, 1958.