Nonparametric identification of nonlinear biomedical systems, part I: Theory

Critical Reviews in Biomedical Engineering

Volumn 26, Issue 3, 1998, Pages 153-226

  Westwick, David T ^a   Kearney, Robert E ^b  

^a Boston University College of Engineering   (United States)

^b MCGILL UNIVERSITY   (Canada)

Author keywords

Block structured models; Estimation; Nonparametric; Volterra kernels; Wiener kernels

Indexed keywords

MATHEMATICAL MODELS; PHYSIOLOGY;

VOLTERRA KERNELS; WIENER KERNELS;

BIOMEDICAL ENGINEERING;

ARTIFICIAL NEURAL NETWORK; BIOMEDICAL ENGINEERING; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; MATHEMATICAL PARAMETERS; PRIORITY JOURNAL; REVIEW; SYSTEM ANALYSIS; THEORY;

EID: 0031727154     PISSN: 0278940X     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (136)

1. Schetzen, M., Nonlinear system modeling based on the Wiener theory, Proc. IEEE, 69, 1557-1573, 1981.
2. Marmarelis, P. Z. and Marmarelis, V. Z., Analysis of Physiological Systems, Plenum Press, New York, 1978.
3. Sakuranaga, M., Sato, S., Hida, E., and Naka, K.-I., Nonlinear analysis: mathematical theory and biological applications, CRC Crit. Rev. Biomed. Eng., 14, 127-184, 1986.
4. Sakai, H. M., White-noise analysis in neurophysiology, Physiol. Rev., 72, 491-505, 1992.
5. Eggermont, J. J., Wiener and Volterra analyses applied to the auditory system, Hear. Res., 66, 177-201, 1993.
6. Lee, Y. W. and Schetzen, M., Measurement of the Wiener kernels of a non-linear system by cross-correlation, Int. J. Control, 2, 237-254, 1965.
7. Schetzen, M., Measurement of the kernels of a nonlinear system by crosscorrelation, Quarterly Progress Report 60:118-130, MIT Electronics Research Lab, 1961.
8. Schetzen, M., Measurement of the kernels of a nonlinear system by crosscorrelation with Gaussian non-white inputs, Quarterly Progress Report 63, MIT Electronics Research Laboratory of Electronics, 113-117, 1961.
9. Marmarelis, V. Z., Editors introduction to the special issue on nonlinear modeling of physiological systems, Ann. Biomed. Eng., 16, 1-2, 1988.
10. Sun, H. H., Looft, F., and Madan, R. N., Editors introduction to the special issue on nonlinear physiological system modeling, Ann. Biomed. Eng., 19, 341-343, 1991.
11. Marmarelis, V. Z., Ed., Advanced Methods of Physiological System Modeling, vol. 1, Biomedical Simulations Resource, USC-LA, Los Angeles, 1987.
12. Marmarelis, V. Z., Ed., Advanced Methods of Physiological System Modeling, vol. 2, Plenum Press, New York, 1989.
13. Marmarelis, V. Z., Ed., Advanced Methods of Physiological System Modeling, vol. 3, Plenum Press, New York, 1994.
14. Korenberg, M. J. and Hunter, I. W., The identification of nonlinear biological systems: Wiener kernel approaches, Ann. Biomed. Eng., 18, 629-654, 1990.
15. Korenberg, M. J. and Hunter, I. W., The identification of nonlinear biological systems: Volterra kernel approaches, Ann. Biomed. Eng., 24, 250-268, 1996. Corrected version appears in Vol. 24, No. 4.
16. Ljung, L., System Identification: Theory for the User, Prentice Hall, Englewood Cliffs, NJ, 1987.
17. Verhaegen, M. and DeWilde, P., Subspace model identification part 1. The output-error state-space model identification class of algorithms, Int. J. Control, 56, 1187-1210, 1992.
18. Brillinger, D. R., Time Series Data Analysis and Theory, Holt, Rhinehart & Winston, New York, 1975.
19. Caines, P. E., Lmear Stochastic Systems, John Wiley, New York, 1988.
20. Söderström, T. and Stoica, P., System Identification, Prentice Hall, New York, 1989.
21. Haber, R. and Unbehauen, H., Structure identification of nonlinear dynamic systems - a survey on input/output approaches, Automatica, 26, 651-677, 1990.
22. Thomsom, M., Schooling, S. P., and Soufian, M., The practical application of a nonlinear identification methodology, Control Eng. Prac., 3, 295-306, 1996.
23. French, A. S. and Korenberg, M. J., Disection of a nonlinear cascade model for sensory encoding, Ann. Biomed. Eng., 19, 473-484, 1991.
24. Junsola, M., Weckstrom, M., Uusitalo, R. O., Korenberg, M. J., and French, A. S., Nonlinear models of the first synapse in the light-adapted fly retina, J. Neurophysiol., 74, 2538-2547, 1995.
25. Hung, G. K. and Stark, L. W., The interpretation of kernels - an overview, Ann. Biomed. Eng., 19, 509-519, 1991.
26. Krenz, W. and Stark, L., Interpretation of functional series expansions, Ann. Biomed. Eng., 19, 485-508, 1991.
27. 70 pp. 303-315.
28. Victor, J. and Shapley, R., A method of nonlinear analysis in the frequency domain, Biophys. J., 29, 459-484, 1980.
29. Bendat, J. S. and Piersol, A. G., Random Data, Analysis, and Measurement Procedures, 2nd ed., John Wiley, New York, 1986.
30. Barrett, J. F., The use of functionals in the analysis of non-linear physical systems, J. Electron. Control, 15, 567-615, 1963.
31. Billings, S. A., Chen, S., and Korenberg, M. J., Identification of MIMO non-linear systems using a forward-regression orthogonal estimator, Int. J. Control, 49, 2157-2189, 1989.
32. Tsang, T. S. and Billings, S. A., Identification of continuous time nonlinear systems using delayed state variable filters, Int. J. Control, 60, 159-180, 1994.
33. 76 pp. 219-227.
34. Zhao, X. and Marmarelis, V. Z., On the relation between continuous and discrete nonlinear parametric models, Automatica, 33, 81-84, 1997.
35. Press, W. H., Teukolsky, S. A., Vetterling, W. T., and Flannery, B. P., Numerical Recipes in C: The Art of Scientific Computing, 2nd ed., Cambridge University Press, Cambridge, 1992.
36. Korenberg, M. J., Identifying nonlinear difference equation and functional expansion representations: The fast orthogonal algorithm, Ann. Biomed. Eng., 16, 123-142, 1988.
37. Hunter, I. W. and Kearney, R. E., Two-sided linear filter identification, Med. Biol. Eng. Comput., 21, 203-209, 1983.
38. Volterra, V., Theory of Functionals and of Integral and Integro-differential Equations, Dover, New York, 1959.
39. Boyd, S. and Chua, L. O., Fading memory and the problem of approximating nonlinear operators with Volterra series, IEEE Trans. Circ. Syst., CAS-32, 1150-1161, 1985.
40. Wiener, N., Nonlinear Problems in Random Theory, John Wiley, New York, 1958.
41. Goussard, Y., Krenz, W. C., and Stark, L., An improvement of the Lee and Schetzen cross-correlation method, IEEE Trans. Automatic Control, 30, 895-898, 1985.
42. Palm, G. and Poggio, T., The Volterra representation and the Wiener expansion: validity and pitfalls, SIAM J. Appl. Math., 33, 195-216, 1977.
43. 70 pp. 1-24.
44. Rugh, W. J., Nonlinear System Theory, the Volterra/Wiener Approach, The Johns Hopkins University Press, Baltimore, 1981.
45. Hunter, I. W. and Korenberg, M. J., The identification of nonlinear biological systems: Wiener and Hammerstein cascade models, Biol. Cybern., 55, 135-144, 1986.
46. Korenberg, M. J. and Hunter, I. W., The identification of nonlinear biological systems: LNL cascade models, Biol. Cybern., 55, 125-134, 1986.
47. Palm, G., On representation and approximation of nonlinear systems, Biol. Cybern., 34, 49-52, 1979.
48. Korenberg, M. J., Parallel cascade identification and kernel estimation for nonlinear systems, Ann. Biomed. Eng., 19, 429-455, 1991.
49. Marmarelis, V. Z., Signal transformation and coding in neural systems, IEEE Trans. Biomed. Eng., 36, 15-24, 1989.
50. Paulin, M. G., A method for constructing data-based models of spiking neurons using a dynamic linear-static nonlinear cascade, Biol. Cybern., 69, 67-76, 1993.
51. 50a. Westwick, D. T. and Kearney, R. E., Use of eigenvector expansions in generalized Wiener system models, Proc. IEEE EMBS, 16, 1328-1329, 1994.
52. Golub, G. and Van Loan, C., Matrix Computations, 2nd ed., The Johns Hopkins University Press, Baltimore, 1989.
53. Marmarelis, P. Z. and Naka, K. I., Identification of multi-input biological systems, IEEE Trans. Biomed. Eng., BME-21, 88-101, 1974.
54. Yasui, S., David, W., and Naka, K.-I., Spatio-temporal receptive field measurement of retinal neurons by random pattern stimulation and cross correlation, IEEE Trans. Biomed. Eng., BME-26, 263-272, 1979.
55. Verhaegen, M. and Westwick, D., Identifying MIMO Hammerstein systems in the context of subspace model identification methods, Int. J. Control, 63, 331-349, 1996.
56. Chen, H. W., Modeling and identification of parallel nonlinear systems: Structural classification and parameter estimation methods, Proc. IEEE, 83, 39-66, 1995.
57. Chen, H. W., Jacobsen, L. D., and Gaska, J. P., Structural classification of multi-input nonlinear systems, Biol. Cybern., 63, 341-357, 1990.
58. Westwick, D. and Verhaegen, M., Identifying MIMO Wiener systems using subspace model identification methods, Sig. Proc., 52, 235-258, 1996.
59. Westwick, D. T. and Kearney, R. E., A new algorithm for the identification of multiple-input Wiener systems, Biol. Cybern., 68, 75-85, 1992.
60. Korenberg, M. J., Identifying noisy cascades of linear and static nonlinear systems, IFAC Symp. Idem. Syst. Param. Est., 4, 421-426, 1985.
61. Stark, L., The pupillary control system, its nonlinear adaptive and stochastic engineering design characteristics, Automatica, 5, 655-676, 1969.
62. Amorocho, J. and Brandstetter, A., Determination of nonlinear functional response functions in rainfall runoff processes, Water Resources Research, 7, 1087-1101, 1971.
63. Westwick, D. T. and Kearney, R. E., Identification of physiological systems: A robust method for non-parametric impulse response estimation, Med. Biol. Eng. Comput., 35, 83-90, 1997.
64. French A. S. and Butz, E. G., Measuring the Wiener kernels of a non-linear system using the fast Fourier transform algorithm, Int. J. Control, 17, 529-539, 1973.
65. French, A. S., Practical nonlinear system analysis by Wiener kernel estimation in the frequency domain, Biol. Cybern., 24, 111-119, 1976.
66. Korenberg, M. J., Bruder, S. B., and McDroy, P. J., Exact orthogonal kernel estimation from finite data records: Extending Wiener's identification of nonlinear systems, Ann. Biomed. Eng., 16, 201-214, 1988.
67. 73 pp. 165-178.
68. 70 pp. 221-240.
69. Zhang, Q., Suki, B., Westwick, D. T., and Lutchen, K. R., Factors affecting Volterra kernel estimation: Emphasis on lung tissue viscoelaslicity, Ann. Biomed Eng., 1998; to appear 26(1).
70. Mathews, V. J., Adaptive polynomial filters, IEEE Sig. Proc. Mag., July, 10-26, 1991.
71. Haykin, S., Adaptive Filter Theory, Prentice Hall, Englewood Cliffs, NJ, 1991.
72. 70 pp. 289-302.
73. Goussard, Y., Krenz, W. C., Stark, L., and Demoment, G., Practical identification of functional expansions of nonlinear systems submitted to non-Gaussian inputs, Ann. Biomed. Eng., 19, 401-427, 1991.
74. Watanabe, A. and Stark, L., Kernel method for nonlinear analysis: identification of a biological control system, Math. Biosci., 27, 99-108, 1975.
75. Marmarelis, V. Z., Identification of nonlinear biological systems using Laguerre expansions of kernels, Ann. Biomed. Eng., 21, 573-589, 1993.
76. 76 pp. 229-242.
77. Ogura, H., Estimation of Wiener kernels of a nonlinear system and fast algorithm using digital Laguerre filters, NIBB Conf., 15, 14-62, 1986.
78. Westwick, D. T., Suki, B., and Lutchen, K. R., Sensitivity analysis of kernel estimates: Implications in nonlinear physiological system identification, Ann. Biomed. Eng., 26, 488-501, 1998.
79. Marmarelis, V. Z. and Orme, M. E., Modeling of neuronal systems by use of neuronal modes, IEEE Trans. Biomed. Eng., 40, 1149-1158, 1993.
80. 76 pp. 1-27.
81. French, A. S. and Marmarelis, V. Z., Nonlinear neuronal mode analysis of action potential encoding an the cockroach tactile spine neuron, Biol. Cybern., 73, 425-430, 1995.
82. Bussgang, J. J., Crosscorrelation functions of amplitude-distorted Gaussian signals, Technical Report 216, MIT Electrical Research Lab, 1952.
83. Korenberg, M. J., Identification of biological cascades of linear and static nonlinear elements, Proc. Midwest Symp. Circ. Theory, 18.2, 1-9, 1973.
84. Korenberg, M. J., Recent advances in the identification of nonlinear sytems: minimum-variance approximation by Hammerstein models, Proc. IEEE EMBS, 13, 2258-2259, 1991.
85. Wigren, T., Convergence analysis of recursive identification algorithms based on the nonlinear Wiener model, IEEE Trans. Automatic Control, 39, 2191-2206, 1994.
86. Spekreijse, H., Rectification in the goldfish retina: analysis by sinusoidal and auxiliary stimulation, Vis. Res., 9, 1461-1472, 1969.
87. Spekreijse, H. and Oosting, J., Linearizing: a method for analyzing and synthesizing nonlinear systems, Kybernetik, 7, 23-31, 1970.
88. Korenberg, M. J., Cross-correlation analysis of neural cascades, Proc. 10th Ann. Rocky Mountain Bioeng. Symp., 1, 47-52, 1973.
89. Korenberg, M. J., Obtaining differential equation, functional expansion or cascade representations for nonlinear biological systems, Proc. N. Engl. Bioeng. Conf., 1, 237-245, 1973.
90. Billings, S. A. and Fakhouri, S. Y., Identification of systems containing linear dynamic and static nonlinear elements, Automatica, 18, 15-26, 1982.
91. Korenberg, M. J., Statistical identification of parallel cascades of linear and nonlinear systems, IFAC Symp. Idem. Syst. Param. Est, 1, 669-674, 1982.
92. Shi, J. and Sun, H. H., Nonlinear system identification for cascaded block model: An application to electrode polarization impedance, IEEE Trans. Biomed. Eng., 37, 574-587, 1990.
93. 73 pp. 179-200.
94. Korenberg, M. J., French, A. S., and Voo, S. K. L., White-noise analysis of nonlinear behavior in an insect sensory neuron: kernel and cascade approaches, Biol. Cybern., 58, 313-320, 1988.
95. French, A. S. and Korenberg, M. J., A nonlinear cascade model for action potential encoding in an insect sensory neuron, Biophys. J., 55, 655-661, 1989.
96. French, A. S., Korenberg, M. J., Jarvilehto, M., Kouvalainen, E., Juusola, M., and Weckstrom, M., The dynamic nonlinear behavior of fly photoreceptors evoked by a wide range of light intensities, Biophys. J., 65, 832-839, 1993.
97. Bendat, J. S., Nonlinear System Analysis and Identification from Random Data, John Wiley, New York, 1990.
98. Westwick, D. T. and Kearney, R. E., Generalized eigenvector algorithm for nonlinear system identification with non-white inputs, Ann. Biomed. Eng., 25, 802-814, 1997.
99. Korenberg, M. J., Statistical identification of Volterra kernels of high order systems, IEEE Symp. Circ. Syst., 2, 570-575, 1984.
100. 76 pp. 163-178.
101. Westwick, D. T. and Kearney, R. E., Identification of high-order nonlinear systems using the parallel cascade method, Proc. Can. Med. Biol. Eng. Conf., 19, 200-201, 1993.
102. 76 pp. 261-267.
103. Marmarelis, V. Z., Modeling methodology for nonlinear physiological systems, Ann. Biomed. Eng., 25, 239-251, 1997.
104. van der Veen, A. J., Deprettere, F., and Swindlehurst, A. L., Subspace-based signal analysis using singular value decomposition, Proc. IEEE, 81, 1277-1308, 1993.
105. van Overschee, P. and de Moor, B., Subspace algorithms for the stochastic identification problem, Automatica, 29, 649-660, 1993.
106. van Overschee, P. and de Moor, B., N4SID: Subspace algorithms for the identification of combined deterministic-stochastic systems, Automatica, 30, 75-93, 1994.
107. Verhaegen, M., Subspace model identification part 3. Analysis of the ordinary output-error state-space model identification algorithm, Int. J. Control, 58, 555-586, 1993.
108. Verhaegen, M., Identification of the deterministic part of MIMO state space models given in innovations form from input-output data, Automatica, 30, 61-74, 1994.
109. Verhaegen, M. and De Wilde, P., Subspace identification part 2. Analysis of the elementary output-error state-space model identification algorithm, Int. J. Control, 56, 1211-1241, 1992.
110. Verhaegen, M., A subspace model identification solution to the identification of mixed causal, anti-causal LTI systems, SIAM J. Matrix Anal. Appl., 17, 332-347, 1996.
111. Verhaegen, M. and Yu, X., A class of subspace model identification algorithms to identify periodically and arbitrarily time-varying systems, Automatica, 31, 201-216, 1995.
112. Cho, Y. M. and Kailath, T., Fast subspace-based system identification: An instrumental variable approach, Automatica, 31, 903-905, 1995.
113. Cho, Y. M., Xu, G., and Kailath, T., Fast identification of state-space models via exploitation of displacement structure, IEEE Trans. Automatic Control, 39, 2004-2017, 1994.
114. Westwick, D. T., Kearney, R. E., and Verhaegen, M. H., An efficient implementation of the PI subspace state-space system identification algorithm, Proc. IEEE EMBS, 18, 690, 1996.
115. Chen, S. and Billings S. A., Representation of non-linear systems: the NARMAX model, Int. J. Control 49, 1013-1032, 1989.
116. Leontaritis, I. J. and Billings, S. A., Input-output parametric models for non-linear systems part I: deterministic non-linear systems, Int. J. Control, 41, 303-328, 1985.
117. Leontaritis, I. J. and Billings, S. A., Input-output parametric models for non-linear systems part II: stochastic non-linear systems, Int. J. Control 41, 329-344, 1985.
118. Billings, S. A. and Chen, S., Identification of non-linear rational systems using a prediction-error estimation algorithm, Int. J. Syst. Sci., 20, 467-494, 1989.
119. Haber, R. and Keviczky, L., Identification of Nonlinear Dynamic Systems, IFAC Symp. Idem. Syst. Param. Est., 4, 79-126, 1976.
120. 118a. Chon, K. H., Korenberg, M. J., and Holstein-Rathlou, N.-H., Application of fast orthogonal search to linear and nonlinear stochastic systems, Ann. Biomed. Eng., 25, 793-801, 1997.
121. Billings, S. A. and Jones, G. N., Orthogonal least-squares parameter estimation algorithms for non-linear stochastic systems, Int. J. Syst. Sci., 23, 1019-1032, 1992.
122. Billings, S. A., Korenberg, M. J., and Chen, S., Identification of non-linear output-affine systems using an orthogonal least-squares algorithm, Int. J. Syst. Sci., 19, 1559-1568, 1988.
123. Korenberg, M. J., A robust orthogonal algorithm for system identification and time series analysis, Biol. Cybern., 60, 267-276, 1989.
124. 121a. Mao, K. Z. and Billings, S. A., Algorithms for minimal model structure detection in nonlinear dynamic system identification, Int. J. Control 68, 311-330, 1997.
125. Hsia, T. C., On least-squares algorithms for system parameter identification, IEEE Trans. Automatic Control, 21, 104-108, 1976.
126. 76 pp. 211-217.
127. Rojas, R., Neural Networks, a Systematic Introduction, Springer-Verlag, Berlin, 1996.
128. Wray, J. and Green, G. G. R., Calculation of the Volterra kernels of non-linear dynamic systems using an artificial neural network, Biol. Cybern., 71, 187-195, 1994.
129. Chen, S., Billings, S. A., and Grant, P. M., Non-linear system identification using neural networks, Int. J. Control, 51, 1191-1214, 1990.
130. Billings, S. A. and Voon, W. S. F., A prediction-error and stepwise-regression estimation algorithm for non-linear systems, Int. J. Control, 44, 803-822, 1986.
131. 76 pp. 243-259.
132. Chon, K. H. and Cohen, R. J., Linear and nonlinear ARMA model parameter estimation using an artificial neural network, IEEE Trans. Biomed. Eng., 44, 168-174, 1997.
133. Chen, S., Cowan, C. F. N., and Grant, P. M., Orthogonal least squares learning algorithm for radial basis function networks, IEEE Trans. Neur. Net., 2, 302-309, 1991.
134. Chen, S., Billings, S. A., Cowan, C. F. N., and Grant, P. M., Non-linear systems identification using radial basis functions, Int. J. Syst. Sci., 21, 2513-2539, 1990.
135. Chen, S., Billings, S. A., Cowan, C. F. N., and Grant, P. M., Practical identification of NARMAX models using radial basis functions, Int. J. Control, 52, 1327-1350, 1990.
136. Chen, S., Billings, S. A., and Grant, P. M., Recursive hybrid algorithm for non-linear system identification using radial basis function networks, Int. J. Control, 55, 1051-1070, 1992.