Maximum-likelihood parameter estimation of bilinear systems

IEEE Transactions on Automatic Control

Volumn 50, Issue 10, 2005, Pages 1581-1596

  Gibson, Stuart ^a   Wills, Adrian ^b   Ninness, Brett ^b  

^a LEHMAN BROTHERS   (United States)

^b UNIVERSITY OF NEWCASTLE   (Australia)

Author keywords

Bilinear systems; Maximum likelihood (ML); Parameter estimation; System identification

Indexed keywords

COMPUTATIONAL COMPLEXITY; IDENTIFICATION (CONTROL SYSTEMS); MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD ESTIMATION; PARAMETER ESTIMATION; PROBABILITY DENSITY FUNCTION;

BILINEAR SYSTEMS; EXPECTATION-MAXIMIZATION METHOD;

MULTIVARIABLE CONTROL SYSTEMS;

EID: 27644543355     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2005.856664     Document Type: Article

References (51)

1. R. Baheti, R. Mohler, and H. Spang, "Second order correlation method for bilinear system identification," IEEE Trans. Autom. Control, vol. AC-25, no. 6, pp. 1141-1146, Dec. 1980.
2. L. Baum, T. Petrie, G. Soules, and N. Weiss, "A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains," Ann. Math. Statist., vol. 41, pp. 164-171, 1970.
3. N. Bergboer, V. Verdult, and M. Verhaegen, "An efficient implementation of maximum likelihood identification of LTI state-space models by local gradient search," in Proc. 41st IEEE Conf. Decision Control, Las Vegas, NV, Dec. 2002.
4. M. Borran and B. Aazhang, "EM-based multiuser detection in fast fading multipath environments," in Proc. EURASIP, vol. 8, 2002, pp. 787-796.
5. J. W. Brewer, "Kronecker products and matrix calculus in system theory," IEEE Trans. Circuits Syst., vol. CAS-25, no. 9, pp. 772-781, Sep. 1978.
6. C. Bruni, G. Dipillo, and G. Koch, "Bilinear systems: An appealing class of "nearly linear" systems in theory and applications," IEEE Trans. Autom. Control, vol. AC-19, no. 4, pp. 334-348, Aug. 1974.
7. P. Caines, Linear Stochastic Systems. New York: Wiley, 1988.
8. H. Chen and J. Maciejowski, "An improved subspace identification method for Bilinear systems," in Proc. IFAC Symp. System Identification, 2000, pp. 164-170.
9. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Royal Statist. Soc., ser. B, vol. 39, pp. 1-38, 1977.
10. J. Dennis and R. B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations. Upper Saddle River, NJ: Prentice-Hall, 1983.
11. W. Favoreel, B. De Moor, and P. Van Overschee, "Subspace identification of bilinear systems subject to white inputs," IEEE Trans. Autom. Control, vol. 44, no. 6, pp. 1157-1165, Jun. 1999.
12. F. Fnaiech and L. Ljung, "Recursive identification of bilinear systems," Int. J. Control, vol. 45, pp. 453-470, 1987.
13. M. Gabr and T. S. Rao, "On the identification of bilinear systems from operating records," Int. J. Control, vol. 40, pp. 121-128, 1984.
14. S. Gibson and B. Ninness, "Robust maximum-likelihood estimation of multivariable dynamic systems," Automatica, vol. 41, no. 5, pp. 1667-1682, 2005.
15. G. Golub and C. V. Loan, Matrix Computations. Baltimore, MD: Johns Hopkins Univ. Press, 1989.
16. G. Goodwin and A. Feuer, "Estimation with missing data," Math. Comput. Model. Dyna. Syst., vol: 5, pp. 220-244, 1999.
17. G. Goodwin and R. Payne, Dynamic System Identification. New York: Academic, 1977.
18. G. Goodwin and K. Sin, Adaptive Filtering Prediction and Control. Englewood Cliffs, NJ: Prentice-Hall, 1984.
19. N. Gupta and R. Mehra, "Computational aspects of maximum likelihood estimation and reduction in sensitivity function calculations," IEEE Trans. Autom. Control, vol. AC-19, no. 6, pp. 774-783, Dec. 1974.
20. E. Hannan, Multiple Time Series. New York: Wiley, 1970.
21. M. Inagaki and H. Mochizuki, "Bilinear system identification by volterra kernel estimation," IEEE Trans. Autom. Control, vol. AC-29, no. 8, pp. 746-749, Aug. 1984.
22. A. Isaksson, "Identification of ARX models subject to missing data," IEEE Trans. Autom. Control, vol. 38, no. 5, pp. 813-819, May 1993.
23. A. H. Jazwinski, Stochastic Processes and Filtering Theory. New York: Academic, 1970.
24. T. Kailath, A. Sayed, and B. Hassabi, Linear Estimation. Upper Saddle River, NJ: Prentice-Hall, 2000.
25. A. J. Krener, "Bilinear and nonlinear realizations of input-output maps," SIAM J. Control, vol. 13, pp. 827-834, 1975.
26. E. Lehmann, Theory of Point Estimation. New York: Wiley, 1983.
27. L. Ljung, System Identryication: Theory for the User, 2nd ed. Upper Saddle River, NJ: Prentice-Hall, 1999.
28. T. McKelvey and A. Helmersson, "System identification using an over-parametrized model class-Improving the optimization algorithm," in Proc. 36th IEEE Conf. Decision and Control, San Diego, CA, Dec.1997, pp. 2984-2989.
29. T. McKelvey and A. Helmersson, "A dynamical minimal parametrization of multivariable linear systems and its application to optimization and system identification," in Proc. of the 14th World Congr. IFAC, Vol. H, Beijing, China, 1999, pp. 7-12.
30. T. McKelvey, A. Helmersson, and T. Ribarits, "Data driven local coordinates for multivariable linear systems and their application to system identification," Automatica, vol. 40, pp. 1629-1635, 2004.
31. G. McLachlan and T. Krishnan, The EM Algorithm and Extensions. New York: Wiley, 1996.
32. S. Meddeb, J. Y. Tourneret, and F. Castanie, "Identification of bilinear systems using Bayesian inference," in Proc. 1998 IEEE Int. Conf. Acoustics, Speech, and Signal Pmoessing, Seattle, WA, May 1998, pp. 1609-1612.
33. X. Meng and D. van Dyk, "The EM algorithm-An old folk-song sung to a fast new tune," Journal of the Royal Statistical Society, ser. B, vol. 59, pp. 511-567, 1997.
34. I. Misztal and M. Perez-Enciso, "Sparse matrix inversion for restricted maximum likelihood estimation of variance components by Expectation-Maximization," J. Dairy Sci., vol. 76, pp. 1479-1483, 1993.
35. B. Ninness, A. Wills, and S. Gibson, "The university of newcastle identification toolbox (UNIT)," in Proc. IFAC World Congr., Prague, Czech Republic, Jul. 2005.
36. J. Nocedal and S. Wright, Numerical Optimization. New York: Springer-Verlag, 1999.
37. W. J. Rugh, Nonlinear System Theory: The Volterra/Wiener Approach. Baltimore, MD: Johns Hopkins Univ. Press, 1981.
38. P. A. Ruud, "Extensions of estimation methods using the EM algorithm," J. Economet., vol. 49, pp. 305-341, 1991.
39. R. Shumway, "An approach to time series smoothing and forecasting using the EM algorithm," J. Time Series Anal., vol. 3, pp. 253-264, 1982.
40. R. H. Shumway and D. S. Stoffer, Time Series Analysis and Its Applications. New York: Springer-Verlag, 2000.
41. D. Titterington, A. Smith, and U. Makov, Statistical Analysis of Finite Mixture Distributions. New York: Wiley, 1985.
42. T. Söderström and P. Stoica, System Identryication. Upper Saddle River, NJ: Prentice-Hall, 1989.
43. V. Tsoulkas, P. Koukoulas, and N. Kalouptisdis, "Identification of input-output bilinear systems using cumulants," IEEE Trans. Signal Process., vol. 49, pp. 2753-2761, 2001.
44. P. van Overschee and B. de Moor, "N4SID: Subspace algorithms for the identification of combined deterministic-stochastic systems," Automatica, vol. 30, pp. 75-93, 1994.
45. V. Verdult, "Nonlinear system identification: A state-space approach," Ph.D. dissertation, Univ. Twente, Twente, The Netherlands, 2002.
46. V. Verdult, N. Bergboer, and M. Verghaegen, "Maximum likelihood identification of multivariable bilinear state-space systems by projected gradient search," in Proc. 41st IEEE Conf. Decision and Control, Las Vegas, NV, Dec. 2002.
47. V. Verdult and M. Verhaegen, "Subspace identification of mimo bilinear systems,"in Proc. European Control Conf., Karlsruhe, Germany, 1999.
48. V. Verdult and M. Verhaegen, "Subspace identification of multivariable linear parameter-varying systems," Automatica, vol. 38, pp. 805-814, 2002.
49. V. Verdult and M. Verhaegen, "A kernel method for subspace identification of multivariable bilinear systems," in Proc. IEEE Conf. Decision and Control, vol. 4, 2003, pp. 3972-3977.
50. A. Wills, B. Ninness, and S. Gibson, "On the estimation of fully parametrized state space models via gradient-based search," in Proc. IFAC World Congr., 2005.
51. C. F. Wu, "On the convergence properties of the EM algorithm," Ann. Statist., vol. 11, pp. 95-103, 1983.