Efficient recursive estimation and adaptive control in stochastic regression and armax models

Statistica Sinica

Volumn 16, Issue 3, 2006, Pages 741-772

  Lai, Tze Leung ^a   Ying, Zhiliang ^a,b  

^a STANFORD UNIVERSITY   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

Adaptive control; Asymptotic efficiency; Least squares; M estimators; Semiparametric estimation; Stochastic regression; Strong consistency

Indexed keywords

EID: 33750972856     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (58)

1. Anderson, T. W. and Taylor, J. (1976). Some experimental results on the statistical problem of least squares estimates in control problems. Econometrica 44, 1289-1302.
2. Aokoi, M. (1974). On some price adjustment schemes. Ann. Econ. Soc. Measurements 3, 95-116.
3. Åström, K. and Eykhof, P. (1971). System identification - a survey. Automatica 7, 123-167.
4. Åström, K. and Wittenmark, B. (1973). On self-tuning regulators. Automatica 9, 195-199.
5. Banach, S. (1930). Über einige Eigenschaften der lacunaren trigonometrishe Reihen. Studio, Math. 2, 207-220.
6. Bickel, P. J. (1982). On adaptive estimation. Ann. Statist. 10, 647-671.
7. Becker, A., Kumar, P. R. and Wei, C. Z. (1985). Adaptive control with stochastic approximation algorithm: geometry and convergence. IEEE Trans. Automat. Control 30, 330-338.
8. Caines, P. E. and Lafortune, S. (1984). Adaptive control with recursive identification for stochastic linear systems. IEEE Trans. Automat. Control AC-29, 312-321.
9. Chan, N. H. (2006). Inference in time series and stochastic processes. Statist. Sinica 16, 683-696.
10. Chen, G. J., Lai, T. L. and Wei, C. Z. (1981). Convergence systems and strong consistency of least squares estimates in regression model. J. Multivariate Anal. 11, 319-333.
11. Fabian, V. and Hannan, J. (1982). On estimation and adaptive estimation for locally asymptotically normal families. Z. Wahrsch. Verw. Gebiete 59, 459-478.
12. Feldbaum, A. A. (1961). The theory of dual control I-II. Autom. Remote Control 21, 874-883, 1022-1039.
13. Gaposhkin, V. F. (1966). Lacunary series and independent functions. Russian Math. Surveys 216, 1-82.
14. Gladyshev, E. G. (1965). On stochastic approximation. Theory Probab. Appl. 10, 275-278.
15. Goodwin, G. C., Ramage, P. J. and Cainse, P. E. (1981). Discrete time stochastic adaptive control. SIAM J. Control Optim. 19, 829-853.
16. Guo, L. (1995). Convergence and logarithmic laws of self-tuning regulators. Automatica 31, 435-450.
17. Guo, L. and Chen, H. F. (1988). Convergence rate of ELS based adaptive tracker. Syst. Sci & Math. Sci. 1, 131-138.
18. Guo, L. and Chen, H. F. (1991). The Åström-Wittenmark self-tuning regulator revisited and ELS-baaed adaptive trackers. IEEE Trans. Automat. Control 36, 802-812.
19. Han, J., Lai, T. L. and Spivakovsky, V. (2005). Approximate policy optimization and adaptive control in regression models. To appear in Computational Economics.
20. Hansen, L. (1982). Large sample properties of generalized method of moments estimators. Econometrica 50, 1029-1054.
21. Kreiss, J-P. (1987). On adaptive estimation in stationary ARMA processes. Ann. Statist. 15, 112-133.
22. Lai, T. L. (1986). Asymptotically efficient adaptive control in stochastic regression models. Adv. Appl. Math. 7, 23-45.
23. Lai, T. L. (2003). Stochastic approximation. Ann. Statist. 31, 391-406.
24. Lai, T.L. and Robbins, H. (1977). Strong consistency of least-squares estimates in regression models. Proc. Natl. Acad. Sci. USA 74, 2667-2669.
25. Lai, T. L. and Robbins, H. (1979). Adaptive design and stochastic approximation. Ann. Statis. 7, 1196-1221.
26. Lai, T. L. and Robbins, H. (1981). Consistency and asymptotic efficiency of slope in stochastic: approximation schemes. Z. Wahrsch. Verw. Gebiete 56, 329-360.
27. Lai, T.L. and Robbins, H. (1982). Iterated least squares in multiperiod control. Adv. Appl. Math. 3, 50-73.
28. Lai, T. L., Robbins, H. and Wei, C. Z. (1978). Strong consistency of least squares estimates in multiple regression. Proc. Natl. Acad. Sci. USA 75, 3034-3036.
29. Lai, T. L., Robbins, H. and Wei, C. Z. (1979). Strong consistency of least squares estimates in multiple regression II. J. Multivariate Anal. 9, 343-361.
30. Lai, T. L. and Wei, C. Z. (1982a). A law of the iterated logarithm for double arrays of independent random variables with applications to regression and time series models. Ann. Probab. 10, 320-335.
31. Lai, T. L. and Wei, C. Z. (1982b). Least squares estimates in stochastic regression models with applications to identification and control of dynamic systems. Ann. Statist. 10, 154-166.
32. Lai, T. L. and Wei, C. Z. (1982c). Asymptotic properties of projections with applications to stochastic regression problems. J. Multivariate Anal. 12, 346-370.
33. Lai, T. L. and Wei, C. Z. (1983a). Lacunary systems and generalized linear processes. Stoch. Proc. Appl. 14, 187-199.
34. Lai, T. L. and Wei, C. Z. (1983b). Asymptotic properties of general autoregressive models and strong consistency of least squares estimates of their parameters. J. Multivariate Anal. 13, 1-23.
35. Lai, T. L. and Wei, C. Z. (1984). Moment inequalities with applications to regression and time series models. In Inequalities in Statistics and Probability (Edited by Y. L. Tong), 165-172. Monograph Series, Institute of Mathematical Statistics.
36. Lai, T. L. and Wei, C. Z. (1985). Orthonormal Banach systems with applications to linear processes. Z. Wahrsch. Verw. Gebiete 70, 381-393.
37. Lai, T. L. and Wei, C. Z. (1986a). Extended least squares and their applications to adaptive control and prediction in linear systems. IEEE Trans. Automat. Control 31, 898-906.
38. Lai, T. L. and Wei, C. Z. (1986b). On the concept of excitation in least squares identication and adaptive control. Stochastics 16, 227-254.
39. Lai, T. L. and Wei, C. Z. (1987). Asymptotically efficient self-tuning regulators. SIAM J. Contr. Optim. 25.
40. Lai, T. L. and Ying, Z. (1991a). Parallel recursive algorithms in asymptotically efficient adaptive control of linear stochastic systems. SIAM J. Control Optim. 29, 1091-1127.
41. Lai, T. L. and Ying, Z. (1991b). Recursive identification and adaptive prediction in linear stochastic systems. SIAM J. Control Optim. 29, 1061-1190.
42. Lai, T. L. and Ying, Z. (1992). Recursive solutions of estimating equations and adaptive spectral factorization. IEEE Trans. Automat. Control 37, 240-243.
43. Ljung, L. (1977). Analysis of recursive stochastic algorithms. IEEE Trans. Automat. Control 22, 551-575.
44. Ljung, L. and Söderström, T. (1983). Theory and Practice of Recursive Estimation. MIT Press.
45. Martin, R. D. and Yohai, V. J. (1985). Robustness in time series and estimating ARMA models. In Handbook of Statistics 5 (Edited by E. J. Hannan, P. R. Krishnaiah and M. M. Rao), 119-155. North Holland, Amsterdam.
46. Móricz, F. (1976). Moment inequalities and strong laws of large numbers. Z. Wahrsch. Verw. Gebiete 35, 299-314.
47. Nevel'son, M. B. and Has'minskii, R. Z. (1973). Stochastic Approximation and Recursive Estimation. Amer. Math. Soc., Providence, RI.
48. Prescott, E. C. (1972). The multiperiod control problem under uncertainty. Econometrica 40, 1043-1058.
49. Robbins, H. and Siegmund, D. (1970). A convergence theorem for nonnegative lamost supermartingales and some applications. In Optimizing Methods in Statistics (Edited by J. Rustagi), 233-257. Academic Press, New York.
50. Solo, V. (1979). The convergence of AML. IEEE Trans. Automat. Control 24, 958-962.
51. Stein, C. (1956). Efficient nonparametric testing and estimation. Proc. Third Berkeley Symp. Math. Statist. Probab. 1, 187-196. Univ. California Press.
52. Tunnicliffe-Wilson, G. (1979). Factorization of the covariance generating function of a pure moving average process. SIAM J. Numer. Anal. 6, 1-7.
53. Wei, C. Z. (1980). Limit theorems for weighted sums with applications to regression and time series models. Ph.D. dissertation, Columbia University.
54. Wei, C. Z. (1985). Asymptotic properties of least squares estimates in stochastic regression models. Ann. Statist. 13, 1498-1508.
55. Wei, C. Z. (1987a). Multivariate adaptive stochastic approximation. Ann. Statist. 15, 1115-1130.
56. Wei, C. Z. (1987b). Adaptive prediction by least squares predictors in stochastic regression models with applications to time series. Ann. Statist. 15, 1667-1682.
57. Wieland, V. (2000). Learning by doing and the value of experimentation. J. Econom. Dynam. Control 24, 501-534.
58. Zellner, A. (1971). An Introduction to Bayesian Inference in Econometrics. Wiley, New York.