Theoretical properties of the ASMOD algorithm for empirical modelling

International Journal of Control

Volumn 67, Issue 5, 1997, Pages 767-790

  Weyer, Erik ^a   Kavli, Tom ^b  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b SINTEF   (Norway)

Author keywords

[No Author keywords available]

Indexed keywords

ASYMPTOTIC STABILITY; CONVERGENCE OF NUMERICAL METHODS; FUNCTIONS; MATHEMATICAL MODELS; PARAMETER ESTIMATION;

ADAPTIVE SPLINE MODELLING OF OBSERVATION DATA (ASMOD) ALGORITHM; RISK MINIMIZATION THEORY;

ALGORITHMS;

EID: 0031177236     PISSN: 00207179     EISSN: 13665820     Source Type: Journal    
DOI: 10.1080/002071797223992     Document Type: Article

References (28)

1. Akaike, H. 1969, Fitting autoregressive models for prediction. Annals of the Institute for Statistics and Mathematics, 21, 425-439
2. Akaike, H. 1974, A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19, 716-723.
3. Breiman, L., Friedman, J. H., Olshen, R. A. and Stone, C. J., 1984, Classification and Regression Trees (Belmont, California, U.S.A: Wadsworth)
4. Bridgett, N. A., Brown, M., Harris, C. J., and Mills, D. J., 1994, High-dimensional approximation using an associative memory network. Proceedings of IEE Control’94, Vol. 2, pp. 1458-1465.
5. Carlin, M., Kavli, T., and Lillekjendlie, B., 1994, A comparison of four methods for non-linear data modelling. Chemometrics and Intelligient Laboratory Systems, 23, 163-177.
6. Dudley, R. M., 1984, A course on empirical processes. Ecole d’Eté de Probabilités de Saint-Flour XII-1982. Lectures notes in Mathematics, Vol. 1097 (Berlin: Springer-Verlag), pp. 1-142.
7. Friedman, J., 1991, Multivariate adaptive regression splines. The Annals of Statistics, 19, 1141.
8. Geman, S. E., Bienenstock, E., and Doursat, R., 1992, Neural networks and the bias/ variance dilemma. Neural Computation, 4, 1-58.
9. Haussler, D., 1992, Decision theoretic generalization of the PAC model for neural net and other learning applications. Information and Computation, 100, 78-150.
10. Hjorth, J. S. U., 1994, Computer Intensive Statistical Methods-Validation Model Selection and Bootstrap (London, U.K.: Chapman & Hall).
11. Hole, a., 1996, Vapnik-Chervonenkis generalization bounds for real valued neural networks. Neural Computation, 8, 1277-1299.
12. Kavli, T, 1992, Learning principles in dynamic control. Ph.D. thesis, University of Oslo, Norway
13. Kavli, T, 1993, ASMOD-an algorithm for adaptive spline modelling of observation data. International Journal of Control, 58, 947-967.
14. Kavli, T., and Weyer, E., 1995, On ASMOD-an algorithm for empirical modelling using spline functions. Neural Network Engineering in Dynamic Control Systems, edited by K. J. Hunt, G. R. Irwin and K. Warwick, Advances in Industrial Control (Berlin: Springer-Verlag), pp. 83-104.
15. Lj ung, L., 1978, Convergence analysis of parametric identification methods. IEEE Transactions on Automatic Control, 23, 770-783
16. Lj ung, L., 1987, System Identification-Theory for the User (Englewood Cliffs, New Jersey, U.S.A.: Prentice Hall).
17. Moody, J., and Darken, C. J., 1989, Fast learning in networks of locally tuned processing units. Neural Computation, 1, 281-294.
18. Pollard, D., 1984, Convergence of Stochastic Processes (Berlin: Springer-Verlag).
19. Rissanen, j., 1978, Modelling by shortest data description. Automatica, 14, 465-471.
20. Schumaker, L. L., 1981, Spline Functions Basic Theory (New York: Wiley).
21. Shawe-Taylor, J., Bartlett, P., Williamson, R. C., and Anthony, M., 1996, A Framework for structural risk minimization. Proceedings of the 9th Annual Conference on Computational Learning Theory (New York: ACM), pp. 68-76.
22. Shiryayev, A. N., 1984, Probability (Berlin: Springer-Verlag).
23. Stone, C. J., 1994, The use of polynomial splines and their tensor products in multivariate function estimation. Annals of Statistics, 22, pp. 118-184.
24. Soderstrom, T., and Stoica, P., 1988, System Identification (U.K.: Prentice Hall).
25. Vapnik, V., 1982, Estimation of Dependences Based on Empirical Data (Berlin: SpringerVerlag)
26. Vapnik, V., 1989, Inductive principles of the search for empirical dependences (methods based on weak convergence of probability measures). Proceedings of the 2nd Workshop on Computational Learning Theory (San Mateo, California, U.S.A.: Morgan Kaufman).
27. Weyer, E., 1992, System identification in the behavioural framework. Ph.D. thesis, Norwegian Institute of Technology, Trondheim, Norway.
28. Weyer, E., Williamson, R. C., and Mareels, I. M. Y., 1996, Finite sample complexity of stochastic least squares systems identification. Submitted for publication.