A sequential learning approach for single hidden layer neural networks

Neural Networks

Volumn 11, Issue 1, 1998, Pages 65-80

  Zhang, Jie ^a   Morris, A J ^a  

^a Chemometrics Contr Dept Chem P   (United Kingdom)

Author keywords

Neural network structures; Neural network training; Neural networks; Non linear system modelling

Indexed keywords

LEARNING SYSTEMS; LEAST SQUARES APPROXIMATIONS; MATHEMATICAL MODELS; OPTIMIZATION; REGRESSION ANALYSIS; VECTORS;

HIDDEN LAYER NEURAL NETWORKS; SEQUENTIAL LEARNING APPROACH;

NEURAL NETWORKS;

ARTICLE; INFORMATION PROCESSING; LEARNING; NERVE CELL NETWORK; POSITIVE FEEDBACK; PRIORITY JOURNAL; REGRESSION ANALYSIS;

EID: 0031891445     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(97)00111-1     Document Type: Article

References (33)

1. Akaike H. A new look at the statistical model identification. IEEE Transactions on Automatic Control. 19(6):1974;716-723.
2. Ballard, D.H. (1988). Cortical connections and parallel processing: Structure and function. In M. Arbib and Hamson (Eds.), Vision, brain and cooperative computation (pp. 563-621). Cambridge: MIT Press.
3. Bhat N.V., McAvoy T.J. Use of neural nets for dynamical modelling and control of chemical process systems. Computers and Chemical Engineering. 14:1990;573-583.
4. Billings S.A., Voon W.S.F. Correlation based model validation tests for non-linear models. International Journal of Control. 44:1986;235-244.
5. Bishop C. Improving the generalization properties of radial basis function neural networks. Neural Computation. 3(4):1991;579-588.
6. Chen, S., Billings, S.A., & Grant, P.M. (1990a) Non-linear system identification using neural networks. International Journal of Control, 51, 1191-1214.
7. Chen, S., Billings, S.A., Cowan, C.F.N., & Grant, P.M. (1990b) Practical identification of NARMAX models using radial basis functions. International Journal of Control, 52, 1327-1350.
8. Chen S., Cowan C.F.N., Grant P.M. Orthogonal least squares learning algorithm for radial basis function networks. IEEE Transaction on Neural Networks. 2(2):1991;302-309.
9. Chen S., Chng E.S., Alkadhimi K. Regularized orthogonal least squares algorithm for constructing radial basis function networks. International Journal of Control. 64:1996;820-837.
10. Chentouf, R. and Jutten, C. (1996). Combining sigmoids and radial basis function in evolutive neural architectures. In Proceedings of the 4th European Symposium on Artificial Neural Networks (pp. 129-134).
11. Cybenko G. Approximation by superpositions of a sigmoidal function. Mathematical Control Signal Systems. 2:1989;303-314.
12. Fahlman, S. and Lebiere, C. (1990). The cascade-correlation learning architecture. In D. Touretzky (Ed.), Advances in neural information processing systems 2 (pp. 524-532). Morgan Kaufmann.
13. Friedman J.W., Stuetzle W. Projection pursuit regression. Journal of the American Statistical Association. 76:1981;817-823.
14. Gemperline P.J., Long J.R., Gregoriou V.G. Nonlinear multivariate calibration using principal components regression and artificial neural networks. Analytical Chemistry. 63:1991;2313-2323.
15. Girosi F., Poggio T. Networks and the best approximation property. Biological Cybernetics. 63:1990;169-179.
16. Haesloop, D. and Holt, B.R. (1990). A neural network structure for system identification. In Proceedings of American Control Conference (pp. 2460-2465). San Diego, CA, USA, 23-25 May.
17. Hofland, A., Montague, G.A., and Morris, A.J. (1992, June). Radial basis function networks applied to process control. In Proceedings of the ACC (pp. 480-484), Chicago, USA.
18. Holcomb, T. and Morari, M. (1991). Local training for radial basis function networks: towards solving the hidden units problem. In Proceedings of the ACC (pp. 2331-2336). Boston, MA, USA, 26-28 June.
19. Holcomb T., Morari M. PLS/Neural networks. Computers and Chemical Engineering. 16(4):1992;393-411.
20. Hwang J.N., Lay S.R., Maechler M., Martin R.D., Schimert J. Regression modelling in back-propagation and projection pursuit learning. IEEE Transactions on Neural Networks. 5(3):1994;342-353.
21. Leontaritis I.J., Billings S.A. Model selection and validation methods for non-linear systems. International Journal of Control. 45:1987;311-341.
22. Marquardt D. An algorithm for least squares estimation of nonlinear parameters. SIAM Journal of Applied Mathematics. 11:1963;431.
23. Montague, G.A., Tham, M.T., Willis, M.J. and Morris, A.J. (1992). Predictive control of distillation columns using dynamic neural networks. In 3rd IFAC Symposium on Dynamics and Control of Chemical Reactors, Distillation Columns, and Batch Processes (pp. 231-236), College Park, MD, USA.
24. Narendra K.S., Parthasarathy K. Identification and control of dynamical systems using neural networks. IEEE Transactions on Neural Networks. 1(1):1990;4-27.
25. Orr M.J.L. Regularization in the selection of radial basis function centers. Neural Computation. 7(3):1995;606-623.
26. Park J., Sandberg I.W. Universal approximation using radial basis function networks. Neural Computing. 3:1991;246-257.
27. Poggio T., Girosi F. Networks for approximation and learning. Proceedings of the IEEE. 78:1990;1481-1497.
28. Sietsma, J., & Dow, R.J.F. (1988) Neural net pruning - Why and how. Proceedings of IEEE International Conference on Neural Networks, 1, 325-333. San Diego, CA, USA, 24-27 July.
29. Sietsma J., Dow R.J.F. Creating artificial neural networks that generalize. Neural Networks. 4:1991;67-79.
30. Sjoberg J., Zhang Q., Ljung L., Benveniste A., Delyon B., Glorennec P.Y., Hjalmarsson H., Judisky A. Nonlinear black-box modelling in system identification: a unified overview. Automatica. 31:1995;1691-1724.
31. Wang Z., Tham M.T., Morris A.J. Multilayer neural networks: approximated canonical decomposition of nonlinearity. International Journal of Control. 56:1992;655-672.
32. Wang Z., Di Massimo C., Montague G.A., Morris A.J. A procedure for determining the topology of feed forward neural networks. Neural Networks. 7(2):1994;291-300.
33. Willis M.J., Di Massimo C., Montague G.A., Tham M.T., Morris A.J. On artificial neural networks in process engineering. Proceedings of the IEEE, Part D. 138:1991;256-266.