Developing robust non-linear models through bootstrap aggregated neural networks

Neurocomputing

Volumn 25, Issue 1-3, 1999, Pages 93-113

  Zhang, Jie ^a  

^a NEWCASTLE UNIVERSITY   (United Kingdom)

Author keywords

Bootstrap; Confidence bounds; Model robustness; Neural networks; Non linear models

Indexed keywords

MATHEMATICAL MODELS; REGRESSION ANALYSIS; ROBUSTNESS (CONTROL SYSTEMS);

BOOTSTRAP AGGREGATED NEURAL NETWORKS; SOFTWARE SENSORS;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; MATHEMATICAL MODEL; NONLINEAR SYSTEM; POLYMERIZATION; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; REACTOR;

EID: 0032928495     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0925-2312(99)00054-5     Document Type: Article

References (37)

1. Bates J.M., Granger C.W.J. The combination of forecasts. Oper. Res. Q. 20:1969;451-468.
2. Bishop C. Improving the generalisation properties of radial basis function neural networks. Neural Comput. 13:1991;579-588.
3. L. Breiman, Stacked regressions, Technical Report No. 367, Department of Statistics, University of California at Berkeley, USA, 1992.
4. L. Breiman, Bagging predictors, Technical Report No. 421, Department of Statistics, University of California at Berkeley, USA, 1994.
5. Bhat N.V., McAvoy T.J. Use of neural nets for dynamical modelling and control of chemical process systems. Comput. Chem. Eng. 14:1990;573-583.
6. Chen S., Billings S.A., Grant P.M. Non-linear system identification using neural networks. Int. J. Control. 51:1990;1191-1214.
7. Chryssolouris G., Lee M., Ramsey A. Confidence interval prediction for neural network models. IEEE Trans. Neural Networks. 7:1996;229-232.
8. Cybenko G. Approximation by superpositions of a sigmoidal function. Math. Control Signal Systems. 2:1989;303-314.
9. Dimitrators J., Georgakis C., El-Aasser M.S., Klein A. Dynamic modelling and state estimation for an emulsion copolymerization reactor. Comput. Chem. Eng. 13:1989;21-33.
10. B. Efron, The Jackknife, the Bootstrap and Other Resampling Plans, Society for Industrial and Applied Mathematics, Philadelphia, 1982.
11. B. Efron, R. Tibshirani, An Introduction to Bootstrap, Chapman & Hall, London, 1993.
12. Ellis M.F., Taylor T.W., Gonzalez V., Jensen K.F. Estimation of the molecular weight distribution in batch polymerization. A.I.Ch.E. J. 34:1988;1341-1353.
13. Friedman J.H. Multivariate adaptive regression splines. The Ann. Statist. 19:1991;1-141.
14. Geladi P., Kowalski B.R. Partial least-squares regression: a tutorial. Anal. Chim. Acta. 185:1986;1-17.
15. Girosi F., Poggio T. Networks and the best approximation property. Biol. Cybernet. 63:1990;169-179.
16. Hashem S. Optimal linear combinations of neural networks. Neural Networks. 10:1997;599-614.
17. Hoerl A.E., Kennard R.W. Ridge regression: biased estimation for nonorthogonal problems. Technometrics. 12(1):1970;55-67.
18. Jacobs R.A., Jordan M.I., Nowlan S.J., Hinton G.E. Adaptive mixture of local experts. Neural Comput. 3:1991;79-87.
19. Jordan M.I., Jacobs R.A. Hierarchical mixture of experts and the EM algorithm. Neural Comput. 6:1994;181-214.
20. Kent T. Robust properties of likelihood ratio tests. Biometrika. 69:1982;19-27.
21. Kiparissides C. Polymerisation reactor modelling: a review of recent developments and future directions. Chem. Eng. Sci. 51:1996;1637-1659.
22. Kozub D.J., MacGregor J.F. State estimation for semi-batch polymerization reactors. Chem. Eng. Sci. 47:1992;1047-1062.
23. Leonard J.A., Kramer M.A., Ungar L.H. A neural network architecture that computes its own reliability. Comput. Chem. Eng. 16:1992;819-835.
24. Narendra K.S., Parthasarathy K. Identification and control of dynamical systems using neural networks. IEEE Trans. Neural Networks. 1:1990;4-27.
25. Raviv Y., Intrator N. Bootstrapping with noise: an effective regularisation technique. Connection Sci. 8:1996;355-372.
26. Shao R., Martin E.B., Zhang J., Morris A.J. Confidence bounds for neural network representations. Comput. Chem. Eng. 21:1997;s1173-s1178.
27. Y. Shimshoni, N. Intrator, Classifying seismic signals by integrating ensembles of neural networks, Proceedings of ICONIP, Hong Kong, 18-21 September 1996.
28. J. Sietsma, R.J.F. Dow, Neural net pruning - why and how, Proceedings of IEEE International Conference on Neural Networks, 1988, pp. 325-333.
29. Sjoberg J., Zhang Q., Ljung L., Benveniste A., Delyon B., Glorennec P.Y., Hjalmarsson H., Juditsky A. Nonlinear black-box modelling in system identification: a unified overview. Automatica. 31:1995;1691-1724.
30. Sridhar D.V., Seagrave R.C., Bartlett E.B. Process modelling using stacked neural networks. A.I.Ch.E. J. 42:1996;2529-2539.
31. Tibshirani R. A comparison of some error estimates for neural network models. Neural Comput. 8:1996;152-163.
32. Wolpert D.H. Stacked generalization, Neural Networks. 5:1992;241-259.
33. J. Zhang, A.J. Morris, G.A. Montague, M.T. Tham, Dynamic system modelling using mixed node neural networks, Proceedings of IFAC Symposium ADCHEM'94, Kyoto, Japan, May 25-27, 1994, pp. 114-119.
34. Zhang J., Martin E.B., Morris A.J., Kiparissides C. Inferential estimation of polymer quality using stacked neural networks. Comput. Chem. Eng. 21:1997;s1025-s1030.
35. Zhang J., Morris A.J. A sequential training strategy for single hidden layer neural networks. Neural Networks. 11:1998;65-80.
36. Zhang J., Morris A.J., Martin E.B. Long term prediction models based on mixed order locally recurrent neural networks. Comput. Chem. Eng. 22:1998;1051-1063.
37. Zhang J., Morris A.J., Martin E.B., Kiparissides C. Prediction of polymer quality in batch polymerisation reactors using robust neural networks. Chem. Eng. J. 69:1998;135-143.