Selective combination of multiple neural networks for improving model prediction in nonlinear systems modelling through forward selection and backward elimination

Neurocomputing

Volumn 72, Issue 4-6, 2009, Pages 1198-1204

  Ahmad, Zainal ^a   Zhang, Jie ^b  

^a SCHOOL OF CHEMICAL ENGINEERING   (Malaysia)

^b NEWCASTLE UNIVERSITY   (United Kingdom)

Author keywords

Backward elimination; Forward selection; Generalisation; Multiple neural networks; Selective combination of neural networks

Indexed keywords

BACKWARD ELIMINATION; FORWARD SELECTION; GENERALISATION; MULTIPLE NEURAL NETWORKS; SELECTIVE COMBINATION OF NEURAL NETWORKS;

COMPUTATIONAL METHODS; HEURISTIC METHODS; METROPOLITAN AREA NETWORKS; NONLINEAR SYSTEMS; OPTIMAL CONTROL SYSTEMS; VEGETATION;

NEURAL NETWORKS;

ALGORITHM; ANALYTICAL ERROR; ARTICLE; ARTIFICIAL NEURAL NETWORK; CLASSIFICATION; COMPUTER ANALYSIS; DATA ANALYSIS; DATA BASE; DIABETES MELLITUS; DYNAMICS; INFORMATION PROCESSING; MEDICAL INFORMATION SYSTEM; NONLINEAR SYSTEM; PREDICTION; PRIORITY JOURNAL; STATISTICAL MODEL;

EID: 58149472217     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2008.02.005     Document Type: Article

References (30)

1. Bishop C. Neural Networks for Pattern Recognition (1995), Clarendon Press, Oxford
2. Brieman L. Bagging predictors. Mach. Learn. 24 (1996) 123-140
3. Caruana R., Lawrence S., and Giles C.L. Overfitting in neural networks: backpropagation, conjugate gradient and early stopping. Neural Inf. Process. System 13 (2000) 402-408
4. Dietterich T.G. An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization. Mach. Learn. 40 (2000) 139-157
5. Efron B. The Jackknife, The Bootstrap and other Resampling Plans (1982), Society for Industrial and Applied Mathematics, Philadelphia
6. Franke J., and Neumann M.H. Bootstrapping neural networks. Neural Comput. 12 (2000) 1929-1949
7. K. Hagiwara, K. Kuno, Regularisation learning and early stopping in linear networks, in: International Joint Conference on Neural Networks, 2000, pp. 511-516.
8. Hashem S. Optimal linear combination. Neural Networks 10 (1997) 599-614
9. Hashem S. Treating harmful collinearity in neural networks ensembles. In: Sharkey A.J.C. (Ed). Combining Artificial Neural Nets Ensemble and Modular (1999), Springer Publication, London
10. Heartz J.A., Krogh A., and Palmer R.G. Introduction to the Theory of Neural Network Computation (1991), Addison-Wesley, Redwood City, CA
11. Jacobs R.A., Jordan M.I., Nowlan S.J., and Hinton G.E. Adaptive mixture of local expert. Neural Comput. 3 (1991) 79-87
12. Jordan M.I., and Jacobs R.A. Hierarchical mixtures of expert and the EM algorithm. Neural Comput. 6 (1994) 191-214
13. Kleinbaum D.G., Kupper L.L., and Muller K.E. Applied Regression Analysis and Other Multivariable Methods (1987), Kent Pub Co.
14. Laar P.V.D. Input selection based on an ensembles. Neurocomputing 34 (2000) 227-238
15. McAvoy T.J., Hsu E., and Lowenthal S. Dynamics of pH in controlled stirred tank reactor. Ind. Chem. Process Des. Dev. 11 (1972) 68-70
16. McLoone S., and Irwin G. Improving neural networks training solution using regularization. Neurocomputing 37 (2001) 71-90
17. N. Morgan, H. Bourlard, Generalisation and Parameter Estimation in Feedforward Nets: Some Experiments, San Mateo, CA, 1990.
18. M. Ohbayashi, K. Hirasawa, K. Toshimitsu, J. Murata, J. Hu, Robust control for non-linear system by universal learning networks considering fuzzy criterion and second order derivatives, in: IEEE World Congress on Computational Intelligence: IEEE International Conference Proceedings on Neural Networks, vol. 2, 1998, pp. 968-973.
19. Perrone M.P., and Cooper L.N. When networks disagree: ensemble methods for hybrid neural networks. In: Mammone R.J. (Ed). Artificial Neural Networks for Speech and Vision (1993), Chapman & Hall, London 126-142
20. Smith J.W., Everhart J.E., Dickson W.C., Knowler W.C., and Johannes R.S. Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. The Proceedings of the Symposium on Computer Applications and Medical Care (1988), IEEE Computer Society Press, Silver Spring, MD 261-265
21. In: Sharkey A.J.C. (Ed). Multi Nets System (1999), Springer Publication, London
22. Sridhar D.V., Bartlett E.B., and Seagrave R.C. Process modelling using stacked neural networks. AIChE J. 42 (1996) 2529-2539
23. Sridhar D.V., Bartlett E.B., and Seagrave R.C. An information theoretic approach for combining neural network process models. Neural Networks 12 (1999) 915-926
24. Wolpert D.H. Stacked generalization. Neural Networks 5 (1992) 241-259
25. Zhang J. Developing robust non-linear models through bootstrap aggregated neural networks. Neurocomputing 25 (1999) 93-113
26. Zhang J. Inferential estimation of polymer quality using bootstrap aggregated neural networks. Neural Networks 12 (1999) 927-938
27. Zhang J. Developing robust neural network models by using both dynamic and static process operating data. Ind. Eng. Chem. Res. 40 (2001) 234-241
28. Zhang J., Morris A.J., and Martin E.B. Long-term prediction models based on mixed order locally recurrent neural networks. Comput. Chem. Eng. 22 (1998) 1051-1063
29. Zhang J., Morris A.J., Martin E.B., and Kiparissides C. Prediction of polymer quality in batch polymerisation reactors using robust neural networks. Chem. Eng. J. 69 (1998) 135-143
30. Zhou Z.H., Wu J., and Tang W. Ensembling neural networks: many could be better than all. Artif. Intell. 137 1-2 (2002) 239