Optimal linear combinations of neural networks

Neural Networks

Volumn 10, Issue 4, 1997, Pages 599-614

  Hashem, Sherif ^a,b  

^a PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

^b CAIRO UNIVERSITY   (Egypt)

Author keywords

Collinearity; Function approximation; Mixture of experts; Model selection; Optimal linear combination; Robust estimation

Indexed keywords

OPTIMAL LINEAR COMBINATIONS (OLC);

ALGORITHMS; APPROXIMATION THEORY; COMPUTER SIMULATION; KNOWLEDGE ACQUISITION;

NEURAL NETWORKS;

ACCURACY; ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; PRIORITY JOURNAL; STATISTICAL MODEL;

EID: 0031171679     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(96)00098-6     Document Type: Article

References (21)

1. Alpaydin, E. (1993). Multiple networks for function learning. In Proceedings of the 1993 IEEE International Conference on Neural Networks: Vol. 1. (pp. 9-14). New Jersey: IEEE Press.
2. Battiti, R., & Colla, A.M. (1994). Democracy in neural nets: Voting schemes for classification. Neural Networks, 7 (4), 691-707.
3. Baxt, W.G. (1992). Improving the accuracy of an artificial neural network using multiple differently trained networks. Neural Computation, 4, 772-780.
4. Belsley, D. A. (1991). Conditioning Diagnostics: Collinearity and Weak Data in Regression. New York: John Wiley and Sons.
5. Belsley, D. A., Kuth, E., & Welsch, R. E. (1980). Regression Diagnostics: Identifying Influential Data and Sources of Collinearity. New York: John Wiley.
6. Benediktsson, J. A., Sveinsson, J. R., Ersoy, O. K., & Swain, P. H. (1993). Parallel consensual neural networks. In Proceedings of the 1993 IEEE International Conference on Neural Networks: Vol. I. (pp. 27-32). New Jersey: IEEE Press.
7. Breiman, L. ( 1992) Stacked regressions. Technical Report 367, Department of Statistics, University of California, Berkeley, California 94720, USA. Revised June 1994.
8. Bunn, D.W. (1989). Forecasting with more than one model. Journal of Forecasting, 8, 161-166.
9. Cherkassky, V., Gehring, D., & Mulier, F. (1995). Pragmatic comparison of statistical and neural network methods for function estimation. In Proceedings of the 1995 World Congress on Neural Networks, Vol. 2. (pp. 917-926). New Jersey: Lawrence Erlbaum Assoc.
10. Cherkassky, V., & Lari-Najafi, H. ( 1991 ). Constrained topological mapping for nonparametric regression analysis. Neural Networks, 4, 27-40.
11. Clemen, R.T. (1986). Linear constraints and the efficiency of combined forecasts. Journal of Forecasting, 5, 31-38.
12. Clemen, R.T. (1989). Combining forecasts: A review and annotated bibliography. International Journal of Forecasting, 5, 559-583.
13. Clemen, R.T., & Winkler, R.L. (1986). Combining economic forecasts. Journal of Business and Economic Statistics, 4 (1), 39-46.
14. Cooper, L. (1991). Hybrid neural network architectures. Equilibrium systems that pay attention. In R.J. Mammone & Y.Y. Zeevi (Eds.), Neural Networks: Theory and Applications, (pp. 81-96). New York: Academic Press.
15. Drago, G.P., & Ridella, S. (1992). Statistically controlled activation weight initialization SCAWI. IEEE Transactions on Neural Networks, 3(4), 627-631.
16. Drucker, H., & Le Cun, Y. (1991). Double backpropagation increasing generalization performance. In Proceedings of the 1991 International Joint Conference on Neural Networks in Seattle: Vol. 2. (pp. 145-150). New Jersey: IEEE Press.
17. Gardner, E.S. Jr., & Makridakis, S. (1988). The future of forecasting. International Journal of Forecasting, 4, 325-330.
18. Granger, C.W.J. (1989). Combining forecasts - twenty years later. Journal of Forecasting, 8, 167-173.
19. Granger, C.W.J., & Ramanathan, R. (1984). Improved methods of combining forecasts. Journal of Forecasting, 3, 197-204.
20. Guerard, J.B. Jr., & Clemen, R.T. (1989). Collinearity and the use of latent root regression for combining GNP forecasts. Journal of Forecasting, 8, 231-238.
21. Hansen, L.K., & Salamon, P. (1990). Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence. 12 (10), 993-1001.