Model selection in neural networks

Neural Networks

Volumn 12, Issue 2, 1999, Pages 309-323

  Anders, Ulrich ^a   Korn, Olaf ^a  

^a CENTRE FOR EUROPEAN ECONOMIC RESEARCH ZEW   (Germany)

Author keywords

Cross validation; Identification; Information criteria; Model selection; Monte Carlo simulation; Neural networks; Pruning; Statistical inference

Indexed keywords

COMPUTER SIMULATION; MATHEMATICAL MODELS; MONTE CARLO METHODS;

MODEL SELECTION;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; HYPOTHESIS; PRIORITY JOURNAL; SIMULATION; STATISTICAL ANALYSIS; STATISTICAL MODEL; SYSTEM ANALYSIS; VALIDATION PROCESS;

EID: 0033105287     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(98)00117-8     Document Type: Article

References (37)

1. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B. N. Petrov, & F. Csaki (Eds.), Second International Symposium on Information Theory (pp. 267-281). Budapest: Akademiai Kiado.
2. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, AC19, 716-723.
3. Anders, U. (1997). Neural network pruning and statistical hypotheses tests. In N. Kasabov, R. Kozma, K. Ko, R. O'Shea, G. Coghill, & T. Gedeon (Eds.), Progress in Connectionist-Based Information Systems (Addendum pp. 1-4). Proceedings of ICONIP '97. Berlin: Springer.
4. Anders, U., Korn, O., & Schmitt, C. (1998). Improving the pricing of options - a neural network approach. Journal of Forecasting (in press).
5. Bishop, C. M. (1995). Neural networks for pattern recognition. Oxford: Clarendon Press.
6. Burgess, A. N. (1995). Nonlinear model identification and statistical significance tests and their application to financial modeling. In: IEE Proceedings of the Fourth International Conference on Artificial Neural Networks 409 (pp. 312-317).
7. Davidson, R., & MacKinnon, R. G. (1993). Estimation and inference in econometrics. Oxford: Oxford University Press.
8. Davies, R. B. (1977). Hypothesis testing when a nuisance parameter is present only under the alternative. Biometrika, 64, 247-254.
9. Davies, R. B. (1987). Hypothesis testing when a nuisance parameter is present only under the alternative. Biometrika, 74, 33-34.
10. Efron, B., & Tibshirani, R. J. (1993). An introduction to the bootstrap. London: Chapman and Hall.
11. Granger, C. W. J., & Teräsvirta, T. (1993). Modeling nonlinear economic relationships. Oxford: Oxford University Press.
12. Hornik, K., Stinchcombe, M., & White, H. (1989). Multilayer feedforward networks are universal approximators. Neural Networks, 2, 359-366.
13. Judge, G. G., Griffiths, W. E., Hill, R. C., Lütkepohl, H., & Lee, T.-S. (1985). The theory and practice of econometrics, 2nd ed. Chichester: Wiley.
14. Kingdon, J. (1997). Intelligent systems and financial forecasting. Berlin: Springer.
15. Kuan, C.-M., & White, H. (1994). Artificial neural networks: an econometric perspective. Econometric Reviews, 13, 1-91.
16. Lee, T.-H., White, H., & Granger, C. W. J. (1993). Testing for neglected nonlinearity in time series models. Journal of Econometrics, 56, 269-290.
17. Moody, J. E. (1992). The effective number of parameters: an analysis of generalization and regularization in nonlinear learning systems. In J. E. Moody, S. J. Hanson, & R. P. Lippmann (Eds.), Advances in neural information processing systems 4 (pp. 847-854). San Mateo, CA: Morgan Kaufmann.
18. Moody, J. E., & Rögnvaldsson, T. S. (1997). Smoothing regularizes for projective basis function networks. In M. C. Mozer, M. I. Jordan, & T. Petsche (Eds.), Advances In Neural Information Processing Systems 9 (pp. 585-591). Cambridge, MA: MIT Press.
19. Murata, N., Yoshizawa, S., & Amari, S. (1994). A criterion for determining the number of parameters in an artificial neural network model. IEEE Transactions of Neural Networks, 5 (6), 865-872.
20. Phillips, P. C. B. (1989). Partially identified econometric modells. Econometric Theory, 5, 181-240.
21. Reed, R. (1993). Pruning algorithms - a survey. IEEE Transactions on Neural Networks, 4, 740-747.
22. Refenes, A.-P., Burgess, A. N., & Bentz, Y. (1997). Neural networks in financial engineering: a study in methodology. IEEE Transactions on Neural Networks, 8 (6), 1222-1267.
23. Ripley, B. D. (1993). Statistical aspects of neural networks. In O. E. Barndorff-Nielsen, J. L. Lensen, & W. S. Kendall (Eds.), Networks and chaos - statistical and probabalistic aspects (pp. 40-123). London: Chapman and Hall.
24. Ripley, B. D. (1996). Pattern recognition and neural networks. Cambridge: Cambridge University Press.
25. Sarle, W. S. (1994). Neural networks and statistical models. In Proceedings Of The 19th Annual SAS Users Group International Conference (pp. 1538-1550). Cary, NC: SAS Institute.
26. Sarle, W. S. (1995). Stopped training and other remedies for overfitting. In Proceedings of the 27th Symposium on the Interface of Computing Science and Statistics (pp. 352-360).
27. Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461-464.
28. Stone, M. (1974). Cross validation choice and assessment of statistical predictions. Journal of the Royal Statistical Society, B36, 111-147.
29. Stone, M. (1977). An asymptotic equivalence of choice of model by cross-validation and Akaike's criterion cross validation. Journal of the Royal Statistical Society, B36, 44-47.
30. Swanson, N. R., & White, H. (1995). A model-selection approach to assessing the information in the term structure using linear models and artificial neural nelworks. Journal of Business and Economic Statistics, 13 (3), 265-275.
31. Teräsvirta, T., Lin, C.-R, & Granger, C. W. J. (1993). Power of the neural network linearity test Journal of Time Series Analysis, 14 (2), 209-220.
32. Weigend, A. S., Huberman, B. A., & Rumelhart, D. E. (1991). Predicting sunspots and exchange rates with connectionist networks. In M. Casdagli, & S. Eubank (Eds.), Nonlinear modeling and forecasting (pp. 395-432). Reading, MA: Addison-Wesley.
33. White, H. (1981). Consequences and detection of misspecified nonlinear regression models. Journal of the American Statistical Association, 76 (374), 419-433.
34. White, H. (1982). Maximum likelihood estimation of misspecified models. Econometrica, 50 (1), 1-25.
35. White, H. (1989a). An additional hidden unit test for neglected nonlinearity in multilayer feedforward networks. In Proceedings Of The International Joint Conference On Neural Networks, Washington, DC (pp. 451-455). San Diego, CA: SOS Printing.
36. White, H. (1989b). Learning in neural networks: a statistical perspective. Neural Computation, 1, 425-464.
37. White, H. (1994). Estimation, inference and specification analysis. Cambridge: Cambridge University Press.