Optimizing number of hidden neurons in neural networks

Proceedings of the IASTED International Conference on Artificial Intelligence and Applications, AIA 2007

Volumn , Issue , 2007, Pages 121-126

  Liu, Yinyin ^a   Starzyk, Janusz A ^a   Zhu, Zhen ^a  

^a Ohio University   (United States)

Author keywords

Function approximation; Network optimization; Neural network; Overfitting; Signal to noise ratio figure

Indexed keywords

APPROXIMATION THEORY; FUNCTION EVALUATION; INFORMATION ANALYSIS; OPTIMIZATION; SIGNAL TO NOISE RATIO;

FUNCTION APPROXIMATION; NETWORK OPTIMIZATION; OVERFITTING;

NEURAL NETWORKS;

EID: 38349106530     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. S. I. Gallant, Perceptron-based learning algorithms, IEEE Trans. on Neural Networks, 1(2), 1990, 179-191.
2. K. Hornik, M. Stinchcombe, H. White, Multilayer feedforward networks are universal approximators, Neural Networks, 2(5), 1989, 359-366.
3. J. M. Zurada, Introduction to artificial neural systems (West Publishing Company, 1992).
4. S. Geman, E. Bienenstock, R. Doursat, Neural networks and the bias/variance dilemma, Neural Computation, 4(1), 1992, 1-58.
5. L. Prechelt. Early stopping ~ but when, Neural Networks: Tricks of the trade, Lecture Notes in Computer Science 1524 (Springer Verlag, Heidelberg, 1998).
6. R. Setiono, Feedforward neural network construction using cross validation, Neural Computation, 13(12), 2001, 2865-2877.
7. S. Amari, N. Murata, K. Muller, M. Finke, H. H. Yang, Asymptotic statistical theory of overtraining and cross-validation, IEEE Trans. On Neural Networks, 8(5), 1997, 985-996.
8. C. Wang, S. J. Judd, S. S. Venkatesh, When to stop: on optimal stopping and effective machine size in learning, Proc. Conf. on Neural Information Processing Systems, Colorado, 1993.
9. E. L. Lehmann, Testing statistical hypotheses (New York, Springer, 1997).
10. D. Erdogmus et al. Linear-least-squares initialization of multilayer perceptions through backpropagation of the desired response, IEEE Trans. On Neural Networks, 16(2), 2005, 325-337.
11. M. C Mackey, L. Glass, Oscillations and chaos in physiological control systems, Science, 197(4300), 1977, 287-289.
12. http://www.cs.toronto.edu/delve/data/datasets.html