For valid generalization, the size of the weights is more important than the size of the network

Advances in Neural Information Processing Systems

Volumn , Issue , 1997, Pages 134-140

  Bartlett, Peter L ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ERROR ESTIMATES; FEED-FORWARD NETWORK; GENERALIZATION PERFORMANCE; INPUT DIMENSIONS; MISCLASSIFICATION PROBABILITY; PATTERN CLASSIFICATION PROBLEMS; TRAINING EXAMPLE; TRAINING PATTERNS;

NEURAL NETWORKS;

EID: 84898957627     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. N. Alon, S. Ben-David, N. Cesa-Bianchi, and D. Haussler. Scale-sensitive dimensions, uniform convergence, and learnability. In Proceedings of the 1993 IEEE Symposium on Foundations of Computer Science. IEEE Press, 1993.
2. P. L. Bartlett. The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. Technical report, Department of Systems Engineering, Australian National University, 1996. (available by anonymous ftp from syseng.arm.edu.au: pub/peter/TR96d.ps).
3. P. L. Bartlett, S. R. Kulkarni, and S. E. Posner. Covering numbers for real-valued function classes. Technical report, Australian National University and Princeton University, 1996.
4. E. Baum and D. Haussler. What size net gives valid generalization? Neural Computation, 1(1):151-160, 1989.
5. A. Blumer, A. Ehrenfeucht, D. Haussler, and M. K. Warmuth. Learnability and the Vapnik-Chervonenkis dimension. J. ACM, 36(4):929-965, 1989.
6. L. Gurvits and P. Koiran. Approximation and learning of convex superpositions. In Computational Learning Theory: EUROCOLT'95, 1995.
7. D. Haussler. Decision theoretic generalizations of the PAC model for neural net and other learning applications. Inform. Comput., 100(1):78-150, 1992.
8. J. Hertz, A. Krogh, and R. G. Palmer. Introduction to the Theory of Neural Computation. Addison-Wesley, 1991.
9. G. Lugosi and M. Pintér. A data-dependent skeleton estimate for learning. In Proc. 9th Annu. Conference on Comput. Learning Theory. ACM Press, New York, NY, 1996.
10. W. Maass. Vapnik-Chervonenkis dimension of neural nets. In M. A. Arbib, editor, The Handbook of Brain Theory and Neural Networks, pages 1000-1003. MIT Press, Cambridge, 1995.
11. J. Shawe-Taylor, P. L. Bartlett, R. C. Williamson, and M. Anthony. A framework for structural risk minimisation. In Proc. 9th Annu. Conference on Comput. Learning Theory. ACM Press, New York, NY, 1996.
12. J. Shawe-Taylor, P. L. Bartlett, R. C. Williamson, and M. Anthony. Structural risk minimization over data-dependent hierarchies. Technical report, 1996.
13. V. N. Vapnik. Estimation of Dependences Based on Empirical Data. Springer-Verlag, New York, 1982.