Exponentially many local minima for single neurons

NIPS 1995: Proceedings of the 8th International Conference on Neural Information Processing Systems

Volumn , Issue , 1995, Pages 316-322

  Auer, Peter ^a   Herbster, Mark ^a   Warmuth, Manfred K ^a  

^a Department of Computer Science ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ERROR-FUNCTION; LOCAL MINIMUMS; LOGISTICS FUNCTIONS; SINGLE NEURON;

EID: 85156194133     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (11)

1. P. Auer, M. Herbster, and M. K. Warmuth. Exponentially many local minima for single neurons. Technical Report UCSC-CRL-96-1, Univ. of Calif. Computer Research Lab, Santa Cruz, CA, 1996. In preperation.
2. E. K. Blum. Approximation of boolean functions by sigmoidal networks: Parti: Xorand other two-variable functions. Neural Computation, 1:532-540, February 1989.
3. M. L. Brady, R. Raghavan, and J. Slawny. Back propagation fails to separate where perceptrons succeed, IEEE Transactions On Circuits and Systems, 36 (5):665-674, May 1989.
4. E. Baum and F. Wilczek. Supervised learning of probability distributions by neural networks. In D. Z. Anderson, editor, Neural Information Processing Systems, pages 52-61, New York, 1988. American Insitute of Physics.
5. Marco Gori and Alberto Tesi. On the problem of local minima in backpropagation. IEEE Transaction on Pattern Analysis and Machine Intelligence, 14 (1):76-86, 1992.
6. S. Haykin. Neural Networks; a Comprehensive Foundation. Macmillan, New York, NY, 1994.
7. S. A. Solla, E. Levin, and M. Fleisher. Accelerated learning in layered neural networks. Complex Systems, 2:625-639, 1988.
8. E, D, Sontag and H. J. Sussmann. Backpropagation can give rise to spurious local minima even for networks without hidden layers. Complex Systems, 3 (1):91-106, February 1989.
9. E. D. Sontag and H. J. Sussmann. Back propagation separates where perceptrons do. Neural Networks, 4 (3), 1991.
10. R. L. Watrous. A comparison between squared error and relative entropy metrics using several optimization algorithms. Complex Systems, 6:495-505, 1992.
11. B. S. Wittner and J. S. Denker. Strategies for teaching layered networks classification tasks. In D. Z. Anderson, editor, Neural Information Processing Systems, pages 850-859, New York, 1988. American Insitute of Physics.