Approximation with neural networks activated by ramp sigmoids

Journal of Approximation Theory

Volumn 162, Issue 8, 2010, Pages 1450-1465

  Cheang, Gerald H L ^a  

^a UNIVERSITY OF SOUTH AUSTRALIA   (Australia)

Author keywords

Approximation error bounds; Approximation of ellipsoids; Ramp sigmoids; Two hidden layer neural net approximation

Indexed keywords

EID: 77953536452     PISSN: 00219045     EISSN: 10960430     Source Type: Journal    
DOI: 10.1016/j.jat.2010.03.004     Document Type: Article

References (21)

1. Artstein-Avidan S., Friedland O., Milman V. Geometric applications of Chernoff-type estimates and a zigzag approximation for balls. Proc. Amer. Math. Soc. 2005, 134:1735-1742.
2. A.R. Barron, Neural net approximation, in: K.S. Narendra (Ed.), Proc. of the 7th Yale Workshop on Adaptive and Learning Systems, Center for System Science, Yale University, 1992, pp. 69-72.
3. Barron A.R. Universal approximation bounds for superpositions of a sigmoidal function. IEEE Trans. Inform. Theory 1993, 39:930-945.
4. Cheang G.H.L., Barron A.R. A better approximation for balls. J. Approx. Theory 2000, 104:183-203.
5. Cybenko G. Approximations by superpositions of a sigmoidal function. Math. Control Signals Systems 1989, 2:303-314.
6. Dudley R. Metric entropy of some classes of sets with differentiable boundaries. J. Approx. Theory. J. Approx. Theory 1979, 26:192-193. Correction,.
7. Gruber P.M. Approximation of convex bodies. Convexity and its Applications 1983, 131-162. Birkhäuser, Basel. P.M. Gruber, J.M. Wills (Eds.).
8. Gruber P.M., Kenderov P. Approximation of convex bodies by polytopes. Rend. Circ. Mat. Palermo 1982, 31:195-225.
9. Haussler D. Decision theoretic generalizations of the PAC model for neural net and other learning applications. Inform. and Comput. 1992, 100:78-150.
10. Haykin S.S. Neural Networks: A Comprehensive Foundation 1994, Macmillan, New York.
11. Hornik K., Stinchcombe M.B., White H. Multi-layer feedforward networks are universal approximators. Neural Netw. 1988, 2:359-366.
12. Jones L.K. A simple lemma on greedy approximation in Hilbert space and convergence rates for projection pursuit regression and neural network training. Ann. Statist. 1990, 20:608-613.
13. Kolmogorov A.N. On the representation of continuous functions of several variables by superpositions of continuous functions of one variable and addition. Dokl. Akad. Nauk SSSR 1957, 114:679-681.
14. Lorentz G.G. Approximation of Functions. Amer. Math. Soc. 2005, AMS Chelsea Publishing, Providence, RI.
15. Pollard D. Convergence of Stochastic Processes 1984, Springer-Verlag, Berlin.
16. Pollard D. Empirical Processes: Theory and Applications. NSF-CBMS Regional Conference Series in Prob. and Stats. 1990, vol. 2. SIAM, Philadelphia.
17. Rosenblatt F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 1958, 65:386-408.
18. Rosenblatt F. Principles of Neurodynamics 1962, Spartan Books, Washington, DC.
19. Schneider R., Wieacker J.A. Approximation of convex bodies by polytopes. Bull. Lond. Math. Soc. 1981, 13:149-156.
20. Vapnik V.N., Červonenkis A.Ya. On the uniform convergence of relative frequencies of events to their probabilities. Theory Probab. Appl. 1971, 16(2):264-280.
21. Yukich J.E., Stinchcombe M.B., White H. Sup-norm approximation bounds for networks through probabilistic methods. IEEE Trans. Inform. Theory 1995, 41:1021-1027.