Decision region approximation by polynomials or neural networks

IEEE Transactions on Information Theory

Volumn 43, Issue 3, 1997, Pages 903-907

  Blackmore, Kim L ^b   Williamson, Robert C ^a,c   Mareels, Iven M Y ^a,c,d  

^a IEEE

^b DEFENCE SCIENCE AND TECHNOLOGY ORGANISATION   (Australia)

^c AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^d UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Classification; Decision region; Neural networks; Polynomials; Rate of approximation

Indexed keywords

DECISION REGIONS;

APPROXIMATION THEORY; CLASSIFICATION (OF INFORMATION); DECISION THEORY; ERROR COMPENSATION; LEARNING ALGORITHMS; POLYNOMIALS;

NEURAL NETWORKS;

EID: 0031139265     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.568700     Document Type: Article

References (25)

1. J. Sklansky and G. Wassel, Pattern Classifiers and Trainable Machines. New York: Springer-Verlag, 1981.
2. K. Blackmore, R. Williamson, and I. Mareels, "Learning nonlinearly parametrized decision regions," J. Math. Syst., Estim., Contr., vol. 6, no. 1, pp. 129-132, 1996. (Full manuscript [On line]. Available FTP: ftp://trick.ntp.springer.de/jmsec/88289.ps.)
3. G. Lorentz, Approximation of Functions. New York: Holt, Rinehart and Winston, 1966.
4. K. Hornik, M. Stinchcombe, and H. White, "Multilayer feedforward networks are universal approximators," Neural Networks, vol. 2, pp. 359-366, 1989.
5. E. Cheney, Introduction to Approximation Theory, 2nd ed. New York: Chelsea, 1982.
6. K. Hornik, M. Stinchcombe, and H. White, "Universal approximation of an unknown mapping and its derivatives using multilayer feedforward neural networks," Neural Networks, vol. 3, pp. 551-560, 1990.
7. A. Barron, "Universal approximation bounds for superposition of a sigmoidal function," IEEE Trans. Inform. Theory, vol. 39, pp. 930-945, 1993.
8. H. Mhaskar and C. Micchelli, "Approximation by superposition of sigmoid and radial basis functions," Adv. Appl. Math., vol. 13, pp. 350-373, 1992.
9. _, "Degree of approximation by neural and translation networks with a single hidden layer," Adv. Appl. Math., vol. 16, pp. 151-183, 1995.
10. H. Mhaskar, "Approximation properties of a multilayered feedforward artificial neural network," Adv. Comput. Math., vol. 1, pp. 61-80, 1993.
11. C. Darken, M. Donahue, L. Gurvits, and E. Sontag, "Rate of approximation results motivated by robust neural network learning," in Proc. 6th ACM Conf.on Computational Learning Theory, 1993, pp. 103-109.
12. K. Hornik, M. Stinchcombe, H. White, and P. Auer, "Degree of approximation results for feedforward networks approximating unknown mappings and their derivatives," Tech. Rep. NC-TR-95-004, Neuro-COLT Tech. Rep. Ser., Jan. 1995.
13. A. Bengtsson and J.-O. Eklundh, "Shape representation by multiscale contour approximation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, pp. 85-93, 1991.
14. P. Kenderov and N. Kirov, "A dynamical systems approach to the polygonal approximation of plane convex compacts," J. Approx. Theory, vol. 74, pp. 1-15, 1993.
15. J.-S. Wu and J.-J. Leou, "New polygonal approximation schemes for object shape representation," Pattern Recogn., vol. 26, pp. 471-484, 1993.
16. N. Korneichuk, "Approximation and optimal coding of plane curves," Ukranian Math. J., vol. 41, no. 4, pp. 429-435, 1989.
17. A. Korostelev and A. Tsybakov, "Estimation of the density support and its functional," Probl. Inform. Transm., vol. 29, no. 1, pp. 1-15, 1993.
18. _, Minimax Theory of Image Reconstruction (Lecture Notes in Statistics, vol. 82). New York: Springer, 1993.
19. R. Dudley, "Metric entropy of some classes of sets with differentiable boundaries," J. Approx. Theory, vol. 10, pp. 227-236, 1974.
20. n+1," Math. Acad. Sci. USSR, vol. 47, pp. 515-521, 1990.
21. N. Ivanov, "Approximation of smooth manifolds by real algebraic sets," Russian Math. Surv., vol. 37, no. 1, pp. 1-59, 1982.
22. ∞ functions without changing their zero-set," Ann. Inst. Fourier, Grenoble, vol. 39, no. 3, pp. 611-632, 1989.
23. H. Weyl, "On the volume of tubes," Amer. J. Math., vol. 61, pp. 461-472, 1939.
24. M. Berger and B. Gostiaux, Differential Geometry: Manifolds, Curves, and Surfaces. New York: Springer-Verlag, 1988.
25. A. Timan, Theory of Approximation of Functions of a Real Variable. New York: Macmillan, 1963.