Upper bound on pattern storage in feedforward networks

IEEE International Conference on Neural Networks - Conference Proceedings

Volumn , Issue , 2007, Pages 1714-1719

  Narasimha, Pramod L ^a   Manry, Michael T ^a   Maldonado, Francisco ^b  

^a The University of Texas at Arlington   (United States)

^b Williams Pyro Inc   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER NETWORKS; CONJUGATE GRADIENT METHOD; MULTILAYER NEURAL NETWORKS; SUPPORT VECTOR MACHINES; VECTORS;

UPPER BOUNDS;

NEURAL NETWORKS;

EID: 51749113577     PISSN: 10987576     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2007.4371216     Document Type: Conference Paper

References (27)

1. Y. S. A. Moussaoui, H. A. Abbassi, Hybrid hot strip rolling force prediction using a bayesian trained artificial neural network and analytical models, American Journal of Applied Sciences 3 (6) (2006) 1885-1889.
2. Y. S. Abu-Moustafa, J.-M. S. Jacques, Information capacity of hopfield model, IEEE Transactions on Information Theory IT-31 (4) (1985) 461-464.
3. E. B. Baum, On the capabilities of multilayer perceptrons, Journal of Complexity 4 (1988) 193-215.
4. M. Cosnard, P. Koiran, H. Paugam-Moisy, Bounds on the number of units for computing arbitrary dichotomies by multilayer perceptrons, Journal of Complexity 10 (1994) 57-63.
5. P. J. Davis, Interpolation and Approximation, Blaisdell Publishing Company, 1963.
6. A. Elisseeff, H. Paugam-Moisy, Size of multilayer networks for exact learning: Analytic approach, in: Neural Information Processing Systems, 1996.
7. S. Haykin, Neural Networks: A Comprehensive Foundation, 2nd ed., Pearson Education, 2004.
8. M. A. Sartori and P. J. Antsaklis, "A Simple Method to Derive Bounds on the Size and to Train Multilayer Neural Networks," IEEE Transactions on Neural Networks, vol. 2, no. 4, pp. 467-471, Jul. 1991.
9. G-B. Huang and H. A. Babri, "Upper Bounds on the Number of Hidden Neurons in Feedforward Networks with Arbitrary Bounded Nonlinear Activation Function," IEEE Transactions in Neural Networks, vol. 9, no. 1, pp. 224-229, Jan. 1998.
10. V. N. Vapnik, "An overview of Statistical Learning Theory," IEEE Transactions on Neural Networks, vol. 10, no. 5, pp. 988-999, Sep. 1999.
11. V. N. Vapnik, Statistical Learning Theory, New York, Wiley, 1998.
12. H. Jeffreys, B. S. Jeffreys, Methods of Mathematical Physics, chap. Lagrange's Interpolation Formula, 3rd ed., Cambridge University Press, Cambridge, England, 1988, p. §9.011 pp. 260.
13. C. Ji, D. Psaltis, Capacity of two-layer feedforward neural networks with binary weights, IEEE Transaction on Information Theory 44 (1) (1998) 256-268.
14. E. M. Johansson, F. U. Dowla, D. M. Goodman, Backpropagation learning for multilayer feed-forward neural networks using the conjugate gradient method, Journal of Neural Systems 2 (4) (1992) 291-301.
15. T. Kim, M. T. Manry, F. Maldonado, New learning factor and testing methods for conjugate gradient training algorithm, in: International Joint Conference on Neural Networks, vol. 3, 2003.
16. T.-H. Kim, J. Li, M. T. Manry, Evaluation and improvement of two training algorithms, in: The 36th Asilomar Conference on Signals, Systems, and Computers, 2002.
17. S. Ma, C. Ji, Performance and efficiency: Recent advances in supervised learning, Proceedings of the IEEE 87 (9) (1999) 1519-1535.
18. C. Mazza, On the storage capacity of nonlinear neural networks, Neural Networks 10 (4) (1997) 593-597.
19. Y.-H. Pao, Y. Takefuji, Functional-link net computing: Theory, system architecture, and functionalities, IEEE Computer 25 (5) (1992) 76-79.
20. M. J. D. Powell, Radial basis function approximations to polynomials, Numerical Analysis 1987 Proceedings (1988) 223-241.
21. H. Suyari, I. Matsuba, New approach to the storage capacity of neural networks using the minimum distance between input patterns, in: International Joint Conference on Neural Networks, vol. 1, 1999.
22. B. J. de Kruif and T. J. A. de Vries, "Pruning Error Minimization in Least Squares Support Vector Machines," IEEE Transactions on Neural Networks, vol. 14, no. 3, pp. 696-702, May 2003.
23. F. J. Maldonado, M. T. Manry and T-H. Kim, "Finding optimal neural network basis function subsets using the Schmidt procedure," International Joint Conference on Neural Networks, vol. 1, pp. 444-449, Jul. 2003.
24. W. Gong, H. C. Yau and M. T. Manry, "Non-Gaussian Feature Analyses Using a Neural Network,", Progress in Neural Networks, vol. 2, pp. 253-269, 1994.
25. R. Gore, J. Li, M. T. Manry, L. M. Liu, C. Yu and J. Wei, "Iterative Design of Neural Network Classifiers Through Regression," International Journal on Artificial Intelligence Tools, vol. 14, no. 1&2, 2005.
26. R.R. Bailey, E. J. Pettit, R. T. Borochoff, M. T. Manry, and X. Jiang, "Automatic Recognition of USGS Land Use/Cover Categories Using Statistical and Neural Network Classifiers," Proceedings of SPIE OE/Aerospace and Remote Sensing, 1993.
27. C. Chang and C. Lin. LIBSVM: A library for support vector machines. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm, 2001.