An efficient hardware implementation of feed-forward neural networks

Applied Intelligence

Volumn 21, Issue 2 SPEC. ISS., 2004, Pages 143-158

  Szabó, Tamás ^a   Horváth, Gábor ^a  

^a BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

Author keywords

Activation function; B spline approximation; Feed forward neural networks; Hardware implementation

Indexed keywords

ALGORITHMS; COMPUTATIONAL METHODS; DISTRIBUTED COMPUTER SYSTEMS; ERROR ANALYSIS; MATRIX ALGEBRA; OPTIMIZATION; POLYNOMIALS; THEOREM PROVING; VECTORS;

ACTIVATION FUNCTION; B-SPLINE APPROXIMATION; FEED-FORWARD NEURAL NETWORK; HARDWARE IMPLEMENTATION;

NEURAL NETWORKS;

EID: 3142744693     PISSN: 0924669X     EISSN: None     Source Type: Journal    
DOI: 10.1023/B:APIN.0000033634.62074.46     Document Type: Conference Paper

References (22)

1. M.H. Hassoun, Fundamentals of Artificial Neural Networks, MIT Press, 1995.
2. S. Knerr, L. Personnaz, and G. Dreyfus, " Handwritten digit recognition by neural networks with single-layer training," IEEE Trans. on Neural Networks, vol. 6, pp. 962-969, 1992.
3. " White blood cell classification & counting with the ZISC," http://www.fr.ibm.com/france/cdlab/zblcell.htm, 2000.
4. T.G. Clarkson and Y. Ding, RAM-Based Neural Networks, chap. 'Extracting directional information for the recognition of finger-prints by pRAM networks,' World Scientific, 1998, pp. 174-185.
5. J.W.M. Van Dam, B.J.A. Krose, and F.C.A. Groen, " Adaptive sensor models," in Proc. of 1996 International Conference on Multisensor Fusion and Integration for Intelligent Systems, Washington DC, Dec. 1996, pp. 705-712.
6. T. Szabó, B. Fehér, and G. Horváth, " Neural network implementation using distributed arithmetic," in Proceedings of the International Conference on Knowledge-Based Electronic Systems, Adelaide, Australia, 1998, vol. 3, pp. 511-520.
7. T. Szabó, L. Antoni, G. Horváth, and B. Fehér, " An efficient implementation for a matrix-vector multiplier structure," in Proceedings of IEEE International Joint Conference on Neural Networtks, IJCNN2000, 2000, vol. II, pp. 49-54.
8. M. Glesner and W. Pöchmüller, Neurocomputers, an Overview of Neural Networks in VLSI, Neural Computing. Chapman & Hall, 1994.
9. F. Scarselli and A.C. Tsoi, " Universal approximation using feed-forward neural networks: A survey of some existing methods and some new results," Neural Networks, vol. 11, no. 1, pp. 15-37, 1998.
10. V. Kurková, " Approximation of functions by neural networks," in Proceedings of NC'98, 1998, pp. 29-36.
11. M.B. Stinchcombe and H. White, " Approximating and learning unknown mappings using multilayer networks with bounded weights," in Proc. of Int. Joint Conference on Neural Networks, IJCNN'90, IEEE Press, 1990, vol. III, pp. 7-16.
12. M. Leshno, V.Ya. Lin, A. Pinkus, and S. Schocken, " Multilayer feedforward networks with a nonpolynomial activation function can approximate any function," Neural Networks, vol. 6, pp. 861-867, 1993.
13. K. Hornik, " Some new results on neural network approximatiom," Neural Networks, vol. 6, pp. 1069-1072, 1993.
14. C. de Boor, A Practical Guide to Splines, Springer-Verlag, 1978.
15. L.L. Schumaker, Spline Functions, Basic Theory, Wiley & Sons, 1981.
16. V. Kurková, " Kolmogorov's theorem and multilayer neural networks," Neural Networks, vol. 5, pp. 501-506, 1992.
17. J.T. Lewis, " Computation of best monotone approximations," Mathematics of Computation, vol. 26, no. 119, pp. 737-747, 1972.
18. R.A. De Vore, " Monotone approximation by splines," SIAM J. Math. Anal., vol. 8, no. 5, pp. 891-905, 1977.
19. E. Passow and J.A. Roulier, " Monotone and convex spline interpolation," SIAM J. Numer. Anal, vol. 14, no. 5, pp. 904-909, 1977.
20. X.M. Yu and S.P. Zhou, " On monotone spline approximation," SIAM J. Math. Anal., vol. 25, no. 4, pp. 1227-1239, 1994.
21. D. Saal and S. Solla, " Learning from corrupted examples in multilayer perceptions," Tech. Rep., Aston University, UK, 1996.
22. University of Stuttgart, Institute of Parallel and Distributed High-Performance Systems (IPVR), http://www.informatik.uni-stuttgart.de/ipvr/bv/ projekte/snns/snns.html, Stuttgart Neural Network Simulator, User Manual 4.2, 2000.