Efficient hardware implementation of the hyperbolic tangent sigmoid function

Proceedings - IEEE International Symposium on Circuits and Systems

Volumn , Issue , 2009, Pages 2117-2120

  Namin, Ashkan Hosseinzadeh ^a   Leboeuf, Karl ^a   Muscedere, Roberto ^a   Wu, Huapeng ^a   Ahmadi, Majid ^a  

^a UNIVERSITY OF WINDSOR   (Canada)

Author keywords

Artificial neural networks; Hardware implementation; Hyperbolic tangent function; Piecewise linear approximation; Sigmoid function

Indexed keywords

ARTIFICIAL NEURAL NETWORKS; HARDWARE IMPLEMENTATION; HYPERBOLIC TANGENT FUNCTION; PIECEWISE LINEAR APPROXIMATION; SIGMOID FUNCTION;

BACKPROPAGATION; NEURAL NETWORKS; PIECEWISE LINEAR TECHNIQUES; SPOT WELDING; TABLE LOOKUP;

HARDWARE;

EID: 70350148871     PISSN: 02714310     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISCAS.2009.5118213     Document Type: Conference Paper

References (12)

1. S. Haykin, "Neural networks : a comprehensive foundation", Prentice Hall, July, 1998.
2. D.E. Rumelhart and J.L. McClelland and the PDP Research Group,"Parallel Distributed Processing, Vol. 1: Foundations", The MIT Press, July, 1987.
3. M. Krips, T. Lammert, and A. Kummert ,"FPGA implementation of a neural network for a real-time hand tracking system", Proc. 1st IEEE Int. Workshop on Electronic Design, Test and Applications (DELTA), Christchurch, New Zealand, 29-31 January 2002, pp. 313-317.
4. A.R. Omondi, and J.C. Rajapakse, "Neural networks in FPGAs". Proc. 9th Int. Conf. on Neural Information Processing (ICONIP), Singapore, 18-22 November 2002, vol. 2, pp. 954-959.
5. K. Basterretxea and J.M. Tarela and I. Del Campo, "Approximation of sigmoid function and the derivative for hardware implementation of artificial neurons",IEE Proceedings - Circuits, Devices and Systems, vol. 151, no. 1, pp. 18-24, February 2004.
6. K. Basterretxea and J.M. Tarela, "Approximation of sigmoid function and the derivative for artificial neurons", advances in neural networks and applications, WSES Press, Athens, pp.397-401, 2001.
7. C. Lin and J. Wang, "A digital circuit design of hyperbolic tangent sigmoid function for neural networks", IEEE International Symposium on Circuits and Systems (ISCAS), pp. 856-859, May 2008.
8. K. Leboeuf, A.H. Namin, R. Muscedere, H. Wu, and M. Ahmadi, "High Speed VLSI Implementation of the Hyperbolic Tangent Sigmoid Function", Third International Conference on Convergence and hybrid Information Technology, accepted, November 2008.
9. H.K. Kwan, "Simple sigmoid-like activation function suitable for digital hardware implementation" Electronic Letters,vol. 28, no. 15, pp. 1379-1380, July 1992 .
10. F. Piazza, A. Uncini, and M. Zenobi, "Neural networks with digital LUT activation functions", Proceedings of 1993 International Joint Conference on Neural Networks, IJCNN, pp. 1401-1404, October 1993.
11. R. Muscedere, V. Dimitrov, G.A. Jullien, and W.C. Miller,"Efficient techniques for binary-to-multidigit multidimensional logarithmic number system conversion using range-addressable look-up tables", IEEE Transactions on Computers, vol. 54, no. 3, pp. 257-271, March 2005.
12. M. Zhang, S. Vassiliadis, and J.G. Delgago-Frias, "Sigmoid generators for neural computing using piecewise approximations" IEEE Trans. Comput. vol. 45, no. 9, pp. 1045-1049, 1996.