Sigmoid generators for neural computing using piecewise approximations

IEEE Transactions on Computers

Volumn 45, Issue 9, 1996, Pages 1045-1049

  Zhang, Ming ^a   Vassiliadis, Stamatis ^b   Delgado Frias, José G ^c  

^a AT and T Wireless Services Inc   (United States)

^b DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^c State University of New York at Binghamton   (United States)

Author keywords

Error analysis; Hardware for twos complement notation; Neural networks; Nonlinear function generators; Piecewise approximations; Sigmoid function

Indexed keywords

APPROXIMATION THEORY; CALCULATIONS; COMPUTATIONAL METHODS; COMPUTER HARDWARE; ERROR ANALYSIS; FUNCTION GENERATORS; NUMBER THEORY; PIECEWISE LINEAR TECHNIQUES; TABLE LOOKUP;

NEURAL COMPUTING; NONLINEAR FUNCTION GENERATORS; NUMBER SYSTEM REPRESENTATION; PIECEWISE APPROXIMATIONS; SIGMOID FUNCTION; SIGMOID GENERATORS;

NEURAL NETWORKS;

EID: 0030246261     PISSN: 00189340     EISSN: None     Source Type: Journal    
DOI: 10.1109/12.537127     Document Type: Article

References (7)

1. D.E. Rumelhart, J.L. McClelland, and the PDP Research Group, Parallel Distributed Processing, vol. 1, Foundations. Cambridge, Mass.: MIT Press, 1986.
2. J.L. Holt and J.N. Hwang, "Finite Precision Error Analysis of Neural Network Hardware Implementations," IEEE Trans. Computers, vol. 42, no. 3, pp. 281-290, Mar. 1993.
3. P. Murtagh and A.C. Tsoi, "Implementation Issues of Sigmoid Function and its Derivative for VLSI Digital Neural Networks," IEE Proc.-E, vol. 139, no.3, May 1992.
4. D.J. Myers and G. Storti-Gajani, "Efficient Implementation of Piecewise Linear Activation Function for Digital VLSI Neural Networks," Electronics Letter, vol. 25, no.24, pp. 1,662-1,663, Nov., 1989.
5. C. Alippi and G. Storti-Gajani, "Simple Approximation of Sigmoid Functions: Realistic Design of Digital VLSI Neural Networks," Proc. IEEE Int'l Symp. Circuits and Systems, pp. 1,505-1,508, 1991.
6. H.K. Kwan, "Digital Implementation Methods for Nonlinear Functions in Neural Networks," unpublished manuscript, 1993.
7. M. Zhang, S. Vassiliadis, and J.G. Delgado-Frias, "Sigmoid Generators for Neural Computing Using Piecewise Approximations," TR 1-68340-44(1994)11, Dept. of Electrical Eng., Delft Univ. of Technology, Nov. 1994.