Approximation of sigmoid function and the derivative for hardware implementation of artificial neurons

IEE Proceedings: Circuits, Devices and Systems

Volumn 151, Issue 1, 2004, Pages 18-24

  Basterretxea, K ^a   Tarela, J M ^a   Del Campo, I ^a  

^a UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; COMPUTATIONAL METHODS; ERROR ANALYSIS; HARDWARE; INTERPOLATION; LEARNING SYSTEMS; OPTIMIZATION; PIECEWISE LINEAR TECHNIQUES; VLSI CIRCUITS;

ARTIFICIAL NEURONS; DIGITAL IMPLEMENTATION; SIGMOID FUNCTIONS;

NEURAL NETWORKS;

EID: 1542791539     PISSN: 13502409     EISSN: None     Source Type: Journal    
DOI: 10.1049/ip-cds:20030607     Document Type: Conference Paper

References (10)

1. Myers, D.J., and Hutchinson, R.A.: 'Efficient implementation of piecewise linear activation function for digital VLSI neural networks', Electron. Lett., 1989, 25, (24), pp. 1662-1663
2. Alippi, C., and Storti-Gajani, G.: 'Simple approximation of sigmoidal functions: realistic design of digital neural networks capable of learning'. Proc. IEEE Int. Symp. on Circuits and systems', 1991. pp. 1505-1508
3. Amin, H., Curtis, K.M., and Hayes-Gill, B.R.: 'Piecewise Linear Approximation Applied to Nonlinear Function of a Neural Network', IEE Proc., Circuits Devices Syst., 1997. 144, (6), pp. 313-317
4. Murtagh, P., and Tsoi, A.C.: 'Implementation issues of sigmoid function and its derivative for VLSI digital neural networks', IEE Proc.-E, Comput. Digit. Tech., 1992, 139, (3), pp. 207-214
5. Basterretxea, K., Tarela, J.M., and Del Campo, I.: 'Consequences of Gaussian function approximation in the performance of neuro-fuzzy systems'. Proc. 4th Int. Conf. on Recent advances in soft computing, RASC'02, Nottingham, UK, Dec. 2002, pp. 313-318
6. Reyneri, L.M.: 'Implementation issues of neuro-fuzzy hardware: going toward HW/SW codesign', IEEE Trans. Neural Netw., 2003. 14, (1), pp. 176-194
7. Basterretxea, K., Alonso, E., Tarela, J.M., and Del Campo, I.: 'PWL Approximation of non-linear, functions for the implementation of neuro-fuzzy systems'. Proc. IMACS/IEEE CSCC'99, Athens, Greece, 1999
8. Tarela, J.M., Basterretxea, K., Del Campo, I., Martinez, M.V., and Alonso, E.: 'Optimised PWL recursive approximation and its application to neuro-fuzzy systems', Math. Comput. Model., 2002, 35, (7-8), pp. 867-883
9. Zhang, M., Vassiliadis, V., and Delgado-Frias, J.G.: 'Sigmoid generators for neural computing using piecewise approximations'. IEEE Trans. Comput., 1996, 45, (9), pp. 1045-1049
10. Sammut, K.M., and Jones S., R.: 'Implementing nonlinear activation functions in neural network emulators', Electron. Lett., 1991, 27, (12). pp. 1037-1038