An efficient hardware architecture for a neural network activation function generator

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3973 LNCS, Issue , 2006, Pages 1319-1327

  Larkin, Daniel ^a   Kinane, Andrew ^a   Muresan, Valentin ^a   O'Connor, Noel ^a  

^a DUBLIN CITY UNIVERSITY   (Ireland)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; FUNCTION GENERATORS; GENETIC ALGORITHMS; NEURAL NETWORKS; POLYNOMIALS;

ACTIVATION FUNCTIONS; APPROXIMATION ERRORS; HARDWARE MULTIPLICATION; MINIMAX POLYNOMIALS;

COMPUTER ARCHITECTURE;

EID: 33745899311     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11760191_192     Document Type: Conference Paper

References (17)

1. Widrow, B., Rumelhart, D.E., Lehr, M.A.: Neural Networks: Applications in Industry, Business and Science. Communications of the ACM 37 (1994) 93-105
2. Cauwenberghs, G., Bayoumi, M.: Learning on Silicon - Adaptive VLSI Neural Systems. Kluwer Academic (1999)
3. Zhang, D., Pal, S.K.: Neural Networks and Systolic Array Design. World Scientific, New Jersey (2002)
4. Ruckert, U.: ULSI Architectures for Artificial Neural Aetworks. IEEE Micro 22 (2002) 10-19
5. Draghici, S.: On the Capabilities of Neural Networks using Limited Precision Weights. Neural Networks 15 (2002) 395 - 414
6. Holt, J., Hwang, J,: Finite Precision Error Analysis of Neural Network Hardware Implementations. IEEE Transactions on Computers 42 (1993) 280 - 291
7. Haykins, S.: Neural Networks - A Comprehensive Foundation. Prentice-Hall (1999)
8. Myers, D.J. and Hutchinson, R.A: Efficient Implementation of Piecewise Linear Activation Function for Digital VLSI Neural Networks. Electronics Letters 25 (1989) 1662-1663
9. Alippi, C., Storti-Gajani, G.: Simple Approximation of Sigmoid Functions: Realistic Design of Digital VLSI Neural Networks. In: Proceedings of the IEEE Int'l Symp. Circuits and Systems. (1991) 1505-1508
10. Amin, H., Curtis, K., Hayes Gill, B.: Piecewise Linear Approximation applied to Non-Linear Function of a Neural Network. IEE Proceedings Circuits, Devices and Systems 144 (1997) 313 - 317
11. Vassiliadis, S., Zhang, M., Delgado-Frias, J.: Elementary Function Generators for Neural-Network Emulators. IEEE Transactions on Neural Networks 11 (2000) 1438 - 1449
12. Faiedh, H., Gafsi, Z., Besbes, K.: Digital Hardware Implementation of Sigmoid Function and its Derivative for Artificial Neural Networks. In: Proceedings, of the 13th International Conference on Microelectronics, Rabat, Morocco (2001) 189 - 192
13. Basterretxea, K., Tarela, J., del Campo, I.: Approximation of Sigmoid Function and the Derivative for Hardware Implementation of Artificial Neurons. IEE Proceedings of Circuits, Devices and Systems 151 (2004) 18-24
14. Tommiska, M.: Efficient Digital Implementation of the Sigmoid Function for Reprogrammable Logic. IEE Proceedings Computers and Digital Techniques 150 (2003) 403 - 411
15. Pineiro, J., Oberman, S., Muller, J., Bruguera, J.: High-Speed Function Approximation Using a Minimax Quadratic Interpolator. IEEE Transactions on Computers 54 (2005) 304 - 318
16. The MathWorks: MATLAB and Simulink for Technical Computing (2006) http://www.mathworks.com/.
17. Koren, I.: Computer Arithmetic Algorithms. 2nd edn. A K Peters Ltd (2001)