A quantitative comparison of different MLP activation functions in classification

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3971 LNCS, Issue , 2006, Pages 849-857

  Shenouda, Emad A M Andrews ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER APPLICATIONS; DATABASE SYSTEMS; FUNCTION EVALUATION;

ACTIVATION FUNCTIONS; GAUSSIAN RBF NETWORKS; MULTILAYER PERCEPTIONS (MLP);

CLASSIFICATION (OF INFORMATION);

EID: 33745892359     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11759966_125     Document Type: Conference Paper

References (17)

1. Lu, B., Evans, B.L.: Channel Equalization by Feedforward Neural Networks. In: IEEE Int. Symposium on Circuits and Systems, Vol. 5. Orlando, FL (1999) 587-590
2. Michie, D., Spiegelhalter, D.J., Taylor, C.C.: Machine Learning, Neural and Statistical Classification. Elis Horwood, London (1994)
3. Piekniewski, F., Rybicki, L.: Visual Comparison of Performance for Different Activation Functions in MLP Networks. In: IJCNN 2004 & FUZZ-IEEE, Vol. 4. Budapest (2004) 2947-2953
4. Dorffner, G.: A Unified Framework for MLPs and RBFNs: Introducing Conic Section Function Networks. Cybernetics and Systems 25(4) (1994) 511-554
5. Haykin, S.: Neural Networks A Comprehensive Introduction. Prentice Hall, New Jersey (1999)
6. Huang, G., Chen, Y., Babri, H.A.: Classification Ability of Single Hidden Layer Feedforward Neural Networks. IEEE Transactions on Neural Networks 11(3) (2000) 799-801
7. Le Cun, Y., Touresky, D., Hinton G., Sejnowski, T.: A Theoretical Framework for Backpropagation. In: The Connectionist Models Summer School. (1988) 21-28
8. Li, Y., Pont, M. J., Jones, N.B.: A Comparison of the Performance of Radial Basis Function and Multi-layer Perceptron Networks in Condition Monitoring and Fault Diagnosis. In: The International Conference on Condition Monitoring. Swansea (1999) 577-592
9. Arahal, M.R., Camacho, E.F.: Application of the Ran Algorithm to the Problem of Short Term Load Forecasting. Technical Report, University of Sevilla, Sevilla (1996)
10. Finan, R.A., Sapeluk, A.T., Damper, R.I.: Comparison of Multilayer and Radial Basis Function Neural Networks for Text-Dependent Speaker Recognition. In: IEEE Int. Conf. on Neural Networks, Vol. 4. Washington DC (1996) 1992-1997
11. Karkkainen, T.: MLP in Layer-Wise Form with Applications to Weight Decay. Neural Computation 14(6) (2002) 1451-1480
12. Werbos, P. J.: Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences. Doctoral Thesis, Applied Mathematics, Harvard University. Boston (1974)
13. Wang, D., Huang, G.: Protein Sequence Classification Using Extreme Learning Machine. In: IJCNN05, Vol. 3. Montréal (2005) 1406-1411
14. Duch, W., Jankowski, N.: Survey of Neural Transfer Functions. Neural Computing Surveys 2 (1999) 163-212
15. Duch, W., Jankowski, N.: Transfer functions: Hidden Possibilities for Better Neural Networks. In: 9th European Symposium on Artificial Neural Network. Bruges (2001) 81-94
16. Hu, Y., Hwang, J.: Handbook of Neural Network Signal Processing. 3 rd edn. CRC-Press, Florida (2002)
17. Zurada, J. M.: Introduction to Artificial Neural Systems. PWS Publishing, Boston (1999)