A skewed derivative activation function for SFFANNs

International Conference on Recent Advances and Innovations in Engineering, ICRAIE 2014

Volumn , Issue , 2014, Pages

  Chandra, Pravin ^a   Sodhi, Sartaj Singh ^a  

^a GURU GOBIND SINGH INDRAPRASTHA UNIVERSITY   (India)

Author keywords

[No Author keywords available]

Indexed keywords

CHEMICAL ACTIVATION; FEEDFORWARD NEURAL NETWORKS; RADIOACTIVITY LOGGING;

ACTIVATION FUNCTIONS; FEED-FORWARD ARTIFICIAL NEURAL NETWORKS; FUNCTION APPROXIMATION; HIDDEN LAYERS; HYPERBOLIC TANGENT FUNCTION; NEW ACTIVATION FUNCTIONS; SFFANNS; SIGMOIDAL ACTIVATION FUNCTIONS;

HYPERBOLIC FUNCTIONS;

EID: 84908635236     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRAIE.2014.6909324     Document Type: Conference Paper

References (22)

1. M. T. Hagan, H. B. Demuth, and M. H. Beale, Neural Network Design. Boston, MA: PWS Publishing Company, 1996.
2. V. Cherkas sky and F. Mooulier, Learning from Data - Concepts, Theory and Methods. New York: John Wiley, 1998.
3. S. Haykin, Neural Networks: A Comprehensive Foundations. Englewood Cliffs, NJ: Prentice-Hall, 1999.
4. A. R. Gallant and H. White, "There exists a neural network that does not make avoidable mistakes, " in International Joint Conference onNeural Networks, vol. I, 1988, pp. 593-606.
5. G. Cybenko, "Approximation by superpositions of a sigmoidal function, " Math. Control, Signals, and Systems, vol. 2, pp. 303-314, 1989.
6. K. Funahashi, "On the approximate realization of continuous mapping by neural networks, " Neural Networks, vol. 2, pp. 183-192, 1989.
7. K. Hornik, M. Stinchcombe, and H. White, "Multilayer feedforward networks are universal approximators, " Neural Networks, vol. 2, pp. 359-366, 1989.
8. W. Ouch and N. Jankowski, "Survey of neural transfer functions, " Neural Computing Surveys, vol. 2, pp. 163-212, 1999. [Online]. Available: http://www.icsi.berkeley. edu/ jagotalNCS
9. S. M. Caroll and D. W. Dickinson, "Construction of neural nets using the radon transform, " in International Joint Conference on Neural Networks. IEEE, 1989, pp. 607-611.
10. P. Chandra and Y. Singh, "Feedforward sigmoidal networks - equicontinuity and fault-tolerance, " IEEE Transactions on Neural Networks, vol. 15, no. 6, pp. 1350-1366, 2004.
11. M. Maechler, D. Martin, 1. Schimert, M. Csoppenszky, and 1. Hwang, "Projection pursuit learning networks for regression, " in Proc. of the 2nd International IEEE Conference on Tools for Artificial Intelligence, 1990, pp. 350-358.
12. V. Cherkassky, D. Gehring, and F. Mooulier, "Comparison of adaptive methods for function estimation from samples, " IEEE Transactions on Neural Networks, vol. 7, no. 4, pp. 969-984, 1996.
13. L. Breiman, "The PI method for estimating multivariate functions from noisy data, " Technometrics, vol. 3, no. 2, pp. 125-160, 1991.
14. M. Riedmiller and H. Braun, "A direct adaptive method for faster backpropagation learning: The RPROP algorithm, " in Proc. of IEEE conference on Neural Networks, vol. 1, San Francisco, 2010, pp. 586- 591.
15. J. F. Kolen and J. B. Pollack, "Back propagation is sensitive to initial conditions, " in Proc. of the 1990 conference on Advances in neural information processing systems 3. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., 1990, pp. 860-867.
16. R. Battiti and F. Masulli, "BFGS optimization for faster and automated supervised learning, " in Proc. of International Neural Network Conference (INCC 90), vol. 2, Paris, 1990, pp. 757-760.
17. M. F. Moller, "A scaled conjugate gradient algorithm for fast supervised learning, " Neural Networks, vol. 6, pp. 525-533, 1993.
18. R. Battiti, "First and second order methods for learning: between steepest descent and Newton's method, " Neural Computation, vol. 4, no. 2, pp. 141-166, 1992.
19. F. D. Foresee and M. T. Hagan, "Gauss-Newton approximation to bayesian regularization, " in Proc. International Joint Conference on Neural Network, vol. 3, Houston, Texas, 1990, pp. 1930-1935.
20. Y. Singh and P. Chandra, "A class +1 sigmoidal activation functions for FFANNs, " Journal of Economic Dynamics and Control, vol. 28, no. I, pp. 183 - 187, 2003.
21. P. Chandra, "Sigmoidal function classes for feedforward artificial neural networks, " Neural Processing Letters, vol. 18, no. 3, pp. 205- 215, 2003.
22. P. Chandra and Y. Singh, "A case for the self-adaptation of activation functions in FF ANNs, " Neurocomputing, vol. 56, pp. 447 - 454, 2004.