A comparative study of the scalability of a sensitivity-based learning algorithm for artificial neural networks

Expert Systems with Applications

Volumn 40, Issue 10, 2013, Pages 3900-3905

  Peteiro Barral, Diego ^a   Guijarro Berdiñas, Bertha ^a   Pérez Sánchez, Beatriz ^a   Fontenla Romero, Oscar ^a  

^a UNIVERSITY OF A CORUÑA   (Spain)

Author keywords

Algorithms; Classifier design and evaluation; Machine learning; Neural nets

Indexed keywords

CLASSIFIER DESIGN AND EVALUATION; COMMON CRITERIA; COMPARATIVE STUDIES; FEED-FORWARD; LEARNING METHODS; LINEAR SYSTEM OF EQUATIONS; PERFORMANCE OF ALGORITHM; TRAINING ALGORITHMS;

ALGORITHMS; BIOINFORMATICS; INTRUSION DETECTION; LEARNING SYSTEMS; LINEAR SYSTEMS; NEURAL NETWORKS; SCALABILITY;

LEARNING ALGORITHMS;

EID: 84875364685     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2012.12.076     Document Type: Article

References (18)

1. Bengio, Y.; & LeCun, Y. (2007). Scaling learning algorithms towards AI, Large-Scale Kernel Machines, 34.
2. C. Bishop Pattern recognition and machine learning 2006 Springer New York
3. Bottou, L. (1991). Stochastic gradient learning in neural networks. In Proceedings of Neuro-Nîmes 91, EC2, Nimes, France.
4. L. Bottou, and O. Bousquet The tradeoffs of large scale learning Advances in Neural Information Processing Systems 20 2008 161 168
5. M. Boullé A parameter-free classification method for large scale learning Journal of Machine Learning Research 10 2009 1367 1385
6. E. Castillo, B. Guijarro-Berdiñas, O. Fontenla-Romero, and A. Alonso-Betanzos A very fast learning method for neural networks based on sensitivity analysis Journal of Machine Learning Research 7 2006 1159 1182
7. Catlett, J. (1991). Megainduction: Machine learning on very large databases. Ph.D. thesis. School of Computer Science, University of Technology, Sydney, Australia.
8. R. Collobert, and S. Bengio SVMTorch: Support vector machines for large-scale regression problems Journal of Machine Learning Research 1 2001 160
9. J. Dong Speed and accuracy: Large-scale machine learning algorithms and their applications 2003 Concordia University Montreal PQ, Canada
10. O. Fontenla-Romero, B. Guijarro-Berdiñas, B. Pérez- Sánchez, and A. Alonso-Betanzos A new convex objective function for the supervised learning of single-layer neural networks Pattern Recognition 43 5 2010 1984 1992
11. R. Hecht-Nielsen Neurocomputing 1990 Addison-Wesley Menlo Park, California
12. M. Møller A scaled conjugate gradient algorithm for fast supervised learning Neural Networks 6 4 1993 525 533
13. J. More The Levenberg-Marquardt algorithm: Implementation and theory Numerical Analysis 1978 105 116
14. B. Pérez-Sánchez, O. Fontenla-Romero, and B. Guijarro-Berdiñas A supervised learning method for neural networks based on sensitivity analysis with automatic regularization Bio-Inspired Systems: Computational and Ambient Intelligence 2009 157 164
15. B. Pérez-Sánchez, O. Fontenla-Romero, and B. Guijarro-Berdiñas An incremental learning method for neural networks based on sensitivity analysis Current Topics in Artificial Intelligence 2010 42 50
16. Sonnenburg, S.; Franc, V.; Yom-Tov, E.; & Sebag, M. (2008). Pascal large scale learning challenge. ICML'08 Workshop, URL http://largescale.first. fraunhofer.de.
17. S. Sonnenburg, G. Ratsch, and K. Rieck Large scale learning with string kernels Large Scale Kernel Machines 2007 73 104
18. S. Weiss, and C. Kulikowski Computer systems that learn: Classification and prediction methods from statistics, neural nets, machine learning, and expert systems 1991 Morgan Kaufmann San Francisco