Robust learning algorithm based on LTA estimator

Neurocomputing

Volumn 120, Issue , 2013, Pages 624-632

  Rusiecki, Andrzej ^a  

^a WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Feedforward neural networks; Outliers; Robust learning algorithms; Robust statistics

Indexed keywords

NEURAL NETWORKS TRAININGS; OUTLIERS; ROBUST LEARNING ALGORITHM; ROBUST STATISTICS; TRADITIONAL APPROACHES; TRADITIONAL LEARNING; TRAINING DATA SETS; TRAINING FRAMEWORK;

FEEDFORWARD NEURAL NETWORKS; STATISTICS;

LEARNING ALGORITHMS;

ANALYTICAL PARAMETERS; ARTICLE; ARTIFICIAL FEEDFORWARD NEURAL NETWORK; ARTIFICIAL NEURAL NETWORK; CONTROLLED STUDY; LEARNING ALGORITHM; LEAST TRIMMED ABSOLUTE VALUE; PRIORITY JOURNAL; PROBABILITY; ROBUSTNESS; STATISTICAL PARAMETERS; SYSTEMATIC ERROR;

EID: 84882840750     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.04.008     Document Type: Article

References (25)

1. G. Beliakov, A. Kelarev, J. Yearwood, Derivative-free optimization and neural networks for robust regression, Optimization (2012). doi:10.1080/02331934.2012.674946.
2. Chen D.S., Jain R.C. A robust back propagation learning algorithm for function approximation. IEEE Trans. Neural Netw. 1994, 5(May):467-479.
3. Chuang C., Su S., Hsiao C. The annealing robust backpropagation (ARBP) learning algorithm. IEEE Trans. Neural Netw. 2000, 11(September):1067-1076.
4. Chuang C.C., Jeng J.T., Lin P.T. Annealing robust radial basis function networks for function approximation with outliers. Neurocomputing 2004, 56:123-139.
5. David Sanchez V.A. Robustization of a learning method for RBF networks. Neurocomputing 1995, 9:85-94.
6. Demsar J. Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 2006, 7:1-30.
7. Edgeworth F.Y. On observations relating to several quantities. Hermathena 1887, 6:279-285.
8. M.T. El-Melegy, M.H. Essai, A.A. Ali, Robust training of artificial feedforward neural networks, in: Foundations of Computational Intelligence, vol. 1, 2009, pp. 217-242.
9. M.T. El-Melegy, Random sampler m-estimator algorithm for robust function approximation via feed-forward neural networks, in: Proceedings of International Joint Conference on Neural Networks, San Jose, California, pp. 3134-3140.
10. M.T. El-Melegy, Ransac algorithm with sequential probability ratio test for robust training of feed-forward neural networks, in: Proceedings of International Joint Conference on Neural Networks, San Jose, California, 2011, pp. 3256-3263.
11. Hagan M.T., Demuth H.B., Beale M.H. Neural Network Design 1996, PWS Publishing, Boston, MA.
12. Hampel F.R., Ronchetti E.M., Rousseeuw P.J., Stahel W.A. Robust Statistics the Approach Based on Influence Functions 1986, John Wiley & Sons, New York.
13. Haykin S. Neural Networks-A Comprehensive Foundation 1999, Prentice Hall, NJ. 2nd ed.
14. Hornik K., Stinchconbe M., White H. Multilayer feedforward networks are universal approximators. Neural Netw. 1989, 2:359-366.
15. Huber P.J. Robust Statistics 1981, Wiley, New York.
16. Liano K. Robust error measure for supervised neural network learning with outliers. IEEE Trans. Neural Netw. 1996, 7(January):246-250.
17. D. Nguyen, B. Widrow, Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights, in: Proceedings of the International Joint Conference on Neural Networks, vol. 3, 1990, pp. 21-26.
18. D.J. Olive, D.M. Hawkins, Robustifying Robust Estimators, NY, 2007.
19. Pernia-Espinoza A.V., Ordieres-Mere J.B., Martinez-de-Pison F.J., Gonzalez-Marcos A. TAO-robust backpropagation learning algorithm. Neural Netw. 2005, 18:191-204.
20. L. Prechelt, PROBEN 1-a standardized benchmark collection for neural network algorithms, 1994. Available from 〈〉, 2012. http://ftp://ftp.ira.uka.de/pub/neuron/proben1.tar.gz.
21. Rousseeuw P.J. Least median of squares regression. J. Am. Stat. Assoc. 1984, 79:871-880.
22. Rousseeuw P.J. Multivariate Estimation with High Breakdown Point, Mathematical Statistics and Applications 1985, vol. B. Reidel, The Netherlands.
23. Rousseeuw P.J., Leroy A.M. Robust Regression and Outlier Detection 1987, Wiley, New York.
24. A.L. Rusiecki, Robust MCD-based backpropagation learning algorithm, in: Rutkowski, et al. (Eds.), ICAISC 2008. LNCS (LNAI), vol. 5097, Springer-Verlag, 2008, pp. 154-163.
25. A.L. Rusiecki, Robust LTS backpropagation learning algorithm, in: IWANN 2007. Lecture Notes in Computer Sciences, vol. 4507, Springer-Verlag, 2007, pp. 102-109.