Extreme learning machine: A robust modeling technique? yes!

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7902 LNCS, Issue PART 1, 2013, Pages 17-35

  Lendasse, Amaury ^a,b,c   Akusok, Anton ^a   Simula, Olli ^a   Corona, Francesco ^a   Van Heeswijk, Mark ^a   Eirola, Emil ^a   Miche, Yoan ^a  

^a AALTO UNIVERSITY   (Finland)

^b BASQUE FOUNDATION FOR SCIENCE   (Spain)

^c UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

EXTREME LEARNING MACHINE; GAUSSIAN PROCESSES; ROBUST MODELING; STATE-OF-THE-ART METHODS; VARIABLE SELECTION;

KNOWLEDGE ACQUISITION; NEURAL NETWORKS;

LEARNING SYSTEMS;

EID: 84880077016     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-38679-4_2     Document Type: Conference Paper

References (40)

1. Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: Theory and applications. Neurocomputing 70(1-3), 489-501 (2006)
2. Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. Prentice Hall (July 1998)
3. Miche, Y., Bas, P., Jutten, C., Simula, O., Lendasse, A.: A methodology for building regression models using extreme learning machine: OP-ELM. In: European Symposium on Artificial Neural Networks, ESANN 2008, Bruges, Belgium, April 23-25 (2008)
4. Miche, Y., Sorjamaa, A., Bas, P., Simula, O., Jutten, C., Lendasse, A.: OP-ELM: Optimallypruned extreme learning machine. IEEE Transactions on Neural Networks 21(1), 158-162 (2010)
5. Miche, Y., Sorjamaa, A., Lendasse, A.: OP-ELM: Theory, experiments and a toolbox. In: K°urková, V., Neruda, R., Koutník, J. (eds.) ICANN 2008, Part I. LNCS, vol. 5163, pp. 145-154. Springer, Heidelberg (2008)
6. Tibshirani, R.: Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B 58, 267-288 (1994)
7. Allen, D.M.: The relationship between variable selection and data agumentation and a method for prediction. Technometrics 16(1), 125-127 (1974)
8. Efron, B., Hastie, T., Johnstone, I., Tibshirani, R.: Least angle regression. Annals of Statistics 32, 407-499 (2004)
9. Golub, G.H., Heath, M., Wahba, G.: Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics 21(2), 215-223 (1979)
10. Hoerl, A.E.: Application of ridge analysis to regression problems. Chemical Engineering Progress 58, 54-59 (1962)
11. Owen, A.B.: A robust hybrid of lasso and ridge regression. Technical report, Stanford University (2006)
12. Similä, T., Tikka, J.: Multiresponse sparse regression with application to multidimensional scaling. In: Duch, W., Kacprzyk, J., Oja, E., Zadro?zny, S. (eds.) ICANN 2005. LNCS, vol. 3697, pp. 97-102. Springer, Heidelberg (2005)
13. Thisted, R.A.: Ridge regression, minimax estimation, and empirical bayes methods. Technical Report 28, Division of Biostatistics, Stanford University (1976)
14. Tychonoff, A.N.: Solution of incorrectly formulated problems and the regularization method. Soviet Mathematics 4, 1035-1038 (1963)
15. Zhao, P., Rocha, G.V., Yu, B.: Grouped and hierarchical model selection through composite absolute penalties. Annals of Statistics 37(6A), 3468-3497 (2009)
16. Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society Series B 67(2), 301-320 (2005)
17. Miche, Y., van Heeswijk, M., Bas, P., Simula, O., Lendasse, A.: Trop-elm: A doubleregularized elm using lars and tikhonov regularization. Neurocomputing 74(16), 2413-2421 (2011)
18. Miche, Y., Eirola, E., Bas, P., Simula, O., Jutten, C., Lendasse, A., Verleysen, M.: Ensemble modeling with a constrained linear system of leave-one-out outputs. In: Verleysen, M. (ed.) ESANN 2010: 18th European Symposium on Artificial Neural Networks, Computational Intelligence andMachine Learning, April 28-30, pp. 19-24. d-side Publications, Bruges (2010)
19. van Heeswijk, M., Miche, Y., Oja, E., Lendasse, A.: GPU-accelerated and parallelized ELM ensembles for large-scale regression. Neurocomputing 74(16), 2430-2437 (2011)
20. Hua Zhou, Z.,Wu, J., Tang, W.: Ensembling neural networks: Many could be better than all. Artif. Intell. 137(1-2), 239-263 (2002)
21. Bishop, C.M.: Neural Networks for Pattern Recognition. Oxford University Press, USA (1996)
22. Huang, G.B., Chen, L., Siew, C.K.: Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Transactions on Neural Networks 17, 879-892 (2005)
23. Huang, G.B., Chen, L.: Enhanced random search based incremental extreme learning machine. Neurocomputing 71(16-18), 3460-3468 (2008)
24. Huang, G.B., Chen, L.: Convex incremental extreme learning machine. Neurocomputing 70(16-18), 3056-3062 (2007)
25. Huang, G.B., Zhu, Q.Y., Mao, K., Siew, C.K., Saratchandran, P., Sundararajan, N.: Can threshold networks be trained directly? IEEE Transactions on Circuits and Systems II: Express Briefs 53(3), 187-191 (2006)
26. Li,M.B., Huang, G.B., Saratchandran, P., Sundararajan, N.: Fully complex extreme learning machine. Neurocomputing 68, 306-314 (2005)
27. Huang, G.B., Siew, C.K.: Extreme learning machine with randomly assigned rbf kernels. International Journal of Information Technology 11(1), 16-24 (2005)
28. Rao, C.R., Mitra, S.K.: Generalized Inverse of Matrices and Its Applications. John Wiley & Sons Inc. (1971)
29. Yuan, L., Chai, S.Y., Huang, G.B.: Random search enhancement of error minimized extreme learning machine. In: Verleysen, M. (ed.) European Symposium on Artificial Neural Networks, ESANN 2010, April 28-30, pp. 327-332. d-side Publications, Bruges (2010)
30. Feng, G., Huang, G.B., Lin, Q., Gay, R.: Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Transactions on Neural Networks 20(8), 1352-1357 (2009)
31. Group, E.: The op-elm toolbox (2009), http://www.cis.hut.fi/projects/ eiml/research/downloads/op-elm-toolbox
32. Berger, J.: Minimax estimation of a multivariate normal mean under arbitrary quadratic loss. Journal of Multivariate Analysis 6(2), 256-264 (1976)
33. Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd edn. Springer (2009)
34. Deng,W., Zheng, Q., Chen, L.: Regularized extreme learning machine. In: IEEE Symposium on Computational Intelligence and Data Mining, CIDM 2009, March 30-April 2, pp. 389-395 (2009)
35. Nelder, J.A., Mead, R.: A simplex method for function minimization. The Computer Journal 7(4), 308-313 (1965)
36. Lendasse, A., Wertz, V., Verleysen, M.: Model selection with cross-validations and bootstraps-application to time series prediction with RBFN models. In: Kaynak, O., Alpaydin, E., Oja, E., Xu, L. (eds.) ICANN/ICONIP 2003. LNCS, vol. 2714, pp. 573-580. Springer, Heidelberg (2003)
37. Lawson, C.L., Hanson, R.J.: Solving least squares problems, 3rd edn. SIAM Classics in Applied Mathematics (1995)
38. Frank, A., Asuncion, A.: UCI machine learning repository (2010), http://archive.ics.uci.edu/ml
39. Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines (2001), Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
40. Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. The MIT Press (2006)