LARSEN-ELM: Selective ensemble of extreme learning machines using LARS for blended data

Neurocomputing

Volumn 149, Issue Part A, 2015, Pages 285-294

  Han, Bo ^a   He, Bo ^a   Nian, Rui ^a   Ma, Mengmeng ^a   Zhang, Shujing ^a   Li, Minghui ^b   Lendasse, Amaury ^c,d  

^a OCEAN UNIVERSITY OF CHINA   (China)

^b UNIVERSITY OF STRATHCLYDE   (United Kingdom)

^c UNIVERSITY OF IOWA   (United States)

^d ARCADA UNIVERSITY OF APPLIED SCIENCES   (Finland)

Author keywords

Extreme learning machine; LARS algorithm; LARSEN ELM; Robustness; Selective ensemble

Indexed keywords

GENETIC ALGORITHMS; KNOWLEDGE ACQUISITION; LEARNING ALGORITHMS; ROBUSTNESS (CONTROL SYSTEMS);

EXTREME LEARNING MACHINE; INPUT VARIABLES; LARS-EN; LEAST ANGLE REGRESSIONS; NEURAL NETWORK ALGORITHM; SELECTIVE ENSEMBLES; SIMPLE STRUCTURES; UCI REPOSITORY;

LEARNING SYSTEMS;

ARTICLE; DATA BASE; EXTREME LEARNING MACHINE; GENETIC ALGORITHM; INTERMETHOD COMPARISON; LARSEN EXTREME LEARNING MACHINE; LEAST ANGLE REGRESSION ALGORITHM; MACHINE LEARNING; MATHEMATICAL COMPUTING;

EID: 84922018056     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2014.01.069     Document Type: Article

References (39)

1. Huang G.-B., Zhu Q.-Y., Siew C.-K. Extreme learning machine: theory and applications. Neurocomputing 2006, 70:489-501.
2. Ilonen J., Kamarainen J.-K., Lampinen J. Differential evolution training algorithm for feed-forward neural networks. Neural Process. Lett. 2003, 17:93-105.
3. Bebis G., Georgiopoulos M. Feed-forward neural networks. IEEE Potentials 1994, 13:27-31.
4. Rumelhart D.-E., Hinton G.-E., Willians R.-J. Learning representations by back-propagating errors. Cogn. Model. 2002, 1:213.
5. W. Jin, J.-L. Zhao, L.-S. Wei, et al., The improvements of BP neural network learning algorithm, WCCC-ICSP 2000, in: Proceedings of the 5th International Conference on Signal Processing Proceedings, 3, 2000 pp. 1647-1649.
6. Huang G.-B., Wang D.-H., Lan Y. Extreme learning machines: a survey. Int. J. Mach. Learn. Cybern. 2011, 2:107-122.
7. G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, Extreme learning machine: a new learning scheme of feedforward neural networks, in: Proceedings of the IEEE International Joint Conference on Neural Networks, 2. 2004, pp. 985-990.
8. Deng J.-P., Sundararajan N., Saratchandran P. Communication channel equalization using complex-valued minimal radial basis function neural networks. IEEE Trans. Neural Netw. 2002, 13:687-696.
9. Li G., Liu M., Dong M. A new online learning algorithm for structure-adjustable extreme learning machine. Comput. Math. Appl. 2010, 60:377-389.
10. Huang G.-B., Chen L. Convex incremental extreme learning machine. Neurocomputing 2007, 70:3056-3062.
11. Frénay B., Verleysen M. Parameter-insensitive kernel in extreme learning for non-linear support vector regression. Neurocomputing 2011, 74:2526-2531.
12. Huang G.-B., Babri H.A. Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Trans. Neural Netw. 1998, 9:224-229.
13. Miche Y., Sorjamaa A., Bas P., et al. OP-ELM: optimally pruned extreme learning machine. IEEE Trans. Neural Netw. 2010, 21:158-162.
14. Y. Miche, A. Sorjamaa, A. Lendasse, OP-ELM: theory, experiments and a toolbox, artificial neural networks, in: Proceedings of the International Conference on Artificial Neural Networks (2008 ed), Springer, 2008, pp. 145-154.
15. Y. Miche, P. Bas, C. Jutten, et al., A methodology for building regression models using extreme learning machine: OP-ELM, in: Proceedings of the European Symposium on Artificial Neural Networks (ESANN), 2008, pp. 247-252.
16. Hansen L.K., Salamon P. Neural network ensembles. IEEE Trans. Pattern Anal. Mach. Intell. 1990, 12:993-1001.
17. Sun Z.-L., Choi T.-M., Au K.-F., et al. Sales forecasting using extreme learning machine with applications in fashion retailing. Decis Support Syst. 2008, 46:411-419.
18. Slepian D. The one-sided barrier problem for Gaussian noise. Bell Syst. Tech. J. 1962, 41:463-501.
19. M. van Heeswijk, Y. Miche, T. Lindh-Knuutila, et al., Adaptive ensemble models of extreme learning machines for time series prediction, artificial neural networks, in: Proceedings of the International Conference on Artificial Neural Networks (2009 ed.), Springer, 2009, pp. 305-314.
20. Y. Tang, B. Biondi, Least-squares migration/inversion of blended data, SEG Technical Program Expanded Abstracts, 2009, pp. 2859-2863.
21. T. Similä, J. Tikka, Multiresponse sparse regression with application to multidimensional scaling, artificial neural networks: formal models and their applications, in: Proceedings of the International Conference on Artificial Neural Networks (2005 ed), Springer, 2005, pp. 97-102.
22. Z.-H. Zhou. J.-X. Wu, J. Yuan, et al., Genetic algorithm based selective neural network ensemble, IJCAI-01, in: Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence, Seattle, Washington, August 4-10, 2001, p. 797.
23. N. Li, Z.-H. Zhou, Selective ensemble Under Regularization Framework Multiple Classifier Systems, in: Proceedings of the 8th International Workshop on Multiple Classifier Systems, Reykjavik, Iceland, 5519, 2009, pp. 293-303.
24. Asuncion A., Newman D.- J. UCI machine learning repository 2007.
25. G.-B. Huang, C.-K. Siew, Extreme learning machine: RBF network case, control, automation, in: Proceedings of the 8th Robotics and Vision Conference (ICARCV), 2, 2004, pp. 1029-1036.
26. G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, Extreme learning machine: a new learning scheme of feedforward neural networks, in: Proceedings of the IEEE International Joint Conference on Neural Networks, 2, 2004, pp. 985-990.
27. Huang G.-B. Learning capability and storage capacity of two-hidden-layer feedforward networks. IEEE Trans. Neural Netw. 2003, 14:274-281.
28. Rao C.-R., Mitra S.-K. Generalized Inverse of a Matrix And its Applications 1972, J. Wiley, New York.
29. Serre D. Matrices: Theory and Applications. 2002, Springer, New York. 2002 ed.
30. Axelsson O. A generalized conjugate gradient, least square method. Numer. Math. 1987, 51:209-227.
31. G. Chavent, Identification of distributed parameter systems: about the output least square method, its implementation and identifiability, in: Proceedings of the 5th IFAC Symposium on Identification and System Parameter Estimation, 1979, pp. 85-97.
32. Breiman L. Bagging predictors. Mach. Learn. 1996, 24:123-140.
33. Atoufi B., Hosseini H.S. Bio-inspired algorithms for fuzzy rule-based systems. Adv. Knowl. Based Syst.: Model, Appl. Res. 2010, 1:126-159.
34. Barai S., Reich Y. Ensemble modelling or selecting the best model: Many could be better than one. Artif. Intell. Eng. Des. Anal. Manuf. 1999, 13:377-386.
35. Zhao L.-J., Chai T.-Y., Yuan D.-C. Selective ensemble extreme learning machine modeling of effluent quality in wastewater treatment plants. Int. J. Autom. Comput. 2012, 9:627-633.
36. J.-X. Wu, Z.-H. Zhou, and Z.-Q. Chen, et al., Ensemble of GA based selective neural network ensembles, in: Proceedings of the 8th International Conference on Neural Information Processing, Shanghai, China, 3, 2001, pp. 1477-1483.
37. R. Bellman, Dynamic programming and Lagrange multipliers, in: Proceedings of the National Academy of Sciences of the United States of America, 42, 1956 p. 767.
38. D.W. Opitz, J.W. Shavlik, Generating accurate and diverse members of a neural-network ensemble, in: Advances in Neural Information Processing Systems, 8, MIT Press, Cambridge, MA, 1996, pp. 535-541.
39. Huang G.B., Chen L., Siew C.K. Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans. Neural Netw. 2006, 17:4.