Regression and classification using extreme learning machine based on L1-norm and L2-norm

Neurocomputing

Volumn 174, Issue , 2016, Pages 179-186

  Luo, Xiong ^a   Chang, Xiaohui ^a   Ban, Xiaojuan ^a  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY BEIJING   (China)

Author keywords

Bayesian information criterion (BIC); Elastic net; Extreme learning machine; Model selection; Ridge regression

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BENCHMARKING; COMPLEX NETWORKS; KNOWLEDGE ACQUISITION; LEARNING ALGORITHMS; MACHINERY; REGRESSION ANALYSIS;

BAYESIAN INFORMATION CRITERION; ELASTIC NET; EXTREME LEARNING MACHINE; MODEL SELECTION; RIDGE REGRESSION;

LEARNING SYSTEMS;

ARTICLE; BAYES THEOREM; BAYESIAN INFORMATION CRITERION; CLASSIFIER; COMPUTER PREDICTION; COMPUTER SIMULATION; ELASTIC NET ALGORITHM; EXTREME LEARNING MACHINE; LEARNING ALGORITHM; MACHINE LEARNING; PRIORITY JOURNAL; REGRESSION ANALYSIS;

EID: 84940063453     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.03.112     Document Type: Article

References (28)

1. Brown B., Chui M., Manyika J. Are you ready for the era of 'big data'. McKinsey Q. 2011, 4:24-35.
2. Yu D., Deng L. Efficient and effective algorithms for training single-hidden-layer neural networks. Pattern Recognit. Lett. 2012, 33(5):554-558.
3. Ding S., Su C., Yu J. An optimizing BP neural network algorithm based on genetic algorithm. Artif. Intell. Rev. 2011, 36(2):153-162.
4. Luo X., Chang X., Liu H. A Taylor based localization algorithm for wireless sensor network using extreme learning machine. IEICE Trans. Inf. Syst. E 2014, 97D(10):2652-2659.
5. Huang G.-B., Zhu Q., Siew C. Extreme learning machine. theory and applications. Neurocomputing 2006, 70(1):489-501.
6. Luo X., Chang X. A novel data fusion scheme using grey model and extreme learning machine in wireless sensor networks. Int. J. Control Autom. Syst. 2015, 13(3):539-546.
7. Horata P., Chiewchanwattana S., Sunat K. Robust extreme learning machine. Neurocomputing 2013, 102:31-44.
8. W. Deng, Q. Zheng, L. Chen, Regularized extreme learning machine, in: Proceedings of IEEE Symposium on Computational Intelligence and Data Mining, Nashville, 2009, pp. 389-395.
9. Rong H.-J., Ong Y.-S., Tan A.-H., Zhu Z. A fast pruned-extreme learning machine for classification problem. Neurocomputing 2008, 72(1):359-366.
10. Martínez-Martínez J.M., Escandell-Montero P., Soria-Olivas E., Martín-Guerrero J.D., Magdalena-Benedito R., Gómez-Sanchis J. Regularized extreme learning machine for regression problems. Neurocomputing 2011, 74(17):3716-3721.
11. Miche Y., Sorjamaa A., Bas P., Simula O., Jutten C., Lendasse A. OP-ELM. optimally pruned extreme learning machine. IEEE Trans. Neural Netw. 2010, 21(1):158-162.
12. de Mol C., de Vito E., Rosasco L. Elastic-net regularization in learning theory. J. Complex. 2009, 25(2):201-230.
13. Burnham K.P., Anderson D.R. Multimodel inference understanding AIC and BIC in model selection. Sociol. Methods Res. 2004, 33(2):261-304.
14. He Q., Shang T., Zhuang F., Shi Z. Parallel extreme learning machine for regression based on MapReduce. Neurocomputing 2013, 102:52-58.
15. Huang G.-B., Wang D.H., Lan Y. Extreme learning machines. a survey. Int. J. Mach. Learn. Cybern. 2011, 2(2):107-122.
16. R. Tibshirani, Regression shrinkage and selection via the lasso, J. R. Stat. Soc. Ser. B (Methodological) (1996) 267-288.
17. L. Jacob, G. Obozinski, J.-P. Vert, Group lasso with overlap and graph lasso, in: Proceedings of the 26th Annual International Conference on Machine Learning, Montreal, 2009, pp. 433-440.
18. Efron B., Hastie T., Johnstone I., Tibshirani R. Least angle regression. Ann. Stat. 2004, 32(2):407-499.
19. Zou H., Hastie T. Regularization and variable selection via the elastic net. J. R. Stat. Soc.: Ser. B (Stat. Methodol.) 2005, 67(2):301-320.
20. Breiman L. Heuristics of instability and stabilization in model selection. Ann. Stat. 1996, 24(6):2350-2383.
21. Hoerl A.E., Kennard R.W. Ridge regression. biased estimation for nonorthogonal problems. Technometrics 1970, 12(1):55-67.
22. Zhou T., Tao D., Wu X. Manifold elastic net. a unified framework for sparse dimension reduction. Data Min. Knowl. Discov. 2011, 22(3):340-371.
23. Li Q., Lin N. The Bayesian elastic net. Bayesian Anal. 2010, 5(1):151-170.
24. Bozdogan H. Model selection and Akaike's information criterion (AIC). the general theory and its analytical extensions. Psychometrika 1987, 52(3):345-370.
25. Huang G.-B., Zhou H., Ding X., Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern.: Part B 2012, 42(2):513-529.
26. Li D., Han M., Wang J. Chaotic time series prediction based on a novel robust echo state network. IEEE Trans. Neural Netw. Learn. Syst. 2012, 23(5):787-799.
27. A. Asuncion, D. Newman, UCI machine learning repository, 2007. 〈〉. http://archive.ics.uci.edu/ml/.
28. Grigorievskiy A., Miche Y., Ventelä A.-M., Séverin E., Lendasse A. Long-term time series prediction using OP-ELM. Neural Netw. 2014, 51:50-56.