Outlier-robust extreme learning machine for regression problems

Neurocomputing

Volumn 151, Issue P3, 2015, Pages 1519-1527

  Zhang, Kai ^a   Luo, Minxia ^a  

^a CHINA JILIANG UNIVERSITY   (China)

Author keywords

Augmented Lagrange multipliers method; Extreme learning machine; Outlier robustness; 1 norm

Indexed keywords

CONSTRAINED OPTIMIZATION; DATA HANDLING; KNOWLEDGE ACQUISITION; LAGRANGE MULTIPLIERS; MACHINE LEARNING;

AUGMENTED LAGRANGE MULTIPLIERS; AUGMENTED LAGRANGIAN MULTIPLIER METHOD; EFFECTIVENESS AND EFFICIENCIES; EXTREME LEARNING MACHINE; FUNCTION APPROXIMATION; LOSS FUNCTIONS; OUTLIER ROBUSTNESS; REGRESSION PROBLEM;

STATISTICS;

ALGORITHM; ARTICLE; CLINICAL EFFECTIVENESS; DATA ANALYSIS; EXTREME LEARNING MACHINE; LAGRANGIAN MULTIPLIER METHOD; MACHINE LEARNING; MATHEMATICAL ANALYSIS; MATHEMATICAL PARAMETERS; MEASUREMENT ACCURACY; REGRESSION ANALYSIS; REGULARIZED EXTREME LEARNING MACHINE; WEIGHTED REGULARIZED EXTREME LEARNING MACHINE;

EID: 84918773829     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2014.09.022     Document Type: Article

References (40)

1. S. Kaisler, F. Armour, J.A. Espinosa, W. Money, Big data: issues and challenges moving forward, in: The 46th Hawaii International Conference on System Sciences, 2013, pp. 995-1004.
2. Hodge V.J., Austin J. A survey of outlier detection methodologies. Artif. Intell. Rev. 2004, 22:85-126.
3. Huang G.-B., Zhu Q.-Y., Siew C.-K. Extreme learning machine. theory and applications. Neurocomputing 2006, 70:489-501.
4. Huang G.-B. An insight into extreme learning machines. random neurons, random features and kernels. Cogn. Comput. 2014, 1-15.
5. Huang G.-B., Zhou H., Ding X., Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 2012, 42:513-529.
6. Chen X., Dong Z.Y., Meng K., Xu Y., Wong K.P., Ngan H. Electricity price forecasting with extreme learning machine and bootstrapping. IEEE Trans. Power Syst. 2012, 27:2055-2062.
7. A. Sorjamaa, Y. Miche, R. Weiss, A. Lendasse, Long-term prediction of time series using NNE-based projection and OP-ELM, in: IEEE International Joint Conference on Neural Networks, 2008, pp. 2674-2680.
8. Zhao J., Wang Z., Park D.S. Online sequential extreme learning machine with forgetting mechanism. Neurocomputing 2012, 87:79-89.
9. L. Shuai, Z. Zheng, H. Liu, B. Wei, Experimental study on the semi-quantitative measurement for ferromagnetic material based on extreme learning machine (ELM), in: The 19th International Conference on Mechatronics and Machine Vision in Practice, 2012, pp. 403-407.
10. Horata P., Chiewchanwattana S., Sunat K. Robust extreme learning machine. Neurocomputing 2013, 102:31-44.
11. W. Deng, Q. Zheng, L. Chen, Regularized extreme learning machine, in: IEEE Symposium on Computational Intelligence and Data Mining, 2009, pp. 389-395.
12. Wang H. Block principal component analysis with L1-norm for image analysis. Pattern Recognit. Lett. 2012, 33:537-542.
13. Chuang C.-C., Su S.-F., Jeng J.-T., Hsiao C.-C. Robust support vector regression networks for function approximation with outliers. IEEE Trans. Neural Netw. 2002, 13:1322-1330.
14. A.D. McQuarrie, C.-L. Tsai, Regression and Time Series Model Selection, vol. 43, World Scientific, Singapore, 1998.
15. 1-norm" estimates in a partly linear model. Commun. Stat.: Theory Methods 1994, 23:175-196.
16. Daszykowski M., Kaczmarek K., Vander Heyden Y., Walczak B. Robust statistics in data analysis-a review. basic concepts. Chemom. Intell. Lab. Syst. 2007, 85:203-219.
17. Donoho D.L. Compressed sensing. IEEE Trans. Inf. Theory 2006, 52:1289-1306.
18. 1 minimization. J. Fourier Anal. Appl. 2008, 14:877-905.
19. 1-norm solution is also the sparsest solution. Commun. Pure Appl. Math. 2006, 59:797-829.
20. 1-norm minimization problems when the solution may be sparse. IEEE Trans. Inf. Theory 2008, 54:4789-4812.
21. E.J. Candès, X. Li, Y. Ma, J. Wright, Robust principal component analysis?, CoRR (2009), http://arxiv.org/abs/0912.3599.
22. J. Wright, A. Ganesh, S. Rao, Y. Peng, Y. Ma, Robust principal component analysis: exact recovery of corrupted low-rank matrices via convex optimization, in: Advances in Neural Information Processing Systems, 2009, pp. 2080-2088.
23. Nocedal J., Wright S.J. Numerical Optimization 2006, Springer, New York.
24. Miche Y., Van Heeswijk M., Bas P., Simula O., Lendasse A. TROP-ELM. a double-regularized ELM using LARS and Tikhonov regularization. Neurocomputing 2011, 74:2413-2421.
25. Neumann K., Steil J.J. Optimizing extreme learning machines via ridge regression and batch intrinsic plasticity. Neurocomputing 2013, 102:23-30.
26. Rao C.R., Mitra S.K. Generalized Inverse of Matrices and Its Applications 1971, Wiley, New York.
27. Bartlett P. The sample complexity of pattern classification with neural networks. the size of the weights is more important than the size of the network. IEEE Trans. Inf. Theory 1998, 44:525-536.
28. Suykens J.A., De Brabanter J., Lukas L., Vandewalle J. Weighted least squares support vector machines. robustness and sparse approximation. Neurocomputing 2002, 48:85-105.
29. 1-problems in compressive sensing. SIAM J. Sci. Comput. 2011, 33:250-278.
30. L. Zhang, M. Yang, X. Feng, Y. Ma, D. Zhang, Collaborative representation based classification for face recognition, CoRR (2012), http://arxiv.org/abs/1204.2358.
31. Z. Lin, M. Chen, Y. Ma, The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices, arXiv preprint (2010). http://arXiv:1009.5055.
32. W. Zuo, D. Meng, L. Zhang, X. Feng, D. Zhang, A generalized iterated shrinkage algorithm for non-convex sparse coding, in: The IEEE International Conference on Computer Vision (ICCV), 2013, pp. 217-224.
33. Figueiredo M.A., Nowak R.D., Wright S.J. Gradient projection for sparse reconstruction. application to compressed sensing and other inverse problems. IEEE J. Sel. Top. Signal Process. 2007, 1:586-597.
34. He B., Liao L.-Z., Han D., Yang H. A new inexact alternating directions method for monotone variational inequalities. Math. Program. 2002, 92:103-118.
35. Wang Y., Cao F., Yuan Y. A study on effectiveness of extreme learning machine. Neurocomputing 2011, 74:2483-2490.
36. K. Bache, M. Lichman, UCI Machine Learning Repository, 2013. University of California, Irvine, School of Information and Computer Sciences. http://archive.ics.uci.edu/ml.
37. Luo M., Zhang K. A hybrid approach combining extreme learning machine and sparse representation for image classification. Eng. Appl. Artif. Intell. 2014, 27:228-235.
38. Wang D., Alhamdoosh M. Evolutionary extreme learning machine ensembles with size control. Neurocomputing 2013, 102:98-110.
39. Rong H.-J., Ong Y.-S., Tan A.-H., Zhu Z. A fast pruned-extreme learning machine for classification problem. Neurocomputing 2008, 72:359-366.
40. Zong W., Huang G.-B., Chen Y. Weighted extreme learning machine for imbalance learning. Neurocomputing 2013, 101:229-242.