Robust extreme learning machine

Neurocomputing

Volumn 102, Issue , 2013, Pages 31-44

  Horata, Punyaphol ^a   Chiewchanwattana, Sirapat ^a   Sunat, Khamron ^a  

^a Khon Kaen University   (Thailand)

Author keywords

Extended Complete Orthogonal Decomposition; Extreme learning machine; Iteratively reweighted least squares; Meta metrics evaluation; Minimax probability machine regression; Moore Penrose pseudo inverse; Multivariate least trimmed squares; Outlier; Robustness; Singular Value Decomposition

Indexed keywords

EXTREME LEARNING MACHINE; ITERATIVELY REWEIGHTED LEAST SQUARES; META-METRICS EVALUATION; MINIMAX PROBABILITY MACHINE; MULTIVARIATE LEAST-TRIMMED SQUARES; ORTHOGONAL DECOMPOSITION; OUTLIER; PSEUDO-INVERSES;

EXPERIMENTS; KNOWLEDGE ACQUISITION; LEARNING ALGORITHMS; LEARNING SYSTEMS; REGRESSION ANALYSIS; ROBUSTNESS (CONTROL SYSTEMS); SINGULAR VALUE DECOMPOSITION; STATISTICS; VIRTUAL REALITY;

PROBLEM SOLVING;

ACCURACY; ALGORITHM; ANALYTICAL PARAMETERS; ARTICLE; COMPUTATIONAL ROBUSTNESS; CONTROLLED STUDY; EXPERIMENTAL DESIGN; EXTENDED COMPLETE ORTHOGONAL DECOMPOSITION; EXTREME LEARNING MACHINE; ITERATIVELY REWEIGHTED LEAST SQUARE EXTREME LEARNING MACHINE ALGORITHM; MACHINE LEARNING; MINIMAX PROBABILITY MACHINE REGRESSION ALGORITHM; MULTIVARIATE LEAST TRIMMED SQUARE EXTREME LEARNING MACHINE ALGORITHM; OUTLIER ROBUSTNESS; PRIORITY JOURNAL; REWEIGHTED MULTIVARIATE LEAST TRIMMED SQUARE EXTREME LEARNING MACHINE ALGORITHM; SINGULAR VALUE DECOMPOSITION; STATISTICAL ANALYSIS; STATISTICAL PARAMETERS; TRAINING SPEED;

EID: 84870248640     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.12.045     Document Type: Article

References (37)

1. Huang G.-B., Zhu Q.-Y., Siew C.-K. Extreme learning machine: theory and applications. Neurocomputing 2006, 70:489-501.
2. Huang G.-B., Wang D.H., Lan Y. Extreme learning machines: a survey. Int. J. Mach. Learn. Cybern. 2011, 2(2):107-122.
3. Huang G.-B., Zhou H., Ding X., Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern.: Part B 2012, 42(2):513-529.
4. Wang X., Chen A., Feng H. Upper integral network with extreme learning mechanism. Neurocomputing 2011, 74(16):2520-2525.
5. Yeu C.-W.T., Lim M.-H., Huang G.-B. A new machine learning paradigm for terrain reconstruction. IEEE Geosci. Remote Sensing Lett. 2006, 3(3):382-386.
6. Bhat A.U., Merchant S.S., Bhagwat S.S. Prediction of melting points of organic compounds using extreme learning machines. Ind. Eng. Chem. Res. 2008, 47:920-925.
7. Sun Z.-L., Choi T.-M., Au K.-F., Yu Y. Sales forecasting using extreme learning machine with applications in fashion retailing. Decision Support Syst. 2008, 46(1):411-419.
8. S.O. Olatunji, A. Selamat, A.A.A.R. Abdul, Modeling permeability prediction using extreme learning machines, in: Proceedings of the 2010 Fourth Asia International Conference on Mathematical/Analytical Modelling and Computer Simulation, AMS '10, IEEE Computer Society, Washington, DC, USA, 2010, pp. 29-33.
9. Golub G.H., Loan C.F.V. Matrix Computations 1996, Johns Hopkins University Press, MD. third ed.
10. Maronna R., Martin R., Yohai V. Robust Statistics Theory and Methods 2006, Wiley, Chichester, West Sussex, England.
11. Wang Y., Cao F., Yuan Y. A study on effectiveness of extreme learning machine. Neurocomputing 2011, 74(16):2483-2490.
12. Yuan Y., Wang Y., Cao F. Optimization approximation solution for regression problem based on extreme learning machine. Neurocomputing 2011, 74(16):2475-2482.
13. Huynh H.T., Won Y. Weighted least squares scheme for reducing effects of outliers in regression based on extreme learning machine. Int. J. Digital Content Technol. Appl. (JDCTA) 2008, 2(3):40-46.
14. W. Deng, Q. Zheng, L. Chen, Regularized extreme learning machine, in: IEEE Symposium on Computational Intelligence and Data Mining, CIDM '09, 2009, pp. 389-395.
15. Huang G.-B., Chen L., Siew C.-K. Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans. Neural Networks 2006, 17(4):879-892.
16. Huang G.-B., Chen L. Enhanced random search based incremental extreme learning machine. Neurocomputing 2008, 71:3460-3468.
17. Tang X., Han M. Partial Lanczos extreme learning machine for single-output regression problems. Neurocomputing 2009, 72(13-15):3066-3076.
18. Rousseeuw P.J., Leroy A.M. Robust Regression and Outlier Detection 1987, John Wiley & Sons, Inc., New York.
19. Huber P.J. Robust Statistics 1981, John Wiley & Sons.
20. Mbamalu G.A.N., El-Hawary M.E. Loading forecasting via suboptimal seasonal autoregressive models and iteratively reweighted least squares estimation. IEEE Trans. Power Syst. 1993, 8(1):343-348.
21. x emission modelling using the iteratively reweighted least-square procedures. Int. J. Electr. Power Energy Syst. 1995, 17(2):129-136.
22. Street J.O., Carroll R.J., Ruppert D. A note on computing robust regression estimates via iteratively reweighted least squares. Am. Stat. 1998, 42(2):152-154.
23. Dumouchel W., O'Brien F. Integrating a Robust Option into a Multiple Regression Computing Environment 1991, Springer-Verlag New York, Inc., New York, pp. 41-48.
24. Hough P.D., Vavasis S.A. Complete orthogonal decomposition for weighted least squares. SIAM J. Matrix Anal. Appl. 1997, 18:369-392.
25. Rousseeuw P.J., Driessen K.V. A fast algorithm for the minimum covariance determinant estimator. Technometrics 1999, 41:212-223.
26. Agulló J., Croux C., Aelst S.V. The multivariate least-trimmed squares estimator. J. Multivariate Anal. 2008, 99(3):311-338.
27. C. Croux, K. Joossens, Robust estimation of the vector autoregressive model by a least trimmed squares procedure, in: COMPSTAT 2008: Proceedings in Computational Statistics, 2008, pp. 489-501.
28. Higham N.J., Schreiber R.S. Fast polar decomposition of an arbitrary matrix. SIAM J. Sci. Stat. Comput. 1990, 11:648-655.
29. C.R. Goodall, Computation using the QR decomposition, Handbook of Statistics, vol. 9, Elsevier Science Publishers B.V., Amsterdam, The Netherlands, 1993, pp. 467-508 (Chapter 13).
30. T. Strohmann, G.Z. Grudic, A formulation for minimax probability machine regression, in: Advances in Neural Information Processing Systems, vol. 15, MIT Press, 2003, pp. 769-776.
31. N.J. Higham, The Matrix Computation Toolbox, URL 〈〉. http://www.ma.man.ac.uk/~higham/mctoolbox.
32. Courrieu P. Fast computation of Moore-Penrose inverse matrices. Neural Inf. Process.-Lett. Rev. 2005, 8(2):25-29.
33. A. Frank, A. Asuncion, UCI Machine Learning Repository, 2010. URL 〈〉. http://archive.ics.uci.edu/ml.
34. Khan J.A., Aelst S.V., Zamar R.H. Robust linear model selection based on least angle regression. J. Am. Stat. Assoc. 2007, 102:1289-1299.
35. Stefani A., Xenos M. Meta-metric evaluation of e-commerce-related metrics. Electron. Notes Theor. Comput. Sci. 2009, 233:59-72.
36. Björck Å. Numerical Methods for Least Squares Problems 1996, SIAM, Philadelphia.
37. Watkins D.S. Fundamentals of Matrix computation 2002, John Wiley & Sons, New York. second ed.