Extreme learning machine with parallel layer perceptrons

Neurocomputing

Volumn 166, Issue , 2015, Pages 164-171

  Tavares, L D ^a   Saldanha, R R ^a   Vieira, D A G ^b  

^a FEDERAL UNIVERSITY OF MINAS GERAIS   (Brazil)

^b Belo Horizonte Techonology Park   (Brazil)

Author keywords

Extreme learning machine; Least square estimate; Parallel layer perceptrons; Structural risk minimization

Indexed keywords

FEEDFORWARD NEURAL NETWORKS; KNOWLEDGE ACQUISITION; MACHINE LEARNING; NETWORK LAYERS; NUMBER THEORY; RISK PERCEPTION;

EXTREME LEARNING MACHINE; LEAST SQUARE ESTIMATES; LEAST SQUARES ESTIMATE; LINEAR PARAMETERS; NON-LINEAR NEURONS; PARALLEL LAYER PERCEPTRON; SINGLE LAYER FEED-FORWARD NEURAL NETWORKS; STRUCTURAL RISK MINIMIZATION;

MULTILAYER NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CALCULATION; CONTROLLED STUDY; KERNEL METHOD; LEAST SQUARE ESTIMATE; LINEAR SYSTEM; MACHINE LEARNING; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MATHEMATICAL PARAMETERS; NONLINEAR SYSTEM; PARALLEL LAYER PERCEPTRON EXTREME LEARNING MACHINE; PRIORITY JOURNAL; SINGLE LAYER FEEDFORWARD NEURAL NETWORK;

EID: 84931561658     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.04.018     Document Type: Article

References (68)

1. Cybenko G. Approximation by superpositions of a sigmoidal function. Math. Control Signals Syst. 1989, 2(4):303-314.
2. Funahashi K. On the approximate realization of continuous mappings by neural networks. Neural Netw. 1989, 2(3):183-192.
3. Huang G.B., Babri H.A. Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Trans. Neural Netw. 1998, 9(1):224-229.
4. Haykin S. Neural Networks: A Comprehensive Foundation 1998, Prentice-Hall PTR, Upper Saddle River, NJ, USA, ISBN 0132733501. 2nd ed.
5. G.B. Huang, Q.Y. Zhu, C.K. Siew, Extreme learning machine: a new learning scheme of feedforward neural networks, in: Neural Networks, 2004. 2004 IEEE International Joint Conference on Proceedings, vol. 2. 2004, pp. 985-990.
6. Huang G.B., Zhu Q.Y., Siew C.K. Extreme learning machine. theory and applications. Neurocomputing 2006, 70(1-3):489-501.
7. Huang G.B., Zhou H., Ding X., Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybernet. Part B 2012, 42(2):513-529.
8. Martínez-Martínez J.M., Escandell-Montero P., Soria-Olivas E., Martín-Guerrero J.D., Magdalena-Benedito R., Gómez-Sanchis J. Regularized extreme learning machine for regression problems. Neurocomputing 2011, 74(17):3716-3721.
9. Mao W., Zhao S., Mu X., Wang H. Multi-dimensional extreme learning machine. Neurocomputing 2015, 149:160-170.
10. Miche Y., Sorjamaa A., Bas P., Simula O., Jutten C., Lendasse A. OP-ELM. optimally pruned extreme learning machine. IEEE Trans. Neural Netw. 2010, 21:158-162.
11. Zhang R., Lan Y., Huang G.B., Xu Z.B. Universal approximation of extreme learning machine with adaptive growth of hidden nodes. IEEE Trans. Neural Netw. Learn. Syst. 2012, 23(2):365-371.
12. Vuković N., Miljković Z. A growing and pruning sequential learning algorithm of hyper basis function neural network for function approximation. Neural Netw. 2013, 46:210-226.
13. Grigorievskiy A., Miche Y., Ventelä A.M., Séverin E., Lendasse A. Long-term time series prediction using OP-ELM. Neural Netw. 2014, 51:50-56.
14. W. Changji, W. Zenghui, S. Hengqiang, Z. Cuijuan, A application of OP-ELM in the remote sensing images recognition, in: World Automation Congress, 2012, pp. 1-4.
15. Zhang R., Lan Y., Huang G.B., Xu Z.B., Soh Y.C. Dynamic extreme learning machine and its approximation capability. IEEE Trans. Cybern. 2013, 2168-2267.
16. Bai Z., Huang G.B., Wang D., Wang H., Westover M. Sparse extreme learning machine for classification. IEEE Trans. Cybern. 2014, 44(10):1858-1870.
17. Neumann K., Steil J.J. Optimizing extreme learning machines via ridge regression and batch intrinsic plasticity. Neurocomputing 2013, 102:23-30. Advances in Extreme Learning Machines (ELM 2011).
18. van Heeswijk M., Miche Y. Binary/ternary extreme learning machines. Neurocomputing 2015, 149:187-197.
19. D. Silva, L. Pacifico, T. Ludermir, An evolutionary extreme learning machine based on group search optimization, in: 2011 IEEE Congress on Evolutionary Computation (CEC), 2011, pp. 574-580.
20. Han F., Yao H.F., Ling Q.H. An improved evolutionary extreme learning machine based on particle swarm optimization. Neurocomputing 2013, 116:87-93.
21. L. Pacifico, T. Ludermir, Evolutionary extreme learning machine based on particle swarm optimization and clustering strategies, in: The 2013 International Joint Conference on Neural Networks, 2013, pp. 2161-4393.
22. Han B., He B., Nian R., Ma M., Zhang S., Li M., Lendasse A. LARSEN-ELM. Selective ensemble of extreme learning machines using LARS for blended data. Neurocomputing 2015, 149:285-294.
23. Bazi Y., Alajlan N., Melgani F., AlHichri H., Malek S., Yager R. Differential evolution extreme learning machine for the classification of hyperspectral images. IEEE Geosci. Remote Sens. Lett. 2014, 11(6):1066-1070.
24. L.j. Su, M. Yao, Extreme learning machine with multiple kernels, in: IEEE International Conference on Control and Automation, 2013, pp. 424-429.
25. Wang X., Han M. Online sequential extreme learning machine with kernels for nonstationary time series prediction. Neurocomputing 2014, 145:90-97.
26. L.l. Cao, W.b. Huang, F.c. Sun, Optimization-based extreme learning machine with multi-kernel learning approach for classification, in: 22nd International Conference on Pattern Recognition, 2014, pp. 3564-3569.
27. S. Scardapane, D. Comminiello, M. Scarpiniti, A. Uncini, Online sequential extreme learning machine with kernels, IEEE Trans. Neural Netw. Learn. Syst. 99 (2014) 1.
28. Liu X., Wang L., Huang G.b., Zhang J. Multiple kernel extreme learning machine. Neurocomputing 2015, 149:253-264.
29. Zhang W., Ji H. Fuzzy extreme learning machine for classification. Electron. Lett. 2013, 49(7):448-450.
30. J. Tang, C. Deng, G.B. Huang, J. Hou, A fast learning algorithm for multi-layer extreme learning machine, in: IEEE International Conference on Image Processing, 2014, pp. 175-178.
31. Liu X., Lin S., Fang J., Xu Z. Is extreme learning machine feasible? a theoretical assessment (Part I). IEEE Trans. Neural Netw. Learn. Syst. 2014, 26(1):7-20.
32. Lin S., Liu X., Fang J., Xu Z. Is extreme learning machine feasible? a theoretical assessment (Part II). IEEE Trans. Neural Netw. Learn. Syst. 2014, 26(1):21-34.
33. J. Xu, H. Zhou, G.B. Huang, Extreme Learning Machine based fast object recognition, in: International Conference on Information Fusion, 2012, pp. 1490-1496.
34. K. Yang, E. Du, E. Delp, P. Jiang, F. Jiang, Y. Chen, R. Sherony, H. Takahashi, An extreme learning machine-based pedestrian detection method, in: Intelligent Vehicles Symposium, 2013, pp. 1404-1409.
35. Samat A., Du P., Liu S., Li J., Cheng L. Ensemble extreme learning machines for hyperspectral image classification. IEEE J. Select. Top. Appl. Earth Obs. Remote Sens. 2014, 7(4):1060-1069.
36. Bencherif M., Bazi Y., Guessoum A., Alajlan N., Melgani F., AlHichri H. Fusion of extreme learning machine and graph-based optimization methods for active classification of remote sensing images. IEEE Geosci. Remote Sens. Lett. 2014, 12(3):527-531.
37. H. Zhou, Y. Lan, Y.C. Soh, G.B. Huang, R. Zhang, Credit risk evaluation with extreme learning machine, in: IEEE International Conference on Systems, Man, and Cybernetics, 2012, pp. 1064-1069.
38. X. Mo, Y. Wang, X. Wu, Hypoglycemia prediction using extreme learning machine (ELM) and regularized ELM, in: Control and Decision Conference, 2013, pp. 4405-4409.
39. Wang B., Huang S., Qiu J., Liu Y., Wang G. Parallel online sequential extreme learning machine based on MapReduce. Neurocomputing 2015, 149:224-232.
40. Soria-Olivas E., Gomez-Sanchis J., Jarman I., Vila-Frances J., Martinez M., Magdalena J., Serrano A. BELM. Bayesian extreme learning machine. IEEE Trans. Neural Netw. 2011, 22:505-509.
41. Chen H., Peng J., Zhou Y., Lib L., Pana Z. Extreme learning machine for ranking. generalization analysis and applications. Neural Netw. 2014, 53:119-126.
42. Huang G., Huang G.B., Song S., You K. Trends in extreme learning machines. a review. Neural Netw. 2015, 61:32-48.
43. Vieira D.A.G., Takahashi R.H.C., Palade V., Vasconcelos J.A., Caminhas W.M. The Q-norm complexity measure and the minimum gradient method. a novel approach to the machine learning structural risk minimization problem. IEEE Trans. Neural Netw. 2008, 19(8):1415-1430.
44. Bartlett P.L. The sample complexity of pattern classification with neural networks. the size of the weights is more important than the size of the network. IEEE Trans. Inf. Theor. 2006, 44(2):525-536.
45. Vapnik V.N. Principles of structural risk minimization for learning theory. Adv. Neural Inf. Process. Syst. 2006, 4:831-838.
46. Caminhas W.M., Vieira D.A., Vasconcelos J.A. Parallel layer perceptron. Neurocomputing 2003, 55(3-4):771-778.
47. Kasabov N. Foundations of Neural Networks Fuzzy Systems, and Knowledge Engineering. A Bradford Book 1996, The MIT Press, Cambridge, Massachusetts, London, England, ISBN 9780262112123.
48. Vieira D., Vasconcelos J., Saldanha R. Recent Advances in Neural Networks Structural Risk Minimization Based on Multiobjective Complexity Control Algorithms 2010, INTECH Open Access Publisher, ISBN 9789533070339. URL http://cdn.intechopen.com/pdfs-wm/10442.pdf.
49. A. James, D.A.G. Vieira, L. Benny, D. Ara, G.Z. Yang, Eye-gaze driven surgical workflow segmentation, in: Lecture Notes in Computer Science, vol. 4792, 2007, pp. 110-117.
50. Travassos L., Vieira D.A.G., Ida N., Vollaire C., Nicolas A. Characterizing inclusions in a non-homogenous GPR problem by Neural Networks. IEEE Trans. Mag. 2008, 44:1630-1633.
51. Travassos L., Vieira D.A.G., N.I., A.N. In the use of parametric and non parametric algorithms for the non destructive evaluation of concrete structures. Res. Nondestr. Eval. 2009, 20:71-93.
52. Travassos X., Nicolas A., Vieira D., Palade V. Noise reduction in a non-homogenous ground penetrating radar problem by multiobjective neural networks. IEEE Trans. Mag. 2009, 45:1454-1457.
53. Queiroz F.A.A., Vieira D.A.G., Travassos X.L., Pantoja M. A review of soft techniques for electromagnetic assessment of concrete condition. Math. Prob. Eng. (Online) 2012, 2012:1-20.
54. Vieira D., Travassos L., Saldanha R.R., Palade V. Signal denoising in engineering problems through the minimum gradient method. Neurocomputing (Amsterdam) 2009, 72:2270-2275.
55. Hornik K., Stinchcombe M., White H. Multilayer feedforward networks are universal approximators. Neural Netw. 1989, 2(5):359-366.
56. K. Bache, M. Lichman, UCI Machine Learning Repository, URL , 2013. http://archive.ics.uci.edu/ml.
57. Demšar J. Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 2006, 7:1-30.
58. Nemenyi P. Distribution-Free Multiple Comparisons (PhD Thesis) 1963, Princeton University, Princeton, NJ, USA.
59. W. Deng, Q. Zheng, L. Chen, Regularized extreme learning machine, in: Computational Intelligence and Data Mining, 2009. IEEE Symposium on CIDM '09, 2009, pp. 389-395.
60. Poria S., Cambria E., Winterstein G., Huang G.B. Sentic patterns. dependency-based rules for concept-level sentiment analysis. Knowl. Based Syst. 2014, 69:45-63.
61. Shao Y.E., Lu C.J., Hou C.D. Hybrid soft computing schemes for the prediction of import demand of crude oil in Taiwan. Math. Prob. Eng. 2014, 2014:11.
62. An G., Liu S., Jin Y., Ruan Q., Lu S. Facial expression recognition based on discriminant neighborhood preserving nonnegative tensor factorization and ELM. Math. Prob. Eng. 2014, 2014:10.
63. Cambria E., Gastaldo P., Bisio F., Zunino R. An ELM-based model for affective analogical reasoning. Neurocomputing 2015, 149:443-455.
64. Wang X., Han M. Improved extreme learning machine for multivariate time series online sequential prediction. Eng. Appl. Artif. Intell. 2015, 40:28-36.
65. Frenay B., Verleysen M. Parameter-insensitive kernel in extreme learning for non-linear support vector regression. Neurocomputing 2011, 74(16):2526-2531.
66. Liu X., Gao C., Lia P. A comparative analysis of support vector machines and extreme learning machines. Neural Netw. 2012, 33:58-66.
67. G.B. Huang, Extreme Learning Machine, URL , 2015. (Online; accessed February 2015). http://www.ntu.edu.sg/home/egbhuang/elm_kernel.html.
68. Vieira D.A.G., Vasconcelos J.A., Caminhas W.M. Controlling the parallel layer perceptron complexity using a multiobjective learning algorithm. Neural Comput. Appl. 2007, 16:317-325.