SW-ELM: A summation wavelet extreme learning machine algorithm with a priori parameter initialization

Neurocomputing

Volumn 123, Issue , 2014, Pages 299-307

  Javed, Kamran ^a   Gouriveau, Rafael ^a   Zerhouni, Noureddine ^a  

^a FEMTO ST INSTITUTE   (France)

Author keywords

Activation functions; Extreme learning machine; Parameters initialization; Prediction accuracy; Wavelet neural network

Indexed keywords

ACTIVATION FUNCTIONS; EXTREME LEARNING MACHINE; PARAMETERS INITIALIZATION; PREDICTION ACCURACY; WAVELET NEURAL NETWORKS;

ALGORITHMS; COMPLEX NETWORKS; FORECASTING; KNOWLEDGE ACQUISITION; NETWORK LAYERS; NEURAL NETWORKS;

LEARNING SYSTEMS;

ACCURACY; ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; DATA BASE; ELMAN NETWORK; LEVENBERG MARQUARDT ALGORITHM; MACHINE LEARNING; NONLINEAR SYSTEM; PREDICTION; PRIORITY JOURNAL; RANDOMIZATION; SINGLE LAYER FEED FORWARD NETWORK; STATISTICAL MODEL; STATISTICAL PARAMETERS; SUMMATION WAVELET EXTREME LEARNING MACHINE; TIME SERIES ANALYSIS;

EID: 84885695058     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.07.021     Document Type: Article

References (32)

1. Daqi G., Genxing Y. Influences of variable scales and activation functions on the performances of multilayer feedforward neural networks. Pattern Recognition 2003, 36(4):869-878.
2. Cao J., Lin Z., Huang G.-B. Composite function wavelet neural networks with extreme learning machine. Neurocomputing 2010, 73(7-9):1405-1416.
3. Banakar A., Azeem M.F. Artificial wavelet neural network and its application in neuro-fuzzy models. Applied Soft Computing 2008, 8(4):1463-1485.
4. Li X., Zeng H., Zhou J.H., Huang S., Thoe T.B., Shaw K.C., Lim B.S. Multi-modal sensing and correlation modelling for condition-based monitoring in milling machine. SIMTech Technical Reports 2007, 8(1):50-56.
5. W. Ting, Y. Sugai, A wavelet neural network for the approximation of nonlinear multivariable function, in: Proceedings of 1999 IEEE International Conference on Systems, Man, and Cybernetics, IEEE SMC'99, vol. 3, 1999, pp. 378-383.
6. T. Yamakawa, E. Uchino, T. Samatsu, Wavelet neural networks employing over-complete number of compactly supported non-orthogonal wavelets and their applications, in: Proceedings of 1994 IEEE World Congress on Computational Intelligence, vol. 3, 1994, pp. 1391-1396.
7. Pourtaghi A., Lotfollahi-Yaghin M. Wavenet ability assessment in comparison to ANN for predicting the maximum surface settlement caused by tunneling. Tunnelling and Underground Space Technology 2012, 28:257-271.
8. Rajesh R., Prakash J.S. Extreme learning machines-a review and state-of-the-art. International Journal of Wisdom Based Computing 2011, 1(1):35-49.
9. G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, Extreme learning machine: a new learning scheme of feedforward neural networks, in: Proceedings of the International Joint Conference on Neural Networks IJCNN, Budapest, Hungary, 2004.
10. Bhat A.U., Merchant S.S., Bhagwat S.S. Prediction of melting points of organic compounds using extreme learning machines. Industrial & Engineering Chemistry Research 2008, 47(3):920-925.
11. da G., Gomes S., Ludermir T., Lima L. Comparison of new activation functions in neural network for forecasting financial time series. Neural Computing and Applications 2011, 20(3):417-439.
12. Singh R., Balasundaram S. Application of extreme learning machine method for time series analysis. International Journal of Computer Systems Science and Engineering 2007, 2(4):256-262.
13. Li M.-B., Huang G.-B., Saratchandran P., Sundararajan N. Fully complex extreme learning machine. Neurocomputing 2005, 68:306-314.
14. D. Nguyen, B. Widrow, Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights, in: Proceedings of the International Joint Conference on Neural Networks IJCNN, San Diego, CA, USA, 1990.
15. Oussar Y., Dreyfus G. Initialization by selection for wavelet network training. Neurocomputing 2000, 34(1-4):131-143.
16. Hagan M.T., Menhaj M.B. Training feedforward networks with the Marquardt algorithm. IEEE Transactions on Neural Networks 1994, 5(6):989-993.
17. Huang G.-B., Zhu Q.-Y., Siew C.-K. Extreme learning machine: theory and applications. Neurocomputing 2006, 70:489-501.
18. Rao C.R., Mitra S.K. Generalized Inverse of Matrices and its Applications 1972, John Wiley and Sons, New York.
19. Huang G.-B., Wang D.H., Lan Y. Extreme learning machines. a survey. International Journal of Machine Learning and Cybernetics 2011, 2(2):107-122.
20. Malathi V., Marimuthu N., Baskar S., Ramar K. Application of extreme learning machine for series compensated transmission line protection. Engineering Applications of Artificial Intelligence 2011, 24(5):880-887.
21. Wang Y., Cao F., Yuan Y. A study on effectiveness of extreme learning machine. Neurocomputing 2011, 74(16):2483-2490.
22. G. Zhao, Z. Shen, C. Miao, Z. Man, On improving the conditioning of extreme learning machine: a linear case, in: Proceedings of 7th International Conference on Information, Communications and Signal processing, ICICS'09, Piscataway, NJ, USA, 2009.
23. Jalab H.A., Ibrahim R.W. New activation functions for complex-valued neural network. International Journal of the Physical Sciences 2011, 6(7):1766-1772.
24. Huang G.-B., Chen L. Enhanced random search based incremental extreme learning machine. Neurocomputing 2008, 71(16-18):3460-3468.
25. A. Pavelka, A. Prochazka, Algorithms for Initialization of Neural Network Weights, 2004, http://www.dsp.vscht.cz/konference_matlab/matlab04/pavelka.pdf.
26. Samhouri M., Al-Ghandoor A., Ali S.A., Hinti I., Massad W. An intelligent machine condition monitoring system using time-based analysis. neurofuzzy versus neural network. Jordan Journal of Mechanical and Industrial Engineering 2009, 3(4):294-305.
27. Zhou J., Li X., Gan O.P., Han S., Ng W.K. Genetic algorithms for feature subset selection in equipment fault diagnostics. Engineering Asset Management 2006, 10:1104-1113.
28. Industrial Dryer,. http://www.ftp://ftp.esat.kuleuven.ac.be/sista/data/process_industry.
29. Hair Dryer,http://www.ftp://ftp.esat.kuleuven.ac.be/sista/data/mechanical.
30. NN3 Forecasting Competition, http://www.neural-forecasting-competition.com/nn3/.
31. A. Saxena, K. Goebel, D. Simon, N. Eklund, Damage propagation modeling for aircraft engine run-to-failure simulation, in: International Conference on Prognostics and Health Management, 2008, IEEE, 2008, pp. 1-9.
32. Gouriveau R., Zerhouni N. Connexionist-systems-based long term prediction approaches for prognostics. IEEE Transactions on Reliability 2012, 61(4):909-920.