An evolutionary constructive and pruning algorithm for artificial neural networks and its prediction applications

Neurocomputing

Volumn 86, Issue , 2012, Pages 140-149

  Yang, Shih Hung ^a   Chen, Yon Ping ^a  

^a NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

Author keywords

Constructive; Evolutionary algorithm; Neural network; Prediction; Pruning

Indexed keywords

AGE-BASED; CLUSTER-BASED; COMPLEX STRUCTURE; CONSTRUCTIVE; CROSSOVER AND MUTATION; EXPONENTIAL GROWTH; HIDDEN NEURONS; INPUT NODE; MACKEY-GLASS TIME SERIES; NUMERICAL RESULTS; PREDICTION PROBLEM; PRUNING; PRUNING ALGORITHMS; REAL-WORLD APPLICATION; SIMPLE STRUCTURES; TRAFFIC FLOW;

FORECASTING; NEURAL NETWORKS;

EVOLUTIONARY ALGORITHMS;

ALGORITHM; ARCHITECTURE; ARTICLE; ARTIFICIAL NEURAL NETWORK; CONSTRUCTIVE ALGORITHM; CONTROLLED STUDY; EVOLUTIONARY ALGORITHM; EVOLUTIONARY CONSTRUCTIVE AND PRUNING ALGORITHM; NERVE CELL; PREDICTION; PRIORITY JOURNAL; PRUNING ALGORITHM; TIME SERIES ANALYSIS;

EID: 84862800910     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2012.01.024     Document Type: Article

References (46)

1. Markel J.D., Gray A.H. Linear Prediction of Speech 1976, Springer Verlag, New York.
2. Makhoul J. Linear prediction: a tutorial review. Proc. IEEE 1975, 63:561-580.
3. Deng J.L. Introduction to grey system theory. J. Grey Syst. 1989, 1:1-24.
4. Adya M., Collopy F. How effective are neural networks at forecasting and prediction? A review and evaluation. J. Forecast. 1998, 17:481-495.
5. Yang S.H., Chen Y.P. Intelligent forecasting system using grey model combined with neural network. Int. J. Fuzzy Syst. 2011, 13:8-15.
6. Kosko B. Neural Networks and Fuzzy Systems: A Dynamical Systems Approach to Machine Intelligence 1992, Prentice-Hall, Upper Saddle River, NJ, ch2.
7. Kang S., Isik C. Partially connected feedforward neural networks structured by input types. IEEE Trans. Neural Networks 2005, 16:175-184.
8. Hornik K., Stinchcombe M., White H. Multilayer feedforward networks are universal approximators. Neural Networks 1989, 2:359-366.
9. Chen S.T., Yu D.C., Moghaddamjo A.R. Weather sensitive short-term load forecasting using nonfully connected artificial neural network. IEEE Trans. Power Syst. 1991, 7:1098-1105.
10. Canning A., Gardner E. Partially connected models of neural networks. J. Phys. A 1988, 21:3275-3284.
11. Elizondo D., Fiesler E. A survey of partially connected neural networks. Int. J. Neural Syst. 1997, 8:535-558.
12. Kwok T.Y., Yeung D.Y. Constructive algorithms for structure learning in feedforward neural networks for regression problems. IEEE Trans. Neural Networks 1997, 8:630-645.
13. Reed R. Pruning algorithms-A survey. IEEE Trans. Neural Networks 1993, 4:740-747.
14. Engelbrecht A.P. A new pruning heuristic based on variance analysis of sensitivity information. IEEE Trans. Neural Networks 2001, 12:1386-1399.
15. Sietsma J., Dow R.J.F. Creating artificial neural networks that generalize. Neural Networks 1991, 4:67-79.
16. Hirose Y., Yamashita K., Hijiya S. Back-propagation algorithm which varies the number of hidden units. Neural Networks 1991, 4:61-66.
17. Rivals I., Personnaz L. Neural-network construction and selection in nonlinear modeling. IEEE Trans. Neural Networks 2003, 14:804-819.
18. Islam Md.M., Sattar Md.A., Amin Md.F., Yao X., Murase K. A new adaptive merging and growing algorithm for designing artificial neural networks. IEEE Trans. Syst. Man Cybern. Part B 2009, 39:705-722.
19. Angeline P.J., Saunders G.M., Pollack J.B. An evolutionary algorithm that constructs recurrent neural networks. IEEE Trans. Neural Networks 1994, 5:54-65.
20. Mantzaris D., Anastassopoulos G., Adamopoulos A. Genetic algorithm pruning of probabilistic neural networks in medical disease estimation. Neural Networks 2011, 24:831-835.
21. Curry B., Morgan P.H. Seasonality and neural networks: a new approach. Int. J. Metaheurist. 2010, 1:181-197.
22. Huang D.-S., Du J.-X. A constructive hybrid structure optimization methodology for radial basis probabilistic neural networks. IEEE Trans. Neural Networks 2008, 19:2099-2115.
23. Masutti T.A.S., de Castro L.N. Neuro-immune approach to solve routing problems. Neurocomputing 2009, 72:2189-2197.
24. Kaylani A., Georgiopoulos M., Mollaghasemi M., Anagnostopoulos G.C. AG-ART: an adaptive approach to evolving ART architectures. Neurocomputing 2009, 72:2079-2092.
25. Goh C.-K., Teoh E.-J., Tan K.C. Hybrid multiobjective evolutionary design for artificial neural networks. IEEE Trans. Neural Networks 2008, 19:1531-1548.
26. Hervás-Martínez C., Martínez-Estudillo F.J., Carbonero-Ruz M. Multilogistic regression by means of evolutionary product-unit neural networks. Neural Networks 2008, 21:951-961.
27. Palmes P.P., Hayasaka T., Usui S. Mutation-based genetic neural network. IEEE Trans. Neural Networks 2005, 16:587-600.
28. Ludermir T.B., Yamazaki A., Zanchettin C. An optimization methodology for neural network weights and architectures. IEEE Trans. Neural Networks 2006, 17:1452-1459.
29. Zhang G., Patuwo B.E., Hu M.Y. Forecasting with artificial neural networks: the state of the art. Int. J. Forecast. 1998, 14:35-62.
30. Rumelhart D.E., Hinton G.E., Wiliams R.J. Learning representations by back-propagating errors. Nature 1986, 323:533-536.
31. Zanchettin C., Ludermir T.B., Almeida L.M. Hybrid training method for mlp: optimization of architecture and training. IEEE Trans. Syst. Man Cybern. Part B 2011, 41:1097-1109.
32. Zurada J.M., Malinowski A., Cloete I. Sensitivity analysis for minimization of input data dimension for feedforward neural network. ISCAS 1994, 447-450.
33. Zurada J.M., Malinowski A., Usui S. Perturbation method for deleting redundant inputs of perceptron networks. Neurocomputing 1997, 14:177-193.
34. Tukey J.W. Exploratory Data Analysis 1977, Addison Wesley, Reading, MA.
35. Khan Z.H., Alin T.S., Hussain Md.A. Price prediction of share market using artificial neural network (ANN). Int. J. Comput. Appl. 2011, 22:42-47.
36. Cioppa A.D., Stefano C.D., Marcelli A. On the role of population size and niche radius in fitness sharing. IEEE Trans. Evol. Comput. 2004, 8:580-592.
37. Du H., Zhang N. Time series prediction using evolving radial basis function networks with new encoding scheme. Neurocomputing 2008, 71:1388-1400.
38. Jang J.S.R. ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans. Syst. Man Cybern. 1993, 23:665-685.
39. Harpham C., Dawson C.W. The effect of different basis functions on a radial basis function network for time series prediction: a comparative study. Neurocomputing 2006, 69:2161-2170.
40. Rojas I., Pomares H., Bernier J.L., Ortega J., Pino B., Pelayo F.J., Prieto A. Time series analysis using normalized PG-RBF network with regression weights. Neurocomputing 2002, 42:267-285.
41. Chen Y., Yang B., Dong J. Time-series prediction using a local linear wavelet neural network. Neurocomputing 2006, 69:449-465.
42. Cho K.B., Wang B.H. Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction. Fuzzy Sets Syst. 1996, 83:325-339.
43. Leung F.H.F., Lam H.K., Ling S.H., Tam P.K.S. Tuning of the structure and parameters of a neural network using an improved genetic algorithm. IEEE Trans. Neural Networks 2003, 14:79-88.
44. Wong W.K., Xia M., Chu W.C. Adaptive neural network model for time-series forecasting. Eur. J. Oper. Res. 2010, 207:807-816.
45. Zhang G.P. Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 2003, 50:159-175.
46. Kulesh M., Holschneider M., Kurennaya K. Adaptive metrics in the nearest neighbours method. Phys. D 2008, 237:283-291.