GRADIENT: Grammar-driven genetic programming framework for building multi-component, hierarchical predictive systems

Expert Systems with Applications

Volumn 39, Issue 18, 2012, Pages 13253-13266

  Tsakonas, Athanasios ^a   Gabrys, Bogdan ^a  

^a BOURNEMOUTH UNIVERSITY   (United Kingdom)

Author keywords

Ensemble systems; Function approximation; Grammar driven genetic programming; Multi level prediction systems; Non linear regression

Indexed keywords

AUTOMATIC BUILDINGS; COMPONENT MODEL; ENSEMBLE SYSTEMS; FUNCTION APPROXIMATION; HIERARCHICAL STRUCTURES; MULTI POPULATION; MULTICOMPONENTS; NON-LINEAR REGRESSION; PREDICTION METHODS; PREDICTION SYSTEMS; PREDICTIVE SYSTEMS; PROGRAMMING FRAMEWORK; RESAMPLING;

EVOLUTIONARY ALGORITHMS; FORECASTING; GENETIC PROGRAMMING; REGRESSION ANALYSIS;

HIERARCHICAL SYSTEMS;

EID: 84865229886     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2012.05.076     Document Type: Article

References (61)

1. D. André, and J.R. Koza Parallel genetic programming: A scalable implementation using the transputer network Advances in genetic programming 1996 MIT Press Cambridge USA (pp. 317-337)
2. W. Banzhaf, P. Nordin, R.E. Keller, and F.D. Francone Genetic programming-An introduction; on the automatic evolution of computer programs and its applications 1998 Morgan Kaufmann San Francisco, CA
3. M. Berthold, N. Cebron, F. Dill, T. Gabriel, T. Kötter, and T. Meinl KNIME: The Konstanz information miner C. Preisach, H. Burkhardt, L. Schmidt-Thieme, R. Decker, Data analysis, machine learning and application 2008 319 326
4. C. Bishop Neural networks for pattern recognition 1995 University Press Oxford
5. L. Breiman, J. Friedman, R. Olshen, and C. Stone Classification and regression trees 1984 Wadsworth and Brooks Monterey, CA
6. G. Brown, J. Wyatt, R. Harris, and X. Yao Diversity creation methods: A survey and categorisation Information Fusion 6 2005 520 (Special issue on Diversity in multiple classifier systems)
7. M. Budka, and B. Gabrys Ridge regression ensemble for toxicity prediction Procedia Computer Science 1 1 2010 193 201
8. M. Budka, B. Gabrys, and E. Ravagnan Robust predictive modelling of water pollution using biomarker data Water Research 44 10 2010 3294 3308
9. A. Chandra, and X. Yao Evolving hybrid ensembles of learning machines for better generalisation Neurocomputing 69 2006 686 700 (Pubitemid 43230374)
10. R.T. Clemen Combining forecasts: A review and annotated bibliography International Journal of Forecasting 5 4 1989 559 583
11. A. Coelho, E. Fernandes, and K. Faceli Multi-objective design of hierarchical consensus functions for clustering ensembles via genetic programming Decision Support Systems 51 4 2011 794 809
12. R. Colobert, and S. Bengio SVMTorch: Support vector machines for large-scale regression problems Journal of Machine Learning Research 1 2001 143 160 (Pubitemid 33738779)
13. P. Comon Independent component analysis: A new concept? Signal Processing 36 1994 Elsevier 3 (pp. 287-314)
14. T. Dietterich Ensemble methods in machine learning Multiple Classifier Systems 1857 2000 115
15. De Falco, I.; Tarantino, E.; Cioppa, A. D.; & Gagliardi, F. (2005). A novel grammar-based genetic programming approach to clustering. In Proceedings of the 2005 ACM symposium on applied computing, Santa Fe, New Mexico (pp. 928-932).
16. M. Eastwood, and B. Gabrys The dynamics of negative correlation learning Journal of VLSI Signal Processing 49 2 2007 251 263 (Pubitemid 47536851)
17. B. Efron Bootstrap methods: Another look at the jackknife The Annals of Statistics 7 1 1979 126
18. P. Ein-Dor, and J. Feldmesser Attributes of the performance of central processing units: A relative performance prediction model Communications of the ACM 30 4 1984 308 317 (Pubitemid 17550640)
19. T. Evgeniou, M. Pontil, and A. Elisseeff Leave one out error, stability, and generalization of voting combinations of classifiers Machine Learning 55 1 2004 71 97
20. F. Fernández, M. Tommassini, and L. Vanneschi An empirical study of multipopulation genetic programming Genetic programming and evolvable machines 4 2003 Kluwer 1
21. Folino, G.; Pizzuti, C.; Spezzano, G.; Vanneschi, L.; & Tommassini, M. (2003). Diversity analysis in cellular and multipopulation genetic programming. In Proceedings of the 2003 congress on evolutionary computation CEC2003, Dec 8-12, Canberra, Australia.
22. G. Folino, C. Pizzuti, and G. Spezzano Ensemble techniques for parallel genetic programming based classifiers C. Ryan, T. Soule, M. Keijzer, Proceedings of the European conference on genetic programming (EuroGP 03) LNCS 2610 2003 Springer 59 69
23. Frank, A.; & Asuncion, A. (2010). UCI machine learning repository. Irvine, CA: University of California, School of Information and Computer Science. .
24. B. Gabrys Learning hybrid Neuro-Fuzzy classifier models from data: To combine or not to combine? Fuzzy Sets and Systems 147 2004 39 56
25. B. Gabrys, and D. Ruta Genetic algorithms in classifier fusion Applied Soft Computing 6 4 2006 337 347 (Pubitemid 44160505)
26. S. Geman, E. Bienenstock, and R. Doursat Neural networks and the bias/variance dilemma Neural Computation 4 1 1992 158
27. W.H. Greene Econometric analysis 2008 Prentice Hall
28. J.-H. Hong, and S.-B. Cho The classification of cancer based on DNA microarray data that uses diverse ensemble genetic programming Artificial Intelligence in Medicine 36 1 2006 43 58 (Pubitemid 43068582)
29. Iba, H. (1999). Bagging, boosting, and bloating in genetic programming. In Proceedings of 1999 genetic and evolutionary computation conference, Orlando, FL, USA (Vol. 2, pp. 1053-1060).
30. U. Johansson, C. Sönströd, T. Löfström, and R. König Using genetic programming to obtain implicit diversity 2009 IEEE Congress on Evolutionary Computation, CEC 2009 2009 2454 2459
31. P. Kadlec, and B. Gabrys Architecture for development of adaptive on-line prediction models Memetic Computing 1 4 2009 241 269
32. J.R. Koza Genetic programming-On the programming of computers by means of natural selection 1992 The MIT Press Cambridge, Massachussets, USA
33. L. Kuncheva Combining pattern classifiers: Methods and algorithms 2004 John Wiley and Sons New York, USA
34. C. Lemke, and B. Gabrys Meta-learning for time series forecasting and forecast combination Neurocomputing 73 10-12 2010 2006 2016
35. Lemke, C.; & Gabrys, B. (2009). Dynamic combination of forecasts generated by diversification procedures applied to forecasting of airline cancellations. In Proceedings of the IEEE symposium series on computational intelligence 2009.
36. A. Liaw, and M. Wiener Classification and regression by random forest R News 2 3 2002 18 22
37. B. Manderick, and P. Spiessens Fine-grained parallel genetic algorithms Proceedings of the 3rd international conference on genetic algorithms 1989 Morgan Kaufmann
38. S. Marsland Machine learning: An algorithmic perspective 2009 Chapman and Hall-CRC Machine Learning and Pattern Recognition, CRC Press
39. V. Medina-Chico, A. Suarez, and J.F. Lutsko Backpropagation in decision trees for regression L. De Raedt, P. Flach, ECML 2001 LNAI Vol. 2167 2001 Springer Verlag 348 359 (Pubitemid 33331082)
40. J.R. Quinlan Learning with continuous classes Proceedings of the AI'92 1992 World Scientific Singapore (pp. 343-348)
41. Ruta, D. (2006). Crosstrained ensemble of neural networks for robust time series prediction. Technical Report, NiSIS 2006.
42. D. Ruta, and B. Gabrys An overview of classifier fusion methods Computing and Information Systems 7 1 2000 110
43. D. Ruta, and B. Gabrys A theoretical analysis of the limits of majority voting errors for multiple classifier systems Pattern Analysis and Applications 5 4 2002 333 350 (Pubitemid 36177590)
44. D. Ruta, and B. Gabrys Set analysis of coincident errors and its applications for combining classifiers D. Chen, X. Cheng, Pattern recognition and string matching 2002 Kluwer Academic Publishers
45. Ruta, D.; & Gabrys, B. (2002c). New measure of classifier dependency in multiple classifier systems. In Proceedings of the MCS 2002 conference, Italy.
46. D. Ruta, and B. Gabrys Classifier selection for majority voting Information Fusion 6 1 2005 63 81
47. Ruta, D.; & Gabrys, B. (2007a). Neural network ensembles for time series prediction. In Proceedings of the international joint conference on neural networks, IEEE (pp. 1204-1209).
48. S. Riedel, and B. Gabrys Combination of multi level forecasts International Journal of VLSI Signal Processing Systems 49 2 2007 265 280 (Pubitemid 47536852)
49. Riedel, S.; & Gabrys, B. (2007c). Dynamic pooling for the combination of forecasts generated using multi level learning. In Proceedings of the international joint conference on neural networks (IJCNN'2007), Orlando, Florida, USA (pp. 454-459).
50. S. Riedel, and B. Gabrys Pooling for combination of multi level forecasts IEEE transactions on knowledge and data engineering 21 12 2009 1753 1766
51. D. Ruta, B. Gabrys, and C. Lemke A generic multilevel architecture for time series prediction IEEE Transactions on Knowledge and Data Engineering 23 3 2011 350 359
52. A. Sharkey, and N. Sharkey Combining diverse neural networks Knowledge Engineering Review 12 3 1997 231 247
53. D. Stronger, and P. Stone Polynomial regression with automated degree: A function approximator for autonomous agents Artificial Intelligence Tools 17 1 2008
54. R. Tanese Distributed genetic algorithms J. Schaffer, Proceedings of the 3rd international conference on genetic algorithms 1989 Morgan Kaufmann USA 434 439
55. Tsakonas, A.; & Gabrys B. (2011). Evolving Takagi-Sugeno-Kang fuzzy systems using multi-population grammar guided genetic programming. In Proceedings of the international conference on evolutionary computation theory and applications (ECTA'11), Paris, France.
56. G. Valentini, and T.G. Dietterich Bias-variance analysis of support vector machines for the development of SVM-based ensemble methods Journal of Machine Learning Research 5 2004 725 775
57. Ueda N.; & Nakano, R. (1996). Generalization error of ensemble estimators. In Proceedings of international conference on neural networks (pp. 90-95).
58. L.-X. Wang, and J.M. Mendel Fuzzy basis functions, universal approximation, and orthogonal least-squares learning IEEE Transactions on Neural Networks 3 5 1992 807 814
59. I-C. Yeh Modeling slump of concrete with fly ash and superplasticizer Computers and Concrete 5 6 2008 559 572
60. Y. Zhang, and S. Bhattacharyya Genetic programming in classifying large-scale data: An ensemble method Information Sciences 163 1-3 2004 85 101
61. Z. Zhou, J. Wu, Y. Jiang, and R. S. Chen Genetic algorithm based selective neural network ensemble Proceedings of the 17th international joint conference on artificial intelligence 2001 Morgan Kaufman USA (pp. 797-802)