Predicting long-term population dynamics with bagging and boosting of process-based models

Expert Systems with Applications

Volumn 42, Issue 22, 2015, Pages 8484-8496

  Simidjievski, Nikola ^a   Todorovski, Ljupčo ^b   Džeroski, Sašo ^a  

^a JO EF STEFAN INSTITUTE   (Slovenia)

^b UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

Bagging; Boosting; Ensembles; Machine learning; Population dynamics; Predictive modeling; Process based modeling

Indexed keywords

AQUATIC ECOSYSTEMS; ARTIFICIAL INTELLIGENCE; DYNAMICS; FORECASTING; LEARNING SYSTEMS; OBJECT ORIENTED PROGRAMMING; POPULATION DYNAMICS;

BAGGING; BOOSTING; ENSEMBLES; PREDICTIVE MODELING; PROCESS-BASED MODELING;

ADAPTIVE BOOSTING;

EID: 84940461850     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2015.07.004     Document Type: Article

References (41)

1. Atanasova N., Recknagel F., Todorovski L., Džeroski S., and Kompare B. Computational assemblage of ordinary differential equations for chlorophyll-a using a lake process equation library and measured data of Lake Kasumigaura F. Recknagel, Ecological Informatics 2006 Springer 409 427
2. Atanasova N., Todorovski L., Džeroski S., and Kompare B. Constructing a library of domain knowledge for automated modelling of aquatic ecosystems Ecological Modelling 194 13 2006 14 36
3. Atanasova N., Todorovski L., Džeroski S., Remec R., Recknagel F., and Kompare B. Automated modelling of a food web in Lake Bled using measured data and a library of domain knowledge Ecological Modelling 194 1-3 2006 37 48
4. Breiman L. Classification and regression trees 1984 Chapman & Hall
5. Breiman L. Bagging predictors Machine Learning 24 2 1996 123 140
6. Breiman L. Random forests Machine Learning 45 1 2001 5 32 10.1023/A:1010933404324
7. Bridewell W., Asadi N.B., Langley P., and Todorovski L. Reducing overfitting in process model induction Proceedings of the 22nd international conference on machine learning (ICML '05) 2005 ACM Press 81 88
8. Bridewell W., Langley P.W., Todorovski L., and Džeroski S. Inductive process modeling Machine Learning 71 2008 1 32
9. Čerepnalkoski D., Taškova K., Todorovski L., Atanasova N., and Džeroski S. The influence of parameter fitting methods on model structure selection in automated modeling of aquatic ecosystems Ecological Modelling 245 2012 136 165
10. Demšar J. Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30
11. Dietterich T.G. Ensemble methods in machine learning Proceedings of the 1st international workshop on multiple classifier systems 2000 Springer 1 15
12. Dietzel A., Mieleitner J., Kardaetz S., and Reichert P. Effects of changes in the driving forces on water quality and plankton dynamics in three Swiss lakes long-term simulations with BELAMO Freshwater Biology 58 1 2013 10 35 10.1111/fwb.12031
13. Drucker H. Improving regressors using boosting techniques Proceedings of the 14th international conference on machine learning (ICML'97) 1997 Morgan Kaufmann Publishers Inc 107 115
14. Džeroski S., and Todorovski L. Learning population dynamics models from data and domain knowledge Ecological Modelling 170 2003 129 140
15. Freund Y. An adaptive version of the boost by majority algorithm Proceedings of the 12th annual conference on computational learning theory (COLT'99) 1999 ACM Press 102 113
16. Freund Y., and Schapire R.E. A decision-theoretic generalization of on-line learning and an application to boosting Journal of Computer and System Sciences 55 1 1997 119 139
17. Friedman M. A comparison of alternative tests of significance for the problem of m rankings The Annals of Mathematical Statistics 11 1 1940 86 92 10.2307/2235971
18. Ho T.K. The random subspace method for constructing decision forests IEEE Transactions on Pattern Analysis and Machine Intelligence 20 8 1998 832 844
19. Iman R.L., and Davenport J.M. Approximations of the critical region of the Friedman statistic Communications in Statistics - Theory and Methods 9 6 1980 571 595 10.1080/03610928008827904
20. Jiménez A., Barba I., del Valle C., and Weber B. Optbpplanner: automatic generation of optimized business process enactment plans H. Linger, J. Fisher, A. Barnden, C. Barry, M. Lang, C. Schneider, Building sustainable information systems 2013 Springer US 429 442 10.1007/978-1-4614-7540-8-33
21. Jørgensen S.E., and Bendoricchio G. Fundamentals of ecological modelling vol. 21 2001 Elsevier
22. Joshi M.V., Agarwal R.C., and Kumar V. Predicting rare classes: can boosting make any weak learner strong? Proceedings of the 8th ACM sigkdd international conference on knowledge discovery and data mining (KDD'02) 2002 ACM Press 297 306 10.1145/775047.775092
23. King M.A., Abrahams A.S., and Ragsdale C.T. Ensemble methods for advanced skier days prediction Expert Systems with Applications 41 2014 1176 1188
24. Kourentzes N., Barrow D.K., and Crone S.F. Neural network ensemble operators for time series forecasting Expert Systems with Applications 41 9 2014 4235 4244 http://dx.doi.org/10.1016/j.eswa.2013.12.011
25. Kuncheva L.I., and Whitaker C.J. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy Machine Learning 51 2 2003 181 207
26. Luenberger D. Introduction to dynamic systems: theory, models, and applications 1979 Wiley
27. Ma Z., Dai Q., and Liu N. Several novel evaluation measures for rank-based ensemble pruning with applications to time series prediction Expert Systems with Applications 42 1 2015 280 292 http://dx.doi.org/10.1016/j.eswa.2014.07.049
28. Maclin R., and Opitz D. Popular ensemble methods: an empirical study Journal of Artificial Intelligence Research 11 1999 169 198
29. Mirchev M., Duane G.S., Tang W.K., and Kocarev L. Improved modeling by coupling imperfect models Communications in Nonlinear Science and Numerical Simulation 17 7 2012 2741 2751
30. Nemenyi P.B. Ph.D. thesis Distribution-free Multiple Comparisons 1963 Princeton University
31. Rokach L. Ensemble-based classifiers Artificial Intelligence Review 33 1-2 2010 1 39 10.1007/s10462-009-9124-7
32. Simidjievski N., Todorovski L., and Džeroski S. Learning ensembles of population dynamics models and their application to modelling aquatic ecosystems Ecological Modelling 306 0 2015 305 317 http://dx.doi.org/10.1016/j.ecolmodel.2014.08.019
33. Smith D., Dutta R., Hellicar A., Bishop-Hurley G., Rawnsley R., Henry D., and et al. Bag of class posteriors, a new multivariate time series classifier applied to animal behaviour identification Expert Systems with Applications 42 7 2015 3774 3784 http://dx.doi.org/10.1016/j.eswa.2014.11.033
34. Storn R., and Price K. Differential evolution a simple and efficient heuristic for global optimization over continuous spaces Journal of Global Optimization 11 4 1997 341 359 10.1023/A:1008202821328
35. Taškova K., Šilc J., Atanasova N., and Džeroski S. Parameter estimation in a nonlinear dynamic model of an aquatic ecosystem with meta-heuristic optimization Ecological Modelling 226 2012 36 61
36. Tay W.-L., Chui C.-K., Ong S.-H., and Ng A.C.-M. Ensemble-based regression analysis of multimodal medical data for osteopenia diagnosis Expert Systems with Applications 40 2 2013 811 819
37. Todorovski L., Bridewell W., Shiran O., and Langley P.W. Inducing hierarchical process models in dynamic domains Proceedings of the 20th national conference on artificial intelligence (NAI'05) 2005 AAAI Press 892 897
38. Todorovski L., and Džeroski S. Integrating domain knowledge in equation discovery S. Dzeroski, L. Todorovski, Computational discovery of scientific knowledge Lecture Notes in Computer Science vol. 4660 2007 Springer 69 97
39. van den Berge L.A., Selten F.M., Wiegerinck W., and Duane G.S. A multi-model ensemble method that combines imperfect models through learning Earth System Dynamics 2 1 2011 161 177
40. White S.A. Process modeling notations and workflow patterns. Technical report 2004 IBM Corporation
41. Wolpert D.H. Stacked generalization Neural Networks 5 1992 241 259