Modeling dynamic systems with efficient ensembles of process-based models

PLoS ONE

Volumn 11, Issue 4, 2016, Pages

  Simidjievski, Nikola ^a   Todorovski, Ljupčo ^b   Džeroski, Sašo ^a  

^a JO EF STEFAN INSTITUTE   (Slovenia)

^b UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

[No Author keywords available]

Indexed keywords

EXPERIMENTAL MODEL; LAKE ECOSYSTEM; LEARNING ALGORITHM; MODEL; POPULATION DYNAMICS; PREDICTION; SAMPLING; TIME SERIES ANALYSIS; ALGORITHM; ANALYSIS; ANIMAL; BIOLOGICAL MODEL; COMPUTER SIMULATION; ECOSYSTEM; LAKE; MACHINE LEARNING; PREDATION;

ALGORITHMS; ANIMALS; COMPUTER SIMULATION; ECOSYSTEM; LAKES; MACHINE LEARNING; MODELS, BIOLOGICAL; POPULATION DYNAMICS; PREDATORY BEHAVIOR;

EID: 84964318219     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0153507     Document Type: Article

References (54)

1. Taškova K, Šilc J, Atanasova N, Džeroski S. Parameter estimation in a nonlinear dynamic model of an aquatic ecosystem with meta-heuristic optimization. Ecological Modelling. 2012;226:36-61. doi:10. 1016/j.ecolmodel.2011.11.029
2. Čerepnalkoski D, Taškova K, Todorovski L, Atanasova N, Džeroski S. The influence of parameter fitting methods on model structure selection in automated modeling of aquatic ecosystems. Ecological Modelling. 2012;245(0):136-165. doi:10.1016/j.ecolmodel.2012.06.001
3. Borrett SR, Bridewell W, Langley P, Arrigo KR. A method for representing and developing process models. Ecological Complexity. 2007;4(1-2):1-12. doi:10.1016/j.ecocom.2007.02.017
4. Atanasova N, Todorovski L, Džeroski S, Remec R, Recknagel F, Kompare B. Automated modelling of a food web in Lake Bled using measured data and a library of domain knowledge. Ecological Modelling. 2006;194(1-3):37-48. doi:10.1016/j.ecolmodel.2005.10.029
5. Dietterich TG. Ensemble Methods in Machine Learning. In: Proceedings of the 1st International Workshop on Multiple Classifier Systems. London, UK: Springer; 2000. p. 1-15.
6. Maclin R, Opitz D. Popular ensemble methods: An empirical study. Journal of Artificial Intelligence Research. 1999;11:169-198.
7. Rokach L. Ensemble-based classifiers. Artificial Intelligence Review. 2010 Feb; 33(1-2):1-39. doi:10. 1007/s10462-009-9124-7
8. Simidjievski N, Todorovski L, Džeroski S. Learning ensembles of population dynamics models and their application to modelling aquatic ecosystems. Ecological Modelling. 2015;306:305-317. doi:10. 1016/j.ecolmodel.2014.08.019
9. Simidjievski N, Todorovski L, Džeroski S. Predicting long-term population dynamics with bagging and boosting of process-based models. Expert Systems with Applications. 2015;42(22):8484-8496. doi:10.1016/j.eswa.2015.07.004
10. Ho TK. The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1998 Aug; 20(8):832-844. doi:10.1109/34.709601
11. Bridewell W, Asadi NB, Langley P, Todorovski L. Reducing overfitting in process model induction. In: Proceedings of the 22nd International Conference on Machine Learning. ICML'05. New York, NY, USA: ACM; 2005. p. 81-88.
12. Langley PW, Simon HA, Bradshaw G, Zytkow JM. Scientific Discovery: Computational Explorations of the Creative Processes. Cambridge, MA, USA: The MIT Press; 1987.
13. Washio T, Motoda H, Niwa Y. Enhancing the Plausibility of Law Equation Discovery. In: Proceedings of the 17th International Conference on Machine Learning, ICML'00. San Francisco, CA, USA: Morgan Kaufmann; 2000. p. 1127-1134.
14. Bridewell W, Langley PW, Todorovski L, Džeroski S. Inductive Process Modeling. Machine Learning. 2008;71:1-32. doi:10.1007/s10994-007-5042-6
15. Todorovski L, Džeroski S. Integrating Domain Knowledge in Equation Discovery. In: Džeroski S, Todorovski L, editors. Computational Discovery of Scientific Knowledge. vol. 4660. Springer; 2007. p. 69-97.
16. Kocev D, Džeroski S. Habitat modeling with single- and multi-target trees and ensembles. Ecological Informatics. 2013;18:79-92. doi:10.1016/j.ecoinf.2013.06.003
17. Blockeel H, Raedt LD. Top-down induction of first-order logical decision trees. Artificial Intelligence. 1998;101(1-2):285-297. doi:10.1016/S0004-3702 (98) 00034-4
18. Knudby A, Brenning A, Le Drew E. New approaches to modelling fish-habitat relationships. Ecological Modelling. 2010 Feb; 221(3):503-511. doi:10.1016/j.ecolmodel.2009.11.008
19. Todorovski L, Bridewell W, Shiran O, Langley PW. Inducing hierarchical process models in dynamic domains. In: Proceedings of the 20th National Conference on Artificial Intelligence, NAI'05. AAAI Press; 2005. p. 892-897.
20. Durillo JJ, Nebro AJ. jMetal: A Java framework for multi-objective optimization. Advances in Engineering Software. 2011;42:760-771. doi:10.1016/j.advengsoft.2011.05.014
21. Cohen SD, Hindmarsh AC. CVODE, a stiff/nonstiff ODE solver in C. Computers in Physics. 1996 Mar; 10(2):138-143. doi:10.1063/1.4822377
22. Okun O, Valentini G, Re M. Ensembles in Machine Learning Applications. vol. 373. Springer; 2011.
23. Drucker H. Improving Regressors using Boosting Techniques. In: Proceedings of the 14th International Conference on Machine Learning, ICML'97. San Francisco, CA, USA: Morgan Kaufmann; 1997. p. 107-115.
24. Wolpert DH. Stacked Generalization. Neural Networks. 1992;5:241-259. doi:10.1016/S0893-6080 (05) 80023-1
25. Breiman L. Bagging predictors. Machine Learning. 1996a; 24(2):123-140. doi:10.1023/A:1018054314350
26. Schapire RE. The boosting approach to machine learning: An overview. In: Denison DD, Hansen MH, Holmes CC, Mallick B, Yu B, editors. Nonlinear Estimation and Classification. LNCS. Springer; 2003. p. 149-173.
27. Panov P, Džeroski S. Combining Bagging and Random Subspaces to Create Better Ensembles. In: Proceeding of the 7th International Symposium on Advances in Intelligent Data Analysis, IDA07. vol. 4723 of LNCS. Springer; 2007. p. 118-129.
28. Breiman L. Classification and Regression Trees. Chapman & Hall, London, UK; 1984.
29. Bauer E, Kohavi R. An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants. Machine Learning. 1999;36(1-2):105-139. doi:10.1023/A:1007515423169
30. Freund Y, Schapire RE. A Short Introduction to Boosting. In: Proceedings of the 16th International Joint Conference on Artificial Intelligence, IJCAI'99. Morgan Kaufmann; 1999. p. 1401-1406.
31. Freund Y, Schapire RE. A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting. Journal of Computer and System Sciences. 1997;55(1):119-139. doi:10.1006/jcss.1997. 1504
32. Ho T. Complexity of Classification Problems and Comparative Advantages of Combined Classifiers. In: 1st International Workshop on Multiple Classifier Systems. vol. 1857 of LNCS. Springer; 2000. p. 97-106.
33. Dietzel A, Mieleitner J, Kardaetz S, Reichert P. Effects of changes in the driving forces on water quality and plankton dynamics in three Swiss lakes-long-term simulations with BELAMO. Freshwater Biology. 2013;58(1):10-35. doi:10.1111/fwb.12031
34. Atanasova N, Recknagel F, Todorovski L, Džeroski S, Kompare B. Computational Assemblage of Ordinary Differential Equations for Chlorophyll-a Using a Lake Process Equation Library and Measured Data of Lake Kasumigaura. In: Recknagel F, editor. Ecological Informatics. Springer; 2006. p. 409-427.
35. Atanasova N, Todorovski L, Džeroski S, Kompare B. Constructing a library of domain knowledge for automated modelling of aquatic ecosystems. Ecological Modelling. 2006;194(1-3):14-36. doi:10. 1016/j.ecolmodel.2005.10.002
36. Storn R, Price K. Differential Evolution-A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces. Journal of Global Optimization. 1997;11(4):341-359. doi:10.1023/A:1008202821328
37. Demšar J. Statistical Comparisons of Classifiers over Multiple Data Sets. Journal of Machine Learning Research. 2006;7:1-30.
38. Iman RL, Davenport JM. Approximations of the critical region of the Friedman statistic. Communications in Statistics-Theory and Methods. 1980;9(6):571-595. doi:10.1080/03610928008827904
39. Friedman M. A comparison of alternative tests of significance for the problem of m rankings. The Annals of Mathematical Statistics. 1940;11(1):86-92. doi:10.1214/aoms/1177731944
40. Nemenyi PB. Distribution-free Multiple Comparisons. Princeton University; 1963.
41. Dunn OJ. Multiple Comparisons Among Means. Journal of the American Statistical Association. 1961;56(293):pp. 52-64. doi:10.1080/01621459.1961.10482090
42. Cerepnalkoski D. Process-Based Models of Dynamical Systems: Representation and Induction. Jožef Stefan International Postgraduate School, Ljubljana; 2013.
43. Kuncheva LI, Whitaker C. Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy. Machine Learning. 2003;51(2):181-207. doi:10.1023/A: 1022859003006
44. Brown G, Wyatt J, Harris R, Yao X. Diversity creation methods: A survey and categorisation. Journal of Information Fusion. 2005;6(1):5-20. doi:10.1016/j.inffus.2004.04.004
45. Whigham PA, Recknagel F. Predicting chlorophyll-a in freshwater lakes by hybridizing process-based models and genetic algorithms. Ecological Modelling. 2001;146(1-3):243-251. doi:10.1016/S0304-3800 (01) 00310-6
46. Cao H, Recknagel F, Cetin L, Zhang B. Process-based simulation library SALMO-OO for lake ecosystems. Part 2: Multi-objective parameter optimization by evolutionary algorithms. Ecological Informatics. 2008;3(2):181-190. doi:10.1016/j.ecoinf.2008.02.001
47. Tanevski J, Todorovski L, Džeroski S. Learning stochastic process-based models of dynamical systems from knowledge and data. BMC Systems Biology. 2016;10(1):30. doi:10.1186/s12918-016-0273-4 PMID: 27005698
48. Todorovski L, D'Ałeroski S, Langley P, Potter C. Using equation discovery to revise an Earth ecosystem model of the carbon net production. Ecological Modelling. 2003;170(2-3):141-154. doi:10.1016/S0304-3800 (03) 00222-9
49. Taškova K, Korošec P, Šilc J, Todorovski L, Džeroski S. Parameter estimation with bio-inspired metaheuristic optimization: modeling the dynamics of endocytosis. BMC Systems Biology. 2011;5(1):1-26.
50. Tanevski J, Todorovski L, Kalaidzidis Y, Džeroski S. Domain-specific model selection for structural identification of the Rab5-Rab7 dynamics in endocytosis. BMC Systems Biology. 2015;9(1):1-17. doi:10.1186/s12918-015-0175-x
51. Liu B, Fang L, Long R, Lan X, Chou KC. iEnhancer-2L: a two-layer predictor for identifying enhancers and their strength by pseudo k-tuple nucleotide composition. Bioinformatics. 2016;32(3):362-369. doi:10.1093/bioinformatics/btv604 PMID: 26476782
52. Chen J, Wang X, Liu B. iMiRNA-SSF: Improving the Identification of MicroRNA Precursors by Combining Negative Sets with Different Distributions. Scientific Reports. 2016;6:19062. doi:10.1038/srep19062 PMID: 26753561
53. Ackermann M, Clément-Ziza M, Michaelson JJ, Beyer A. Teamwork: Improved eQTL Mapping Using Combinations of Machine Learning Methods. PLoSONE. 2012;7(7):1-8. doi:10.1371/journal.pone. 0040916
54. Škerjanec M, Atanasova N, Cerepnalkoski D, Džeroski S, Kompare B. Development of a knowledge library for automated watershed modeling. Environmental Modelling & Software. 2014;54:60-72. doi:10.1016/j.envsoft.2013.12.017