Statistical inference for stochastic simulation models - theory and application

Ecology Letters

Volumn 14, Issue 8, 2011, Pages 816-827

  Hartig, Florian ^a   Calabrese, Justin M ^a,b   Reineking, Björn ^c   Wiegand, Thorsten ^a   Huth, Andreas ^a  

^a HELMHOLTZ CENTRE FOR ENVIRONMENTAL RESEARCH UFZ   (Germany)

^b SMITHSONIAN CONSERVATION BIOLOGY INSTITUTE   (United States)

^c UNIVERSITY OF BAYREUTH   (Germany)

Author keywords

Bayesian statistics; Indirect inference; Intractable likelihood; Inverse modelling; Likelihood approximation; Likelihood free inference; Maximum likelihood; Model selection; Parameter estimation; Stochastic simulation

Indexed keywords

BAYESIAN ANALYSIS; BOUNDARY CONDITION; DATA PROCESSING; ECOLOGICAL APPROACH; ECOLOGICAL MODELING; ECOLOGICAL THEORY; INVERSE ANALYSIS; MAXIMUM LIKELIHOOD ANALYSIS; NUMERICAL MODEL; PARAMETERIZATION; STOCHASTICITY;

ALGORITHM; BAYES THEOREM; COMPUTER SIMULATION; ECOSYSTEM; MONTE CARLO METHOD; NONPARAMETRIC TEST; PROBABILITY; REVIEW; STATISTICAL MODEL;

ALGORITHMS; BAYES THEOREM; COMPUTER SIMULATION; ECOSYSTEM; MARKOV CHAINS; MODELS, STATISTICAL; MONTE CARLO METHOD; STATISTICS, NONPARAMETRIC;

EID: 79960410421     PISSN: 1461023X     EISSN: 14610248     Source Type: Journal    
DOI: 10.1111/j.1461-0248.2011.01640.x     Document Type: Review

References (100)

1. de Aguiar, M.A.M., Baranger, M., Baptestini, E.M., Kaufman, L. & Bar-Yam, Y. (2009). Global patterns of speciation and diversity. Nature, 460, 384-387.
2. Alonso, D., Ostling, A. & Etienne, R.S. (2008). The implicit assumption of symmetry and the species abundance distribution. Ecol. Lett., 11, 93-105.
3. Andrieu, C. & Roberts, G.O. (2009). The pseudo-marginal approach for efficient Monte Carlo computations. Ann. Stat., 37, 697-725.
4. Andrieu, C., de Freitas, N., Doucet, A. & Jordan, M.I. (2003). An introduction to MCMC for machine learning. Mach. Learn., 50, 5-43.
5. Arita, H.T. & Vázquez-Domínguez, E. (2008). The tropics: cradle, museum or casino? A dynamic null model for latitudinal gradients of species diversity. Ecol. Lett., 11, 653-663.
6. Arulampalam, M.S., Maskell, S., Gordon, N. & Clapp, T. (2002). A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal. Process., 50, 174-188.
7. Bazin, E., Dawson, K.J. & Beaumont, M.A. (2010). Likelihood-free inference of population structure and local adaptation in a Bayesian hierarchical model. Genetics, 185, 587-602.
8. Beaumont, M.A. (2003). Estimation of population growth or decline in genetically monitored populations. Genetics, 164, 1139-1160.
9. Beaumont, M.A. (2010). Approximate Bayesian computation in evolution and ecology. Ann. Rev. Ecol. Evol. Syst., 41, 379-406.
10. Beaumont, M.A., Zhang, W. & Balding, D.J. (2002). Approximate Bayesian computation in population genetics. Genetics, 162, 2025-2035.
11. Beaumont, M.A., Cornuet, J.M., Marin, J.M. & Robert, C.P. (2009). Adaptive approximate Bayesian computation. Biometrika, 96, 983-990.
12. Berkley, H.A., Kendall, B.E., Mitarai, S. & Siegel, D.A. (2010). Turbulent dispersal promotes species coexistence. Ecol. Lett., 13, 360-371.
13. Bertorelle, G., Benazzo, A. & Mona, S. (2010). ABC as a flexible framework to estimate demography over space and time: some cons, many pros. Mol. Ecol., 19, 2609-2625.
14. Besag, J. (1974). Spatial interaction and the statistical analysis of lattice systems. J. R. Stat. Soc. B Methodol., 36, 192-236.
15. Beven, K. (2006). A manifesto for the equifinality thesis. J. Hydrol., 320, 18-36.
16. Blazkova, S. & Beven, K. (2009). A limits of acceptability approach to model evaluation and uncertainty estimation in flood frequency estimation by continuous simulation: Skalka catchment, Czech Republic. Water Resour. Res., 45, W00B16.
17. Blum, M.G.B. (2010). Approximate Bayesian computation: a nonparametric perspective. J. Am. Stat. Assoc., 105, 1178-1187.
18. Blum, M.G.B. & François, O. (2010). Non-linear regression models for approximate bayesian computation. Stat. Comput., 20, 63-73.
19. Bridle, J.R., Polechová, J., Kawata, M. & Butlin, R.K. (2010). Why is adaptation prevented at ecological margins? New insights from individual-based simulations. Ecol. Lett., 13, 485-494.
20. Chave, J., Muller-Landau, H.C. & Levin, S.A. (2002). Comparing classical community models: theoretical consequences for patterns of diversity. Am. Nat., 159, 1-23.
21. Clark, J.S. & Gelfand, A.E. (2006). A future for models and data in environmental science. Trends Ecol. Evol., 21, 375-380.
22. Concordet, D. & Nunez, O. (2002). A simulated pseudo-maximum likelihood estimator for nonlinear mixed models. Comput. Stat. Data Anal., 39, 187-201.
23. Couzin, I.D., Krause, J., Franks, N.R. & Levin, S.A. (2005). Effective leadership and decision-making in animal groups on the move. Nature, 433, 513-516.
24. Cowles, M.K. & Carlin, B.P. (1996). Markov chain Monte Carlo convergence diagnostics: a comparative review. J. Am. Stat. Assoc., 91, 883-904.
25. Csilléry, K., Blum, M.G.B., Gaggiotti, O.E. & François, O. (2010). Approximate Bayesian Computation (ABC) in practice. Trends Ecol. Evol., 25, 410-418.
26. Dempster, A.P., Laird, N.M., Rubin, D.B. (1977). Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. B Methodol., 39, 1-38.
27. Didelot, X., Everitt, R.G., Johansen, A.M. & Lawson, D.J. (2011). Likelihood-free estimation of model evidence. Bayesian Anal., 6, 1-28.
28. Diggle, P.J. & Gratton, R.J. (1984). Monte Carlo methods of inference for implicit statistical models. J. R. Stat. Soc. B Methodol., 46, 193-227.
29. Dislich, C., Günter, S., Homeier, J., Schröder, B. & Huth, A. (2009). Simulating forest dynamics of a tropical montane forest in South Ecuador. Erdkunde, 63, 347-364.
30. Drovandi, C.C., Pettitt, A.N. & Faddy, M.J. (2011). Approximate Bayesian computation using indirect inference. J. R. Stat. Soc. Ser. C. (Appl. Stat.), 60, 317-337.
31. Duboz, R., Versmisse, D., Travers, M., Ramat, E. & Shin, Y.J. (2010). Application of an evolutionary algorithm to the inverse parameter estimation of an individual-based model. Ecol. Model., 221, 840-849.
32. Ellison, A.M. (2004). Bayesian inference in ecology. Ecol. Lett., 7, 509-520.
33. Fearnhead, P. & Prangle, D. (2010). Semi-automatic Approximate Bayesian Computation. arXiv:1004.1112v1.
34. Fisher, R.A. (1922). On the mathematical foundations of theoretical statistics. Phil. Trans. R. Soc. A., 222, 309-368.
35. François, O., Blum, M.G.B., Jakobsson, M. & Rosenberg, N.A. (2008). Demographic history of European populations of Arabidopsis thaliana. PLoS Genet., 4, e1000075.
36. Fu, Y.X. & Li, W.H. (1997). Estimating the age of the common ancestor of a sample of DNA sequences. Mol. Biol. Evol., 14, 195-199.
37. Gordon, N.J., Salmond, D.J. & Smith, A. (1993). Novel approach to nonlinear/non-Gaussian Bayesian state estimation. IEE. Proc. F, 140, 107-113.
38. Gourieroux, C., Monfort, A. & Renault, E. (1993). Indirect inference. J. Appl. Econ., 8, S85-S118.
39. Grimm, V. & Railsback, S.F. (2005). Individual-Based Modeling and Ecology. Princeton University Press, Princeton, NJ.
40. Grimm, V., Revilla, E., Berger, U., Jeltsch, F., Mooij, W.M., Railsback, S.F. et al. (2005). Pattern-oriented modeling of agent-based complex systems: lessons from ecology. Science, 310, 987-991.
41. Heggland, K. & Frigessi, A. (2004). Estimating functions in indirect inference. J. R. Stat. Soc. B Methodol., 66, 447-462.
42. Henderson, D.A., Boys, R.J., Krishnan, K.J., Lawless, C. & Wilkinson, D.J. (2009). Bayesian emulation and calibration of a stochastic computer model of mitochondrial DNA deletions in Substantia Nigra neurons. J. Am. Stat. Assoc., 104, 76-87.
43. Holmes, E.E. (2004). Beyond theory to application and evaluation: diffusion approximations for population viability analysis. Ecol. Appl., 14, 1272-1293.
44. Huth, A. & Ditzer, T. (2000). Simulation of the growth of a lowland Dipterocarp rain forest with FORMIX3. Ecol. Model., 134, 1-25.
45. Huth, A. & Wissel, C. (1992). The simulation of the movement of fish schools. J. Theor. Biol., 156, 365-385.
46. Hyrien, O., Mayer-Pröschel, M., Noble, M. & Yakovlev, A. (2005). A stochastic model to analyze clonal data on multi-type cell populations. Biometrics, 61, 199-207.
47. Irony, T.Z. & Singpurwalla, N.D. (1997). Non-informative priors do not exist - a dialogue with José M. Bernardo. J. Stat. Plan. Infer., 65, 159-177.
48. Jabot, F. (2010). A stochastic dispersal-limited trait-based model of community dynamics. J. Theor. Biol., 262, 650-661.
49. Jabot, F. & Chave, J. (2009). Inferring the parameters of the neutral theory of biodiversity using phylogenetic information and implications for tropical forests. Ecol. Lett., 12, 239-248.
50. Jiang, W. & Turnbull, B. (2004). The indirect method: inference based on intermediate statistics - a synthesis and examples. Stat. Sci., 19, 239-263.
51. Johnson, J.B. & Omland, K.S. (2004). Model selection in ecology and evolution. Trends Ecol. Evol., 19, 101-108.
52. Joyce, P. & Marjoram, P. (2008). Approximately sufficient statistics and Bayesian computation. Stat. Appl. Genet. Mo. B., 7, 26.
53. Kass, R.E. & Wasserman, L. (1996). The selection of prior distributions by formal rules. J. Am. Stat. Assoc., 91, 1343-1370.
54. Komuro, R., Ford, E.D. & Reynolds, J.H. (2006). The use of multi-criteria assessment in developing a process model. Ecol. Model., 197, 320-330.
55. Kramer-Schadt, S., Revilla, E., Wiegand, T. & Breitenmoser, U. (2004). Fragmented landscapes, road mortality and patch connectivity: modelling influences on the dispersal of Eurasian lynx. J. Appl. Ecol., 41, 711-723.
56. Laroque, G. & Salanié, B. (1993). Simulation-based estimation of models with lagged latent variables. J. Appl. Econ., 8, S119-S133.
57. Leuenberger, C. & Wegmann, D. (2010). Bayesian computation and model selection without likelihoods. Genetics, 184, 243-252.
58. Liu, Y., Freer, J., Beven, K. & Matgen, P. (2009). Towards a limits of acceptability approach to the calibration of hydrological models: extending observation error. J. Hydrol., 367, 93-103.
59. Lopes, J. & Boessenkool, S. (2010). The use of approximate Bayesian computation in conservation genetics and its application in a case study on yellow-eyed penguins. Conserv. Genet., 11, 421-433.
60. Marjoram, P., Molitor, J., Plagnol, V. & Tavare, S. (2003). Markov chain Monte Carlo without likelihoods. Proc. Natl Acad. Sci. U S A, 100, 15324-15328.
61. Martínez, I., Wiegand, T., Camarero, J.J., Batllori, E. & Gutiérrez, E. (2011). Disentangling the formation of contrasting tree line physiognomies combining model selection and Bayesian parameterization for simulation models. Am. Nat., 5, E136-E152.
62. McFadden, D. (1989). A method of simulated moments for estimation of discrete response models without numerical integration. Econometrica, 5, 995-1026.
63. Nathan, R., Safriel, U.N. & Noy-Meir, I. (2001). Field validation and sensitivity analysis of a mechanistic model for tree seed dispersal by wind. Ecology, 82, 374-388.
64. O'Neill, P.D., Balding, D.J., Becker, N.G., Eerola, M. & Mollison, D. (2000). Analyses of infectious disease data from household outbreaks by Markov chain Monte Carlo methods. J. R. Stat. Soc. Ser. C. Appl., 49, 517-542.
65. Patterson, T.A., Thomas, L., Wilcox, C., Ovaskainen, O. & Matthiopoulos, J. (2008). State-space models of individual animal movement. Trends Ecol. Evol., 23, 87-94.
66. Pawitan, Y. (2001). In all Likelihood: Statistical Modelling and Inference Using Likelihood. Oxford University Press, Oxford, NY.
67. Plummer, M. (2008). Penalized loss functions for Bayesian model comparison. Biostatistics, 9, 523-539.
68. Pritchard, J.K., Seielstad, M.T., Perez-Lezaun, A. & Feldman, M.W. (1999). Population growth of human Y chromosomes: a study of Y chromosome microsatellites. Mol. Biol. Evol., 16, 1791-1798.
69. Ratmann, O., Jørgensen, O., Hinkley, T., Stumpf, M., Richardson, S. & Wiuf, C. (2007). Using likelihood-free inference to compare evolutionary dynamics of the protein networks of H. pylori and P. falciparum. PLoS Comp. Biol., 3, e230.
70. Refsgaard, J., der Sluijs, J., Højberg, A. & Vanrolleghem, P. (2007). Uncertainty in the environmental modelling process - a framework and guidance. Environ. Model. Softw., 22, 1543-1556.
71. Riley, S., Donnelly, C.A. & Ferguson, N.M. (2003). Robust parameter estimation techniques for stochastic within-host macroparasite models. J. Theor. Biol., 225, 419-430.
72. Robert, C.P., Cornuet, J.M., Marin, J.M. & Pillai, N. (2011). Lack of confidence in ABC model choice. arXiv:1102.4432v3.
73. Rossmanith, E., Blaum, N., Grimm, V. & Jeltsch, F. (2007). Pattern-oriented modelling for estimating unknown pre-breeding survival rates: the case of the Lesser Spotted Woodpecker (Picoides minor). Biol. Conserv., 135, 555-564.
74. Ruokolainen, L., Ranta, E., Kaitala, V. & Fowler, M.S. (2009). When can we distinguish between neutral and non-neutral processes in community dynamics under ecological drift? Ecol. Lett., 12, 909-919.
75. Schröder, B. & Seppelt, R. (2006). Analysis of pattern-process interactions based on landscape models-overview, general concepts, and methodological issues. Ecol. Model., 199, 505-516.
76. Sims, D.W., Southall, E.J., Humphries, N.E., Hays, G.C., Bradshaw, C.J.A., Pitchford, J.W. et al. (2008). Scaling laws of marine predator search behaviour. Nature, 451, 1098-1102.
77. Sisson, S.A., Fan, Y. & Tanaka, M.M. (2007). Sequential Monte Carlo without likelihoods. Proc. Natl Acad. Sci. U S A, 104, 1760-1765.
78. Smith, P., Beven, K.J. & Tawn, J.A. (2008). Informal likelihood measures in model assessment: theoretic development and investigation. Adv. Water Resour., 31, 1087-1100.
79. Sousa, V.C., Fritz, M., Beaumont, M.A. & Chikhi, L. (2009). Approximate Bayesian computation without summary statistics: the case of admixture. Genetics, 181, 1507-1519.
80. Spiegelhalter, D.J., Best, N.G., Carlin, B.P. & van der Linde, A. (2002). Bayesian measures of model complexity and fit. J. R. Stat. Soc. B, 64, 583-639.
81. Swanack, T.M., Grant, W.E. & Forstner, M.R. (2009). Projecting population trends of endangered amphibian species in the face of uncertainty: a pattern-oriented approach. Ecol. Model., 220, 148-159.
82. Tavare, S., Balding, D.J., Griffiths, R.C. & Donnelly, P. (1997). Inferring coalescence times from DNA sequence data. Genetics, 145, 505-518.
83. Thornton, K. & Andolfatto, P. (2006). Approximate Bayesian inference reveals evidence for a recent, severe bottleneck in a Netherlands population of Drosophila melanogaster. Genetics, 172, 1607-1619.
84. Tian, T., Xu, S., Gao, J. & Burrage, K. (2007). Simulated maximum likelihood method for estimating kinetic rates in gene expression. Bioinformatics, 23, 84-91.
85. Toni, T. & Stumpf, M.P.H. (2010). Simulation-based model selection for dynamical systems in systems and population biology. Bioinformatics, 26, 104-110.
86. Toni, T., Welch, D., Strelkowa, N., Ipsen, A. & Stumpf, M.P.H. (2009). Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. J. R. Soc. Interface, 6, 187-202.
87. Topping, C.J., Høye, T.T., Odderskær, P. & Aebischer, N.J. (2010). A pattern-oriented modelling approach to simulating populations of grey partridge. Ecol. Model., 221, 729-737.
88. Van Oijen, M., Rougier, J. & Smith, R. (2005). Bayesian calibration of process-based forest models: bridging the gap between models and data. Tree Physiol., 25, 915-927.
89. Wegmann, D., Leuenberger, C. & Excoffier, L. (2009). Efficient approximate Bayesian computation coupled with Markov chain Monte Carlo without likelihood. Genetics, 182, 1207-1218.
90. Wiegand, T., Jeltsch, F., Hanski, I. & Grimm, V. (2003). Using pattern-oriented modeling for revealing hidden information: a key for reconciling ecological theory and application. Oikos, 100, 209-222.
91. Wiegand, T., Knauer, F., Kaczensky, P. & Naves, J. (2004a). Expansion of brown bears (Ursus arctos) into the Eastern alps: a spatially explicit population model. Biodivers. Conserv., 13, 79-114.
92. Wiegand, T., Revilla, E. & Knauer, F. (2004b). Dealing with uncertainty in spatially explicit population models. Biodivers. Conserv., 13, 53-78.
93. Wikle, C.K. (2003). Hierarchical Bayesian models for predicting the spread of ecological processes. Ecology, 84, 1382-1394.
94. Wilkinson, R.D. (2008). Approximate Bayesian computation (ABC) gives exact results under the assumption of model error. arXiv:0811.3355v1.
95. Wilkinson, D.J. (2009). Stochastic modelling for quantitative description of heterogeneous biological systems. Nat. Rev. Genet., 10, 122-133.
96. Wilkinson, R.D., Steiper, M.E., Soligo, C., Martin, R.D., Yang, Z. & Tavaré, S. (2011). Dating primate divergences through an integrated analysis of palaeontological and molecular data. Syst. Biol., 60, 16-31.
97. Winkler, E. & Heinken, T. (2007). Spread of an ant-dispersed annual herb: an individual-based simulation study on population development of Melampyrum pratense L. Ecol. Model., 203, 424-438.
98. Wood, S.N. (2010). Statistical inference for noisy nonlinear ecological dynamic systems. Nature, 466, 1102-1104.
99. Zinck, R.D. & Grimm, V. (2008). More realistic than anticipated: a classical forest-fire model from statistical physics captures real fire shapes. Open Ecol. J., 6, 8-13.
100. Zurell, D., Berger, U., Cabral, J.S., Jeltsch, F., Meynard, C.N., Münkemüller, T. et al. (2009). The virtual ecologist approach: simulating data and observers. Oikos, 119, 622-635.