Monte Carlo state-space likelihoods by weighted posterior kernel density estimation

Journal of the American Statistical Association

Volumn 99, Issue 466, 2004, Pages 523-536

  De Valpine, Perry ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Importance sampling; Monte Carlo expectation maximization; Monte Carlo kernel likelihood; Monte Carlo likelihood ratio; Population dynamics; State space model

Indexed keywords

EID: 2942538599     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/016214504000000476     Document Type: Article

References (88)

1. Berzuini, C., Best, N. G., Gilks, W. R., and Larizza, C. (1997), "Dynamic Conditional Independence Models and Markov Chain Monte Carlo Methods," Journal of the American Statistical Association, 92, 1403-1412.
2. Berzuini, C., and Gilks, W. (2001), "RESAMPLE-MOVE Filtering With Cross-Model Jumps," in Sequential Monte Carlo Methods in Practice, eds. A. Doucet, N. de Freitas, and N. Gordon, New York: Springer, pp. 117-138.
3. Bjørnstad, O. N., Fromentin, J.-M., Stenseth, N. C., and Gjosaeter, J. (1999), "Cycles and Trends in Cod Populations," Proceedings of the National Academy of Sciences USA, 96, 5066-5071.
4. Bjørnstad, O. N., Sait, S. M., Stenseth, N. C., Thompson, D. J., and Begon, M. (2001), "The Impact of Specialized Enemies on the Dimensionality of Host Dynamics," Nature, 409, 1001-1006.
5. Booth, J. G., and Hobert, J. P. (1999), "Maximizing Generalized Linear Mixed Model Likelihoods With an Automated Monte Carlo EM Algorithm," Journal of the Royal Statistical Society, Ser. B, 61, 265-285.
6. Carlin, B. P., Poison, N. G., and Stoffer., D. S. (1992), "A Monte Carlo Approach to Nonnormal and Nonlinear State-Space Modeling," Journal of the American Statistical Association, 87, 493-500.
7. Carpenter, S. R., and Kitchell, J. F. (1993), The Trophic Cascade in Lakes, Cambridge, U.K.: Cambridge University Press.
8. Caswell, H. (2001), Matrix Population Models: Construction, Analysis, and Interpretation (2nd ed.), Sunderland, MA: Sinauer Associates.
9. Chan, K., and Ledolter, J. (1995), "Monte Carlo EM Estimation for Time Series Models Involving Counts," Journal of the American Statistical Association, 90, 242-252.
10. Chen, M.-H. (1994), "Importance-Weighted Marginal Bayesian Posterior Density Estimation," Journal of the American Statistical Association, 89, 818-824.
11. Clayton, D. (1996), "Generalized Linear Mixed Models," in Markov Chain Monte Carlo in Practice, eds. W. Gilks, S. Richardson, and D. Spiegelhalter, Boca Raton, FL: Chapman & Hall/CRC, pp. 275-301.
12. Costantino, R. F., Desharnais, R. A., Cushing, J. M., and Dennis, B. (1997), "Chaotic Dynamics in an Insect Population," Science, 275, 389-391.
13. Dennis, B., Desharnais, R. A., Cushing, J. M., and Costantino, R. (1995), "Non-linear Demographic Dynamics: Mathematical Models, Statistical Methods, and Biological Experiments," Ecological Monographs, 65, 261-281.
14. Dennis, B., Desharnais, R. A., Cushing, J. M., Henson, S. M., and Costantino, R. F. (2001), "Estimating Chaos and Complex Dynamics in an Insect Population," Ecological Monographs, 71, 277-303.
15. de Valpine, P. (2003), "Better Inferences From Population Dynamics Experiments Using Monte Carlo State-Space Likelihood Methods," Ecology, 84, 3064-3077.
16. Doucet, A., de Freitas, N., and Gordon, N. (2001a), "An Introduction to Sequential Monte Carlo Methods," in Sequential Monte Carlo Methods in Practice, eds. A. Doucet, N. de Freitas, and N. Gordon, New York: Springer-Verlag, pp. 3-14.
17. _ (eds.) (2001b), Sequential Monte Carlo Methods in Practice, New York: Springer-Verlag.
18. Downing, A. L., and Leibold, M. A. (2002), "Ecosystem Consequences of Species Richness and Composition in Pond Food Webs," Nature, 416, 837-839.
19. Durbin, J., and Koopman, S. J. (1997), "Monte Carlo Maximum Likelihood Estimation for Non-Gaussian State-Space Models," Biometrika, 84, 669-684.
20. _ (2000), "Time Series Analysis of Non-Gaussian Observations Based on State-Space Models From Both Classical and Bayesian Perspectives," Journal of the Royal Statistical Society, Ser. B, 62, 3-56.
21. Durham, G. B., and Gallant, R. (2002), "Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes," Journal of Business & Economic Statistics, 20, 297-316.
22. Efron, B., and Tibshirani, R. J. (1993), An Introduction to the Bootstrap, New York: Chapman & Hall.
23. Ellner, S. P., McCauley, E., Kendall, B. E., Briggs, C. J., Hosseini, P. R., Wood, S. N., Janssen, A., Sabelis, M. W., Turchin, P., Nisbet, R. M., and Murdoch, W. W. (2001), "Habitat Structure and Population Persistence in an Experimental Community," Nature, 412, 538-543.
24. Gause, G. (1934), The Struggle for Existence, Baltimore, MD: Williams & Wilkins.
25. Geyer, C. J. (1994), "Estimating Normalizing Constants and Reweighting Mixtures in Markov Chain Monte Carlo," Technical Report 568, University of Minnesota, School of Statistics.
26. _ (1996), "Estimation and Optimization of Functions," in Markov Chain Monte Carlo in Practice, eds. W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, New York: Chapman & Hall, pp. 241-258.
27. Geyer, C. J., and Thompson, E. A. (1992), "Constrained Monte Carlo Maximum Likelihood for Dependent Data," Journal of the Royal Statistical Society, Ser. B, 54, 657-699.
28. Gibson, G., Gilligan, C., and Kleczkowski, A. (1999), "Predicting Variability in Biological Control of a Plant-Pathogen System Using Stochastic Models," Proceedings of the Royal Society of London, Ser. B, 266, 1743-1753.
29. Gilks, W. R., and Berzuini, C. (2001), "Following a Moving Target-Monte Carlo Inference for Dynamic Bayesian Models," Journal of the Royal Statistical Society, Ser. B, 63, 127-146.
30. Givens, G. H., and Raftery, A. E. (1996), "Local Adaptive Importance Sampling for Multivariate Densities With Strong Nonlinear Relationships," Journal of the American Statistical Association, 433, 132-141.
31. Gordon, N. J., Salmond, D. J., and Smith, A. F. M. (1993), "Novel Approach to Nonlinear Non-Gaussian Bayesian State Estimation," IEE Proceedings F, 140, 107-113.
32. p Error in Mode Estimation," The Annals of Statistics, 23, 2264-2284.
33. Gurney, W., Blythe, S., and Nisbet, R. (1980), "Nicholson's Blowflies Revisited," Nature, 287, 17-21.
34. Gurney, W., and Nisbet, R. (1998), Ecological Dynamics, New York: Oxford University Press.
35. Gurney, W., Nisbet, R., and Lawton, J. (1983), "The Systematic Formulation of Tractable Single-Species Population Models Incorporating Age Structure," Journal of Animal Ecology, 52, 479-495.
36. Hairston, N. G., Sr. (1989), Ecological Experiments: Purpose, Design, and Execution, Cambridge, U.K.: Cambridge University Press.
37. Holyoak, M. (2000), "Effects of Nutrient Enrichment on Predator-Prey Metapopulation Dynamics," Journal of Animal Ecology, 69, 985-997.
38. Huffaker, C. B. (1958), "Experimental Studies on Predation: Dispersion Factors and Predator-Prey Oscillations," Hilgardia, 27, 343-383.
39. Hürzeler, M., and Künsch, H. R. (1998), "Monte Carlo Approximations for General State-Space Models," Journal of Computational and Graphical Statistics, 1, 175-193.
40. _ (2001), "Approximating and Maximising the Likelihood for a General State-Space Model," in Sequential Monte Carlo Methods in Practice, eds. A. Doucet, N. de Freitas, and N. Gordon, New York: Springer-Verlag, pp. 159-175.
41. Ives, A. R., Carpenter, S. R., and Dennis, B. (1999), "Community Interaction Webs and Zooplankton Responses to Planktivory Manipulations," Ecology, 80, 1405-1421.
42. Jones, M., and Signorini, D. (1997), "A Comparison of Higher-Order Bias Kernel Density Estimators," Journal of the American Statistical Association, 92, 1063-1073.
43. Karban, R., English-Loeb, G., and Hougen-Eitzman, D. (1997), "Mite Vaccinations for Sustainable Management of Spider Mites in Vineyards," Ecological Applications, 7, 183-193.
44. Kaunzinger, C. M. K., and Morin, P. J. (1998), "Productivity Controls Food-Chain Properties in Microbial Communities," Nature, 395, 495-497.
45. Kitagawa, G. (1996), "Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State-Space Models," Journal of Computational and Graphical Statistics, 5, 1-25.
46. _ (1998), "A Self-Organizing State-Space Model," Journal of the American Statistical Association, 93, 1203-1215.
47. Kitagawa, G., and Sato, S. (2001), "Monte Carlo Smoothing and Self-Organizing State-Space Model," in Sequential Monte Carlo Methods in Practice, eds. A. Doucet, N. de Freitas, and N. Gordon, New York: Springer, pp. 177-195.
48. Klug, J. L., Fischer, J., Ives, A., and Dennis, B. (2000), "Compensatory Dynamics in Planktonic Community Responses to pH Perturbations," Ecology, 81, 387-398.
49. Kunsch, H. R. (1989), "The Jackknife and the Bootstrap for General Stationary Observations," The Annals of Statistics, 17, 1217-1241.
50. Levine, R. A., and Casella, G. (2001), "Implementations of the Monte Carlo EM Algorithm," Journal of Computational and Graphical Statistics, 10, 422-439.
51. Liu, J., and West, M. (2001), "Combined Parameter and State Estimation in Simulation-Based Filtering," in Sequential Monte Carlo Methods in Practice, eds. A. Doucet, N. de Freitas, and N. Gordon, New York: Springer-Verlag, pp. 197-223.
52. Liu, J. S., and Chen, R. (1998), "Sequential Monte Carlo Methods for Dynamic Systems," Journal of the American Statistical Association, 93, 1032-1044.
53. Liu, J. S., and Sabatti, C. (2000), "Generalised Gibbs Sampler and Multigrid Monte Carlo for Bayesian Computation," Biometrika, 87, 353-369.
54. Liu, J. S., Wong, W. H., and Kong, A. (1994), "Covariance Structure of the Gibbs Sampler With Applications to the Comparisons of Estimators and Augmentation Schemes," Biometrika, 81, 27-40.
55. Luckinbill, L. S. (1973), "Coexistence in Laboratory Populations of Paramecium Aurelia and Its Predator Didinium Nasutum," Ecology, 54, 1320-1327.
56. McCauley, E., Nisbet, R. M., Murdoch, W. W., de Roos, A. M., and Gurney, W. S. C. (1999), "Large-Amplitude Cycles of Daphnia and Its Algal Prey in Enriched Environments," Nature, 402, 653-656.
57. McCulloch, C. E. (1997), "Maximum Likelihood Algorithms for Generalized Linear Mixed Models," Journal of the American Statistical Association, 92, 162-170.
58. Metz, J., and Diekmann, O. (eds.) (1986), The Dynamics of Physiologically Structured Populations, Berlin: Springer-Verlag.
59. Meyer, R., and Millar, R. B. (1999), "Bayesian Stock Assessment Using a State-Space Implementation of the Delay Difference Model," Canadian Journal of Fisheries and Aquatic Sciences, 56, 37-52.
60. Mignani, S., and Rosa, R. (1995), "The Moving Block Bootstrap to Assess the Accuracy of Statistical Estimates of Ising Model Simulations," Computer Physics Communications, 92, 203-213.
61. Millar, R. B., and Meyer, R. (2000), "Non-Linear State Space Modelling of Fisheries Biomass Dynamics by Using Metropolis-Hastings Within-Gibbs Sampling," Applied Statistics, 49, 327-342.
62. Murdoch, W., Nisbet, R. M., McCauley, E., de Roos, A. M., and Gurney, W. S. C. (1998), "Plankton Abundance and Dynamics Across Nutrient Levels: Tests of Hypotheses," Ecology, 79, 1339-1356.
63. Naeem, S., Thompson, L. J., Lawler, S. P., Lawton, J. H., and Woodfin, R. M. (1994), "Declining Biodiversity Can Alter the Performance of Ecosystems," Nature, 368, 734-737.
64. Nicholson, A., and Bailey, V. (1935), "The Balance of Animal Populations, Part I," Proceedings of the Zoological Society, London, 3, 551-598.
65. Pace, M. L., Cole, J. J., Carpenter, S. R., and Kitchell, J. F. (1999), "Trophic Cascades Revealed in Diverse Ecosystems," Trends in Ecology and Evolution, 14, 483-488.
66. Pitt, M. K., and Shephard, N. (1999), "Filtering via Simulation: Auxiliary Particle Filters," Journal of the American Statistical Association, 94, 590-599.
67. Press, W. H., Teukolsky, S. A., Vetterling, W. T., and Flannery, B. P. (1992), Numerical Recipes in C: The Art of Scientific Computing (2nd ed.), Cambridge, U.K.: Cambridge University Press.
68. Resetarits, W. J., and Bernardo, J. (eds.) (1998), Experimental Ecology: Issues and Perspectives, New York: Oxford University Press.
69. Robert, C. P., and Casella, G. (1999), Monte Carlo Statistical Methods, New York: Springer-Verlag.
70. Roberts, G. O., and Sahu, S. (1997), "Updating Schemes, Correlation Structure, Blocking and Parameterization for the Gibbs Sampler," Journal of the Royal Statistical Society, Ser. B, 59, 291-317.
71. Romano, J. (1988), "On Weak Convergence and Optimality of Kernel Density Estimates of the Mode," The Annals of Statistics, 16, 629-647.
72. Rosenheim, J. A. (2001), "Source-Sink Dynamics for a Generalist Insect Predator in Habitats With Strong Higher-Order Predation," Ecological Monographs, 71, 93-116.
73. Rosenheim, J. A., Kaya, H. K., Ehler, L. E., Marois, J. J., and Jaffee, B. A. (1995), "Intraguild Predation Among Biological Control Agents: Theory and Evidence," Biological Control, 5, 303-335.
74. Scott, D. (1992), Multivariate Density Estimation, New York: Wiley.
75. Severini, T. A. (2000), Likelihood Methods in Statistics, New York: Oxford University Press.
76. Shephard, N., and Pitt, M. K. (1997), "Likelihood Analysis of Non-Gaussian Measurement Time Series," Biometrika, 84, 653-667.
77. Silverman, B. (1986), Density Estimation for Statistics and Data Analysis, New York: Chapman & Hall.
78. Snyder, W. E., and Ives, A. R. (2001), "Generalist Predators Disrupt Biological Control by a Specialist Parasitoid," Ecology, 82, 705-716.
79. Stavropoulos, P., and Titterington, D. M. (2001), "Improved Particle Filters and Smoothing," in Sequential Monte Carlo Methods in Practice, eds. A. Doucet, N. de Freitas, and N. Gordon, New York: Springer-Verlag, pp. 295-317.
80. Strong, D. R., Whipple, A. V., Child, A. L., and Dennis, B. (1999), "Model Selection for a Subterranean Trophic Cascade: Root-Feeding Caterpillars and Entomopathogenic Nematodes," Ecology, 80, 2750-2761.
81. Stuart, A., and Ord, J. K. (1994), Kendall's Advanced Theory of Statistics: Distribution Theory (6th ed.), Vol. 1, London: Edward Arnold.
82. Tanizaki, H., and Mariano, R. S. (1998), "Nonlinear and Non-Gaussian State Space Modeling With Monte Carlo Simulations," Journal of Econometrics, 83, 263-290.
83. Tuljapurkar, S., and Caswell, H. (eds.) (1997), Structured-Population Models in Marine, Terrestrial, and Freshwater Systems, New York: Chapman & Hall.
84. Underwood, A. (1997), Experiments in Ecology; Their Logical Design and Interpretation Using Analysis of Variance, Cambridge, U.K.: Cambridge University Press.
85. van der Vaart, A. W. (1998), Asymptotic Statistics, Cambridge, U.K.: Cambridge University Press.
86. Wei, G. C. G., and Tanner, M. A. (1990), "A Monte Carlo Implementation of the EM Algorithm and the Poor Man's Data Augmentation Algorithms," Journal of the American Statistical Association, 85, 699-704.
87. West, M. (1993), "Approximating Posterior Distributions by Mixture," Journal of the Royal Statistical Society, Ser. B, 55, 409-422.
88. Wootton, J. T. (1994), "The Nature and Consequences of Indirect Effects in Ecological Communities," Annual Review of Ecology and Systematics, 25, 443-466.