A sequential Monte Carlo algorithm to incorporate model uncertainty in Bayesian sequential design

Journal of Computational and Graphical Statistics

Volumn 23, Issue 1, 2014, Pages 3-24

  Drovandi, Christopher C ^a   McGree, James M ^a   Pettitt, Anthony N ^a  

^a QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Entropy; Model discrimination; Mutual information; Optimal design; Particle filter

Indexed keywords

EID: 84901750751     PISSN: 10618600     EISSN: 15372715     Source Type: Journal    
DOI: 10.1080/10618600.2012.730083     Document Type: Article

References (52)

1. Amzal, B., Bois, F. Y., Parent, E., and Robert, C. P. (2006), "Bayesian-Optimal Design via Interacting Particle Systems, " Journal of the American Statistical Association, 101, 773-785. [21]
2. Atkinson, A. C. (2008), "DT-Optimum Designs for Model Discrimination and Parameter Estimation, " Journal of Statistical Planning and Inference, 138, 56-64. [4]
3. Atkinson, A. C., and Fedorov, V. V. (1975a), "The Design of Experiments for Discriminating Between Two Rival Models, " Biometrika, 62, 57-70. [4]
4. Atkinson, A. C., and Fedorov, V. V. (1975b), "Optimal Design: Experiments for Discriminating Between Several Models, " Biometrika, 62, 289-303. [4]
5. Baumann, F., Henderson, R. D., Ridall, P. G., Pettitt, A. N., and McCombe, P. A. (2012), "Quantitative Studies of LowerMotor Neuron Degeneration in SubjectsWith Amyotrophic Lateral Sclerosis: Evidence for Exponential Decay of Motor Unit Numbers and Greatest Rate of Loss at the Site of Onset, " Clinical Neurophysiology, 123, 2092-2098. [17,18]
6. Bernardo, J. M., and Smith, A. F. M. (2000), Bayesian Theory, Chichester: Wiley. [5]
7. Bornkamp, B., Bretz, F., Dette, H., and Pinheiro, J. (2011), "Response-Adaptive Dose-Finding Under Model Uncertainty, " The Annals of Applied Statistics, 5, 1611-1631. [4,21]
8. Borth, D. M. (1975), "A Total Entropy Criterion for the Dual Problem of Model Discrimination and Parameter Estimation, " Journal of the Royal Statistical Society, Series B, 37, 77-87. [5,5,11,21]
9. Box, G. E. P., and Hill, W. J. (1967), "Discrimination Among Mechanistic Models, " Technometrics, 9, 57-71. [5,11]
10. Cavagnaro, D. R., Myung, J. I., Pitt, M. A., and Kujala, J. V. (2010), "Adaptive Design Optimization: A Mutual Information-Based Approach to Model Discrimination in Cognitive Science, " Neural Computation, 22, 887-905. [5,5,10,11,13]
11. Chopin, N. (2002), "A Sequential Particle Filter Method for Static Models, " Biometrika, 89, 539-551. [6,7]
12. Clarke, G., Collins, R. A., Leavitt, B. R., Andrews, D. F., Hayden, M. R., Lumsden, C. J., and McInnes, R. R. (2000), "A One-Hit Model of Cell Death in Inherited Neuronal Degenerations, " Nature, 406, 195-199. [17,18]
13. Clyde, M., and Chaloner, K. (1996), "The Equivalence of Constrained andWeighted Designs in Multiple Objective Design Problems, " Journal of the American Statistical Association, 91, 1236-1244. [21]
14. Del Moral, P., Doucet, A., and Jasra, A. (2006), "Sequential Monte Carlo Samplers, " Journal of the Royal Statistical Society, Series B, 68, 411-436. [6,7]
15. Dette, H. (1990), "A Generalization of D-and D1-Optimal Designs in Polynomial Regression, " The Annals of Statistics, 18, 1784-1804. [3]
16. Dette, H. (1995), "Optimal Designs for Identifying theDegree of a Polynomial Regression, " The Annals of Statistics, 23, 1248-1266. [4]
17. Dette, H., Bretz, F., Pepelyshev, A., and Pinheiro, J. (2008), "Optimal Designs for Dose-Finding Studies, " Journal of the American Statistical Association, 103, 1225-1237. [3,14]
18. Dette, H., and Franke, T. (2001), "Robust Designs for Polynomial Regression by Maximizing a Minimum of Dand D1-Efficiencies, " The Annals of Statistics, 29, 1024-1049. [21]
19. Dette, H., and Titoff, S. (2009), "Optimal Discrimination Designs, " The Annals of Statistics, 37, 2056-2082. [4]
20. Doucet, A., Vo, B. N., Andrieu, C., and Davy, M. (2002), "Particle Filtering for Multi-Target Tracking and Sensor Management, " in Proceedings of the Fifth International Conference on Information Fusion, IEEE, Vol. 1, pp. 474-481. [5]
21. Drovandi, C. C., McGree, J. M., and Pettitt, A. N. (2013), "Sequential Monte Carlo for Bayesian Sequentially Designed Experiments for Discrete Data, " Computational Statistics & Data Analysis, 57, 320-335. [21]
22. Gordon, N. J., Salmond, D. J., and Smith, A. F.M. (1993), "Novel Approach to Nonlinear/Non-Gaussian Bayesian State Estimation, " in Radar and Signal Processing, IEE Proceedings F, Vol. 140, pp. 107-113. [6]
23. Kitagawa, G. (1996), "Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models, " Journal of Computational and Graphical Statistics, 5, 1-25. [7]
24. Kullback, S., and Leibler, R. A. (1951), "On Information and Sufficiency, " The Annals of Mathematical Statistics, 22, 79-86. [9]
25. Läuter, E. (1974), "Experimental Design in a Class of Models, " Mathematische Operationsforschung Statistik, 5, 379-398. [3]
26. Liepe, J., Filippi, S., Komorowski, M., and Stumpf, M. P. H., "Maximising the Information Content of Experiments in Systems Biology, " PLOS [online]. Submitted. Available at http://www.ploscompbiol.org/ article/info%3Adoi%2F10.1371%2Fjournal.pcbi.1002888. [5]
27. Lindley, D. V. (1956), "On aMeasure of the Information Provided by an Experiment, " The Annals ofMathematical Statistics, 27, 986-1005. [5]
28. López-Fidalgo, J., Tommasi, C., and Trandafir, P. C. (2007), "An Optimal Experimental Design Criterion for Discriminating Between Non-normalModels, " Journal of the Royal Statistical Society, Series B, 69, 231-242. [4]
29. MacKay, D. J. C. (2003), Information Theory, Inference and Learning Algorithms, Cambridge: Cambridge University Press. [6,9]
30. Matsumoto, M., and Nishimura, T. (1998), "Mersenne Twister: A 623-Dimensionally Equidistributed Uniform Pseudo-Random Number Generator, " ACM Transactions on Modeling and Computer Simulation (TOMACS), 8, 3-30. [22]
31. McCullagh, P., and Nelder, J. A. (1989), Generalized Linear Models (Monographs on Statistics and Applied Probability 37), London: Chapman and Hall. [16]
32. McGree, J. M., Drovandi, C. C., Thompson, M. H., Eccleston, J. A., Duffull, S. B., Mengerson, K., Pettitt, A. N., and Goggin, T. (2012), "Adaptive Bayesian Compound Designs for Dose Finding Studies, " Journal of Statistical Planning and Inference, 142, 1480-1492. [4]
33. Müller, P. (1999), "Simulation-Based Optimal Design, " in Bayesian Statistics 6: Proceedings of the Sixth Valencia International Meeting, June 6-10, 1998 (Vol. 6), eds., J. M. Bernardo, J. O. Berger, A. P. Dawid, A. F. M. Smith, Oxford University Press, pp. 459-474. [21]
34. Müller, P., Berry, D. A., Grieve, A. P., Smith, M., and Krams, M. (2007), "Simulation-Based Sequential Bayesian Design, " Journal of Statistical Planning and Inference, 137, 3140-3150. [21]
35. Ng, S. H., and Chick, S. E. (2004), "Design of Follow-Up Experiments for Improving Model Discrimination and Parameter Estimation, " Naval Research Logistics (NRL), 51, 1129-1148. [5,5]
36. Pavan Kumar, V. V., and Duffull, S. B. (2011), "Evaluation of Graphical Diagnostics for Assessing Goodness of Fit of Logistic Regression Models, " Journal of Pharmacokinetics and Pharmacodynamics, 38, 1-18. [14]
37. Pavan Kumar, V. V., and Duffull, S. B. (2012), "A Generalisation of T-Optimality for Discriminating Between Competing Models With an Application to Pharmacokinetic Studies, " Pharmaceutical Statistics, 2, 503-510. [4]
38. Ponce de Leon, A. C., and Atkinson, A. C. (1991), "Optimum Experimental Design for Discriminating Between Two Rival Models in the Presence of Prior Information, " Biometrika, 78, 601-608. [4]
39. Raftery, A. E. (1995), "Bayesian Model Selection in Social Research, " Sociological Methodology, 25, 111-164. [3]
40. Richardson, S., and Green, P. (1997), "On Bayesian Analysis of Mixtures With an Unknown Number of Components" (with discussion), Journal of the Royal Statistical Society, Series B, 59, 731-792. [3]
41. Ridall, P. G., Pettitt, A. N., Friel, N., McCombe, P. A., and Henderson, R. D. (2007), "Motor Unit Number Estimation Using Reversible Jump Markov Chain Monte Carlo Methods" (with discussion), Journal of the Royal Statistical Society, Series C, 56, 235-269. [17]
42. Rubin, D., Hinton, S., andWenzel, A. (1999), "The Precise Time Recourse of Retention, " Journal of Experimental Psychology, 25, 1161-1176. [13]
43. Ryan, K. J. (2003), "Estimating Expected Information Gains for Experimental Designs With Application to the Random Fatigue-Limit Model, " Journal of Computational and Graphical Statistics, 12, 585-603. [5]
44. Stigler, S. M. (1971), "Optimal Experimental Design for Polynomial Regression, " Journal of the American Statistical Association, 66, 311-318. [4]
45. Tommasi, C. (2009), "Optimal Designs for Both Model Discrimination and Parameter Estimation, " Journal of Statistical Planning and Inference, 139, 4123-4132. [4]
46. Toni, T., and Stumpf, M. P. H. (2010), "Simulation-Based Model Selection for Dynamical Systems in Systems and Population Biology, " Bioinformatics, 26, 104-110. [21]
47. Tsai, M. H., and Zen, M.M. (2004), "Criterion-Robust Optimal Designs forModel Discrimination and Parameter Estimation: Multivariate Polynomial Regression Case, " Statistica Sinica, 14, 591-602. [21]
48. Ucinski, D., and Bogacka, B. (2005), "T-Optimum Designs for Discrimination Between Two Multiresponse Dynamic Models, " Journal of the Royal Statistical Society, Series B, 67, 3-18. [4]
49. Waterhouse, T. H., Eccleston, J. A., and Duffull, S. B. (2009), "Optimal Design Criteria for Discrimination and Estimation in Nonlinear Models, " Journal of Biopharmaceutical Statistics, 19, 386-402. [4]
50. Whitehead, J., and Brunier, H. (1995), "Bayesian Decision Procedures for Dose Determining Experiments, " Statistics in Medicine, 14, 885-893. [14]
51. Woods, D. C., Lewis, S. M., Eccleston, J. A., and Russell, K. G. (2006), "Designs for Generalized Linear Models With Several Variables and Model Uncertainty, " Technometrics, 48, 284-292. [4]
52. Yin, G., and Yuan, Y. (2009), "Bayesian Model Averaging Continual Reassessment Method in Phase I Clinical Trials, " Journal of the American Statistical Association, 104, 954-968. [21]