Finding near-optimal Bayesian experimental designs via Genetic algorithms

American Statistician

Volumn 55, Issue 3, 2001, Pages 175-181

  Hamada, M ^a   Martz, H F ^a   Reese, C S ^a   Wilson, A G ^a  

^a LOS ALAMOS NATIONAL LABORATORY   (United States)

Author keywords

Expected information gain; Linear and nonlinear regression; Logistic regression; Multifactor designs; Shannon information

Indexed keywords

EID: 0035620460     PISSN: 00031305     EISSN: None     Source Type: Journal    
DOI: 10.1198/000313001317098121     Document Type: Article

References (46)

1. AndereRendon, J., Montgomery, D. C., and Rollier, D. A. (1997), "Design of Mixture Experiments Using Bayesian D-Optimality," Journal of Quality Technology, 29, 451-463.
2. Bernardo, J. M. (1979), "Expected Information As Expected Utility," The Annals of Statistics, 7, 686-690.
3. Broudiscou, A., Leardi, R., and Phan-Tan-Luu, R. (1996), "Genetic Algorithm as a Tool for Selection of D-Optimal Design," Chemometrics and Intelligent Laboratory Systems, 35, 105-116.
4. Chaloner, K., and Larntz, K. (1989), "Optimal Bayesian Design Applied to Logistic Regression Experiments," Journal of Statistical Planning and Inference, 21, 191-208.
5. Chaloner, K., and Verdinelli, I. (1995), "Bayesian Experimental Design: A Review," Statistical Science, 10, 273-304.
6. Chatterjee, S., Laudato, M., and Lynch, L. A. (1996), "Genetic Algorithms and Their Statistical Applications: An Introduction," Computational Statistics and Data Analysis, 22, 633-665.
7. Clyde, M., Muller, P., and Parmigiani, G. (1996), "Inference and Design Strategies for a Hierarchical Logistic Regression Model," in Bayesian Biostatistics, eds. D. A. Berry and D. K. Stangl, New York: Marcel Dekker, pp. 297.
8. DeGroot, M. H. (1962), "Uncertainty, Information and Sequential Experiments," Annals of Mathematical Statistics, 33, 404-419.
9. _ (1986), "Concepts of Information Based on Utility," in Recent Developments in the Foundations of Utility and Risk Theory, eds. L. Daboni, A. Montesano, and M. Lines, Dordrecht: Reidel.
10. Dette, H. (1993a), "Elfving's Theorem for D-Optimality," The Annals of Statistics, 21, 753-766.
11. _ (1993b), "Bayesian D-Optimal and Model Robust Designs in Linear-Regression Models," Statistics, 25, 27-46.
12. _ (1996), "A Note on Bayesian c- and D-Optimal Designs in Nonlinear Regression Models," The Annals of Statistics, 24, 1225-1234.
13. Dette, H., and Neugebauer, H. M. (1997), "Bayesian D-Optimal Designs for Exponential Regression Models," Journal of Statistical Planning and Inference, 60, 331-349.
14. Dette, H., and Sperlich, S. (1994), "A Note on Bayesian D-Optimal Designs for a Generalization of the Exponential-Growth Model," South African Statistical Journal, 28, 103-117.
15. _ (1996), "Some Applications of Stieltjes Transforms in the Construction of Optimal Designs for Nonlinear Regression Models," Computational Statistics and Data Analysis, 21, 273-292.
16. Dette, H., and Wong, W. K. (1998), "Bayesian D-Optimal Designs on a Fixed Number of Design Points for Heteroscedastic Polynomial Models," Biometrika, 85, 869-882.
17. Draper, N.R., and Smith, H. (1981), Applied Regression Analysis (2nd ed.), New York: Wiley.
18. DiCiccio, T., Kass, R., Raftery, A., and Wasserman, L. (1997), "Computing Bayes Factors by Combining Simulation and Asymptotic Approximations," Journal of the American Statistical Association, 92, 903-915.
19. Flournoy, N. (1993), "A Clinical Experiment in Bone Marrow Transplantation; Estimating a Percentage Point of a Quantal Response Curve," in Case Studies in Bayesian Statistics, eds. C. Gatsonis, J. Hodges, R. E. Kass, and N. Singpurwalla, New York: Springer, pp. 324-336.
20. Forouraghi, B. (2000), "A Genetic Algorithm for Multiobjective Robust Design," Applied Intelligence, 12, 151-161.
21. Gelfand, A., and Dey, D. (1999), "Bayesian Model Choice: Asymptotic and Exact Calculations," Journal of the Royal Statistical Society, Ser. B. 56, 501-514.
22. Gelman, A., and Meng, X. (1998), "Simulating Normalizing Constants: From Importance Sampling to Bridge Sampling to Path Sampling," Statistical Science, 13, 163-185.
23. Geweke, J. (1989), "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, 57, 1317-1340.
24. Goldberg, D. E. (1989), Genetic Algorithms in Search, Optimization and Machine Learning, New York: Addison-Wesley.
25. Guttman, I. (1971), "A Remark on the Optimal Regression Designs with Previous Observations of Covey-Crump and Silvey," Biometrika, 58, 683-685.
26. Haines, L. M. (1998), "A Class of Equivalent Problems in Statistics and Operations Research," South African Statistical Journal, 32, 43-66.
27. Hammersley, J., and Handscomb, D. (1964), Monte Carlo Methods, London: Chapman and Hall.
28. He, Z., Studden, W. J., and Sun, D. (1996), "Optimal Design for Rational Models," The Annals of Statistics, 24, 2128-2147.
29. Holland, J. M. (1992a), Adaptation in Natural and Artificial Systems, Cambridge, MA: MIT Press.
30. _ (1992b), "Genetic Algorithms," Scientific American, July, 66-72.
31. Lindley, D. V. (1956), "On the Measure of Information Provided By An Experiment," The Annals of Statistics, 27, 986-1005.
32. _ (1972), Bayesian Statistics - A Review, Philadelphia: SIAM.
33. Meng, X., and Wong, W. (1996), "Simulating Ratios of Normalizing Constants Via a Simple Identity: A Theoretical Explanation," Statistica Sinica, 6, 831-860.
34. Michalewicz, Z. (1992), Genetic Algorithms + Data Structures = Evolution Programs, New York: Springer-Verlag.
35. Mukhopadhyay, S., and Haines, L. (1995), "Bayesian D-Optimal Designs for the Exponential Growth Model," Journal of Statistical Planning and Inference, 44, 385-397.
36. Muller, P. (1998), "Simulation Based Optimal Design," Bayesian Statistics, 6, 1-13.
37. Pilz, J. (1991), Bayesian Estimation and Experimental Design in Linear Regression, New York: Wiley.
38. Raiffa, H., and Schlaifer, R. (1961), Applied Statistical Decision Theory, Boston: Division of Research, Harvard Business School.
39. Sebastiani, P., and Wynn, H. P. (2000), "Maximum Entropy Sampling and Optimal Bayesian Experimental Design," Journal of the Royal Statistical Society, Ser. B., 62, 145-157.
40. Shannon, C. E. (1948), "A Mathematical Theory of Communication," Bell System Technical Journal, 21, 379-423; 623-656.
41. Sinha, B. K. (1970), "A Bayesian Approach to Optimum Allocation in Regression Problems," Calcutta Statistical Association Bulletin, 19, 45-52.
42. Song, D., and Wong, W. K. (1998), "Optimal Two-Point Designs for the Michaelis-Menten Model with Heteroscedastic Errors," Communications in Statistics-Theory and Methods, 27, 1503-1516.
43. Smith, A. F. M., and Verdinelli, I. (1980), "A Note on Bayesian Design for Inference Using a Hierarchical Linear Model," Biometrika, 67, 613-619.
44. Stone, M. (1959), "Application of a Measure of Information to the Design and Comparison of Regression Experiment," Annals of Mathematical Statistics, 30, 55-70.
45. Tierney, L., and Kadane, J. (1986), "Accurate Approximations for Posterior Moments and Marginal Densities," Journal of the American Statistical Association, 81, 82-86.
46. Verdinelli, I. (2000), "A Note on Bayesian Design for the Normal Linear Model with Unknown Error Variance," Biometrika, 87, 222-227.