Calibrated Bayes, an alternative inferential paradigm for official statistics

Journal of Official Statistics

Volumn 28, Issue 3, 2012, Pages 309-334

  Little, Roderick J ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Bayesian statistics; Frequentist statistics; Likelihood principle; Model checking; Robust models; Statistical inference

Indexed keywords

EID: 84867069692     PISSN: 0282423X     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (90)

1. Agresti, A. and Coull, B.A. (1998). Approximate is Better than 'Exact' for Interval Estimation of Binomial Proportions. The American Statistician, 52, 119-126.
2. Basu, D. (1971). An Essay on the Logical Foundations of Survey Sampling, Part 1. In Foundations of Statistical Inference, V. Godambe and D. Sprott (eds). Toronto: Holt, Rinehart and Winston, 203-242.
3. Binder, D.A. (1982). Non-parametric Bayesian Models for Samples from Finite Populations. Journal of the Royal Statistical Society, 44, 388-393.
4. Birnbaum, A. (1962). On the Foundations of Statistical Inference (with discussion). Journal of the American Statistical Association, 57, 269-326.
5. Box, G.E.P. (1980). Sampling and Bayes Inference in Scientific Modelling and Robustness (with discussion). Journal of the Royal Statistical Society, Series A, 143, 383-430.
6. Brewer, K.R.W. (1979). A Class of Robust Sampling Designs for Large-Scale Surveys. Journal of the American Statistical Association, 74, 911-915.
7. Brewer, K.R.W. and Mellor, R.W. (1973). The Effect of Sample Structure on Analytical Surveys. Australian Journal of Statistics, 15, 145-152.
8. Brown, L.D., Cai, T.T., and DasGupta, A. (2001). Interval Estimation for a Binomial Proportion. Statistical Science, 16, 101-133.
9. Cassel, C.-M., Särndal, C.-E., and Wretman, J.H. (1977). Foundations of Inference in Survey Sampling. New York: Wiley.
10. Chen, Q., Elliott, M.R., and Little, R.J.A. (2010). Bayesian Penalized Spline Model-Based Inference for a Finite Population Proportion in Unequal Probability Sampling. Survey Methodology, 36, 23-34.
11. Cochran, W.G. (1977). Sampling Techniques, (3rd Edition.). New York: Wiley.
12. Cox, D.R. (1971). The Choice between Alternative Ancillary Statistics. Journal of the Royal Statistical Society, Series B, 33, 251-255.
13. Cox, D.R. and Hinkley, D.V. (1974). Theoretical Statistics. London: Chapman Hall.
14. Dawid, A.P. (1982). The Well-Calibrated Bayesian. Journal of the American Statistical Association, 77, 605-610.
15. Draper, D. (1995). Assessment and Propagation of Model Uncertainty (with discussion). Journal of the Royal Statistical Society, Series B, 57, 45-97.
16. Draper, D. and Krnjajic, M. (2010). Calibration Results for Bayesian Model Specification. Bayesian Analysis, 1, 1-43.
17. Dumouchel, W.H. and Duncan, G.J. (1983). Using Sample Survey Weights in Multiple Regression Analysis of Stratified Samples. Journal of the American Statistical Association, 78, 535-543.
18. Efron, B. (1986). Why Isn't Everyone a Bayesian? The American Statistician, 40, 1-11, (with discussion and rejoinder).
19. Elliott, M. and Little, R.J. (2005). A Bayesian Approach to Census 2000 Evaluation Using A.C.E. Survey Data and Demographic Analysis. Journal of the American Statistical Association, 100, 380-388.
20. Ericson, W.A. (1969). Subjective Bayesian Models in Sampling Finite Populations. Journal of the Royal Statistical Society, Series B, 31, 195-234.
21. Ericson, W.A. (1988). Bayesian Inference in Finite Populations. In Handbook of Statistics 6, P.R. Krishnaiah and C.R. Rao (eds). Amsterdam: North-Holland, 213-246.
22. Fay, R.E. (1996). Alternative Paradigms for the Analysis of Imputed Survey Data. Journal of the American Statistical Association, 91, 490-498.
23. Fay, R. and Herriot, R. (1979). Estimates of Income for Small Places: an Application of James-Stein Procedures to Census Data. Journal of the American Statistical Association, 366, 269-277.
24. Fienberg, S.E. (2011). Bayesian Models and Methods in Public Policy and Government Settings. Statistical Science, 26, 212-226.
25. Firth, D. and Bennett, K.E. (1998). Robust Models in Probability Sampling. Journal of the Royal Statistical Society, Series B, 60, 3-21.
26. Gelman, A. (2006). Prior Distributions for Variance Parameters in Hierarchical Models. Bayesian Analysis, 1, 515-533.
27. Gelman, A. (2007). Struggles with Survey Weighting and Regression Modeling. Statistical Science, 22, 153-164 (with discussion and rejoinder).
28. Gelman, A., Carlin, J.B., Stern, H.S., and Rubin, D.B. (2003). Bayesian Data Analysis, (Second edition). New York: CRC Press.
29. Gelman, A., Meng, X.-L., and Stern, H. (1996). Posterior Predictive Assessment of Model Fitness Via Realized Discrepancies (with discussion). Statistica Sinica, 6, 733-807.
30. Ghosh, M. and Meeden, G. (1997). Bayesian Methods for Finite Population Sampling. London: Chapman and Hall.
31. Groves, R.M. and Lyberg, L. (2010). Total Survey Error: Past. Present, and Future. Public Opinion Quarterly, 74, 934-955.
32. Hansen, M.H., Hurwitz, W.N., and Madow, W.G. (1953). Sampling Survey Methods and Theory, Vols. I and II. New York: Wiley.
33. Hansen, M.H., Madow, W.G., and Tepping, B.J. (1983). An Evaluation of Model-Dependent and Probability-Sampling Inferences in Sample Surveys. Journal of the American Statistical Association, 78, 776-793 (with discussion).
34. Heckman, J. (1976). The Common Structure of Statistical Models of Truncation. Sample Selection and Limited Dependent Variables, and a Simple Estimator for such Models. Annals of Economic and Social Measurement, 5, 475-492.
35. Holt, D. and Smith, T.M.F. (1979). Poststratification. Journal of the Royal Statistical Society, Series A, 142, 33-46.
36. Holt, D., Smith, T.M.F., and Winter, P.D. (1980). Regression Analysis of Data from Complex Surveys. Journal of the Royal Statistical Society, Series A, 143, 474-487.
37. Horvitz, D.G. and Thompson, D.J. (1952). A Generalization of Sampling without Replacement from a Finite Universe. Journal of the American Statistical Association, 47, 663-685.
38. Isaki, C.T. and Fuller, W.A. (1982). Survey Design under the Regression Superpopulation Model. Journal of the American Statistical Association, 77, 89-96.
39. Joyce, P.M., Malec, D., Little, R.J., and Gilary, A. (2012). Statistical Modeling Methodology for the Voting Rights Act Section 203 Language Assistance Determinations. Center for Statistical Research and Methodology, Research and Methodology Directorate Research Report Series (Statistics \#2012-02). U.S. Census Bureau. Available online at http://www.census.gov/srd/papers/pdf/rrs2012-02.pdf.
40. Kalton, G. (2002). Models in the Practice of Survey Sampling (Revisited). Journal of Official Statistics, 18, 129-154.
41. Kim, J.K., Brick, J.M., Fuller, W.A., and Kalton, G. (2006). On the Bias of the Multiple-Imputation Variance Estimator in Survey Sampling. Journal of the Royal Statistical Society, Series B, 68, 509-521.
42. Kish, L. (1965). Survey Sampling. New York: Wiley.
43. Kish, L. and Frankel, M.R. (1974). Inferences from Complex Samples (with discussion). Journal of the Royal Statistical Society, Series B, 36, 1-37.
44. Konijn, H.S. (1962). Regression Analysis in Sample Surveys. Journal of the American Statistical Association, 57, 590-606.
45. Lehtonen, R., Pahkinen, E., and Särndal, C.-E. (2002). Research and Development in Official Statistics and Scientific Co-operation with Universities: An Empirical Investigation. Journal of Official Statistics, 18, 87-110.
46. Lehtonen, R. and Särndal, C.-E. (2009). Research and Development in Official Statistics and Scientific Co-operation with Universities: A Follow-Up Study. Journal of Official Statistics, 25, 467-482.
47. Little, R.J. (1983). Estimating a Finite Population Mean from Unequal Probability Samples. Journal of the American Statistical Association, 78, 596-604.
48. Little, R.J. (1991). Inference with Survey Weights. Journal of Official Statistics, 7, 405-424.
49. Little, R.J. (1993). Post-Stratification: a Modeler's Perspective. Journal of the American Statistical Association, 88, 1001-1012.
50. Little, R.J. (2003). The Bayesian Approach to Sample Survey Inference. In Analysis of Survey Data, R.L. Chambers and C.J. Skinner (eds). New York: Wiley, 49-57.
51. Little, R.J. (2004). To Model or Not to Model? Competing Modes of Inference for Finite Population Sampling. Journal of the American Statistical Association, 99, 546-556.
52. Little, R.J. (2006). Calibrated Bayes: A Bayes / Frequentist Roadmap. The American Statistician, 60, 213-223.
53. Little, R.J. (2007). Comment on "Model-assisted Estimation of Forest Resources with Generalized Additive Models" by Jean D. Opsomer, F. Jay Breidt, Gretchen G. Moisen, and Goran Kauerman. Journal of the American Statistical Association, 102, 412-414.
54. Little, R.J. (2008). Weighting and Prediction in Sample Surveys. Diamond Jubilee volume. Calcutta Statistical Association Bulletin, 60, 1-47 (with discussion and rejoinder).
55. Little, R.J. (2011). Calibrated Bayes, for Statistics in General, and Missing Data in Particular (with Discussion and Rejoinder). Statistical Science, 26, 162-186.
56. Little, R.J.A. and Rubin, D.B. (1983). Discussion of "Six Approaches to Enumerative Sampling" by K.R.W. Brewer and C.E. Sarndal. In Incomplete Data in Sample Surveys, Vol. 3: Proceedings of the Symposium, W.G. Madow and I. Olkin (Eds). New York: Academic Press.
57. Little, R.J.A. and Rubin, D.B. (2002). Statistical Analysis with Missing Data, (2nd edition). New York: Wiley.
58. Meng, X.-L. (1994). Multiple Imputation Inferences with Uncongenial Sources of Input (with discussion). Statistical Science, 9, 538-573.
59. Opsomer, J.D., Breidt, F.J., Moisen, G.G., and Kauerman, G. (2007). Model-Assisted Estimation of Forest Resources with Generalized Additive Models. Journal of the American Statistical Association, 102, 400-416 (with discussion).
60. Peers, H.W. (1965). On Confidence Points and Bayesian Probability Points in the Case of Several Parameters. Journal of the Royal Statistical Society, Series B, 27, 9-16.
61. Pfeffermann, D. (1993). The Role of Sampling Weights when Modeling Survey Data. International Statistical Review, 61, 317-337.
62. Pfeffermann, D. and Holmes, D.J. (1985). Robustness Considerations in the Choice of Method of Inference for Regression Analysis of Survey Data. Journal of the Royal Statistical Society, Series A, 148, 268-278.
63. Raghunathan, T.E., Xie, D., Schenker, N., Parsons, V., Davis, W., Rancourt, E., and Dodd, K. (2007). Combining Information from Multiple Surveys for Small Area Estimation: A Bayesian Approach. Journal of American Statistical Association, 102, 474-486.
64. Rao, J.N.K. (1996). On Variance Estimation with Imputed Data. Journal of the American Statistical Association, 91, 499-506.
65. Rao, J.N.K. (2003). Small Area Estimation. New York: Wiley.
66. Rao, J.N.K. (2011). Impact of Frequentist and Bayesian Methods on Survey Sampling Practice: A Selective Appraisal. Statistical Science, 26, 240-256.
67. Robins, J.M. and Wang, N. (2000). Inference for Imputation Estimators. Biometrika, 87, 113-124.
68. Royall, R.M. (1970). On Finite Population Sampling Under Certain Linear Regression Models. Biometrika, 57, 377-387.
69. Rubin, D.B. (1974). Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies. Journal of Educational Psychology, 66, 688-701.
70. Rubin, D.B. (1983). Comment on "An Evaluation of Model-Dependent and Probability-Sampling Inferences in Sample Surveys" by M.H. Hansen, W.G. Madow, and B.J. Tepping. Journal of the American Statistical Association, 78, 803-805.
71. Rubin, D.B. (1984). Bayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician. Annals of Statistics, 12, 1151-1172.
72. Rubin, D.B. (1987). Multiple Imputation for Nonresponse in Surveys. New York: Wiley.
73. Rubin, D.B. (1996). Multiple Imputation After 18{thorn} Years. Journal of the American Statistical Association, 91, 473-489.
74. SAIPE (2011). U.S. Census Bureau Small Area Income and Poverty Estimates Program. Available at http://www.census.gov//did/www/saipe/
75. Särndal, C.-E., Swensson, B., and Wretman, J.H. (1992). Model Assisted Survey Sampling. New York: Springer.
76. Schenker, N. and Raghunathan, T.E. (2007). Combining Information from Multiple Surveys to Improve Measures of Health. Statistics in Medicine, 26, 1802-1811.
77. Science Watch (2002). Vital Statistics on the Numbers Game: Highly Cited Authors in Mathematics, 1991-2001. Science Watch, 13(3), 2.
78. Scott, A.J. (1977). Large-Sample Posterior Distributions for Finite Populations. Annals of Mathematical Statistics, 42, 1113-1117.
79. Scott, A.J. and Smith, T.M.F. (1969). Estimation in Multistage Samples. Journal of the American Statistical Association, 64, 830-840.
80. Sedransk, J. (2008). Assessing the Value of Bayesian Methods for Inference about Finite Population Quantities. Journal of Official Statistics, 24, 495-506.
81. Smith, T.M.F. (1988). To Weight or not to Weight, that is the Question. In Bayesian Statistics 3, J.M. Bernado, M.H. DeGroot, and D.V. Lindley (eds). Oxford: Oxford University Press, 437-451.
82. Sugden, R.A. and Smith, T.M.F. (1984). Ignorable and Informative Designs in Survey Sampling Inference. Biometrika, 71, 495-506.
83. Thompson, M.E. (1988). Superpopulation Models. Encyclopedia of Statistical Sciences, 1, 93-99.
84. Valliant, R., Dorfman, A.H., and Royall, R.M. (2000). Finite Population Sampling and Inference: a Prediction Approach. New York: Wiley.
85. Welch, B.L. (1965). On Comparisons between Confidence Point Procedures in the Case of a Single Parameter. Journal of the Royal Statistical Society, Series B, 27, 1-8.
86. Yuan, Y. and Little, R.J. (2007). Model-Based Estimates of the Finite Population Mean for Two-Stage Cluster Samples with Unit Nonresponse. Journal of the Royal Statistical Society, Series C, 56, 79-97.
87. Yuan, Y. and Little, R.J. (2008). Model-Based Estimates of the Finite Population Mean for Two-Stage Cluster Samples with Item Nonresponse. Journal of Official Statistics, 24, 193-211.
88. Zanutto, E. and Zaslavsky, A. (2001). Using Administrative Records to Impute for Nonresponse. In Survey Nonresponse, R.M. Groves, D.A. Dillman, J.L. Eltinge, and R.J.A. Little (eds). New York: Wiley.
89. Zheng, H. and Little, R.J. (2004). Penalized Spline Nonparametric Mixed Models for Inference about a Finite Population Mean from Two-Stage Samples. Survey Methodology, 30, 209-218.
90. Zheng, H. and Little, R.J. (2005). Inference for the Population Total from Probability-Proportional-to-Size Samples Based on Predictions from a Penalized Spline Nonparametric Model. Journal of Official Statistics, 21, 1-20.