Modelling of complex survey data: Why model? Why is it a problem? How can we approach it?

Survey Methodology

Volumn 37, Issue 2, 2011, Pages 115-136

  Pfeffermann, Danny ^a,b  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b HEBREW UNIVERSITY OF JERUSALEM   (Israel)

Author keywords

Informative sampling; Likelihood based methods; NMAR nonresponse; Probability weighting; Randomization distribution; Sample model

Indexed keywords

EID: 84855259178     PISSN: 07140045     EISSN: 14920921     Source Type: Journal    
DOI: None     Document Type: Article

References (60)

1. Binder, D.A. (1983). On the variances of asymptotically normal estimators from complex surveys. International Statistical Review, 51, 279-292.
2. Binder, D., and Roberts, G. (2009). Design and model based inference for model parameters. In Handbook of Statistics 29B; Sample Surveys: Inference and Analysis, (Eds., D. Pfeffermann and C.R. Rao). Amsterdam: North Holland, 33-54.
3. Breckling, J.U., Chambers, R.L., Dorfman, A.H., Tam, S.M. and Welsh, A.H. (1994). Maximum likelihood inference from sample survey data. International Statistical Review, 62, 349-363.
4. Brick, J.M., and Montaquila, J.M. (2009). Nonresponse and weighting. In Handbook of Statistics 29A; Sample Surveys: Inference and Analysis, (Eds., D. Pfeffermann and C.R. Rao). Amsterdam: North Holland, 163-185.
5. Chambers, R.L., Dorfman, A.H. and Wang, S. (1998). Limited information likelihood analysis of survey data. Journal of the Royal Statistical Society, Series B, 60, 397-411.
6. Chambers, R.L., and Skinner, C.J. (2003, Eds.). Analysis of survey data. New York: John Wiley & Sons, Inc.
7. Chambless, L.E., and Boyle, K.E. (1985). Maximum likelihood methods for complex sample data: Logistic, regression and discrete proportional hazards models. Communication in Statistics-Theory and Methods, 14, 1377-1392.
8. Chang, T., and Kott, P.S. (2008). Using calibration weighting to adjust for nonresponse under a plausible model. Biometrika, 95, 555-571.
9. Chen, J., and Sitter, R.R. (1999). A pseudo empirical likelihood approach to the effective use of auxiliary information in complex surveys. Statistica sinica, 9, 385-406.
10. Chaudhuri, S., Handcock, M.S. and Rendall, M.S. (2010). A conditional empirical likelihood approach to combine sampling design and population level information. Technical report No. 3/2010, National University of Singapore, Singapore, 117546.
11. DeMets, D., and Halperin, M. (1977). Estimation of simple regression coefficients in samples arising from sub-sampling procedures. Biometrics, 33, 47-56.
12. DuMouchel, W.H., and Duncan, G.L. (1983). Using sample survey weights in multiple regression analysis of stratified samples. Journal of the American Statistical Association, 78, 535-543.
13. Feder, M. (2011). Fitting Regression Models to Complex Survey Data- Gelman's Estimator Revisited. In Proceedings of the ISI meeting, Ireland, (www.isi2011.ie).
14. Francisco, C.A., and Fuller, W.A. (1991). Quantile estimation with a complex survey design. The Annals of Statistics, 19, 454-469.
15. Fuller, W.A. (1975). Regression analysis for sample surveys. Sankhyā, Series C, 37, 117-132.
16. Fuller, W.A. (2002). Regression estimation for survey samples. Survey Methodology, 28, 5-23.
17. Gelman, A., Carlin, J.B., Stern, H.S. and Rubin, D.B. (2003). Bayesian Data Analysis, second edition. London: CRC Press.
18. Gelman, A. (2007). Struggles with survey weighting and regression modeling (with discussion). Statistical Science, 22, 153-164.
19. Godambe, V.P., and Thompson, M.E. (1986). Parameters of superpopulation and survey population: Their relationships and estimation. International Statistical Review, 54, 127-138.
20. Godambe, V.P., and Thompson, M.E. (2009). Estimating functions and survey sampling. In Handbook of Statistics 29B; Sample Surveys: Inference and Analysis, (Eds., D. Pfeffermann and C.R. Rao). Amsterdam: North Holland, 83-101.
21. Goldstein, H. (1986). Multi-level mixed linear model analysis using iterative generalized least squares. Biometrika, 73, 43-56.
22. Hàjek, J. (1971). Comments on a paper by D. Basu. In Foundations of Statistical Inference, (Eds., V.P. Godambe and D.A. Sprott). Toronto: Holt, Rinehart and Winston.
23. Hartley, H.O., and Rao, J.N.K. (1968). A new estimation theory for sample surveys. Biometrika, 55, 547-557.
24. Holt, D., Smith, T.M.F. and Winter, P.D. (1980). Regression analysis of data from complex surveys. Journal of the Royal Statistical Society, Series A, 143, 474-487.
25. Jewell, N.P. (1985). Least squares regression with data arising from stratified samples of the dependent variable. Biometrika, 72, 11-21.
26. Kasprzyk, D., Duncan, G.J., Kalton, G. and Singh, M.P. (1989, Eds.). Panel Surveys. New York: John Wiley & Sons, Inc.
27. Kim, J.K. (2009). Calibration estimation using empirical likelihood in survey sampling. Statistica Sinica, 19, 145-157.
28. Kott, P.S. (2009). Calibration Weighting: Combining Probability Samples and Linear Prediction Models. In Handbook of Statistics 29B; Sample Surveys: Inference and Analysis, (Eds., D. Pfeffermann and C.R. Rao). Amsterdam: North Holland, 55-82.
29. Krieger, A.M., and Pfeffermann D. (1997). Testing of distribution functions from complex sample surveys. Journal of Official Statistics, 13, 123-142.
30. Little, R.J.A. (1982). Models for non-response in sample surveys. Journal of the American Statistical Association, 77, 237-249.
31. Little, R.J.A. (2004). To model or not to model? Competing modes of inference for finite population sampling. Journal of the American Statistical Association, 99, 546-556.
32. Magee, L. (1998). Improving survey-weighted least squares regression. Journal of the Royal Statistical Society, Series B, 60, 115-126.
33. Nathan, G., and Holt, D. (1980). The effect of survey design on regression analysis. Journal of the Royal Statistical Society, Series B, 42, 377-386.
34. th Berkeley Symposium on Mathematical Statistics and Probability, 1, 697-715.
35. Owen, A.B. (1988). Empirical likelihood ratio confidence intervals for a single functional. Biometrika, 75, 237-249.
36. Owen, A.B. (2001). Empirical likelihood. New York: Chapman & Hall.
37. Pfeffermann, D., and Holmes, D. (1985). Robustness consideration in the choice of method of inference for regression analysis of survey data. Journal of the Royal Statistical Society, Series A, 148, 268-278.
38. Pfeffermann, D., and Smith, T.M.F. (1985). Regression models for grouped populations in cross-section surveys. International Statistical Review, 53, 37-59.
39. Pfeffermann, D. (1993). The role of sampling weights when modeling survey data. International Statistical Review, 61, 317-337.
40. Pfeffermann, D. (1996). The use of sampling weights for survey data analysis. Statistical Methods in Medical Research, 5, 239-261.
41. Pfeffermann, D., Krieger, A.M. and Rinott, Y. (1998a). Parametric distributions of complex survey data under informative probability sampling. Statistica Sinica, 8, 1087-1114.
42. Pfeffermann, D., Skinner, C.J., Holmes, D.J., Goldstein, H. and Rasbash, J. (1998b). Weighting for unequal selection probabilities in multi-level models (with discussion). Journal of the Royal Statistical Society, Series B, 60, 23-76.
43. Pfeffermann, D., and Sverchkov, M. (1999). Parametric and semiparametric estimation of regression models fitted to survey data. Sankhyā, 61, 166-186.
44. Pfeffermann, D., and Sverchkov, M. (2003). Fitting generalized linear models under informative probability sampling. In Analysis of Survey Data, (Eds., R.L. Chambers and C.J. Skinner). New York: John Wiley & Sons, Inc., 175-195.
45. Pfeffermann, D., Moura, F.A.S. and Nascimento-Silva, P.L. (2006). Multilevel modeling under informative sampling. Biometrika, 93, 943-959.
46. Pfeffermann., D., and Sverchkov, M. (2007). Small area estimation under informative probability sampling of areas and within the selected areas. Journal of the American Statistical Association, 102, 1427-1439.
47. Pfeffermann, D., and Sverchkov, M. (2009). Inference under Informative Sampling. In Handbook of Statistics 29B; Sample Surveys: Inference and Analysis, (Eds., D. Pfeffermann and C.R. Rao). Amsterdam: North Holland, 455-487.
48. Pfeffermann, D., and Landsman, V. (2011). Are private schools better than public schools? Appraisal for Ireland by methods for observational studies. The Annals of Applied Statistics, 5, 1726-1751.
49. Pfeffermann, D., and Sikov, N. (2011). Imputation and estimation under nonignorable nonresponse in household surveys with missing covariate information. Journal of Official Statistics, 27, 181-209.
50. Rubin, D.B. (1976). Inference and missing data. Biometrika, 63, 605-614.
51. Rubin, D.B. (1985). The use of propensity scores in applied Bayesian inference. In Bayesian Statistics 2, (Eds., J.M. Bernardo, M.H. Degroot, D.V. Lindley and A.F.M. Smith), Elsevier Science Publishers B.V., 463-472.
52. Särndal, C.-E., and Wright, R. (1984). Cosmetic form of estimators in survey sampling. Scandinavian Journal of Statistics, 11, 146-156.
53. Scott, A.J., and Holt, D. (1982). The effect of two-stage sampling on ordinary least squares. Journal of the American Statistical Association, 77, 848-854.
54. Scott, A.J., and Wild, C.J. (2009). Population-based case-control studies. In Handbook of Statistics 29B; Sample Surveys: Inference and Analysis, (Eds., D. Pfeffermann and C.R. Rao). Amsterdam: North Holland, 431-453.
55. Skinner, C.J., Holt, D. and Smith, T.M.F. (Eds.) (1989). Analysis of complex surveys. New York: John Wiley & Sons, Inc.
56. Skinner, C.J. (1994). Sample models and weights. Proceedings of the Section on Survey Research Methods, 133-142.
57. Smith, T.M.F. (1988). To weight or not to weight, that is the question. In Bayesian Statistics 3, (Eds., J.M. Bernardo, M.H. Degroot, D.V. Lindley and A.F.M. Smith), Oxford University Press, 437-451.
58. Sugden, R.A., and Smith, T.M.F. (1984). Ignorable and informative designs in survey sampling inference. Biometrika, 71, 495-506.
59. Sverchkov, M., and Pfeffermann, D. (2004). Prediction of finite population totals based on the sample distribution. Survey Methodology, 30, 79-92.
60. Wu, Y.Y., and Fuller, W.A. (2006). Estimation of regression coefficients with unequal probability samples. Proceedings of the American Statistical Association, Section on Survey Research Methods, 3892-3899