Estimating propensity adjustments for volunteer web surveys

Sociological Methods and Research

Volumn 40, Issue 1, 2011, Pages 105-137

  Valliant, Richard ^a   Dever, Jill A ^b  

^a UNIVERSITY OF MARYLAND   (United States)

^b RTI INTERNATIONAL   (United States)

Author keywords

Calibration estimator; Logistic regression; Nonignorable selection; Propensity model; Reference survey; Web survey

Indexed keywords

EID: 78651387442     PISSN: 00491241     EISSN: 15528294     Source Type: Journal    
DOI: 10.1177/0049124110392533     Document Type: Article

References (36)

1. Bethlehem, J.G. 2002. "Weighting Nonresponse Adjustments Based on Auxiliary Information." Pp. 275-88 in Survey Nonresponse, edited by R. M. Groves, D. A. Dillman, J. L. Eltinge, and R. J. A. Little. New York: John Wiley.
2. Bethlehem, J. 2010. "Selection Bias in Web Surveys." International Statistical Review 78(2):161-88.
3. Blumberg, S.J. and J.V. Luke. 2008. "Wireless Substitution: Early Release of Estimates From the National Health Interview Survey, January-June 2008." National Center for Health Statistics. Retrieved December 17, 2008 (http://www.cdc.gov/nchs/nhis.htm).
4. Börsch-Supan, A., D. Elsner, H. Faβbender, R. Kiefer, D. McFadden, and J. Winter. 2004. "How to Make Internet Surveys Representative: A Case Study of a Two-Step Weighting Procedure." Mannheim University, Germany. Unpublished manuscript.
5. Cochran, W.G. 1968. "The Effectiveness of Adjustment by Subclassification in Removing Bias in Observational Studies." Biometrics 24: 295-313.
6. Copas, J.B., and H.G. Li. 1997. "Inference for Non-Random Samples (and Discussion)." Journal of the Royal Statistical Society B 59: 55-95.
7. Couper, M. 2000. "Web Surveys: A Review of Issues and Approaches. " Public Opinion Quarterly 64: 464-94.
8. Czajka, J.L., S.M. Hirabayashi, R.J.A. Little, and D.B. Rubin. 1992. "Projecting From Advance Data Using Propensity Modeling: An Application to Income and Tax Statistics." Journal of Business and Economic Statistics 10(2):117-32.
9. Dever, J., A. Rafferty, and R. Valliant. 2008. "Internet Surveys: Can Statistical Adjustments Eliminate Coverage Bias?" Survey Research Methods 2: 47-60.
10. Deville, J.-C. 1991. "A Theory of Quota Surveys. " Survey Methodology 17:163-81.
11. Elliott, M.N. and A. Haviland. 2007. "Use of a Web-Based Convenience Sample to Supplement a Probability Sample." Survey Methodology 33: 211-15.
12. Groves, R. 2006. "Nonresponse Rates and Nonresponse Bias in Household Surveys." Public Opinion Quarterly 70: 646-75.
13. Isaksson, A. and G. Forsman. 2003. "A Comparison Between Using the Web and Using Telephone to Survey Political Opinions." Presented at annual conference of the American Association of Public Opinion Research, Nashville, TN. (Available at: http://www.amstat.org/sections/SRMS/Proceedings/.).
14. Kalton, G. and D. Kasprzyk. 1986. "The Treatment of Missing Survey Data. " Survey Methodology 12(1):1-16.
15. Kim, J.J., J. Li, and R. Valliant. 2007. "Cell Collapsing in Poststratification." Survey Methodology 33(2):139-50.
16. Kish, L. 1965. Survey Sampling, New York: John Wiley.
17. Lee, S. 2006. "Propensity Score Adjustment as a Weighting Scheme for Volunteer Panel Web Surveys." Journal of Official Statistics 22(2): 329-49.
18. Lee, S. and R. Valliant. 2009. "Estimation for Volunteer Panel Web Surveys Using Propensity Score Adjustment and Calibration Adjustment." Sociological Methods & Research 37(3): 319-43.
19. Little, R.J. A. (1986). "Survey Nonresponse Adjustments for Estimates of Means." International Statistical Review 54:139-57.
20. Lumley, T.T. 2010. Complex Surveys: A Guide to Analysis Using R. Hoboken, NJ: John Wiley.
21. R Development Core Team. (2009). R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing. (Also available at: http://www.R-project.org.).
22. Rivers, D. (N.d.). "Sample Matching: Representative Sampling From Internet Panels." White paper, YouGovPolimetrix, Palo Alto, CA. (Also available at: http://www.polimetrix.com/documents/PolimetrixWhitepaperSampleMatching.pdf).
23. Rosenbaum, P.R. and D.B. Rubin. 1983. "The Central Role of the Propensity Score in Observational Studies for Causal Effects." Biometrika 70(1): 41-55.
24. SÃ{currency sign}rndal, C.-E., B. Swensson, and J. Wretman, 1992. Model Assisted Survey Sampling. New York: Springer-Verlag.
25. Schonlau, M., A. van Soest, and A. Kapteyn. 2007. "Are 'Webographic' or Attitudinal Questions Useful for Adjusting Estimates From Web Surveys Using Propensity Scoring?" Survey Research Methods 1(3): 155-63.
26. Schonlau, M., A. van Soest, A. Kapteyn, and M. Couper. 2009. "Selection Bias in Web Surveys and the Use of Propensity Scores." Sociological Methods & Research 37(3): 291-318.
27. Schonlau, M., K. Zapert, L. Simon, K. Sanstad, S. Marcus, J. Adams, M. Spranca, H. Kan, R. Turner, and S. Berry. 2004. "A Comparison Between Responses From a Propensity-Weighted Web Survey and an Identical RDD Survey." Social Science Computer Review 22(1):128-38.
28. Smith, T.M.F. 1983. "On the Validity of Inferences From Non-Random Samples." Journal of the Royal Statistical Society, Series A: General 146: 394-403.
29. Terhanian, G. 2000. "How to Produce Credible, Trustworthy Information Through Internet-Based Survey Research." Presented at the annual conference of the American Association for the Public Opinion Research, Portland, OR.
30. Terhanian, G. and J. Bremer. 2000. "Confronting the Selection-Bias and Learning Effects Problems Associated With Internet Research." White paper, Harris Interactive, Rochester, NY. (Also available at: http://growingupwithmedia.com/pdf/ConfrontingSelectionBias.pdf.).
31. Terhanian, G., J. Bremer, R. Smith, and R. Thomas. 2000. "Correcting Data From Online Survey for the Effects of Nonrandom Selection and Nonrandom Assignment." Research paper, Harris Interactive, Rochester, NY.
32. U.S. Census Bureau. 2002. Sources and Accuracy of Estimates for Poverty in the United States: 2002. Washington, DC: U.S. Census Bureau.
33. Valliant, R., A. H. Dorfman, and R. M. Royall. (2000). Finite Population Sampling and Inference: A Prediction Approach. New York: John Wiley.
34. Varedian, M. and G. Forsman. 2003. "Comparing Propensity Score Weighting With Other Weighting Methods: A Case Study on Web Data." Presented at the meetings of the American Association for Public Opinion Research.
35. Vehovar, V., K. Manfreda, and Z. Batagelj. 1999. "Web Surveys: Can the Weighting Solve the Problem?" Presented at the annual conference of the American Association for Public Opinion Research, St. Pete Beach, FL. (Available at http://www.amstat.org/sections/SRMS/Proceedings/.).
36. Wickham, H. 2009. ggplot2: Elegant Graphics for Data Analysis. New York: Springer.