Alternative Indicators for the Risk of Non-response Bias: A Simulation Study

International Statistical Review

Volumn 84, Issue 1, 2016, Pages 43-62

  Nishimura, Raphael ^a   Wagner, James ^a   Elliott, Michael ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Bias; Missing data; Non response; Non response indicators; Survey data quality measures

Indexed keywords

EID: 84927153859     PISSN: 03067734     EISSN: 17515823     Source Type: Journal    
DOI: 10.1111/insr.12100     Document Type: Article

References (36)

1. Andridge, R.R. & Little, R.J.A. (2011). Proxy pattern-mixture analysis for survey nonresponse. J. Off. Statist., 27(2), 153-180.
2. Atrostic, B.K., Bates, N., Burt, G. & Silberstein, A. (2001). Nonresponse in US government household surveys: Consistent measures, recent trends, and new insights. J. Off. Statist., 17(2), 209-226.
3. Beullens, K. & Loosveldt, G. (2012). Should high response rates really be a primary objective?Surv. Pract., 5(3).
4. Bethlehem, J.G. (1988). Reduction of nonresponse bias through regression estimation. J. Off. Statist., 4(3), 251-261.
5. Brick, J.M. & Jones, M.E. (2008). Propensity to respond and nonresponse bias. Metron, 66, 51-73.
6. Brick, J.M. & Williams, D. (2013). Explaining rising nonresponse rates in cross-sectional surveys. Ann. Am. Acad. Pol. Soc. Sci., 645(1), 36-59.
7. Cochran, W.G. (1977). Sampling Techniques, 3rd ed New York: Wiley.
8. Couper, M.P. (1998). Measuring survey quality in a CASIC environment. In Proceedings of the Survey Research Methods Section of the American Statistical Association, pp. 41-49. Dallas, TX, USA.
9. Couper, M.P. & Lyberg, L. (2005). The use of paradata in survey research. In Proceedings of the International Statistical Institute Meetings, pp. 1-5. Sydney, Australia.
10. Curtin, R., Presser, S. & Singer, E. (2005). Changes in telephone survey nonresponse over the past quarter century. Publ. Opin. Q., 69(1), 87-98.
11. de Leeuw, E., de Heer, W. (2002). Trends in household survey nonresponse: A longitudinal and international comparison. In Survey Nonresponse, Ed. R.M. Groves, pp. 41-54. New York: John Wiley & Sons.
12. Dempster, A.P., Laird, N.M. & Rubin, D.B. (1977). Maximum likelihood from incomplete data via the EM algorithm. J. R. Statist. Soc. Ser. B (Methodological), 39(1), 1-38.
13. Graham, J., Olchowski, A. & Gilreath, T. (2007). How many imputations are really needed? Some practical clarifications of multiple imputation theory. Prev. Sci., 8(3), 206-213.
14. Groves, R.M. (2006). Nonresponse rates and nonresponse bias in household surveys. Publ. Opin. Q., 70(5), 646-675.
15. Groves, R.M. & Heeringa, S.G. (2006). Responsive design for household surveys: Tools for actively controlling survey errors and costs. J. R. Statist. Soc. Ser. A (Statistics in Society), 169(3), 439-457.
16. Groves, R.M. & Peytcheva, E. (2008). The impact of nonresponse rates on nonresponse bias: A meta-analysis. Publ. Opin. Q., 72(2), 167-189.
17. Harrell, F.E., Jr. (2014). rms: Regression modeling strategies. R package version 4.2-0. Available at: http://CRAN.R-project.org/package=rms [Accessed on 8 July 2013].
18. Kalton, G. & Kasprzyk, D. (1986). Treatment of missing survey data. Surv. Method., 12, 1-16.
19. Kreuter, F. & Olson, K. (2011). Multiple auxiliary variables in nonresponse adjustment. Sociological Meth. Res., 40(2), 311-332.
20. Kreuter, F. (2013). Improving Surveys with Paradata: Analytic Use of Process Information. New Jersey: Wiley.
21. Little, R.J.A. & Rubin, D.B. (2002). Statistical Analysis with Missing Data. Hoboken, N.J.: Wiley.
22. Little, R.J.A. & Vartivarian, S. (2005). Does weighting for nonresponse increase the variance of survey means? Surv. Method., 31(2), 161-168.
23. Lumley, T. (2012). Survey: Analysis of complex survey samples. R package version 3.28-2.
24. Lumley, T. (2004). Analysis of complex survey samples. J. Statist. Softw., 9(1), 1-19.
25. Nagelkerke, N.J.D. (1991). A note on a general definition of the coefficient of determination. Biometrika, 78(3), 691-692.
26. Petroni, R., Sigman, R., Willimack, D., Cohen, S. & Tucker, C. (2004). Response rates and nonresponse in establishment Surveys BLS and Census Bureau. Presented to the Federal Economic Statistics Advisory Committee: 1-50.
27. R Core Team (2013). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Available at: http://www.R-project.org/ [Accessed on 8 July 2013].
28. Rubin, D.B. (1987). Multiple Imputation for Nonresponse in Surveys. New York: Wiley.
29. Särndal, C.-E. (2011). The 2010 Morris Hansen lecture dealing with survey nonresponse in data collection, in estimation. J. Off. Statist., 27(1), 1-21.
30. Särndal, C.-E. & Lundström, S. (2010). Design for estimation: Identifying auxiliary vectors to reduce nonresponse bias. Surv. Method., 36, 131-144.
31. Schouten, B. (2007). A selection strategy for weighting variables under a not-missing-at-random assumption. J. Off. Statist., 23, 51-68.
32. Schouten, B., Cobben, F. & Bethlehem, J.G. (2009). Indicators for the representativeness of survey response. Surv. Method., 35(1), 101-113.
33. van Buuren, S. & Groothuis-Oudshoorn, K. (2011). MICE: Multivariate imputation by chained equations in R. J. Statist. Softw., 45(3), 1-67.
34. Wagner, J. (2010). The fraction of missing information as a tool for monitoring the quality of survey data. Publ. Opin. Q., 74(2), 223-243.
35. Wagner, J. (2012). A comparison of alternative indicators for the risk of nonresponse bias. Publ. Opin. Q., 76(3), 555-575.
36. Wagner, J., West, B.T., Kirgis, N., Lepkowski, J.M., Axinn, W.G. & Ndiaye, S.K. (2012). Use of paradata in a responsive design framework to manage a field data collection. J. Off. Statist., 28(4), 477-499.