Tailored fieldwork design to increase representative household survey response: An experiment in the Survey of Consumer Satisfaction

Journal of the Royal Statistical Society. Series A: Statistics in Society

Volumn 176, Issue 1, 2013, Pages 169-189

  Luiten, Annemieke ^a   Schouten, Barry ^a  

^a STATISTICS NETHERLANDS   (Netherlands)

Author keywords

Adaptive design; Non response bias; Paradata; R indicators; Representative response; Tailored design

Indexed keywords

EID: 84871662110     PISSN: 09641998     EISSN: 1467985X     Source Type: Journal    
DOI: 10.1111/j.1467-985X.2012.01080.x     Document Type: Article

References (39)

1. American Association for Public Opinion Research (2008) Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys, 5th edn. Lenexa: American Association for Public Opinion Research.
2. Banning, R., Cobben, F. and en Leufkens, K. (2011) Kwaliteitsmeting van EBB Kernvariabelen in Eerste Peiling 2010 (Measuring quality of substantive Labour Force Survey variables, first wave 2010). Internal Report. Statistics Netherlands, The Hague.
3. Bethlehem, J. (2002) Weighting non-response adjustment based on auxiliary information. In Survey Non-response (eds R. M. Groves, D. Dillman, J. Eltinge and R. Little ). New York: Wiley.
4. Bethlehem, J. and Schouten, B. (2009) Representativeness indicators for measuring and enhancing the quality of survey response. RISQ Deliverable 9. (Available from http://www.risq-project.eu/papers.)
5. Cobben, F. (2011) Responsgedrag in de Gezondheidsenquête 2010 (Response behaviour in the Health Survey 2010). Internal Report . Statistics Netherlands, The Hague.
6. Couper, M. (1998) Measuring survey quality in a CASIC environment. Jt Statist. Meet . American Statistical Association, Dallas . (Available from http://www.amstat.org/Sections/Srms/Proceedings.)
7. Couper, M. and Lyberg, L. (2005) The use of paradata in survey research. In Proc. 55th Sessn International Statistical Institute, Sydney.
8. Curtin, R., Presser, S. and Singer, E. (2000) The effects of response rate changes on the index of consumer sentiment. Publ. Opin. Q., 64, 413-428.
9. Durrant, G. B., D'Arrigo, J. and Steele, F. (2011) Using paradata to predict best times of contact, conditioning on household and interviewer influences. J. R. Statist. Soc. A, 174, 1029-1049.
10. Gambino, J., Laflamme, F. and Wrighte, D. (2010) Responsive design at Statistics Canada: development, implementation and early results. 21st Int. Wrkshp Household Survey Non-response, Nürnberg, Aug. 30th-Sept. 1st.
11. Groves, R. M. (2004) Survey Errors and Survey Costs. Hoboken: Wiley.
12. Groves, R. M. (2006) Non-response rates and non-response bias in household surveys. Publ. Opin. Q., 70, 646-675.
13. Groves, R. M. and Heeringa, S. G. (2006) Responsive design for household surveys: tools for actively controlling survey errors and costs. J. R. Statist. Soc. A, 169, 439-457.
14. Groves, R. and Peytcheva, E. (2008) The impact of non-response rates on non-response bias: a meta analysis. Publ. Opin. Q., 72, 167-189.
15. Heerwegh, D., Abts, K. and Loosveldt, G. (2007) Minimizing survey refusal and noncontact rates: do our efforts pay off?Surv. Res. Meth., 1, 3-10.
16. Keeter, S., Miller, C., Kohut, A., Groves, R. M. and Presser, S. (2000) Consequences of reducing non-response in a national telephone survey. Publ. Opin. Q., 64, 125-148.
17. Kraan, T., van den Brakel, J., Buelens, B. and Huys, H. (2009) Social desirability bias, response order effects and selection effects in the new Dutch Safety Monitor. Federal Committee on Statistical Methodology Res. Conf., Nov. 2nd-4th.
18. Kreuter, F., Olson, K., Wagner, J., Yan, T., Ezzati-Rice, T. M., Casas-Cordero, C., Lemay, M., Peytchev, A., Groves, R. M. and Raghunathan, T. E. (2010) Using proxy measures and other correlates of survey outcomes to adjust for non-response: examples from multiple surveys. J. R. Statist. Soc. A, 173, 389-407.
19. de Leeuw, E. and de Heer, W. (2002) Trends in household survey non-response: a longitudinal and international perspective. In Survey Non-response (eds R. M. Groves, D. Dillman, J. Eltinge and R. Little ). New York: Wiley.
20. Lepkowski, J., Axinn, W., Kirgis, N., West, B., Kruger Ndiaye, S., Mosher, W. and Groves, R. (2010) Use of paradata in a responsive design framework to manage a field data collection. Survey Methodology Working Paper 10-012 . National Survey of Family Growth.
21. Luiten, A. and Cobben, F. (2010) Predicting co-operation in survey research. 21st Int. Wrkshp Household Survey Non-response, Nürnberg .
22. Luiten, A., Schouten, B. and Cobben, F. (2007) Experiments in balancing response, representativeness and costs in a CATI survey. 18th Int. Wrkshp Household Survey Non-response, Southampton .
23. Millar, M. and Dillman, D. (2011) Improving response to web and mixed-mode surveys. Publ. Opin. Q., 75, 249-269.
24. Mohl, C. and Laflamme, F. (2007) Research and responsive design options for survey data collection at Statistics Canada. Proc. Am. Statist. Ass., 2962-2968.
25. Peytchev, A., Riley, S., Rosen, J., Murphy, J. and Lindblad, M. (2010) Reduction of non-response bias in surveys through case prioritization. Surv. Res. Meth., 4, 21-29.
26. Schouten, B. (2010) Dynamic adaptive survey designs; from paradata to data. 21st Wrkshp Household Survey Non-response Nürnberg, Aug. 30th-Sept. 1st. (Available from http://cbsh1sps/sites/TmoMeth/WaarPers/0320Waarnemingsmethoden20personen/2010/NR20workshop20paper20-20Schouten.pdf.)
27. Schouten, B. and Cobben, F. (2012) Non-representative survey response: to balance, to adjust or both? Discussion Paper . Statistics Netherlands, The Hague.
28. Schouten, B., Cobben, F. and Bethlehem, J. (2009) Indicators for the representativeness of survey response. Surv. Methodol., 35, 101-113.
29. Schouten, B., Luiten, A., Loosveldt, G., Beullens, K. and Kleven, Ø. (2010) Monitoring and changing data collection through R-indicators and partial R-indicators. RISQ Deliverable . (Available from http://www.risqproject.eu/papers.)
30. Schouten, B., Morren, M., Bethlehem, J., Shlomo, N. and Skinner, C.(2009) How to use R-indicators? RISQ Deliverable . (Available from http://www.risq-project.eu/papers.)
31. Schouten, B. and Shlomo, N. (2010) Indicators for representative response. Quality in Official Statistics Conf., Helsinki, May .
32. Shih, T.-H. and Fan, X. (2007) Response rates and mode preferences in web-mail mixed-mode surveys: a meta-analysis. Int. J. Internet Sci., 2, 59-82.
33. Shlomo, N., Skinner, C., Schouten, B., Bethlehem, J. and Zhang, L.C.(2009a) Statistical properties of representativity indicators. RISQ Deliverable . (Available from http://www.risq-project.eu/papers.)
34. Shlomo, N., Skinner, C., Schouten, B., Carolina, T. and Morren, M.(2009b) Partial indicators for representative response. RISQ Deliverable . (Available from http://www.risq-project.eu/papers.)
35. Starick, R. and Steel, J. (2012) Does increased effort lead to a less representative response?: selected case studies from the Australian Bureau of Statistics. Eur. Conf. Quality in Official Statistics, Athens, May 29th-June 1st.
36. Statistics Netherlands (2011) Media en ICT: Gebruik Televisie, Krant, PC en Internet (Media and ICT: use of television, paper, PC and Internet). Statistics Netherlands, The Hague. (Available from http://statline.cbs.nl/StatWeb/publication/?DMSLNL&PA70655ned&D176-77, 90&D237-41, 52&D3a&HDRT&STBG1, G2&VWT.)
37. van Veen, P. (2004) Contact and participation probabilities in CAPI and CATI surveys. Masters Thesis. University of Utrecht, Utrecht.
38. Wagner, J. (2008) Adaptive survey design to reduce non-response bias. PhD Thesis. University of Michigan, Ann Arbor.
39. Westat (2004) Blaise CATI Guide. Rockville: Westat.