Separating interviewer and area effects by using a cross-classified multilevel logistic model: simulation findings and implications for survey designs

Journal of the Royal Statistical Society. Series A: Statistics in Society

Volumn 180, Issue 2, 2017, Pages 531-550

  Vassallo, Rebecca ^a   Durrant, Gabriele ^a   Smith, Peter ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Area effects; Cross classification; Interpenetration; Interviewer effects; Multilevel models

Indexed keywords

EID: 84973596451     PISSN: 09641998     EISSN: 1467985X     Source Type: Journal    
DOI: 10.1111/rssa.12206     Document Type: Article

References (28)

1. Blom, A. G., De Leeuw, E. D. and Hox, J. J. (2010) Interviewer effects on nonresponse in the European Social Survey. Working Paper 2010-25. Institute for Social and Economic Research, University of Essex, Colchester.
2. Browne, W. J. (2012) MCMC Estimation in MLwiN, Version 2.25. Bristol: Centre for Multilevel Modelling.
3. Browne, W. and Golalizadeh, M. (2009) MLPowSim. Bristol: Centre for Multilevel Modelling.
4. Browne, W. J., Goldstein, H. and Rasbash, J. (2001) Multiple membership multiple classification (MMMC) models. Statist. Modllng, 1, 103–124.
5. Campanelli, P. and O’Muircheartaigh, C. (1999) Interviewers, interviewer continuity, and panel survey nonresponse. Qual. Quant., 33, 59–76.
6. Campanelli, P., Sturgis, P. and Purdon, S. (1997) Can you hear me knocking: an investigation into the impact of interviewers on survey response rates. Final Report. National Centre for Social Research, London.
7. Durrant, G. B., Groves, R. M., Staetsky, L. and Steele, F. (2010) Effects of interviewer attitudes and behaviors on refusal in household surveys. Publ. Opin. Q., 74, 1–36.
8. Durrant, G. B. and Steele, F. (2009) Multilevel modelling of refusal and non-contact in household surveys: evidence from six UK Government surveys. J. R. Statist. Soc. A, 172, 361–381.
9. Fielding, A. and Goldstein, H. (2006) Cross-classified and multiple membership structures in multilevel models: an introduction and review. Research Report RR791. Department for Education and Skills, London. (Available from https://www.education.gov.uk/publications/standard/publicationDetail/Page1/RR791.)
10. Gelman, A., Carlin, J. B., Stern, H. S. and Rubin, D. B. (2004) Bayesian Data Analysis, 2nd edn. London: Chapman and Hall.
11. Goldstein, H. (2011) Multilevel Statistical Models, 4th edn. Chichester: Wiley.
12. Hansen, K. M. (2006) The effects of incentives, interview length, and interviewer characteristics on response rates in a CATI study. Int. J. Publ. Opin. Res., 19, 112–121.
13. Haunberger, S. (2010) The effects of interviewer, respondent and area characteristics on cooperation in panel surveys: a multilevel approach. Qual. Quant., 44, 957–969.
14. Hox, J. and De Leeuw, E. (2002) The influence of interviewers’ attitude and behavior on household survey nonresponse: an international comparison. In Survey Nonresponse (eds R. M. Groves, D. A. Dillman, J. L. Eltinge and R. J. A. Little), pp. 103–119. New York: Wiley.
15. Leckie, G. and Charlton, C. (2011) runmlwin: Stata module for fitting multilevel models in the MLwiN software package. Centre for Multilevel Modelling, University of Bristol, Bristol.
16. Maas, C. J. M. and Hox, J. J. (2005) Sufficient sample sizes for multilevel modelling. Eur. J. Res. Meth. Behav. Socl Sci., 1, 85–91.
17. Moineddin, R., Matheson, F. I. and Glazier R. H. (2007) A simulation study of sample size for multilevel logistic regression models. BMC Med. Res. Methodol., 7, 7–34.
18. Mok, M. (1995) Sample size requirements for 2-level designs in educational research. Multilvl Modllng Newslett., 7, 11–15.
19. O’Muircheartaigh, C. and Campanelli, P. (1999) A multilevel exploration of the role of interviewers in survey non-response. J. R. Statist. Soc. A, 162, 437–446.
20. Paccagnella, O. (2011) Sample size and accuracy of estimates in multilevel models: new simulation results. Methodology, 7, 111–120.
21. Pickery, J. and Loosveldt, G. (2002) A multilevel multinomial analysis of interviewer effects on various components of unit nonresponse. Qual. Quant., 36, 427–437.
22. Pickery, J., Loosveldt, G. and Carton, A. (2001) The effects of interviewer and respondent characteristics on response behavior in panel surveys—a multilevel approach. Sociol. Meth. Res., 29, 509–523.
23. Rodriguez, G. and Goldman, N. (1995) An assessment of estimation procedures for multilevel models with binary responses. J. R. Statist. Soc. A, 158, 73–89.
24. Schnell, R. and Kreuter, F. (2005) Separating interviewer and sampling-point effects. J. Off. Statist., 21, 389–410.
25. Snijders, T. A. B. and Bosker, R. J. (1999) Multilevel Analysis: an Introduction to Basic and Advanced Multilevel Modelling. London: Sage.
26. Theall, K. P., Scribner, R., Broyles, S., Yu, Q., Chotalia, J., Simonsen, N., Schonlau, M. and Carlin, B. P. (2011) Impact of small group size on neighbourhood influences in multilevel models. J. Epidem. Commty Hlth, 65, 688–695.
27. Vassallo, R., Durrant, G. B., Smith, P. W. F. and Goldstein, H. (2015) Interviewer effects on non-response propensity in longitudinal surveys: a multilevel modelling approach. J. R. Statist. Soc. A, 178, 83–99.
28. Von Sanden, N. D. (2004) Interviewer effects in household surveys: estimation and design. PhD Thesis. School of Mathematics and Applied Statistics, University of Wollongong, Wollongong. (Available from http://ro.uow.edu.au/theses/312/.)