Nonresponse and measurement error variance among interviewers in standardized and conversational interviewing

Journal of Survey Statistics and Methodology

Volumn 6, Issue 3, 2018, Pages 335-359

  West, Brady T ^a   Conrad, Frederick G ^a   Kreuter, Frauke ^b   Mittereder, Felicitas ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

Conversational interviewing; Interviewer effects; Interviewer variance; Multilevel modeling; Standardized interviewing; Total survey error

Indexed keywords

EID: 85055344637     PISSN: 23250984     EISSN: 23250992     Source Type: Journal    
DOI: 10.1093/JSSAM/SMX029     Document Type: Article

References (49)

1. Ackermann-Piek, D., and N. Massing (2014), "Interviewer Behavior and Interviewer Characteristics in PIAAC Germany, " Methods, Data, Analyses, 8, 199-222
2. Bailar, B., . L. Bailey, and J. Stevens (1977), "Measures of Interviewer Bias and Variance, " Journal of Marketing Research, 14, 337-343
3. Belli, R. F. (1998), "The Structure of Autobiographical Memory and the Event History Calendar: Potential Improvements in the Quality of Retrospective Reports in Surveys, " Memory, 6, 383-406
4. Belli, R. F., E. H. Lee, F. P. Stafford, and C.-H. Chou (2004), "Calendar and Question-list Survey Methods: Association between Interviewer Behaviors and Data Quality, " Journal of Official Statistics, 20, 185-218
5. Belli, R. F., W. L. Shay, and F. P. Stafford (2001), "Event History Calendars and Question List Surveys: A Direct Comparison of Interviewing Methods, " Public Opinion Quarterly, 65, 45-74
6. Bruckmeier, K., G. Müller, and R. T. Riphahn (2015), "Survey Misreporting of Welfare Receipt: Respondent, Interviewer, and Interview Characteristics, " Economics Letters, 129, 103-107
7. Campanelli, P., P. Sturgis, and S. Purdon (1997), Can You Hear Me Knocking: An Investigation into the Impact of Interviewers on Survey Response Rates, London: SCPR Survey Methods Centre
8. Conrad, F. G., and M. F. Schober (2000), "Clarifying Question Meaning in a Household Telephone Survey, " Public Opinion Quarterly, 64, 1-28
9. Elliott, M. R., and B. T. West (2015), "Clustering by Interviewer': A Source of Variance That Is Unaccounted for in Single-Stage Health Surveys, " American Journal of Epidemiology, 182, 118-126
10. Fowler, F. J., and T. W. Mangione (1990), Standardized Survey Interviewing: Minimizing Interviewer-Related Error, Newbury Park, CA: SAGE Publications
11. Groves, R. M. (2004), "Chapter 8: The interviewer as a source of survey measurement error, " Survey Errors and Survey Costs (2nd ed.), New York: Wiley-Interscience
12. Groves, R. M. (2006), "Nonresponse Rates and Nonresponse Bias in Household Surveys, " Public Opinion Quarterly, 70, 646-675
13. Groves, R. M., and L. J. Magilavy (1986), "Measuring and Explaining Interviewer Effects in Centralized Telephone Surveys, " Public Opinion Quarterly, 50, 251-266
14. Groves, R. M., and K. A. McGonagle (2001), "A Theory-Guided Interviewer Training Protocol Regarding Survey Participation, " Journal of Official Statistics, 17, 249-265
15. Groves, R. M., R. B. Cialdini, and M. P. Couper (1992), "Understanding the Decision to Participate in a Survey, " Public Opinion Quarterly, 56, 475-495
16. Groves, R. M., and E. Peytcheva (2008), "The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-Analysis, " Public Opinion Quarterly, 72, 167-189
17. Groves, R. M., E. Singer, and A. Corning (2000), "Leverage-Saliency Theory of Survey Participation, " Public Opinion Quarterly, 64, 299-308
18. Haan, M., Y. Ongena, and M. Huiskes (2013), "Interviewers' Questions: Rewording Not Always a Bad Thing, " In: Interviewers' Deviations in Surveys: Impact, Reasons, Detection and Prevention, (edited by P. Winker, N. Menold, and R. Porst), Frankfurt: Peter Lang Academic Research
19. Henson, R., C. F. Cannell, and S. Lawson (1976), "Effects of Interviewer Style on Quality of Reporting in a Survey Interview, " Journal of Psychology, 93, 221-227
20. Houtkoop-Steenstra, H. (1995), "Meeting Both Ends: Between Standardization and Recipient Design in Telephone Survey Interviews, " Situated Order: Studies in the Social Organization of Talk and Embodied Activities, ed. P. ten Have and G. Psathas, pp. 91-107, Washington, DC: University Press of America
21. Hubbard, F., C. Antoun, and F. G. Conrad (2012), "Conversational Interviewing, The Comprehension of Opinion Questions and Nonverbal Sensitivity, " Paper presented at the Annual Conference of the American Association for Public Opinion Research, Orlando, FL
22. Kish, L. (1962), "Studies of Interviewer Variance for Attitudinal Variables, " Journal of the American Statistical Association, 57, 92-115
23. Mangione, T. W., F. J. Fowler, and T. A. Louis (1992), "Question Characteristics and Interviewer Effects, " Journal of Official Statistics, 8, 293-307
24. Mittereder, F., J. Durow, B. T. West, F. Kreuter, and F. G. Conrad (forthcoming), "Interviewer-Respondent Interactions in Conversational and Standardized Interviewing, " Field Methods. Morton-Williams, J. (1993), Interviewer Approaches, Aldershot: Dartmouth Publishing Company Limited
25. Moser, C. A., and A. Stuart (1953), "An Experimental Study of Quota Sampling, " Journal of the Royal Statistical Society, Series A, 116, 349-405
26. O'Muircheartaigh, C., and P. Campanelli (1998), "The Relative Impact of Interviewer Effects and Sample Design Effects on Survey Precision, " Journal of the Royal Statistical Society, Series A, 161, 63-77
27. Peneff, J. (1988), "The Observers Observed: French Survey Researchers at Work, " Social Problems, 35, 520-535
28. Sayles, H., R. F. Belli, and E. Serrano (2010), "Interviewer Variance Between Event History Calendar and Conventional Questionnaire Interviews, " Public Opinion Quarterly, 74, 140-153
29. Schaeffer, N. C., J. Dykema, and D. W. Maynard (2010), "Interviewers and Interviewing, " Handbook of Survey Research, (2nd ed.), ed. James D. Wright and Peter V. Marsden, pp. 437-470, Bingley, UK: Emerald Group Publishing Limited
30. Schnell, R., and F. Kreuter (2005), "Separating Interviewer and Sampling-Point Effects, " Journal of Official Statistics, 21, 389-410
31. Schober, M. F., and F. G. Conrad (1997), "Does Conversational Interviewing Reduce Survey Measurement Error?, " Public Opinion Quarterly, 61, 576-602
32. Schober, M. F., F. G. Conrad, W. Dijkstra, and Y. P. Ongena (2012), "Disfluencies and Gaze Aversion in Unreliable Responses to Survey Questions, " Journal of Official Statistics, 28, 555-582
33. Schober, M. F., F. G. Conrad, and S. S. Fricker (2004), "Misunderstanding Standardized Language in Research Interviews, " Applied Cognitive Psychology, 18, 169-188
34. Snijkers, G., J. J. Hox, and E. D. de Leeuw (1999), "Interviewers' Tactics for Fighting Survey Nonresponse, " Journal of Official Statistics, 15, 185-198
35. Stock, J. S., and J. R. Hochstim (1951), "A Method of Measuring Interviewer Variability, " Public Opinion Quarterly, 15, 322-334
36. Stokes, S. L., M. Yeh. (1988), "Searching for Causes of Interviewer Effects in Telephone Surveys, " Telephone Survey Methodology, ed. R. M. Groves, pp. 357-373, New York: John Wiley and Sons
37. Sturgis, P., and P. Campanelli (1998), "The Scope for Reducing Refusals in Household Surveys: An Invesigation Based on Transcripts of Tape-Recorded Doorstep Interactions, " Journal of the Market Research Society, 40, 121-139
38. Suchman, L., and B. Jordan (1990), "Interactional Troubles in Face-to-Face Survey Interviews, " Journal of the American Statistical Association, 85, 232-241
39. Trappmann, M., J. Beste, A. Bethmann, and G. Müller (2013), "The PASS Panel Survey After Six Waves, " Journal of Labor Market Research, 46, 275-281
40. Tucker, C. (1983), "Interviewer Effects in Telephone Surveys, " Public Opinion Quarterly, 47, 84-95
41. Vassallo, R., G. Durrant, and P. Smith (2016), "Separating Interviewer and Area Effects by Using a Cross-Classified Multilevel Logistic Model: Simulation Findings and Implications for Survey Designs, " Journal of the Royal Statistical Society, Series A. doi: 10.1111/rssa.12206
42. West, B. T., and A. G. Blom (2017), "Explaining Interviewer Effects: A Research Synthesis, " Journal of Survey Statistics and Methodology, 5, 175-211
43. West, B. T., F. G. Conrad, F. Kreuter, and F. Mittereder (2017), "Can Conversational Interviewing Improve Survey Response Quality Without Increasing Interviewer Effects?, " Journal of the Royal Statistical Society, Series A. doi: 10.1111/rssa.12255
44. West, B. T., and M. R. Elliott (2014), "Frequentist and Bayesian Approaches for Comparing Interviewer Variance Components in Two Groups of Survey Interviewers, " Survey Methodology, 40, 163-188
45. West, B. T., and M. R. Elliott (2015), "New Methodologies for the Study and Decomposition of Interviewer Effects in Surveys, " Paper Presented at the Annual Meeting of the Statistical Society of Canada (SSC), Halifax, Nova Scotia, 6/17/15
46. West, B. T., F. Kreuter, and U. Jaenichen (2013). "Interviewer' Effects in Face-to-face Surveys: A Function of Sampling, Measurement Error or Nonresponse?, " Journal of Official Statistics, 29, 277-297
47. West, B. T., and K. Olson (2010), "How Much of Interviewer Variance is Really Nonresponse Error Variance?, " Public Opinion Quarterly, 74, 1004-1026
48. West, B. T., J. Wagner, H. Gu, and F. Hubbard (2015), "The Utility of Alternative Commercial Data Sources for Survey Operations and Estimation: Evidence from the National Survey of Family Growth, " Journal of Survey Statistics and Methodology, 3, 240-264
49. Zhang, D., and X. Lin (2008), "Variance Component Testing in Generalized Linear Mixed Models for Longitudinal/Clustered Data and Other Related Topics, " Random Effect and Latent Variable Model Selection, ed. D. B. Dunson, Lecture Notes in Statistics, 192, New York, NY: Springer