A Practical Technique for Improving the Accuracy of Interviewer Observations of Respondent Characteristics

Field Methods

Volumn 27, Issue 2, 2015, Pages 144-162

  West, Brady T ^a   Kreuter, Frauke ^b,c  

^a UNIVERSITY OF MICHIGAN   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c INSTITUTE FOR EMPLOYMENT RESEARCH IAB   (Germany)

Author keywords

interviewer observations; responsive survey design; survey nonresponse; survey paradata

Indexed keywords

EID: 84928490346     PISSN: 1525822X     EISSN: 15523969     Source Type: Journal    
DOI: 10.1177/1525822X14549429     Document Type: Article

References (40)

1. Agresti A.Categorical data analysis. 2012. Categorical data analysis. 3rd ed. New York: Wiley.New York: Wiley; 2012:
2. Alwin D. F.Margins of error: A study of reliability in survey measurement. Hoboken, NJ: John Wiley; 2008:
3. Beaumont J.-F.On the use of data collection process information for the treatment of unit nonresponse through weight adjustment.Survey Methodology. 2005;31:227-31
4. Bethlehem J.Survey nonresponse. Groves R.Dillman D.Eltinge J.Little R., ed. New York: John Wiley; 2002:275-87.
5. Biemer P.,Peytchev A.Using geocoded census data for nonresponse bias correction: An assessment.Journal of Survey Statistics and Methodology. 2013;1:24-44
6. BlomA. G.2009. Nonresponse bias adjustments: What can process data contribute?Institute for Social and Economic Research Working Paper Series, No. 2009-21. www.iser.essex.ac.uk accessed July 15, 2009.
7. Brick J. M.,Williams D.Explaining rising nonresponse rates in cross-sectional surveys.The Annals of the American Academy of Political and Social Science. 2013;645:36-59
8. Campanelli P.,Sturgis P.,Purdon S.London: SCPR; 1997:
9. Funder D. C.On the accuracy of personality judgment: A realistic approach.Psychological Review. 1995;102:652-70
10. Goldstein H.Multilevel statistical models. 1995. Multilevel statistical models. 2nd ed. Kendall’s Library of Statistics 3. London: Edward Arnold.London: Edward Arnold; 1995:
11. Groves R. M.Nonresponse rates and nonresponse bias in household surveys.Public Opinion Quarterly. 2006;70:646-75
12. Groves R. M.,Heeringa S. G.Responsive design for household surveys: Tools for actively controlling survey errors and costs.Journal of the Royal Statistical Society, eries A. 2006;169:439-57
13. Groves R. M.,Peytcheva E.The impact of nonresponse rates on nonresponse bias: A meta-analysis.Public Opinion Quarterly. 2008;72:167-89
14. Heeringa S. G.,West B. T.,Berglund P. A.Applied survey data analysis. Boca Raton, FL: Chapman Hall/CRC Press; 2010:
15. Hosmer D. W.,Lemeshow S.Applied logistic regression. 2000. Applied logistic regression. 2nd ed. New York: John Wiley.New York: John Wiley; 2000:
16. Hox J. J.Classification, data analysis, and data highways. Balderjahn I.Mathar R.Schader M., ed. New York: Springer-Verlag; 1998:147-54.
17. Kazdin A. E.Artifact, bias, and complexity of assessment: The ABCs of reliability.Journal of Applied Behavior Analysis. 1977;10:141-50
18. Keeter S.,Miller C.,Kohut A.,Groves R.,Presser S.Consequences of reducing nonresponse in a national telephone survey.Public Opinion Quarterly. 2000;64:125-48
19. Kreuter F.Improving surveys with paradata: Analytic uses of process information. New York: John Wiley; 2013:
20. Kreuter F.,Olson K.,Wagner J.,Yan T.,Ezzati-Rice T. M.,Casas-Cordero C.,Lemay M.,Peytchev A.,Groves R. M.,Raghunathan T. E.Using proxy measures and other correlates of survey outcomes to adjust for nonresponse: Examples from multiple surveys.Journal of the Royal Statistical Society—Series A. 2010;173:1-21
21. Lepkowski J. M.,Mosher W. D.,Davis K. E.,Groves R. M.,Van Hoewyk J.The 2006–2010 National survey of family growth: Sample design and analysis of a continuous survey. Hyattsville, MD: National Center for Health Statistics; 2010:
22. Lessler J.,Kalsbeek W.Nonsampling errors in surveys. New York: Wiley-Interscience; 1992:
23. Little R. J. A.,Rubin D. B.Statistical analysis with missing data. 2002. Statistical analysis with missing data. 2nd ed. Hoboken, NJ: Wiley-Interscience.Hoboken, NJ: Wiley-Interscience; 2002:
24. Little R. J. A.,Vartivarian S.Does weighting for nonresponse increase the variance of survey means?.Survey Methodology. 2005;31:161-68
25. Most S. B.,Scholl B. J.,Clifford E. R.,Simons D. J.What you see is what you get: Sustained inattentional blindness and the capture of awareness.Psychological Review. 2005;112:217-42
26. O’Muircheartaigh C.,Campanelli P.A multilevel exploration of the role of interviewers in survey non-response.Journal of the Royal Statistical Society, Series A. 1999;162:437-46
27. Raudenbush S. W.,Bryk A. S.Hierarchical linear models: Applications and data analysis methods. Newbury Park, CA: Sage; 2002:
28. ScholesS.WardleH.SprostonK.ErensB.GriffithsM.OrfordJ.2008. Understanding nonresponse to the British Gambling Prevalence Survey 2007. Prepared for the Gambling Commission by the National Centre for Social Research, October. http://www.gamblingcommission.gov.uk/pdf/Understandingnon-responsestoBGPS2007–Oct2008.pdf accessed January 15, 2009.
29. Sinibaldi J.,Durrant G. B.,Kreuter F.Evaluating the measurement error of interviewer observed paradata.Public Opinion Quarterly. 2013;77:173-93
30. Tipping S.,Sinibaldi J.Examining the trade off between sampling and targeted non-response error in a targeted non-response follow-up.Paper presented at the 2010 International Total Survey Error Workshop; 2010Stowe, Vermont; 2010.
31. Tversky A.,Kahneman D.Judgment under uncertainty: Heuristics and biases.Science. 1974;185:1124
32. Wagner J.The fraction of missing information as a tool for monitoring the quality of survey data.Public Opinion Quarterly. 2010;74:223-43
33. Wagner J.,West B. T.,Kirgis N.,Lepkowski J. M.,Axinn W. G.,Ndiaye S.Use of paradata in a responsive design framework to manage a field data collection.Journal of Official Statistics. 2012;28:477-99
34. WestB. T.2010. A practical technique for improving the accuracy of interviewer observations: Evidence from the National Survey of Family Growth. NSFG Paper No. 10-013. http://www.psc.isr.umich.edu/pubs/pdf/ng10-013.pdf accessed November 15, 2013.
35. West B. T.An examination of the quality and utility of interviewer observations in the National Survey of Family Growth. Journal of the Royal Statistical Society.Series A. 2013a;176:211-25
36. West B. T.Improving surveys with paradata: Analytic uses of process information. Kreuter F., ed. Hoboken, NJ: John Wiley; 2013b:361-88.
37. West B. T.,Kreuter F.Observational strategies associated with increased accuracy of interviewer observations: Evidence from the National Survey of Family Growth.Proceedings of the Joint Statistical Meetings, Survey Research Methods Section. 2011;:5646-58
38. West B. T.,Kreuter F.Factors affecting the accuracy of interviewer observations: Evidence from the National Survey of Family Growth (NSFG).Public Opinion Quarterly. 2013;77:522-48
39. West B. T.,Little R. J. A.Nonresponse adjustment of survey estimates based on auxiliary variables subject to error.Journal of the Royal Statistical Society, Series C. 2013;62:213-31
40. West B. T.,Sinibaldi J.Improving surveys with paradata: Analytic uses of process information. Kreuter F., ed. Hoboken, NJ: John Wiley; 2013:339-59.