Improving Social Measurement by Understanding Interaction in Survey Interviews

Policy Insights from the Behavioral and Brain Sciences

Volumn 2, Issue 1, 2015, Pages 211-219

  Schober, Michael F ^a   Conrad, Frederick G ^b  

^a NEW SCHOOL FOR SOCIAL RESEARCH   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

clarification; data quality; interaction; misunderstanding; new communication technologies; social measurement; survey interview; survey participation

Indexed keywords

EID: 84994884062     PISSN: 23727322     EISSN: 23727330     Source Type: Journal    
DOI: 10.1177/2372732215601112     Document Type: Article

References (47)

1. Beatty P., (1995). Understanding the standardized/non-standardized interviewing controversy. Journal of Official Statistics, 11, 147-160
2. Belson W. A., (1981). The design and understanding of survey questions. Aldershot, UK: Gower
3. Belson W. A., (1986). Validity in survey research. Brookfield, VT: Gower
4. Brick J. M., Williams D., (2013). Explaining rising nonresponse rates in cross-sectional surveys. The ANNALS of the American Academy of Political and Social Science, 645(1), 36-59
5. Bruckmeier K., Müller G., Riphahn R. T., (2015). Survey misreporting of welfare receipt—Respondent, interviewer, and interview characteristics. Economics Letters, 129, 103-107
6. Campanelli P., Sturgis P., Purdon S., (1997). Can you hear me knocking: An investigation into the impact of interviewers on survey response rates. London, England: SCPR
7. Clark H. H., Schober M. F., (1991). Asking questions and influencing answers. In Tanur J. M., (Ed.), Questions about questions: Inquiries into the cognitive bases of surveys (pp. 15-48). New York, NY: Russell Sage Foundation
8. Clark H. H., Wilkes-Gibbs D., (1986). Referring as a collaborative process. Cognition, 22, 1-39
9. Conrad F. G., Broome J. S., Benkí J. R., Kreuter F., Groves R. M., Vannette D., McClain C., (2013). Interviewer speech and the success of survey invitations. Journal of the Royal Statistical Society A, 176, 191-210
10. Conrad F. G., Schober M. F., (2000). Clarifying question meaning in a household telephone survey. Public Opinion Quarterly, 64, 1-28. doi:10.1086/316757
11. Conrad F. G., Schober M. F., (Eds.). (2008). Envisioning the survey interview of the future. Hoboken, NJ: Wiley
12. Conrad F. G., Schober M. F., Jans M., Orlowski R., Nielsen D., Levenstein R., (under review). Comprehension and engagement in survey interviews with virtual agents
13. Conrad F. G., Schober M. F., Schwarz N., (2014). Pragmatic processes in survey interviewing. In Holtgraves T., (Ed.), Oxford handbook of language and social psychology (pp. 420-437). New York, NY: Oxford University Press. doi:10.1093/oxfordhb/9780199838639.013.005
14. Conrad F. G., Schober M. F., Zhang C., Yan H., Vickers L., Johnston M. J...Antoun C., (2013, May). Mode choice on an iPhone increases survey data quality. Paper presented at the 68th Annual Conference of the American Association for Public Opinion Research, Boston, MA
15. Couper M. P., Groves R. M., (1992). The role of the interviewer in survey participation. Survey Methodology, 18, 263-277
16. Couper M. P., Groves R. M., (1996). Contact-level influences on cooperation in face-to-face surveys. Journal of Official Statistics, 12, 63-84
17. Feuer S., Schober M. F., (2015, May). Self-view can increase disclosure in Skype survey interviews. Poster presented at the 27th Annual Convention of the Association for Psychological Science, New York, NY
18. Fowler F. J., Mangione T. W., (1990). Standardized survey interviewing: Minimizing interviewer-related error. Newbury Park, CA: SAGE
19. Galesic M., Tourangeau R., (2007). What is sexual harassment? It depends on who asks! Framing effects on survey responses. Applied Cognitive Psychology, 21, 189-202
20. Groves R. M., (2004). Survey errors and survey costs. Hoboken, NJ: John Wiley
21. Groves R. M., Dillman D., Eltinge J. L., Little R. J., (Eds.). (2002). Survey nonresponse. New York, NY: Wiley
22. Groves R. M., Fowler F. J., Jr. Couper M. P., Lepkowski J. M., Singer E., Tourangeau R., (2009). Survey methodology (2nd ed.). Hoboken, NJ: John Wiley
23. Groves R. M., Lyberg L., (2010). Total survey error: Past, present, and future. Public Opinion Quarterly, 74, 849-879
24. Groves R. M., McGonagle K. A., (2001). A theory-guided interviewer training protocol regarding survey participation. Journal of Official Statistics, 17, 249-265
25. Keeter S., Kennedy C., Dimock M., Best J., Craighill P., (2007). Gauging the impact of growing nonresponse on estimates from a national RDD telephone survey. Public Opinion Quarterly, 70, 759-779
26. Lind L. H., Schober M. F., Conrad F. G., Reichert H., (2013). Why do survey respondents disclose more when computers ask the questions? Public Opinion Quarterly, 77, 888-935. doi:10.1093/poq/nft038
27. Link M. W., Murphy J., Schober M. F., Buskirk T. D., Childs J. H., Tesfaye C. L., (2014). Mobile technologies for conducting, augmenting and potentially replacing surveys: Executive summary of the AAPOR task force on emerging technologies in public opinion research. Public Opinion Quarterly, 78, 779-787. doi:10.1093/poq/nfu054
28. Maynard D. W., Hollander M. M., (2014). Asking to speak to another: A skill for soliciting survey participation. Research on Language and Social Interaction, 47, 28-48
29. Morton-Williams J., (1993). Interviewer approaches. Aldershot, UK: Dartmouth
30. Schaeffer N. C., Garbarski D., Freese J., Maynard D. W., (2013). An interactional model of the call for survey participation: Actions and reactions in the survey recruitment call. Public Opinion Quarterly, 77, 323-351
31. Schober M. F., Clark H. H., (1989). Understanding by addressees and overhearers. Cognitive Psychology, 21, 211-232
32. Schober M. F., Conrad F. G., (1997). Does conversational interviewing reduce survey measurement error? Public Opinion Quarterly, 61, 576-602
33. Schober M. F., Conrad F. G., Antoun C., Ehlen P., Fail S., Hupp A. L...Zhang C., (2015). Precision and disclosure in text and voice interviews on smartphones. PLOS ONE, 10, e0128337. doi:10.1371/journal.pone.0128337
34. Schober M. F., Conrad F. G., Dijkstra W., Ongena Y. P., (2012). Disfluencies and gaze aversion in unreliable responses to survey questions. Journal of Official Statistics, 28, 555-582
35. Schober M. F., Conrad F. G., Fricker S. S., (2004). Misunderstanding standardized language in research interviews. Applied Cognitive Psychology, 18, 169-188. doi:10.1002/acp.955
36. Schwarz N., (1996). Cognition and communication: Judgmental biases, research methods and the logic of conversation. Hillsdale, NJ: Lawrence Erlbaum
37. Schwarz N., (1999). Self-reports: How the questions shape the answers. American Psychologist, 54(2), 93-105
38. Schwarz N., Hippler H. J., (1991). Response alternatives: The impact of their choice and ordering. In Biemer P., Groves R., Mathiowetz N., Sudman S., (Eds.), Measurement error in surveys (pp. 41-56). Chichester, UK: Wiley
39. Schwarz N., Hippler H. J., Deutsch B., Strack F., (1985). Response scales: Effects of category range on reported behavior and subsequent judgments. Public Opinion Quarterly, 49, 388-395
40. Sirken M. G., Herrmann D. J., Schechter S., Schwarz N., Tanur J. M., Tourangeau R., (Eds.). (1999). Cognition and survey research. New York, NY: Wiley-Interscience
41. Smith A., (2015). US smartphone use in 2015. Pew Research Center. Retrieved from http://www.pewinternet.org/2015/04/01/us-smartphone-use-in-2015/
42. Snijkers G., Hox J., de Leeuw E. D., (1999). Interviewers’ tactics for fighting survey nonresponse. Journal of Official Statistics, 15, 185-198
43. Sturgis P., Campanelli P., (1998). The scope for reducing refusals in household surveys: An investigation based on transcripts of tape-recorded doorstep interactions. Journal of the Market Research Society, 40, 121-139
44. Suchman L., Jordan B., (1990). Interactional troubles in face-to-face survey interviews. Journal of the American Statistical Association, 85, 232-253
45. Suessbrick A. L., Schober M. F., Conrad F. G., (2000). Different respondents interpret ordinary questions quite differently. In Proceedings of the American Statistical Association, Section on Survey Research Methods, pp. 907-912. Alexandria, VA: American Statistical Association. Retrieved from https://www.amstat.org/sections/SRMS/Proceedings/papers/0000_155.pdf
46. Tanur J. M., (Ed.). (1992). Questions about questions: Inquiries into the cognitive bases of surveys New York, NY: Russell Sage Foundation
47. Weisberg H. F., (2009). The total survey error approach: A guide to the new science of survey research. Chicago, IL: University of Chicago Press