Disfluencies and gaze aversion in unreliable responses to survey questions

Journal of Official Statistics

Volumn 28, Issue 4, 2012, Pages 555-582

  Schober, Michael F ^a   Conrad, Frederick G ^b   Dijkstra, Wil ^c   Ongena, Yfke P ^d  

^a NEW SCHOOL FOR SOCIAL RESEARCH   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

^c VU UNIVERSITY AMSTERDAM   (Netherlands)

^d UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

Conversational interviewing; Face to face interviewing; Interviewing mode; Respondent cues of processing difficulty; Respondent paradata; Standardized interviewing; Telephone interviewing

Indexed keywords

EID: 84872047356     PISSN: 0282423X     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (65)

1. Barr, D.J. (2003). Paralinguistic Correlates of Conceptual Structure. Psychonomic Bulletin & Review, 10, 462-467.
2. Bassili, J.N. and Scott, B.S. (1996). Response Latency as a Signal to Question Problems in Survey Research. Public Opinion Quarterly, 60, 390-399.
3. Biemer, P. and Lyberg, L. (2003). An Introduction to Survey Quality. Hoboken, NJ: Wiley.
4. Bortfeld, H., Leon, S.D., Bloom, J.E., Schober, M.R., and Brennan, S.E. (2001). Disfluency Rates in Conversation: Effects of Age, Relationship, Topic, Role, and Gender. Language and Speech, 44, 123-149.
5. Brennan, S.E. (1990). Seeking and Providing Evidence for Mutual Understanding. Unpublished doctoral dissertation, Stanford University.
6. Brennan, S.E. (2004). How Conversation is Shaped by Visual and Spoken Evidence. In Approaches to Studying World-Situated Language Use: Bridging the Language-as- Product and Language-as-Action Traditions, J.C. Trueswell and M.K. Tanenhaus (eds). Cambridge, MA: MIT Press, 95-130.
7. Brennan, S.E. and Williams, M. (1995). The Feeling of Another's Knowing: Prosody and Filled Pauses as Cues to Listeners About the Metacognitive States of Speakers. Journal of Memory and Language, 34, 383-398.
8. Cameron, D. (2001). Working with Spoken Discourse. Thousand Oaks, CA: SAGE Publications, Inc.
9. Cannell, C.F., Miller, P.V., and Oksenberg, L. (1981). Research on Interviewing Techniques. In Sociological Methodology, S. Leinhardt (ed.). San Francisco: JosseyBass, 389-437.
10. Clark, H.H. (1994). Managing Problems in Speaking. Speech Communication, 15, 243-250.
11. Clark, H.H. (1996). Using Language. Cambridge: Cambridge University Press.
12. Clark, H.H. and Fox Tree, J.E. (2002). Using Uh and Um in Spontaneous Speaking. Cognition, 84, 73-111.
13. Clark, H.H. and Krych, M. (2004). Speaking While Monitoring Addressees for Understanding. Journal of Memory and Language, 50, 62-81.
14. Conrad, F.G. and Schober, M.F. (2000). Clarifying Question Meaning in a Household Telephone Survey. Public Opinion Quarterly, 64, 1-28.
15. Conrad, F.G. and Schober, M.F. (2008). Envisioning the Survey Interview of the Future. Hoboken, NJ: Wiley.
16. Conrad, F.G., Schober, M.F., and Coiner, T. (2007). Bringing Features of Dialogue to Web Surveys. Applied Cognitive Psychology, 21, 165-187.
17. Conrad, F.G., Schober, M.F., and Dijkstra, W. (2008). Cues of Communication Difficulty in Telephone Interviews. In Advances in Telephone Survey Methodology, J.M. Lepkowski, C. Tucker, J.M. Brick, E.D. de Leeuw, L. Japec, P.J. Lavrakas, M.W. Link, and R.L. Sangster (eds). New York: Wiley, 212-230.
18. Couper, M.P. (2000). Usability Evaluation of Computer Assisted Survey Instruments. Social Science Computer Review, 18, 384-396.
19. Couper, M.P. (2008). Designing Effective Web Surveys. New York: Cambridge University Press.
20. Dijkstra, W. (2006). Sequence Viewer, version 4. Available at: http://www.sequenceviewer.nl.
21. Doherty-Sneddon, G., Bruce, V., Bonner, L., Longbotham, S., and Doyle, C. (2002). Development of Gaze Aversion as Disengagement from Visual Information. Developmental Psychology, 38, 438-445.
22. Draisma, S. and Dijkstra, W. (2004). Response Latency and (para)Linguistic Expressions as Indicators of Response Error. In Methods for Testing and Evaluating Survey Questionnaires, S. Presser, J.M. Rothgeb, M.P. Couper, J.T. Lessler, E. Martin, J. Martin, and E. Singer (eds). New York: Wiley.
23. Drew, Paul (1984). Speakers' Reportings in Invitation Sequences. In Structures of Social Action: Studies in Conversation Analysis, J.M. Atkinson and J. Heritage (eds). New York: Cambridge University Press, 129-151.
24. Dykema, J., Lepkowski, J.M., and Blixt, S. (1997). The Effect of Interviewer and Respondent Behavior on Data Quality: Analysis of Interaction Coding in a Validation Study. In Survey Measurement and Process Quality, L. Lyberg, P. Biemer, M. Collins, E. de Leeuw, C. Dippo, N. Schwarz, and D. Trewin (eds). New York: Wiley, 287-310.
25. Ehlen, P., Schober, M.F., and Conrad, F.G. (2007). Modeling Speech Disfluency to Predict Conceptual Misalignment in Speech Survey Interfaces. Discourse Processes, 44, 245-265.
26. Fox Tree, J.E. and Clark, H.H. (1997). Pronouncing "The" as "Thee" to Signal Problems in Speaking. Cognition, 62, 151-167.
27. Fowler, F.J. and Mangione, T.W. (1990). Standardized Survey Interviewing: Minimizing Interviewer-Related Error. Newbury Park, CA: SAGE Publications, Inc.
28. Fromkin, V.A. (1973). Speech Errors as Linguistic Evidence. The Hague, Netherlands: Mouton.
29. Fromkin, V.A. (1980). Errors in Linguistic Performance: Slips of the Tongue, Ear, Pen and Hand. New York: Academic Press.
30. Glenberg, A.M., Schroeder, J.L., and Robinson, D.A. (1998). Averting the Gaze Disengages the Environment and Facilitates Remembering. Memory & Cognition, 26, 651-658.
31. Goldman-Eisler, R. (1958). Speech Production and the Predictability of Words in Context. Quarterly Journal of Experimental Psychology, 10, 96-106.
32. Goodwin, C. (1991). Conversational Organization: Interaction Between Speakers and Hearers. New York: Academic Press.
33. Goodwin, M.H. and Goodwin, C. (1986). Gesture and Coparticipation in the Activity of Searching for a Word. Semiotica, 62(1/2), 51-75.
34. Groves, R.M. and Kahn, R.L. (1979). Surveys by Telephone: A National Comparison with Personal Interviews. New York: Academic Press.
35. Hanna, J.E. and Brennan, S.E. (2007). Speakers' Eye Gaze Disambiguates Referring Expressions Early During Face-to-Face Conversation. Journal of Memory and Language, 57, 596-615.
36. Houtkoop-Steenstra, H. (2000). Interaction and the Standardized Survey Interview: The Living Questionnaire. Cambridge: Cambridge University Press.
37. Kish, L. (1962). Studies of Interviewer Variance for Attitudinal Variables. Journal of the American Statistical Association, 57, 92-115.
38. Landis, J.R. and Koch, G.G. (1977). The Measurement of Observer Agreement for Categorical Data. Biometrics, 33, 159-174.
39. Lavin, D. and Maynard, D.W. (2002). Standardization vs. Rapport: How Interviewers Handle the Laughter of Respondents During Telephone Surveys. In Standardization and Tacit Knowledge: Interaction and Practice in the Survey Interview, D.W. Maynard, H. Houtkoop-Steenstra, N.C. Schaeffer, and J. van der Zouwen (eds). New York: Wiley, 335-364.
40. Levelt, W.J.M. (1989). Speaking: From Intention to Articulation. Cambridge, MA: MIT Press.
41. Mathiowetz, N.A. (1998). Respondent Expressions of Uncertainty: Data Source for Imputation. Public Opinion Quarterly, 62, 47-56.
42. Mathiowetz, N.A. (1999). Respondent Uncertainty as Indicator of Response Quality. International Journal of Public Opinion Research, 11, 289-296.
43. Maynard, D.W., Houtkoop-Steenstra, H., Schaeffer, N.C., and van der Zouwen, J. (2002). Standardization and Tacit Knowledge: Interaction and Practice in the Survey Interview. New York: Wiley.
44. McLemore, C.A. (1991). The Pragmatic Interpretation of English Intonation: Sorority Speech. Unpublished doctoral dissertation, University of Texas, Austin
45. Oksenberg, L., Cannell, C., and Kalton, G. (1991). New Strategies for Pretesting Survey Questions. Journal of Official Statistics, 7, 349-365.
46. Oviatt, S. (1995). Predicting Spoken Disfluencies During Human-Computer Interaction. Computer Speech and Language, 9, 19-35.
47. Person, N.K., D'Mello, S., and Olney, A. (2008). Toward Socially Intelligent Interviewing Systems. In Envisioning the Survey Interview of the Future, F.G. Conrad and M.F. Schober (eds). New York: Wiley, 195-214.
48. Schachter, S., Christenfeld, N., Ravina, B., and Bilous, F. (1991). Speech Disfluency and the Structure of Knowledge. Journal of Personality and Social Psychology, 60, 362-367.
49. Schaeffer, N.C. (1991). Conversation with a Purpose-or Conversation? Interaction in the Standardized Interview. In Survey Measurement and Process Quality, P.P. Biemer, R.M. Groves, L.E. Lyberg, N.A. Mathiowetz, and S. Sudman (eds). New York: John Wiley, 367-391.
50. Schaeffer, N.C. and Maynard, D.W. (2002). Occasions for Intervention: Interactional Resources for Comprehension in Standardized Survey Interviews. In Standardization and Tacit Knowledge: Interaction and Practice in the Survey Interview, D.W. Maynard, H. Houtkoop-Steenstra, N.C. Schaeffer, and J. van der Zouwen (eds). New York: Wiley, 261-280.
51. Schaeffer, N.C. and Maynard, D.W. (2008). The Contemporary Standardized Survey Interview for Social Research. In Envisioning the Survey Interview of the Future, F.G. Conrad and M.F. Schober (eds). New York: Wiley, 31-57.
52. Schaeffer, N.C., Dykema, J., Garbarski, D., and Maynard, D.W. (2008). Verbal and Paralinguistic Behaviors in Cognitive Assessments in a Survey Interview. Proceedings of the American Statistical Association, Section on Survey Research Methods. Alexandria, VA: American Statistical Association.
53. Schegloff, E.A. (1984). On Some Gestures' Relation to Talk. In Structures of Social Action: Studies in Conversation Analysis, J.M. Atkinson and J. Heritage (eds). Cambridge: Cambridge University Press, 266-298.
54. Schegloff, E.A. (1998). Body Torque. Social Research, 65, 535-596.
55. Scherer, K.R. (2003). Vocal Communication of Emotion: A Review of Research Paradigms. Speech Communication, 40, 227-256.
56. Schober, M.F. and Bloom, J.E. (2004). Discourse Cues that Respondents have Misunderstood Survey Questions. Discourse Processes, 38, 287-308.
57. Schober, M.F. and Brennan, S.E. (2003). Processes of Interactive Spoken Discourse: The Role of the Partner. Handbook of Discourse Processes, A.C. Graesser, M.A. Gernsbacher, and S.R. Goldman (eds). Mahwah, NJ: Lawrence Erlbaum Associates, 123-164.
58. Schober, M.F. and Conrad, F.G. (1997). Does Conversational Interviewing Reduce Survey Measurement Error? Public Opinion Quarterly, 61, 576-602.
59. Schober, M.F. and Conrad, F.G. (2002). A Collaborative View of Standardized Survey Interviews. In Standardization and Tacit Knowledge: Interaction and Practice in the Survey Interview, D. Maynard, H. Houtkoop-Steenstra, N.C. Schaeffer, and J. van der Zouwen (eds). New York: Wiley, 67-94.
60. Schober, M.F., Conrad, F.G., and Fricker, S.S. (2004). Misunderstanding Standardized Language in Research Interviews. Applied Cognitive Psychology, 18, 169-188.
61. Smith, V.L. and Clark, H.H. (1993). On the Course of Answering Questions. Journal of Memory and Language, 32, 25-38.
62. Swerts, M. and Krahmer, E. (2005). Audiovisual Prosody and Feeling of Knowing. Journal of Memory and Language, 53, 81-94.
63. Whittaker, S. (2003). Mediated Communication. In Handbook of Discourse Processes, A.C. Graesser, M.A. Gernsbacher, and S.R. Goldman (eds). Mahwah, NJ: Erlbaum, 243-286.
64. Williams, E. (1977). Experimental Comparisons of Face-to-Face and Mediated Communication: A Review. Psychological Bulletin, 84, 963-976.
65. Yan, T. and Tourangeau, R. (2008). Fast Times and Easy Questions: The Effects of Age. Experience and Question Complexity on Web Survey Response Times. Applied Cognitive Psychology, 22, 51-68.