Coding the Behavior of Interviewers and Respondents to Evaluate Survey Questions

Question Evaluation Methods: Contributing to the Science of Data Quality

Volumn , Issue , 2011, Pages 5-21

  Fowler, Floyd J ^a  

^a UNIVERSITY OF MASSACHUSETTS BOSTON   (United States)

Author keywords

Behavior coding results, whether reliably linked to characteristics of questions, three kinds of studies of behavior coding; Behavior coding, and the way it is done integrating it, into pretests of survey instruments; Behavior coding, coding behavior of interviewers respondents, evaluating survey questions, on three key premises

Indexed keywords

EID: 84941896267     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781118037003.ch2     Document Type: Chapter

References (30)

1. Bales RF (1951). Interaction Process Analysis. Cambridge, MA: Addison-Wesley.
2. Bassili JN (1996). The how and why of response latency measurement in telephone surveys. In: Schwarz NA, Sudman S, editors. Answering Questions. San Francisco, CA: Jossey-Bass; pp. 319-346.
3. Cannell CF, Fowler FJ (1964). A note on interviewer effects on self-enumerative procedures. American Sociological Review; 29:269.
4. Cannell CF, Fowler FJ (1965). Comparison of Hospitalization Reporting in Three Survey Procedures. Washington, DC: U.S. Department of Health, Education and Welfare, Public Health Service.
5. Cannell C, Oksenberg L (1988). Observation of behaviour in telephone interviewers. In: Groves RM, Biemer PN, Lyberg LE, Massey JT, Nichols WL II, Waksberg J, editors. Telephone Survey Methodology. New York: John Wiley; pp. 475-595.
6. Cannell CF, Fowler FJ, Marquis K (1968). The Influence of Interviewer and Respondent Psychological and Behavioral Variables on the Reporting in Household Interviews. Washington, DC: U.S. Department of Health, Education and Welfare, Public Health Service.
7. Cannell C, Marquis K, Laurent A (1977). A summary of studies. In: Vital & Health Statistics, Series 2. Washington, DC: Government Printing Office; p. 69.
8. Dijkstra W, van der Zouwen J, editors (1982). Response Behavior in the Survey Interview. London: Academic Press.
9. Draisma S, Dijkstra W (2004). Response latency and (para) linguistic expressions as indicators of response error. In: Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Singer E, editors. Methods for Testing and Evaluating Survey Questionnaires. New York: Wiley; pp. 131-148.
10. Dykema J, Lepkowski J, Blixt S (1997). The effect of interviewer and respondent behavior on data quality. In: Lyberg LE, Biemer P, Collins M, de Leeuw ED, Dippos C, Schwarz N, Trewin D, editors. Survey Measurement and Process Quality. New York: Wiley; pp. 287-310.
11. Forsyth BH, Rothgeb J, Willis G (2004). Does pretesting make a difference? Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Singer E, editors. Questionnaire Development Evaluation and Testing Methods. New York: John Wiley; pp. 525-546.
12. Fowler FJ (1992). How unclear terms affect survey data. Public Opinion Quarterly; 56:218-231.
13. Fowler FJ (2004). The case for more split-ballot experiments in developing survey instruments. In: Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Singer E, editors. Methods for Testing and Evaluating Survey Questionnaires. New York:Wiley; pp. 173-188.
14. Fowler FJ, Cannell CF (1996). Using behavioral coding to identify cognitive problems with survey questions. In: Schwarz NA, Sudman S, editors. Answering Questions. San Francisco, CA: Jossey-Bass; pp. 15-36.
15. Fowler FJ, Cosenza C (2008). Writing effective survey questions. In: Hox J, de Leeuw E, Dillman D, editors. The International Handbook of Survey Methodology. New York: Erlbaum; pp. 136-260.
16. Fowler FJ, Mangione TW (1990). Standardized Survey Interviewing: Minimizing Interviewer Related Error. Newbury Park, CA: Sage.
17. Groves RM, Magilavy LJ (1980). Estimates of interviewer variance in telephone surveys. In: American Statistical Association 1980 Proceedings of the Section on Survey Research Methods. Washington, DC: American Statistical Association; pp. 622-627.
18. Houtcoop-Steenstra H (2000). Interaction and the Standardized Survey Interview: The Living Questionnaire. Cambridge: Cambridge University Press.
19. Houtcoop-Steenstra H (2002). Question turn format and turn-taking problems in standardized interviewing. In: Maynard DW, Houtcoop-Steenstra H, Schaeffer NC, van der Zouwen J, editors. Standardization and Tacit Knowledge. New York: Wiley; pp. 243-260.
20. Lessler JT, Forsyth BH (1996). A coding system for appraising questionnaires. In: Schwartz NA, Sudman S, editors. Answering Questions. San Francisco, CA: Jossey-Bass; pp. 259-292.
21. Mangione TW, Fowler FJ, Louis TA (1992). Question characteristics and interviewer effects. Journal of Official Statistics; 8(3):293-307.
22. Mathiowetz NA (1998). Respondent expressions of uncertainty: data source for imputation. Public Opinion Quarterly; 62: 47-56.
23. Maynard DW, Houtcoop-Steenstra H, Schaeffer NC, van der Zouwen J(2002). Standardization and Tacit Knowledge. New York: Wiley.
24. Oksenberg L, Cannell C, Kalton G (1991). New strategies of pretesting survey questions. Journal of Official Statistics; 7(3):349-366.
25. Presser S, Blair J (1994). Survey pretesting: do different methods produce different results? Marsden P, editors. Sociological Methodology. San Francisco, CA: Jossey-Bass; pp. 73-104.
26. Schuman H, Presser S (1981). Question and Answers in Attitude Surveys. New York: Academic Press.
27. Suchman L, Jordan B (1990). Interactional troubles in face-to-face survey interviews. Journal of the American Statistical Association; 85: 232-241.
28. van der Zouwen J, Dijkstra W (1995). Trivial and non-trivial question answer sequences: types, determinants and effects on data quality. In: Proceedings, International Conference on Survey Measurement and Process Quality in Bristol, UK. Alexandria, VA: American Statistical Association; pp. 81-86.
29. van der Zouwen J, Smit JH (2004). Evaluating survey questions by analyzing patterns of behavior codes and question-answer sequences. In: Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Singer E, editors. Methods for Testing and Evaluating Survey Questionnaires. New York: Wiley; pp. 109-130.
30. Willis GB (2005). Cognitive Interviewing. Thousand Oaks, CA: Sage.