Cognitive Interviewing

Question Evaluation Methods: Contributing to the Science of Data Quality

Volumn , Issue , 2011, Pages 49-75

  Miller, Kristen ^a  

^a NATIONAL CENTER FOR HEALTH STATISTICS   (United States)

Author keywords

Cognitive interviewing detailed depiction of meanings and processes, making up survey data; Method of cognitive testing, rooted in theoretical tradition of cognitive psychology and a movement, as CASM (Cognitive Aspects of Survey Methodology); Shifting paradigms, toward a more integrative approach questioning response, cognitive test methodology incorporating a sociological perspective

Indexed keywords

EID: 84955067916     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781118037003.ch5     Document Type: Chapter

References (44)

1. Ackermann A, Blair J (2006). Efficient respondent selection for cognitive interviewing. Paper presented at the American Association for Public Opinion Research Annual Meeting: Montreal, Canada.
2. Beatty P (2004). The dynamics of cognitive interviewing. In: Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Singer E, editors. Methods for Testing and Evaluating Survey Questionnaires. New York: Wiley; pp. 45-67.
3. Berger PL, Luckmann T (1966). The Social Construction of Reality: A Treatise on the Sociology of Knowledge. Garden City, NY: Anchor Books.
4. Charmaz K (2006). Constructing Grounded Theory: A Practical Guide Through Qualitative Analysis. Thousand Oaks, CA: Sage.
5. Conrad F, Blair J (1996). From impressions to data: increasing the objectivity of cognitive interviews. In: American Statistical Association 1996 Proceedings of the Section on Survey Research Methods. Washington, DC: American Statistical Association; pp. 1-9.
6. Conrad F, Blair J (2004). Data quality in cognitive interviews: the case of verbal reports. In: Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Singer E, editors. Methods for Testing and Evaluating Survey Questionnaires. New York: Wiley; pp. 67-89.
7. Conrad F, Blair J (2009). Sources of error in cognitive interviews. Public Opinion Quarterly; 73(1):32-55.
8. Cook T, Campbell D (1979). Quasi Experimentation: Design and Analytical Issues for Field Settings. Chicago, IL: Rand McNally.
9. DeMaio T, Landreth A (2004). Do different cognitive interview techniques produce different results In: Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Singer E, editors. Methods for Testing and Evaluating Survey Questionnaires. New York: Wiley; pp. 89-108.
10. DeMaio T, Rothgeb J (1996). Cognitive interviewing techniques: in the lab and in the field. In: Schwarz N, Sudman S, editors. Answering Questions: Methodology for Determining Cognitive and Communicative Processes in Survey Research. San Francisco, CA: Jossey-Bass; pp. 177-195.
11. Forgas J (1981). Social Cognition: Perspectives on Everyday Understanding. London and New York: Academic Press.
12. Gerber E (1999). The view from anthropology: ethnography and the cognitive interview. In: Sirken M, Herrmann D, Schechter S, Schwarz N, Tanur J, Tourangeau R, editors. Cognition and Survey Research, Hoboken. New Jersey: John Wiley and Sons; pp. 217-234.
13. Glaser B, Strauss A (1967). The Discovery of Grounded Theory: Strategies for Qualitative Research. Chicago, IL: Aldine.
14. Greene JC, Caracelli VJ, editors (1997). Advances in Mixed-Method Evaluation: The Challenges and Benefits of Integrating Diverse Paradigms. New Directions for Program Evaluation, No. 74, San Francisco, CA: Jossey-Bass.
15. Harkness J, Van de Vijver F, Mohler P, editors (2003). Cross-Cultural Survey Methods. Hoboken, NJ: Wiley.
16. Harris-Kojetin L, Fowler F, Brown J, Schnaier J, Sweeny S (1999). The use of cognitive testing to develop and evaluate CAHPS(TM) 1.0 core survey items. Medical Care; 37(3):MS10-MS21.
17. Josselson R, Lieblich A, editors (1995). Interpreting Experience: The Narrative Study of Lives. Beverly Hills, CA: Sage.
18. Kuhn TS (1962). The Structure of Scientific Revolutions. Chicago, IL: University of Chicago Press.
19. Lincoln YS, Guba EG (1985). Naturalistic Inquiry. Beverly Hills, CA: Sage.
20. Madans J (2004). Discussant commentary: tools, policy and procedures for survey improvement. 2004 Federal Committee on Statistical Methodology Statistical Policy Seminar. December 15-16, 2004.
21. Miller K (2003). Conducting cognitive interviews to understand question-response limitations among poorer and less educated respondents. American Journal of Health Behavior; 27(S3):264-272.
22. Miller K (2006). Results of Cognitive Testing for Oral Health Questions. Available online at http://www.cdc.gov/qbank.
23. Miller K (2007). Design and analysis of cognitive interviews for cross-national testing. 2007 European Survey Research Association Annual Meeting. Prague, Czechoslovakia.
24. Miller K (2008). Results of the Comparative Cognitive Test Workgroup Budapest Initiative Module. Available online at http://www.cdc.gov/qbank.
25. Miller K, Willson S (2002). Results of Cognitive Testing for the NCHS Best Race Question. Available online at http://www.cdc.gov/qbank.
26. Miller K, Willson S (2004). Results of Cognitive Testing for Terrorism Experience Questions. Available online at http://www.cdc.gov/qbank.
27. Miller K, Mont D, Maitland A, Altman B, Madans J (2010). Results of a cross-national structured cognitive interviewing protocol to test measures of disability. Quality and Quantity; 45 (4): 801-815.
28. Miller K, Fitzgerald R, Padilla JL, Willson S, Widdop S, Caspar R, Dimov M, Gray M, Nunes C, Pruefer P, Schoebi N, Schoua-Glusberg A (forthcoming). Design and analysis of cognitive interviews for comparative multi-national testing. Field Methods.
29. Office of Management and Budget Standards and Guidelines for Statistical Surveys (2006). Available online at http://www.whitehouse.gov/omb/inforeg/statpolicy/standards_stat_surveys.pdf.
30. Presser S, Couper MP, Lessler JT, Martin E, Martin J, Rothgeb JM, Singer E (2004). Methods for testing and evaluating survey questions. Public Opinion Quarterly; 68(1): 109-130.
31. Ridolfo H, Schoua-Glusberg A (forthcoming). Analysis of cognitive interview data using the constant comparative method of analysis to understand cross-cultural patterns in survey data. Field Methods.
32. Rothgeb J, Willis G, Forsyth B (2001). Questionnaire pretesting methods: do different techniques and different organizations produce similar results? In: American Statistical Association 2001 Proceedings of the Section on Survey Research Methods. Washington, DC: American Statistical Association.
33. Schwarz N (1994). Judgment in a social context: biases, shortcomings, and the logic of conversation. In: Zanna M. editor. Advances in Experimental Social Psychology. Vol. 26. San Diego, CA: Academic Press; pp. 123-162.
34. Strauss A, Corbin J (1990). Basics of Qualitative Research: Grounded Theory Procedures and Techniques. Newbury Park, CA: Sage.
35. Sudman S, Bradburn N, Schwarz N (1996). Thinking about Answers: The Application of Cognitive Processes to Survey Methodology. San Francisco, CA: Jossey-Bass.
36. Tashakkori A, Teddlie C (1998). Mixed Methodology: Combining Qualitative and Quantitative Approaches. Thousand Oaks, CA: Sage.
37. Tashakkori A, Teddlie C (2002). Handbook of Mixed Methods in Social and Behavioral Research. Thousand Oaks, CA: Sage.
38. Tourangeau R, Rips L, Rasinki K (2000). The Psychology of Survey Response. Cambridge: Cambridge University Press.
39. Tucker C (1997). Methodological issues surrounding the application of cognitive psychology in survey research. Bulletin of Sociological Methodology/Bulletin de Methodologie Sociologique June 1997. 55 (1): 67-92.
40. Willis G (2004). Cognitive interviewing revisited: a useful technique, in theory? Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Singer E, editors. Methods for Testing and Evaluating Survey Questionnaires. New York: Wiley; pp. 23-44.
41. Willis G (2005). Cognitive Interviewing: A Tool for Improving Questionnaire Design. Thousand Oaks, CA: Sage.
42. Willson S (2006). Cognitive Interviewing Evaluation of the 2007 Complementary and Alternative Medicine Module for the National Health Interview Survey. Hyattsville, MD: National Center for Health Statistics. Available online at http://www.cdc.gov/ qbank.
43. Willson S (2007). Cognitive Interviewing Evaluation PRAMS. Hyattsville, MD:National Center for Health Statistics. Available online at http://www.cdc.gov/qbank.
44. Willson S (2009). Data quality in cognitive interviewing: a new perspective on standardizing probes in multi-language and multi-cultural projects. Paper presented at QUEST meetings, Bergen, Norway.