The cognitive interviewing reporting framework (CIRF): Towards the harmonization of cognitive testing reports

Methodology

Volumn 9, Issue 3, 2013, Pages 87-95

  Boeije, Hennie ^a   Willis, Gordon ^b  

^a UTRECHT UNIVERSITY   (Netherlands)

^b NATIONAL CANCER INSTITUTE   (United States)

Author keywords

Checklist; Cognitive interviewing; Comparative effectiveness; Questionnaire pretesting; Standard report format; Survey research

Indexed keywords

EID: 84883498015     PISSN: 16141881     EISSN: 16142241     Source Type: Journal    
DOI: 10.1027/1614-2241/a000075     Document Type: Article

References (28)

1. Beatty, P. (2004). The dynamics of cognitive interviewing. In S. Presser, et al. (Ed.), Questionnaire development evaluation and testing methods (pp. 45-66). Hoboken, NJ: Wiley.
2. Bode, C., & Jansen, H. (2013). Examining the personal experience of Aging Scale with the Three Step Test Interview. Methodology, 9, 96-103.
3. Boeije, H. R. (2010). Analysis in qualitative research. London, UK: Sage.
4. Boeije, H. R., van Wesel, F., & Alisic, E. (2011). Making a difference: Towards a method for weighing the evidence in a qualitative synthesis. Journal of Evaluation in Clinical Practice, 17, 657-663.
5. Cohen, D. J., & Crabtree, B. F. (2008). Evaluative criteria for qualitative research in health care: Controversies and recommendations. Annals of Family Medicine, 6, 331-339.
6. Collins, D. (2007). Analysing and interpreting cognitive interview data: A qualitative approach. In Proceedings of the 6th Questionnaire Evaluation Standard for Testing Conference (pp. 64-73). Ottawa: Statistics Canada.
7. Conrad, F., & Blair, J. (2004). Data quality in cognitive interviews: The case for verbal reports. In S. Presser, et al. (Ed.), Questionnaire development evaluation and testing methods (pp. 67-87). Hoboken, NJ: Wiley.
8. DeMaio, T. J., & Rothgeb, J. M. (1996). Cognitive interviewing techniques: In the lab and in the field. In N. Schwarz & S. Sudman (Eds.), Answering questions: Methodology for determining cognitive and communicative processes in survey research (pp. 175-195). San Francisco, CA: Jossey-Bass.
9. Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87, 215-251.
10. Fitzgerald, R., Widdop, S., Gray, M., & Collins, D. (2011). Identifying sources of error in cross-national questionnaires: Application of an error source typology to cognitive interview data. Journal of Official Statistics, 27, 1-32.
11. Fitzgerald, R., Widdop, S., Gray, M., & Collins, D. (2009). Testing for equivalence using cross-national cognitive interviewing. Center for comparative social surveys. Working Paper Series, No 01.
12. Gerber, E. R., & Wellens, T. R. (1997). Perspectives on pretesting: Cognition in the cognitive interview? Bulletin de Methodologie Sociologique, 55, 18-39.
13. Hak, T., van der Veer, K., & Jansen, H. (2004). The three-step test-interview (TSTI): An observational instrument for pretesting self-completion questionnaires. In ERIM Report ERS-2004-029-ORG. Rotterdam, The Netherlands: Erasmus Research Institute of Management. Retrieved from http://hdl.handle.net/1765/1265
14. Herman, D., Johnson, M., McEvoy, C., Herzog, C., & Hertel, P. (1996). Basic and applied memory research: Vol. 2. Practical application. Hillsdale, NJ: Erlbaum.
15. Jabine, T. B., Straf, M. L., Tanur, J. M., & Tourangeau, R. (Eds.). (1984). Cognitive aspects of survey methodology: Building a bridge between disciplines. Washington, DC: National Academy Press.
16. Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5, 213-236.
17. Loftus, E. (1984). Protocol analysis of responses to survey recall questions. In T. B. Jabine, M. L. Straf, J. M. Tanur, & R. Tourangeau (Eds.), Cognitive aspects of survey methodology: Building a bridge between disciplines (pp. 61-64). Washington, DC: National Academy Press.
18. Miller, K. (2003). Conducting cognitive interviews to understand question-response limitations. American Journal of Health Behavior, 27(Suppl. 3), S264-S272.
19. Miller, K. (2011). Cognitive interviewing. In K. Miller, J. Madans, A. Maitland, & G. Willis (Eds.), Question evaluation methods: Contributing to the science of data quality. New York, NY: Wiley and Sons.
20. Miller, K., Mont, D., Maitland, A., Altman, B., & Madans, J. (2010). Results of a cross-national structured cognitive interviewing protocol to test measures of disability. Quality & Quantity, 4, 801-815.
21. Moher, D., Jones, A., & Lepage, L. (2001). Use of the CONSORT statement and quality of reports of randomized trials: A comparative before-and-after evaluation. JAMA, 285, 1992-1995.
22. Padilla, J.-L., Benítez, I., & Castillo, M. (2013). Obtaining validity evidence by cognitive interviewing to interpret psychometric results. Methodology, 9, 113-122.
23. Tourangeau, R. (1984). Cognitive science and survey methods: A cognitive perspective. In T. Jabine, M. Straf, J. Tanur, & R. Tourangeau (Eds.), Cognitive aspects of survey design: Building a bridge between disciplines (pp. 73-100). Washington, DC: National Academy Press.
24. Vis-Visschers, R., & Meertens, V. (2013). Evaluating the Cognitive Interviewing Reporting Framework (CIRF) by rewriting a Dutch pretesting report of a European Health Survey Questionnaire. Methodology, 9, 104-112.
25. Willis, G. B. (1999). Cognitive interviewing: A how-to guide. Retrieved from http://appliedresearch.cancer.gov/areas/cognitive/interview.pdf
26. Willis, G. B. (2005). Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage.
27. Willis, G., & Boeije, H. (2013). Reflections on the Cognitive Interviewing Reporting Framework: Efficacy, expectations, and promise for the future. Methodology, 9, 123-128.
28. Willis, G., & Zahnd, E. (2007). Questionnaire design from a cross-cultural perspective: An empirical investigation of Koreans and Non-Koreans. Journal of Health Care for the Poor and Underserved, 18, 197-217.