How Cognitive Interviewing can Provide Validity Evidence of the Response Processes to Scale Items

Social Indicators Research

Volumn 114, Issue 3, 2013, Pages 963-975

  Castillo Díaz, Miguel ^a   Padilla, José Luis ^a  

^a UNIVERSITY OF GRANADA   (Spain)

Author keywords

APGAR; Cognitive interviewing; Cognitive response processes; Construct validity

Indexed keywords

COGNITION; CONCEPTUAL FRAMEWORK; MODEL VALIDATION; PSYCHOLOGY; THEORETICAL STUDY;

EID: 84886747366     PISSN: 03038300     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11205-012-0184-8     Document Type: Article

References (41)

1. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
2. Beatty, P., & Willis, G. B. (2007). Research synthesis: The practice of cognitive interviewing. Public Opinion Quarterly. doi: 10. 1093/poq/nfm006.
3. Bellón, J. A., Delgado, J., Luna, P., & Lardelli, P. (1996). Validez y fiabilidad del cuestionario de función familiar Apgar-familiar. Atención Primaria, 18, 289-296.
4. Bickart, B., & Felcher, M. (1996). Expanding and enhancing the use of verbal protocols in survey research. In N. Schwarz & S. Sudman (Eds.), Answering question. Methodology for determining cognitive and communicative processes in survey research (pp. 115-142). San Francisco: Jossey-Bass.
5. Boeije, H., & Willis, G. B. (2011). The cognitive interviewing reporting framework (CIRF): Incorporating the principles of qualitative research. Paper presented at the Fourth Conference of the European Survey Research Association (ESRA), Lausanne, Switzerland. Abstract retrieved from http://surveymethodology. eu/conferences/lausanne-2011/presentation/226/.
6. Castillo, M., Padilla, J. L., Gómez, J., & Andrés, A. (2010). A productivity map of cognitive pretest methods for improving survey questions. Psicothema, 22(3), 475-481.
7. Chapelle, C. A., Enright, M. K., & Jamieson, J. (2010). Does an argument-based approach to validity make a difference? Educational Measurement: Issues and Practice. doi: 10. 1111/j. 1745-3992. 2009. 00165. x.
8. Conrad, F. G., & Blair, J. (2009). Sources of error in cognitive interviews. Public Opinion Quarterly. doi: 10. 1093/poq/nfp01.
9. Conrad, F. G, Brown, N. R., & Cashman, E. (1998). Strategies for estimating behavioural frequency in survey interviews. Memory. doi: 10. 1080/741942603.
10. DeVellis, R. F. (2003). Scale development: Theory and application (2nd ed.). Thousand Oaks, CA: Sage.
11. DeWalt, D. A., Rothrock, N., Yount, S., & Stone, A. A. (2007). Evaluation of item candidates the PROMIS qualitative item review. Medical Care. doi: 10. 1097/01. mlr. 0000254567. 79743. e2.
12. Ding, L., Reay, N. W., Lee, A., & Bao, L. (2009). Are we asking the right questions? Validating clicker question sequences by student interviews. American Journal of Physics. doi: 10. 1119/1. 3116093.
13. Ercikan, K., Arim, R., & Law, D. (2010). Application on think aloud protocols for examining and confirming sources of differential item functioning identified by experts review. Educational Measurement: Issues and Practices, 29(2), 24-35.
14. Gadermann, A. M., Guhn, M., & Zumbo, B. D. (2011). Investigating the substantive aspect of construct validity for the satisfaction with life scale adapted for children: A focus on cognitive processes. Social Indicator Research. doi: 10. 1007/s11205-010-9603-x.
15. Huber, G. L. (2008). AQUAD, software for the analysis of qualitative data (version 6. 8. 1. 1). Ingeborg Huber Verlag, University of Tübingen, Germany.
16. Irwin, D. E., Varni, J. W., Yeatts, K., & DeWalt D. A. (2009). Cognitive interviewing methodology in the development of a pediatric item bank: a patient reported outcomes measurement information system (PROMIS) study. Health and Quality of Life Outcomes. doi: 10. 1186/1477-7525-7-3.
17. Kane, M. (1992). An argument-based approach to validity. Psychological Bulletin. doi: 10. 1037/0033-2909. 112. 3. 527.
18. Kane, M. (2006). Validation. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 17-64). Washington, DC: American Council on Education/Praeger.
19. Kane, M. (2010). Validity and fairness. Language Testing. doi: 10. 1177/0265532209349467.
20. Knaff, K., Deatrick, J., Gallo, A., Holcombe, G., Bakitas, M., Dixon, J., & Grey, M. (2007). The analysis and interpretation of cognitive interviews for instrument development. Research in Nursing and Health. doi: 10. 1002/nur. 20195.
21. Lissitz, R. (2009). The concept of validity: revisions, new directions and applications. Charlotte, NC: Information Age Publishing In.
22. Llosa, L. (2008). Building and supporting a validity argument for a standards-based classroom assessment of English proficiency based on teacher judgments. Educational Measurement: Issues and Practice. doi: 10. 1111/j. 1745-3992. 2008. 00126. x.
23. Menon, G. (1993). The effects of accessibility of information in memory on judgments of behavioral frequencies. Journal of Consumer Research, 20(3), 431-440.
24. Messick, S. (1989). Validity. In R. Linn (Ed.), Educational measurement (3rd ed., pp. 3-103). Washington, DC: American Council on Education.
25. Messick, S. (1995). Validity of psychological assessments: Validation of inferences from person's responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749.
26. Olt, H., Jirwe, M., Gustavsson, P., & Emami, A. (2010). Psychometric evaluation of the swedish adaptation of the Inventory for Assessing the Process of Cultural Competence among Healthcare Professional Revised (IAPCC-R). Journal of Transcultural Nursing. doi: 10. 1177/1043659609349064.
27. Padilla, J. L., Gómez, J., Hidalgo, M. D., & Muñiz, J. (2007). Esquema conceptual y procedimientos para analizar la validez de las consecuencias del uso de los test. Psicothema, 19(1), 173-178.
28. Poole, H. M., Murphy, P., & Nurmikko, T. J. (2009). Development and preliminary validation of the NePIQoL: A quality-of-life measure for neuropathic pain. Journal of Pain and Symptom Management. doi: 10. 1016/j. jpainsymman. 2008. 01. 012.
29. Sijtsma, K. (2009). Correcting fallacies in validity, reliability and clasification. International Journal of Testing. doi: 10. 1080/15305050903106883.
30. Sireci, S. G. (2005). Validity theory and application. In B. S. Everitt & D. C. Howell (Eds.), Encyclopedia of statistics in behavioral science (pp. 2103-2107). Nueva, Jersey: Wiley.
31. Sireci, S. G. (2009). Packing and unpacking sources of validity evidence: History repeats itself again. In R. Lissitz (Ed.), The concept of validity: Revisions, new directions and applications (pp. 19-37). Charlotte, NC: Information Age Publishing Inc.
32. Smilkstein, G. (1978). The family APGAR: A proposal for family function test and its use by physicians. Journal of Family Practice, 6, 1231-1239.
33. Smilkstein, G., Ashworth, C., & Montano, D. (1982). Validity and reliability of the family APGAR as a test of family function. Journal of Family Practice, 15, 303-311.
34. Spanish Ministry of Health and Consume. (2006). Encuesta Nacional de Salud de España 2006 [National Health Survey in Spain, 2006]. Madrid: Ministerio de Sanidad y Consumo. http://www. ine. es/jaxi/menu. do?L=0&type=pcaxis&path=%2Ft15/p419&file=inebase (March, 13 2008).
35. Tourangeau, R. (1984). Cognitive science and survey methods: A cognitive perspective. In T. Jabine, M. Straf, J. Tanur, & R. Tourangeau (Eds.), Cognitive aspects of survey design: Building a bridge between disciplines (pp. 73-100). Washington, DC: National Academy Press.
36. Tourangeau, R., Rips, R. J., & Rasinski, K. (2000). The psychology of survey response. Cambridge: Cambridge University Press.
37. Willis, G. B. (2005). Cognitive interviewing. Thousand Oaks: Sage Publications.
38. Willis, G. B., Royston, P., & Bercini, D. (1991). The use of verbal report methods in the development and testing of survey questionnaires. Applied Cognitive Psychology, 5, 251-267.
39. Zumbo, B. D. (2007). Validity: Foundational issues and statistical methodology. In C. R. Rao & S. Sinharay (Eds.), Handbook of statistics (Vol. 26, pp. 45-79)., Psychometrics Amsterdam: Elsevier.
40. Zumbo, B. D. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In R. W. Lissitz (Ed.), The concept of validity: revisions, new directions and applications (pp. 65-82). Charlotte, NC: IAP-Information Age Publishing Inc.
41. nd Annual Meeting of the Northeastern Educational Research Association, Rocky Hill, CT. Abstract retrieved from http://www. nera-education. org/Full_2011_NERA_Program. pdf.