Using cognitive interviews to evaluate the Spanish-language translation of a dietary questionnaire

Survey Research Methods

Volumn 3, Issue 1, 2009, Pages 13-25

  Levin, Kerry ^a   Willis, Gordon B ^b   Forsyth, Barbara H ^c   Norberg, Alicia ^a   Kudela, Martha Stapleton ^a   Stark, Debra ^a   Thompson, Frances E ^b  

^a Westat ^*  (United States)

^b NATIONAL CANCER INSTITUTE   (United States)

^c UNIVERSITY OF MARYLAND   (United States)

Author keywords

Cognitive interviewing; Dietary questionnaire; Questionnaire adapting; Spanish translation

Indexed keywords

EID: 77956094386     PISSN: None     EISSN: 18643361     Source Type: Journal    
DOI: None     Document Type: Article

References (57)

1. Agans, R. P., Deeb-Sossa, N., & Kalsbeek, W. D. (2006). Mexican immigrants and the use of cognitive assessment techniques in questionnaire development. Hispanic Journal of Behavioral Sciences, 28, 209-230.
2. Bethell, C., Carter, K., Lansky, D., Latzke, B., & Gowen, K. (2003). Measuring and Interpreting Health Care Quality Across Culturally-Diverse Populations: A Focus on Consumer-Reported Indicators of Health Care Quality. Portland, OR: FACCT - Foundation for Accountability.
3. Blais, A., & Gidengil, E. (1993). Things are not always what they seem: French-English differences and the problem of measurement equivalence. Canadian Journal of Political Science, 26, 541-555.
4. Cannell, C. F., Lawson, S. A., & Hausser, D. L. (1975). A technique for evaluating interviewer performance. Ann Arbor, MI: Survey Research Center, University of Michigan.
5. Cannell, C. F., Oksenberg, L., & Kalton, G. (1991). New techniques for pretesting survey questions. Journal of Official Statistics, 7, 349-365.
6. Carrasco, L. (2003). The American Community Survey (ACS) en Espanol: Using cognitive interviews to test the functional equivalency of questionnaire translations. Washington, DC: Statistical Research Division, U.S. Census Bureau.
7. Conrad, F., & Blair, J. (2004). Aspects of data quality in cognitive interviews: The case of verbal reports. In S. Presser et al. (Eds.), Questionnaire Development, Evaluation and Testing Methods (p. 67-87). New York: John Wiley and Sons.
8. Cosenza, C. (2002). Not your grandparent’s cognitive testing: Exploring innovative methods in cognitive evaluations of questions. Paper presented at the International Conference on Questionnaire Development, Evaluation and Testing (QDET), Charleston, SC.
9. DeMaio, T. J., & Rothgeb, J. M. (1996). Cognitive interviewing techniques: In the lab and in the field. In N. Schwarz & S. Sudman (Eds.), Answering questions: Methodology for determining cognitive and communicative processes in survey research (p. 177-195). San San Francisco: Jossey-Bass.
10. DeVellis, R. F. (2003). Scale development: Theory and applications (2nd ed.). Thousand Oaks, CA: Sage Publications.
11. Ellis, B., Minsel, B., & Becker, P. (1989). Evaluations of attitude survey translations: An investigation using item response theory. International Journal of Psychology, 24, 665-684.
12. Forsyth, B. H., Kudela, M. S., Lawrence, D., Levin, K., & Willis, G. (2007). Methods for translating an English-language survey questionnaire on tobacco use into Mandarin, Cantonese, Korean and Vietnamese. Field Methods, 19, 264-283.
13. Forsyth, B. H., & Lessler, J. T. (1991). Cognitive laboratory methods: A taxonomy. In P. Biemer, R. M. Groves, L. E. Lyberg, N. A. Mathoiwetz, & S. Sudman (Eds.), Measurement errors in surveys (p. 393-418). New York: Wiley.
14. Gerber, E. R. (1999). The view from anthropology: Ethnography and the cognitive interview. In M. Sirken, D. Herrmann, S. Schechter, N. Schwarz, J. Tanur, & R. Tourangeau (Eds.), Cognition and survey research (p. 217-234). New York: Wiley.
15. Goerman, P. (2006a). Adapting cognitive interviews for use in pretesting Spanish language instruments. Washington, DC: Statistical Research Division, U.S. Census Bureau.
16. Goerman, P. (2006b). Cognitive interview methodology revisited: Development of best practices for pretesting Spanish survey instruments. Paper presented at the meeting of the American Association for Public Opinion Research, Montreal, Canada.
17. Goerman, P., & Caspar, R. (2007). A new methodology for the cognitive testing of translated materials: Testing the source version as a basis for comparison. http://www.amstat.org/sections/srms/Proceedings/y2007f.html.
18. Hambleton, R. K. (2005). Issues, designs, and technical guidance for adapting tests into multiple languages and cultures. In R. K. Hambleton, P. F. Merenda, & C. D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (p. 3-38). Mahwah, New Jersey: Erlbaum.
19. Hambleton, R. K., Merenda, P., & Spielberger, C. D. (2005). Adapting educational and psychological tests for cross-cultural assessment. Mahwah, New Jersey: Erlbaum.
20. Harkness, J., & Schoua-Glusberg, A. (1998). Questionnaires in translation. In J. A. Harkness (Ed.), Cross-cultural survey equivalence (p. 87-127). Mannheim, Germany: ZUMA Nachrichten Spezial.
21. Harkness, J. A., Mohler, P. P., & Van de Vijver, F. J. R. (2003). Comparative research. In J. A. Harkness, F. J. R. Van de Vivjer, & P. P. Mohler (Eds.), Cross-cultural survey methods (p. 3-16). Hoboken, NJ: John Wiley & Sons.
22. Harkness, J. A., Pennell, B.-E., & Schoua-Glusberg, A. (2004). Survey questionnaire translation and assessment. In S. Presser et al. (Eds.), Methods for testing and evaluating survey questionnaires (p. 453-473). New York: Wiley.
23. Harkness, J. A., Van de Vijver, F. J. R., & Mohler, P. (2003). Crosscultural survey methods. New York: Wiley.
24. Johnson, T. P. (1998). Approaches to equivalence in cross-cultural and cross-national survey research (No. 3). Mannheim, Germany: ZUMA Nachrichten Spezial.
25. Krause, N. (2006). The use of qualitative measures to improve quantitative measures of health-related constructs. Medical Care, 44(11), S34-8.
26. Kudela, M. S., Forsyth, B. H., Levin, K., Lawrence, D., & Willis, G. (2006). Cognitive interviewing versus behavior coding. Paper presented to the American Association of Public Opinion Research, Montreal, Canada.
27. Malda, M., van de Vijver, F., Srinivasan, K., Transler, C., Sukumar, P., & Rao, K. (n.d.). Adapting a cognitive test for a different culture: An illustration of qualitative procedures. Psychology Science Quarterly.
28. McKay, R. B., Breslow, M. J., Sangster, R. L., Gabbard, S. M., Reynolds, R. W., Nakamoto, J. M., et al. (1996). Translating survey questionnaires: Lessons learned. New Directions for Evaluation, 70, 93-105.
29. Merenda, P. F. (2005). Cross-cultural adaptation of educational and psychological testing. In R. K. Hambleton, P. F. Merenda, & C. D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (p. 321-341). Mahwah, New Jersey: Erlbaum.
30. Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis. Thousand Oaks, CA: Sage.
31. Millen, A. E., Midthune, D., Thompson, F. E., Kipnis, V., & Subar, A. F. (2006). The National Cancer institute diet history questionnaire: Validation of pyramid food servings. American Journal of Epidemiology, 163, 279-288.
32. Miller, K., Willis, G., Eason, C., Moses, L., & Canfield, B. (2005). Interpreting the results of cross-cultural cognitive interviews. In J. H. P. Hoffmeyer-Zlotnik & J. Harkness (Eds.), Methodological aspects in cross-national research (p. 79-92). Mannheim, Germany: ZUMA Nachrichten Spezial.
33. Napoles-Springer, A., Santoyo-Olsson, J., O’Brien, H., & Stewart, A. (2006). Using cognitive interviews to develop surveys in diverse populations. Medical Care, 44(11), S3-S4.
34. Napoles-Springer, A., & Stewart, A. (2006). Overview of qualitative methods in research with diverse populations. Making research reflect the population. Medical Care, 44(11), S3-S4.
35. Pan, Y. (2003). The role of sociolinguistics in the development and conduct of federal surveys. Proceedings of the Federal Committee on Statistical Methodology Research Conference. November 2003, Arlington, VA.
36. Pasick, R. J., Stewart, S. L., Bird, J. A., & D’onofrio, C. N. (2001). Quality of data in multiethnic health surveys. Public Health Reports, 116, 223-243.
37. Patton, M. Q. (2002). Qualitative research and evaluation methods. Thousand Oaks, CA: Sage.
38. Presser, S., Couper, M. P., Lessler, J. T., Martin, E., Martin, J., & Rothgeb, J. (2004). Methods for testing and evaluating survey questions. In S. Presser et al. (Eds.), Methods for testing and evaluating survey questionnaires (p. 1-22). New York: Wiley.
39. Schaffer, B., & Riordan, C. (2003). A review of cross-cultural methodologies for organizational research: A best-practices approach. Organizational Research Methods, 6(2), 169-215.
40. Schoua-Glusberg, A. (2006a). Assessing comprehension of translated questionnaires with qualitative methods. Proceedings of the Statistics Canada Symposium 2004: Innovative Methods for Surveying Difficult-to-Reach Populations. http://www.statcan.ca/english/freepub/11-522-XIE/2004001/Schoua-Glusberg eng final.pdf.
41. Schoua-Glusberg, A. (2006b). Eliciting education level in Spanish interviews. Paper presented to the American Association of Public Opinion Research, Montreal, Canada.
42. Silverman, D. (1993). Interpreting qualitative data. Thousand Oaks, CA: Sage.
43. Subar, A. F., Thompson, F. E., Kipnis, V., Midthune, D., Hurwitz, P., McNutt, S., et al. (2001). Comparative validation of the Block, Willett and National Cancer Institute food frequency questionnaires: The eating at America’s Table Study. American Journal of Epidemiology, 154(12), 1089-1099.
44. Subar, A. F., Thompson, F. E., Potischman, N., Forsyth, B. H., Buday, R., Richards, D., et al. (2007). Formative research of a quick list for an automated self-administered 24-hour dietary recall. Journal of the American Dietetic Association, 107(6), 1002-1007.
45. Subar, A. F., Thompson, F. E., Smith, A. G., Jobe, J. B., Ziegler, R. G., Potischman, N., et al. (1995). Improving food frequency questionnaires: A qualitative approach using cognitive interviewing. Journal of the American Dietetic Association, 95(7), 781-788, quiz 789-790.
46. Tanzer, N. K. (2005). Developing tests for use in multiple languages and cultures: A plea for simultaneous development. In R. K. Hambleton, P. F. Merenda, & C. D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (p. 235-263). Mahwah, New Jersey: Erlbaum.
47. Thompson, F. E., Subar, A. R., Brown, C. C., Smith, A. F., Sharbaugh, C. O., Jobe, J. B., et al. (2002a). Cognitive research enhances accuracy of food frequency questionnaire reports: Results of an experimental validation study. Journal of the American Dietetic Association, 102(2), 212-225.
48. Thompson, F. E., Subar, A. R., Smith, A. F., Midthune, D., Radimer, K. L., Kahle, L. L., et al. (2002b). Fruit and vegetable assessment: Performance of 2 new short instruments and a food frequency questionnaire. Journal of the American Dietetic Association, 102(12), 1764-1772.
49. U.S. Census Bureau. (1998). Pretesting policy and options: Demographic surveys at the Census Bureau. Washington, DC: U.S. Census Bureau.
50. U.S. Census Bureau. (2004). Census Bureau guideline: Language translation of data collection instruments and supporting materials. Washington, DC: U.S. Census Bureau.
51. Warnecke, R. B., Johnson, T. P., Chavez, N., Sudman, S., O’Rourke, D. P., & Lacey, L. (1997). Improving question wording in surveys of culturally diverse populations. Annals of Epidemiology, 7(5), 334-342.
52. Weech-Maldonado, R., Weidmer, B., Morales, L., & Hays, R. (2001). Cross-cultural adaptation of survey instruments: The CAHPS experience. Seventh Conference on Health Survey Research Methods. Hyattsville, Maryland.
53. Willis, G., Lawrence, D., Kudela, M., & Levin, K. (2005a). The use of cognitive interviewing to study cultural variation in survey response. Paper presented to the Quest Workshop on Questionnaire Design and Testing.
54. Willis, G., Lawrence, D., Thompson, F. E., Kudela, M., Levin, K., & Miller, K. (2005b). The use of cognitive interviewing to evaluate translated survey questions: Lessons learned. Proceedings of the Federal Committee on Statistical Methodology Research Conference. Arlington, VA.
55. Willis, G., & Zahnd, E. (2007). Questionnaire design from a crosscultural perspective: An empirical investigation of Koreans and Non-Koreans. Journal of Health Care for the Poor and Underserved, 18, 197-217.
56. Willis, G. B. (2004). Cognitive interviewing revisited: A useful technique in theory? In S. Presser et al. (Eds.), Methods for testing and evaluating survey questionnaires. New York: Wiley.
57. Willis, G. B. (2005). Cognitive interviewing: A tool for questionnaire design. Thousand Oaks, CA: Sage.