Using cognitive interviewing and behavioral coding to determine measurement equivalence across linguistic and cultural groups: An example from the international tobacco control policy evaluation project

Field Methods

Volumn 23, Issue 4, 2011, Pages 439-460

  Thrasher, James F ^a,b   Quah, Anne C K ^c   Dominick, Gregory ^d   Borland, Ron ^e   Driezen, Pete ^c   Awang, Rahmat ^f   Omar, Maizurah ^e   Hosking, Warwick ^g   Sirirassamee, Buppha ^h   Boado, Marcelo ⁱ  

^a UNIVERSITY OF SOUTH CAROLINA   (United States)

^b INSTITUTO NACIONAL DE SALUD PÚBLICA   (Mexico)

^c UNIVERSITY OF WATERLOO   (Canada)

^d UNIVERSITY OF DELAWARE   (United States)

^e CANCER EPIDEMIOLOGY CENTRE   (Australia)

^f SCHOOL OF PHYSICS   (Malaysia)

^g VICTORIA UNIVERSITY   (Australia)

^h MAHIDOL UNIVERSITY   (Thailand)

ⁱ UNIVERSIDAD DE LA REPÚBLICA   (Uruguay)

Author keywords

behavioral coding; cognitive interviewing; cross cultural survey research; questionnaire pretesting; tobacco

Indexed keywords

EID: 84555178527     PISSN: 1525822X     EISSN: 15523969     Source Type: Journal    
DOI: 10.1177/1525822X11418176     Document Type: Article

References (40)

1. Blair, J., A. Ackerman, L. Piccinino, and R. Levenstein. 2007. Using behavior coding to validate cognitive interview findings. Paper presented at the Proceedings of the American Statistical Association: Section on Survey Research Methods, Salt Lake City, UT, July 29-August 2.
2. Bollen K. A.,Entwisle B.,Alderson A. S.Macrocomparative research methods.Annual Review of Sociology. 1993;19:321-51.
3. Burlew A. K.,Feaster D.,Brecht M. -L.,Hubbard R.Measurement and data analysis in research addressing health disparities in substance abuse.Journal of Substance Abuse Treatment. 2009;36:25-43.
4. Cannell C. F.,Lawson S. A.,Hausser D. L.A technique for evaluating interviewer performance. Ann Arbor, MI: University of Michigan Press; 1975:.
5. Coronado I.,Earle D.Effectiveness of the American Community Survey of the U.S. Census in a borderlands colonial setting. Washington, DC: U.S. Census Bureau; 2002:.
6. DeMaio T. J.,Rothgeb J. M.Answering questions. Schwarz N.Sudman S., ed. San Francisco, CA: Jossey-Bass; 1996:177-95.
7. Esposito, J. L., J. Rothgeb, A. E. Polivka, J. Hess, and P. C. Campanelli. 1992. Methodologies for evaluating survey questions: Some lessons from the redesign of the Current Population Survey. Paper presented at the International Conference on Social Science Methodology, Trento, Italy, June 22-26.
8. Fong G. T.,Cummings K. M.,Borland R.,Hastings G.,Hyland A.,Giovino G. A.,Hammond D.,Thompson M. E.The conceptual framework of the International Tobacco Control Policy Evaluation Project.Tobacco Control. 2006;15:iii3-iii11.
9. Forsyth B.,Rothgeb J. M.,Willis G. B.Methods for testing and evaluating survey questionnaires. Pressler S.Rothgeb J. M.Couper M. P.Lessler J. T.Martin E.Martin J.Singer E., ed. Hoboken, NJ: Wiley; 2004:525-46.
10. Fowler F.Improving survey questions: Design and evaluation. Thousand Oaks, CA: SAGE; 1995:.
11. Goerman P.Adapting cognitive interview techniques for use in pretesting Spanish language survey instruments (Survey Methodology #2006-3). Washington, DC: U.S. Census Bureau; 2006:.
12. Gregorich S. E.Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework.Medical Care. 2006;44:S78-S94.
13. Harkness J. A.Cross-cultural survey research. Harkness J. A.de Vijver F. J. R. Van.Mohler P. P., ed. Hoboken, NJ: Wiley; 2003:35-56.
14. Harkness J. A.,Pennell B. -A.,Schoua-Glusberg A.Methods for testing and evaluating survey questionnaires. Pressler S.Rothgeb J. M.Couper M. P.Lessler J. T.Martin E.Martin J.Singer E., ed. Hoboken, NJ: Wiley; 2004:453-73.
15. Hughes K. A.Comparing pretesting methods: Cognitive interviews, respondent debriefing, and behavior coding. Washington, DC: Statistical Research Division, U.S. Census Bureau; 2004:.
16. IARC handbooks of cancer prevention: Tobacco control. Vol. 12: Methods for evaluating tobacco control policies. Lyon: International Agency for Research on Cancer; 2009:.
17. Johnson T. P.Cross-cultural survey equivalence. Harkness J. A., ed. Mannheim: ZUMA; 1998:1-40.
18. Johnson T. P.,Cho Y.,Holbrook A.,O'Rourke D.,Warnecke R.,Chávez N.Cultural variability in the comprehension of health survey questions.Annals of Epidemiology. 2006;16:661-68.
19. Kissam E.,Herrera E.,Nakamoto J. M.Hispanic response to census enumeration forms and procedures. Washington, DC: U.S. Census Bureau; 1993:.
20. Knowles E.,Condon C.Why people say "yes": A dual-process theory of acquiescence.Journal of Personality and Social Psychology. 1999;77:379-86.
21. Miles M. B.,Huberman A. M.Qualitative data analysis. London: SAGE; 1994:.
22. Miller, K., R. Fitzgerald, R. Caspar, M. Dimov, M. Gray, C. Nunes, et al. 2008. Design and analysis of cognitive interviews for cross-national testing. Paper presented at the International Conference on Survey Methods in Multicultural, Multinational, and Multiregional Contexts, Berlin, Germany, June 25-29.
23. Miller K.,Mont D.,Maitland A.,Altman B.,Madans J.Implementation and results of a cross-national, structured-interview cognitive test.Quality and Quantity: International Journal of Methodology. 2011;45:801-815.
24. Pan Y.,Craig B.,Scollon S.Results from Chinese cognitive interviews on the Census 2000 Long Form: Language, literacy, and cultural issues. Washington, DC: U.S. Census Bureau; 2005:.
25. Pan Y.,de la Puente M.Census Bureau guideline for the translation of data collection instruments and supporting materials: Documentation of how the guideline was developed. Washington, DC: Statistical Division, U.S. Census Bureau; 2005:.
26. Smith P.Acquiescent response bias as an aspect of cultural communication style.Journal of Cross-Cultural Psychology. 2004;35:50-61.
27. Smith T. W.Methods for testing and evaluating survey questionnaires. Pressler S.Rothgeb J. M.Couper M. P.Lessler J. T.Martin E.Martin J.Singer E., ed. Hoboken, NJ: Wiley; 2004:431-52.
28. Thompson M. E.,Fong G. T.,Hammond D.,Boudreau C.,Dreizen P. R.,Hyland A., et al.The methodology of the International Tobacco Control Policy Evaluation Project.Tobacco Control. 2006;15:iii12-iii18.
29. Thrasher J. F.,Boado M.,Sebrié E. M.,Bianco E.Smoke-free policies and the social acceptability of smoking in Uruguay and Mexico: Findings from the International Tobacco Control Policy Evaluation (ITC) Project.Nicotine & Tobacco Research. 2009;11:591-99.
30. Thrasher J. F.,Chaloupka F.,Hammond D.,Fong G. T.,Borland R.,Hastings G., et al.Evaluación de las políticas contra el tabaquismo en países latinoamericanos en la era del Convenio Marco para el Control del Tabaco [Evaluation of tobacco control policies in Latin American countries during the era of the Framework Convention on Tobacco Control].Salud Pública de México. 2006;48:S155-S166.
31. Thrasher J. F.,Johnson T. P.IARC handbooks of cancer prevention: Tobacco control. Vol. 12: Methods for evaluating tobacco control policies. Lyon: International Agency for Research on Cancer; 2008:59-74.
32. Van de Vijver F. J. R.Cross-cultural survey methods. Harkness J. A.Van de Vijver F. J. R.Mohler P. P., ed. Hoboken, NJ: Wiley; 2003:143-56.
33. Van de Vijver F. J. R.,Leung K.Methods and data analysis for cross-cultural research. London: SAGE; 1997:.
34. Van der Zouwen J.,Smit J. H.Methods for testing and evaluating survey questionnaires. Pressler S.Rothgeb J. M.Couper M. P.Lessler J. T.Martin E.Martin J.Singer E., ed. Hoboken, NJ: Wiley; 2004:109-30.
35. Van Herk H.,Poortinga Y. H.,Verhallen T. M. M.European Journal of Marketing. 2005:351-64.
36. Framework convention on tobacco control. Geneva: Tobacco Free Initiative, World Health Organization; 2003:.
37. Willis G. B.Cognitive interviewing. London: SAGE; 2005:.
38. Willis G. B.,Lawrence D.,Hartman A.,Stapleton Kudela M.,Levin K.,Forsyth B.Translation of a tobacco survey into Spanish and Asian languages.Nicotine & Tobacco Research. 2008;10:1075-84.
39. Willis G. B.,Zahnd E.Questionnaire design from a cross-cultural perspective: An empirical investigation of Koreans and Non-Koreans.Journal of Health Care for the Poor and Underserved. 2007;18:190-210.
40. Zahnd, E., T. Tam, N. Lordi, G. B. Willis, S. Edwards, S. Fry, et al. 2005. Crosscultural behavior coding: Using the 2003 California Health Interview Survey (CHIS) to assess cultural/language data quality. Paper presented at the European Association for Survey Research, Barcelona, Spain, July 18-22.