Item comparability in cross-national surveys: Results from asking probing questions in cross-national web surveys about attitudes towards civil disobedience

Quality and Quantity

Volumn 48, Issue 1, 2014, Pages 127-148

  Behr, Dorothée ^a   Braun, Michael ^a   Kaczmirek, Lars ^a   Bandilla, Wolfgang ^a  

^a GESIS LEIBNIZ INSTITUTE FOR THE SOCIAL SCIENCES   (Germany)

Author keywords

Comparability; Cross national survey research; Mixed method; Probing; Web surveys

Indexed keywords

EID: 84891626669     PISSN: 00335177     EISSN: 15737845     Source Type: Journal    
DOI: 10.1007/s11135-012-9754-8     Document Type: Article

References (25)

1. Beatty P. C., Willis G. B.: Research synthesis: the practice of cognitive interviewing. Public Opin. Quart. 71, 287-311 (2007).
2. Behr, D., Kaczmirek, L., Bandilla, W., Braun, M.: Asking probing questions in web surveys: which factors have an impact on the quality of responses? Soc. Sci. Comput. Rev. (2012). doi: 10. 1177/0894439311435305.
3. Behr, D., Braun, M., Kaczmirek, L., Bandilla, W.: Testing the validity of gender ideology items by implementing probing questions in web surveys. Field Methods (Forthcoming).
4. Bolzendahl, C., Coffe, H.: A gender gap in citizenship norms? The importance of political, civil and social rights and responsibilities. Br. J. Sociol. 60(4), 763-791. http://escholarship. org/uc/item/71x598x2 (2008). Accessed 24 April 2012.
5. Childs J., Goerman P.: Bilingual questionnaire evaluation and development through mixed pretesting methods: the case of the U. S. census nonresponse followup instrument. J. Off. Stat. 26, 535-557 (2010).
6. DeMaio T. J., Rothgeb J. M.: Cognitive interviewing techniques: in the lab and in the field. In: Schwarz, N., Sudman, S. (eds) Answering Questions: Methodology for Determining Cognitive and Communicative Processes in Survey Research, pp. 177-195. Jossey-Bass, San Francisco (1996).
7. Donovan, T., Denemark, D., Bowler, S.: Trust in government. The United States in comparative perspective. http://faculty. wwu. edu/donovat/trust. pdf (2008). Accessed 24 April 2012.
8. Fitzgerald R., Widdop S., Gray M., Collins D.: Identifying sources of error in cross-national questionnaires: application of an error source typology to cognitive interview data. J. Off. Stat. 27, 569-599 (2011).
9. Forsyth B. H., Stapleton Kudela M., Levin K., Lawrence D., Willis G. B.: Methods for translating an English-language survey questionnaire on tobacco use into Mandarin, Cantonese, Korean, and Vietnamese. Field Methods 19, 264-283 (2007).
10. Goerman P. L., Caspar R. A.: A preferred approach for the cognitive testing of translated materials: testing the source version as a basis for comparison. Int. J. Soc. Res. Methodol. 13, 303-316 (2010).
11. Harkness J. A., Edwards B., Hansen S. E., Miller D. R., Villar A.: Designing questionnaires for multipopulation research. In: Harkness, J. A., Braun, M., Edwards, B., Johnson, T. P., Lyberg, L., Mohler, P. P., Pennell, B.-E., Smith, T. W. (eds) Survey Methods in Multinational, Multiregional, and Multicultural Contexts., pp. 33-57. Wiley, Hoboken (2010).
12. ISSP Research Group: International social survey programme 2004: citizenship (ISSP 2004). Source questionnaire. GESIS Data Archive, Cologne (2004a).
13. ISSP Research Group: International social survey programme 2004: citizenship (ISSP 2004). Data file Vers. 1. 2. 0. GESIS Data Archive, Cologne. doi: 10. 4232/1. 10078 (2004b).
14. Lee, J.: Conducting cognitive interviews in cross-national settings. Assessment (2012). doi: 10. 1177/1073191112436671.
15. Miller K., Fitzgerald R., Padilla J.-L., Willson S., Widdop S., Caspar R., Dimov M., Gray M., Nunes C., Prüfer P., Schöbi N., Schoua-Glusberg A.: Design and analysis of cognitive interviews for comparative multinational testing. Field Methods 23, 379-396 (2011).
16. Morren, M., Gelissen, J., Vermunt, J. K.: Exploring the response process of culturally differing survey respondents with a response style: a sequential mixed-methods study. Field Methods (Forthcoming).
17. Prüfer, P., Rexroth, M.: Kognitive Interviews [cognitive interviews]. ZUMA How-to-Reihe 15. http://www. gesis. org/fileadmin/upload/forschung/publikationen/gesis_reihen/howto/How_to15PP_MR. pdf?download=true (2005). Accessed 24 April 2012.
18. Reeve B. B., Willis G., Shariff-Marco S. N., Breen N., Williams D. R., Gee G. C., Alegría M., Takeuchi D. T., Stapleton M., Levin K. Y.: Comparing cognitive interviewing and psychometric methods to evaluate a racial/ethnic discrimination scale. Field Methods 34, 397-419 (2011).
19. Schuman H.: The random probe: a technique for evaluating the validity of closed questions. Am. Sociol. Rev. 31, 218-222 (1966).
20. Schwarz N.: Cognition and Communication: Judgmental Biases, Research Methods, and the Logic of Conversation. Erlbaum, Mahwah (1996).
21. Strack F., Martin L.: Thinking, judging, and communicating: a process account of context effects in attitude surveys. In: Hippler, H.-J., Schwarz, N., Sudman, S. (eds) Social Information Processing and Survey Methodology, pp. 123-148. Springer, New York (1987).
22. Thrasher J. F., Quah A. C. K., Dominick G., Borland R., Driezen P., Awang R., Omar M., Hosking W., Sirirassamee B., Boado M.: Using cognitive interviewing and behavioral coding to determine measurement equivalence across linguistic and cultural groups: an example from the international tobacco control policy evaluation project. Field Methods 23, 439-460 (2011).
23. Tourangeau R., Rips L. J., Rasinski K.: The Psychology of Survey Response. Cambridge University Press, Cambridge (2000).
24. Willis G. B.: Cognitive Interviewing: A Tool for Improving Questionnaire Design. Sage, Thousand Oaks (2005).
25. Willis G. B., Lawrence D., Hartman A., Stapleton Kudela M., Levin K., Forsyth B.: Translation of a tobacco survey into Spanish and Asian languages: the tobacco use supplement to the current population survey. Nicot. Tob. Res. 10, 1075-1084 (2008).