Testing the Validity of Gender Ideology Items by Implementing Probing Questions in Web Surveys

Field Methods

Volumn 25, Issue 2, 2013, Pages 124-141

  Behr, Dorothée ^a   Braun, Michael ^a   Kaczmirek, Lars ^a   Bandilla, Wolfgang ^a  

^a GESIS LEIBNIZ INSTITUTE FOR THE SOCIAL SCIENCES   (Germany)

Author keywords

gender ideology; probing; validity; web survey

Indexed keywords

EID: 84876551683     PISSN: 1525822X     EISSN: 15523969     Source Type: Journal    
DOI: 10.1177/1525822X12462525     Document Type: Article

References (30)

1. Baker R.,Blumberg S. J.,Brick J. M.,Couper M. P.,Courtright M.,Dennis J. M.,Dillman D.,Frankel M. R.,Garland P.,Groves R. M.,Kennedy C.,Krosnick J.,Lavrakas P. J.AAPOR report on online panels.Public Opinion Quarterly. 2010;74:711-81.
2. Beatty P. C.,Willis G. B.Research synthesis: The practice of cognitive interviewing.Public Opinion Quarterly. 2007;71:287-311.
3. Behr D.,Kaczmirek L.,Bandilla W.,Braun M.Asking probing questions in web surveys: Which factors have an impact on the quality of responses?.Social Science Computer Review. 2012;30:487-98.
4. BlairJ.ConradF.AckermannA. C.ClaxtonG. 2006. The effect of sample size on cognitive interview findings. Paper presented at the AAPOR Conference, Montreal, Canada, May 18-21. http://www.abtassociates.com/presentations/aapor06_sample_size_cognitive_interviews.pdf(accessed August 9, 2011).
5. Blasius J.,Thiessen V.Assessing data quality and construct comparability in cross-national surveys.European Sociological Review. 2006;22:229-42.
6. Braun M.Using egalitarian items to measure men's and women's family roles.Sex Roles. 2008;59:644-56.
7. Conrad F.,Blair J.Methods for testing and evaluating survey questionnaires. Presser S.Rothgeb J. M.Couper M. P.Lessler J. T.Martin E.Martin J.Singer E., ed. Hoboken, NJ: Wiley; 2004:67-88.
8. Conrad F.Sources of error in cognitive interviews.Public Opinion Quarterly. 2009;73:32-55.
9. DeMaio T. J.,Rothgeb J. M.Answering questions: Methodology for determining cognitive and communicative processes in survey research. Schwarz N.Sudman S., ed. San Francisco: Jossey-Bass; 1996:177-95.
10. Denscombe M.The length of responses to open-ended questions: A comparison of online and paper questionnaires in terms of a mode effect.Social Science Computer Review. 2008;26:359-68.
11. Dillman D. A.,Smyth J. D.,Christian L. M.Internet, mail, and mixed-mode surveys: The tailored design method. 2008. Internet, mail, and mixed-mode surveys: The tailored design method. 3rd ed. Hoboken, NJ: Wiley.Hoboken, NJ: Wiley; 2008:.
12. Galesic M.Dropouts on the web: Effects of interest and burden experienced during an online survey.Journal of Official Statistics. 2006;22:313-28.
13. HessJ.SingerE. 1995. The role of respondent debriefing questions in questionnaire development. Washington, DC: U.S. Census Bureau. http://www.census.gov/srd/papers/pdf/sm9518.pdf(accessed August 19, 2011).
14. Holland J. L.,Christian L. M.The influence of topic interest and interactive probing on responses to open-ended questions in web surveys.Social Science Computer Review. 2009;27:196-212.
15. ISSP. 2002. International Social Survey Programme 2002: Family and Changing Gender Roles III (ISSP 2002). GESIS Data Archive, Cologne, Germany, ZA3880. Source Questionnaire.
16. Krosnick J. A.Survey research.Annual Review of Psychology. 1999;50:537-67.
17. MacInnes J.Analysing patriarchy capitalism and women's employment in Europe.Innovation. 1998;11:227-48.
18. National Center for Health Statistics. 2011. Centers for Disease Control and Prevention. Q-Bank. List of reports. http://wwwn.cdc.gov/QBANK/Reports.aspx(accessed August 8, 2011).
19. Nichols E.,Hunter Childs J.Respondent debriefings conducted by experts: A technique for questionnaire evaluation.Field Methods. 2009;21:115-32.
20. Oksenberg L.,Cannell C.,Kalton G.New strategies for pretesting survey questions.Journal of Official Statistics. 1991;7:349-65.
21. Oudejans M.,Christian L. M.Social and behavioral research and the internet: Advances in applied methods and research strategies. Das M.Ester P.Kaczmirek L., ed. London: Routledge; 2010:304-32.
22. PrüferP.RexrothM. 2005. Kognitive Interviews [Cognitive Interviews]. ZUMA How-to-Reihe15. http://www.gesis.org/fileadmin/upload/forschung/publikationen/gesis_reihen/howto/How_to15PP_MR.pdf?download=true(accessed August 2, 2011).
23. Saris W.,Gallhofer I.Design, evaluation, and analysis of questionnaires for survey research. Hoboken, NJ: Wiley; 2007:.
24. Schuman H.The random probe: A technique for evaluating the validity of closed questions.American Sociological Review. 1966;31:218-22.
25. Smith T. W.Random probes of GSS questions.International Journal of Public Opinion Research. 1989;1:305-25.
26. Smyth J. D.,Dillman D. A.,Christian L. M.,McBride M.Open-ended questions in web surveys: Can increasing the size of answer boxes and providing extra verbal instructions improve response quality?.Public Opinion Quarterly. 2009;73:325-37.
27. Vandenberg R. J.,Lance C. E.A review and synthesis of the measurement invariance literature: Suggestions, practices and recommendations for organizational research.Organizational Research Methods. 2000;3:4-69.
28. Willis G. B.Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage; 2005:.
29. Willis G. B.,Schechter S.Evaluation of cognitive interviewing techniques: Do the results generalize to the field?.Bulletin de Méthodologie Sociologique. 1997;1997:40-66.
30. Wilson T. D.,LaFleur S. J.,Anderson D. E.Answering questions: Methodology for determining cognitive and communicative processes in survey research. Schwarz N.Sudman S., ed. San Francisco: Jossey-Bass; 1996:91-114.