A Comparison of the Quality of Questions in a Face-to-face and a Web Survey

International Journal of Public Opinion Research

Volumn 25, Issue 2, 2013, Pages 242-253

  Revilla, Melanie A ^a   Saris, Willem E ^a  

^a UNIVERSITAT POMPEU FABRA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84878886398     PISSN: 09542892     EISSN: 14716909     Source Type: Journal    
DOI: 10.1093/ijpor/eds007     Document Type: Review

References (33)

1. Alwin, D. F. (1974). Approaches to the interpretation of relationships in the multitrait-multimethod matrix. In H. L. Costner (Ed.), Sociological methodology (pp. 79-105). San Francisco: Jossey-Bass.
2. Andrews, F. (1984). Construct validity and error components of survey measures: A structural modeling approach. Public Opinion Quarterly, 46, 409-442.
3. Saris, W. E., & van Meurs, A. (1990). Evaluation of measurement instruments by metaanalysis of multitrait multimethod studies. Amsterdam: North-Holland.
4. Browne, M. W. (1984). The decomposition of multitraitmultimethod matrices. British Journal of Mathematical and Statistical Psychology, 37, 1-21.
5. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 6, 81-105.
6. Coenders, G., & Saris, W. E. (1995). Categorization and measurement quality. The choice between Pearson and Polychoric correlations. In W. E. Saris (Ed.), The MTMM approach to evaluate measurement instruments (pp. 125-144). Budapest: Eotvos University Press.
7. Corten, I. W., Saris, W. E., Coenders, G., M., van der Veld, W., Aalberts, C. E., & Kornelis, C. (2002). Fit of different models for multitrait-multimethod experiments. Structural Equation Modeling, 9(2), 213-232.
8. Couper, M. P, & Miller, P. V (2008). Introduction to the special issue. Public Opinion Quarterly, 72, 831-835.
9. Dillman, D. A., Phelps, G., Tortora, R., Swift, K., Kohrell, J., Berck, J., & Messer, B. L. (2009). Response rate and measurement differences in mixed mode surveys using mail, telephone, interactive voice response and the Internet. Social Science Research, 38(1), 1-18.
10. Faas, T., & Schoen, H. (2006). Putting a questionnaire on the Web is not enough-a comparison of online and ofline survey conducted in the context of the German Federal Elections 2002. Journal of Official Statistics, 22, 177-191.
11. Fricker, S., Galesic, M., Tourangeau, R., & Yan, T. (2005). An experimental comparison of web and telephone surveys. Public Opinion Quarterly, 69, 370-392.
12. Heerwegh, D. (2009). Mode differences between face to face and Web surveys: an experimental investigation of data quality and social desirability effects. International Journal of Public Opinion Research, 21, 111-119.
13. Holbrook, A. L., Green, M. C, & Krosnick, J. A. (2003). Telephone versus face-to-face interviewing of national probability samples with long questionnaires. Comparisons of respondent satisficing and social desirability response bias. Public Opinion Quarterly, 67, 79-125.
14. Hox, J. J., & De Leeuw, E. D. (1994). A comparison of nonresponse in mail, telephone, and face-to-face surveys: Applying multilevel models to meta-analysis. Quality and Quantity, 28, 329-344.
15. Joreskog, K. G. (1970). A general method for the analysis of covariance structures. Biometrika, 57, 239-251.
16. Joreskog, K. G. (1971). Statistical analysis of sets of congeneric tests. Psychometrika, 36, 109-133.
17. Joreskog, K. G., & Sorbom, D. (1991). LISREL VII: A guide to the program and applications. Chicago, IL: SPSS.
18. Kaplowitz, M. D., Hadlock, T. D., & Levine, R. (2004). A comparison of web and mail survey response rates. Public Opinion Quarterly, 68, 94-101.
19. Kreuter, F., Presser, S., & Tourangeau, R. (2009). Social desirability bias in CATI, IVR and web surveys: The effects of mode and question sensitivity. Public Opinion Quarterly, 72, 847-865.
20. Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5, 213-236.
21. Lozar Manfreda, K., Bosnjak, M., Berzelak, J., Haas, I., & Vehovar, V. (2008). Web surveys versus other survey modes. International Journal of Market Research, 50, 79-104.
22. Saris, W. E., & Andrews, F. M. (1991). Evaluation of measurement instruments using a structural modeling approach. In P. Biemer, R. M. Groves, L. Lyberg, N. Mathiowetz & S. Sudman (Eds.), Measurement errors in surveys (pp. 575-597). New York: Wiley.
23. Saris, W. E., & Gallhofer, I. (2007). Design, evaluation, and analysis of questionnaires for survey research. New York: Wiley.
24. Saris, W. E., Revilla, M., Krosnick, J. A., & Shaeffer, E. M. (2010). Comparing questions with agree/disagree response options to questions with construct-specific response options. Survey Research Methods, 4, 61-79.
25. Saris, W. E., Satorra, A., & Coenders, G. (2004). A new approach to evaluating the quality of measurement instruments: The split-ballot MTMM design. Sociological Methodology, 34, 311-347.
26. Saris, W. E, Satorra, A., & Van der Veld, W. M. (2009). Testing structural equation models or detection of misspecifications? Structural Equation Modeling: A Multidisciplinary Journal, 16, 561-582.
27. Scherpenzeel, A. (1995). Meta analysis of a European comparative study. In W. E. Saris & A. Munnich (Eds.), The multitrait-multimethod approach to evaluate measurement instruments (pp. 225-242). Budapest: Eotvos University Press.
28. Scherpenzeel, A., & Saris, W. E. (1997). The validity and reliability of survey questions: A meta-analysis of MTMM studies. Sociological Methods and Research, 25(3), 341-383.
29. Schonlau, M., Zapert, K., Simon, L. P., Sanstad, K., Marcus, S., Adams, J., Spranca, M., Kan, H. J., Turner, R., & Berry, S. (2004). A comparison between a propensity weighted Web survey and an identical RDD Survey. Social Science Computer Review, 21, 1-11.
30. Toepoel, V., Das, M., & van Soest, A. (2008). Effects of design in web surveys. Comparing trained and fresh respondents. Public Opinion Quarterly, 72, 985-1007.
31. Van der Veld, W. M., Saris, W. E., & Satorra, A. (2009). Judgement Rule Aid software.
32. Van Meurs, A., & Saris, W. E. (1990). Memory effects in MTMM studies. In W. E. Saris & A. van Meurs (Eds.), Evaluation of measurement instruments by metaanalysis of multitrait-multimethod studies (pp. 134-146). Amsterdam: North Holland.
33. Werts, C. E., & Linn, R. L. (1970). Path analysis: Psychological examples. Psychological Bulletin, 74, 194-212.