Evaluating Relative Mode Effects in Mixed-Mode Surveys:: Three Methods to Disentangle Selection and Measurement Effects

Sociological Methods and Research

Volumn 42, Issue 1, 2013, Pages 82-104

  Vannieuwenhuyze, Jorre T A ^a   Loosveldt, Geert ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

measurement effects; mixed mode; mode effects; opinion about surveys; selection effects

Indexed keywords

EID: 84875539073     PISSN: 00491241     EISSN: 15528294     Source Type: Journal    
DOI: 10.1177/0049124112464868     Document Type: Article

References (37)

1. Biemer P. P."Nonresponse Bias and Measurement Bias in a Comparison of Face To Face and Telephone Interviewing.".Journal of Official Statistics. 2001;17:295-320.
2. Börkan B."The Mode Effect in Mixed-Mode Surveys: Mail and Web Surveys.".Social Science Computer Review. 2010;28:371-80.
3. Bowden R. J.,Turkington D. A.Instrumental Variables. Cambridge, UK: Cambridge University press; 1990:.
4. de Leeuw E. D."To Mix or Not to Mix Data Collection Modes in Surveys.".Journal of Official Statistics. 2005;21:233-55.
5. de Leeuw E. DInternational Handbook of Survey Methodology. de E. D.Leeuw Hox J. J.Dillman D. A., ed. New York, NY: Lawrence Erlbaum; 2008:113-35.
6. Dillman D. A.,Phelps G.,Tortora R.,Swift K.,Kohrell J.,Berck J.,Messer B. L."Response Rate and Measurement Differences in Mixed-Mode Surveys Using Mail, Telephone, Interactive Voice Response (Ivr) and the Internet.".Social Science Research. 2009;38:1-18.
7. Dillman D. A.,Smyth J. D.,Christian L. M.Internet, Mail and Mixed-Mode Surveys: The Tailored Design Method. 2009. Internet, Mail and Mixed-Mode Surveys: The Tailored Design Method. 3rd ed. Hoboken, NJ: John Wiley.Hoboken, NJ: John Wiley; 2009:.
8. Fricker S.,Galesic M.,Tourangeau R.,Yan T."An Experimental Comparison of Web and Telephone Surveys.".Public Opinion Quarterly. 2005;69:370-92.
9. Goyder J."Surveys on Surveys - Limitations and Potentialities.".Public Opinion Quarterly. 1986;50:27-41.
10. Greenfield T. K.,Midanik L. T.,Rogers J. D."Effects of Telephone Versus Face-to-Face Interview Modes on Reports of Alcohol Consumption.".Addiction. 2000;95:277-84.
11. Hayashi T."The Possibility of Mixed-Mode Surveys in Sociological Studies.".International Journal of Japanese Sociology. 2007;16:51-63.
12. Heerwegh D.,Loosveldt G."Assessing Mode Effects in a National Crime Victimization Survey Using Structural Equation Models: Social Desirability Bias and Acquiescence.".Journal of Official Statistics. 2011;27:49-63.
13. Holbrook A. L.,Green M. C.,Krosnick J. A."Telephone Versus Face-To-Face Interviewing of National Probability Samples with Long Questionnaires: Comparisons of Respondent Satisficing and Social Desirability Response Bias.".Public Opinion Quarterly. 2003;67:79-125.
14. Holland P. W."Causal Inference, Path Analysis, and Recursive Structural Equations Models.".Sociological Methodology. 1988;18:449-84.
15. Jäckle A.,Roberts C.,Lynn P."Assessing the Effect of Data Collection Mode on Measurement.".International Statistical Review. 2010;78:3-20.
16. Lee R. M.,Renzetti C. M."The Problems of Researching Sensitive Topics: An Overview and Introduction.".American Behavioral Scientist. 1990;33:510-28.
17. Little R. J. A.,Rubin D. B.Statistical Analysis with Missing Data. 2002. Statistical Analysis with Missing Data. 2nd ed. London, UK: John Wiley.London, UK: John Wiley; 2002:.
18. Loosveldt G.,Storms V."Measuring Public Opinions about Surveys.".International Journal of Public Opinion Research. 2008;20:74-89.
19. Lugtig P.,Lensvelt-Mulders G. J. L. M.,Frerichs R.,Greven A."Estimating Nonresponse Bias and Mode Effects in a Mixed-Mode Survey.".International Journal of Market Research. 2011;53:669-86.
20. Morgan S. L.,Winship C.Counterfactuals and Causal Inference: Methods and Principles for Social Research. New York: Cambridge University Press; 2009:.
21. Nagelkerke N. J. D."A Note on a General Definition of the Coefficient of Determination.".Biometrika. 1991;78:691-92.
22. Pearl J.Causality: Models, Reasoning and Inference. 2009. Causality: Models, Reasoning and Inference. 2nd ed. New York, NY: Cambridge University Press.New York, NY: Cambridge University Press; 2009:.
23. RobertsC.2007. Mixing Modes of Data Collection in Surveys: A Methodological Review. Retrieved March 2, 2010 (http://eprints.ncrm.ac.uk/418/1/MethodsReviewPaperNCRM-008.pdf).
24. Rosenbaum P. R.,Rubin D. B."The Central Role of the Propensity Score in Observational Studies for Causal Effects.".Biometrika. 1983;70:41-55.
25. Roy A.,Berger P. D."E-mail and Mixed Mode Database Surveys Revisited: Exploratory Analysis of Factors Affecting Response Rates.".Database Marketing & Customer Strategy Management. 2005;12:153-71.
26. Rubin D. B."Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies.".Journal of Educational Psychology. 1974;66:688-701.
27. Rubin D. B."Inference and Missing Data.".Biometrika. 1976;63:581-92.
28. Rubin D. B."Practical Implications of Modes of Statistical Inference for Causal Effects and the Critical Role of the Assignment Mechanism.".Biometrics. 1991;47:1213-34.
29. Sato T.,Matsuyama Y."Marginal Structural Models as a Tool for Standardization.".Epidemiology. 2003;14:680-86.
30. Schafer J. L.,Graham J. W."Missing Data: Our View of the State of the Art.".Psychological Methods. 2002;7:147-77.
31. Storms V.,Loosveldt G.Procesevaluatie Van Het Veldwerk Van Een Mixed Mode Survey Naar Het Surveyklimaat In Vlaanderen. Leuven: KUL, Centrum voor sociologisch onderzoek; 2005:.
32. Tourangeau R.,Yan T."Sensitive Questions in Surveys.".Psychological Bulletin. 2007;133:859-83.
33. Vannieuwenhuyze J. T. A.,Loosveldt G.,Molenberghs G."A Method for Evaluating Mode Effects in Mixed Mode Surveys.".Public Opinion Quarterly. 2010;74:1027-45.
34. VannieuwenhuyzeJ. T. A.MolenberghsG. 2010. A SAS Macro to Disentangle Mode Effects on Proportions and Means of a Categorical Variable in an Extended Mixed-Mode Dataset. Retrieved August 20, 2010 (http://perswww.kuleuven.be/jorrevannieuwenhuyze).
35. Voogt R. J.,Saris W. E."Mixed Mode Designs: Finding the Balance Between Nonresponse Bias and Mode Effects.".Journal of Official Statistics. 2005;21:367-87.
36. Weisberg H. F.The Total Survey Error Approach: A Guide to the New Science of Survey Research. Chicago, IL: University of Chicago; 2005:.
37. Weisberg H. F.Bias and Causation: Models and Judgment for Valid Comparisons. Hoboken, NJ: Wiley; 2010:.