A method for evaluating mode effects in mixed-mode surveys

Public Opinion Quarterly

Volumn 74, Issue 5, 2010, Pages 1027-1045

  Vannieuwenhuyze, Jorre ^a   Loosveldt, Geert ^a   Molenberghs, Geert ^b  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b KU LEUVEN   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79951591268     PISSN: 0033362X     EISSN: 15375331     Source Type: Journal    
DOI: 10.1093/poq/nfq059     Document Type: Article

References (27)

1. Agresti, Alan. 2002. Categorical Data Analysis. Hoboken, NJ: Wiley.
2. Aquilino, William S. 1994. "Interview Mode Effects in Surveys of Drug and Alcohol Use: A Field Experiment." Public Opinion Quarterly 58(2):210-40.
3. Biemer, Paul P. 2001. "Nonresponse Bias and Measurement Bias in a Comparison of Face-to-face and Telephone Interviewing." Journal of Official Statistics 17(2):295-320.
4. Bowling, Ann. 2005. "Mode of Questionnaire Administration Can Have Serious Effects on Data Quality." Journal of Public Health 27(3):281-91. (Pubitemid 41298086)
5. Brick, J. Michael, and James M. Lepowski. 2008. "Multiple Mode and Frame Telephone Surveys." In Advances in Telephone Survey Methodology, eds. James Lepowski, Lilli Japec, Clyde Tucker, Paul Lavrakas, Michael Brick, Michael Link, Edith De Leeuw, and Roberta Sangster. Hoboken, NJ: Wiley & Sons.
6. Casella, George, and Roger L. Berger. 2002. Statistical Inference. 2nd ed. Duxbury, CA: Pacific Grove.
7. Day, Neil Atherton, David R. Dunt, and Susan Day. 1995. "Maximizing Response to Surveys in Health Program Evaluation at Minimum Cost Using Multiple Methods." Evaluation Review 19(4):436-50.
8. de Leeuw, Edith D. 1992. Data Quality in Mail, Telephone, and Face-to-face Surveys. Amsterdam: TT Publications.
9. -. 2005. "To Mix or Not to Mix Data Collection Modes in Surveys." Journal of Official Statistics 21(2):233-55.
10. de Leeuw, Edith D., and Johannes Van Der Zouwen. 1988. "Data Quality in Telephone and Face-toface Surveys: A Comparative Analysis." In Telephone Survey Methodology, eds. Robert Groves, Paul Biemer, Lars Lyberg, James Massey, William Nicholls II, and Joseph Waksberg. New York: Wiley-Interscience.
11. Deming, William Edwards, and Frederick F. Stephan. 1940. "On a Least Squares Adjustment of a Sampled Frequency Table When the Expected Marginal Totals Are Known." Annals of Mathematical Statistics 11:427-44.
12. Dillman, Don A. 1991. "The Design and Administration of Mail Surveys." Annual Review of Sociology 17:225-49.
13. -. 2005. "Survey Mode as a Source of Instability in Responses across Surveys." Field Methods 17(1):30-52.
14. Dillman, Don A., Glenn Phelps, Robert Tortora, Karen Swift, Julie Kohrell, Jodi Berck, and Benjamin L. Messer. 2009. "Response Rate and Measurement Differences in Mixed-mode Surveys Using Mail, Telephone, Interactive Voice Response (IVR), and the Internet." Social Science Research 38(1):3-20.
15. Dillman, Don A., Jolene D. Smyth, and Leah Melani Christian. 2009. Internet, Mail, and Mixedmode Surveys: The Tailored Design Method. Hoboken, NJ: Wiley.
16. European Social Survey. 2008. " Round 4 Data." Data file edition 1.0: Norwegian Social Science Data Services, Norway, data archive and distributor of ESS data.
17. Eva, Gillian, Geert Loosveldt, Peter Lynn, Peter Martin, Melanie Revilla, Willem Saris, and Jorre Vannieuwenhuyze. 2010. "ESS Prep WP6 - Mixed Mode Experiment. Delivarable 21 final mode report." London: City University.
18. Groves, Robert M. 1989. Survey Errors and Survey Costs. New York: Wiley.
19. Izrael, David, David C. Hoaglin, and Michael P. Battaglia. 2000. "A SAS Macro for Balancing a Weighted Sample" Proceedings of the Twenty-fifth Annual SAS Users Group International Conference, Paper 275.
20. Jäckle, Anette, Caroline Roberts, and Peter Lynn. 2010. "Assessing the Effect of Data Collection Mode on Measurement." International Statistical Review 78:3-20.
21. Rosenbaum, Paul R., and Donald B. Rubin. 1983. "The Central Role of the Propensity Score in Observational Studies for Causal Effects." Biometrika 70:41-55.
22. Sato, Tosiya, and Yutaka Matsuyama. 2003. "Marginal Structural Models as a Tool for Standardization." Epidemiology 14:680-86. (Pubitemid 40417015)
23. Schwarz, Norbert., Fritz Strack, Hans-J. Hippler, and George Bishop. 1991. "The Impact of Administration Mode on Response Effects in Survey Measurement." Applied Cognitive Psychology 5(3):193-212.
24. Vannieuwenhuyze, Jorre, and Geert Molenberghs. 2010. "An SAS Macro to Disentangle Mode Effects on Proportions and the Mean of a Categorical Variable in an Extended Mixed-mode Dataset." Accessed July 22, 2010. http://perswww.kuleuven.be/jorre-vannieuwenhuyze.
25. Voogt, Robert J. J., and Willem E. Saris. 2005. "Mixed Mode Designs: Finding the Balance Between Nonresponse Bias and Mode Effects." Journal of Official Statistics 21(3):367-87.
26. Voogt, Robert J. J., and Hetty Van Kempen. 2002. "Nonresponse Bias and Stimulus Effects in the Dutch National Election Study." Quality & Quantity 36(4):325-45. (Pubitemid 37132931)
27. Weisberg, Herbert F. 2005. The Total Survey Error Approach: A Guide to the New Science of Survey Research. Chicago: University of Chicago.