When more gets you less: A meta-analysis of the effect of concurrent web options on mail survey response rates

Public Opinion Quarterly

Volumn 76, Issue 4, 2012, Pages 733-746

  Medway, Rebecca L ^a   Fulton, Jenna ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84870234161     PISSN: 0033362X     EISSN: 15375331     Source Type: Journal    
DOI: 10.1093/poq/nfs047     Document Type: Article

References (41)

1. Brady, Sarah E., Courtney N. Stapleton, Julie A. Bouffard, and Jerry D. Imel. 2003. "Effect of Alternative Data Collection Modes on Cooperation Rates and Data Quality." Proceedings of the American Statistical Association, Section on Survey Research Methods, 693-700.
2. Brøgger, Jan, Wenche Nystad, Inger Cappelen, and Per Bakke. 2007. "No Increase in Response Rate by Adding a Web Response Option to a Postal Population Survey: A Randomized Trial." Journal of Medical Internet Research 9(5). Available at http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2270416/ .
3. Couper, Mick. 2000. "Web Surveys: A Review of Issues and Approaches." Public Opinion Quarterly 64(4): 464-94.
4. 2008. Designing Effective Web Surveys. New York: Cambridge University Press.
5. Deci, Edward L., and Richard M. Ryan. 1985. Intrinsic Motivation and Self-Determination in Human Behavior. New York: Plenum Press.
6. de Leeuw, Edith. 2005. "To Mix or Not to Mix Data Collection Modes in Surveys." Journal of Official Statistics 21(2): 233-55.
7. Dhar, Ravi. 1997. "Consumer Preference for a No-Choice Option." Journal of Consumer Research 24(2): 215-31.
8. Dillman, Don A. 2000. Mail and Internet Surveys: The Tailored Design Method. New York: John Wiley.
9. Dillman, Don A., and Benjamin L. Messer. 2010. "Mixed-Mode Surveys." In Handbook of Survey Research, edited by P. V. Marsden and J. D. Wright, 551-74. Bingley, UK: Emerald.
10. Dillman, Don A., Glenn Phelps, Robert Tortora, Karen Swift, Julie Kohrell, Jodi Berck, and Benjamin L. Messer. 2009. "Response Rate and Measurement Differences in Mixed-Mode Surveys Using Mail, Telephone, Interactive Voice Response (IVR), and the Internet." Social Science Research 38(1): 1-18.
11. Dillman, Don A., Kirsten K. West, and Jon R. Clark. 1994. "Influence of an Invitation to Answer by Telephone on Response to Census Questionnaires." Public Opinion Quarterly 58(4): 557-68.
12. Eastin, Matthew S., and Robert LaRose. 2000. "Internet Self-Efficacy and the Psychology of the Digital Divide." Journal of Computer-Mediated Communication 6(1). Available at http://onlinelibrary.wiley.com/doi/10.1111/j. 1083-6101.2000.tb00110.x/full.
13. Friese, Christopher R., Cheryl S. Lee, Sara O'Brien, and Scott D. Crawford. 2010. "Multi-Mode and Method Experiment in a Study of Nurses." Survey Practice. Available at http://survey practice.wordpress. com/2010/10/27/multi-mode-nurses-survey/.
14. Gentry, Robin, and Cindy Good. 2008. "Offering Respondents a Choice of Survey Mode: Use Patterns of an Internet Response Option in a Mail Survey." Paper presented at the Annual Meeting of the American Association for Public Opinion Research, New Orleans, LA, USA.
15. Griffin, Deborah H., Donald P. Fischer, and Michael T. Morgan. 2001. "Testing an Internet Response Option for the American Community Survey." Paper presented at the Annual Meeting of the American Association for Public Opinion Research, Montreal, Canada.
16. Griffin, Deborah H., and Sally Obenski. 2002. "Meeting 21st-Century Demographic Needs Implementing the American Community Survey: May 2002, Report 2: Demonstrating Survey Quality." Washington, DC: U.S. Department of Commerce, Economics and Statistics Administration, U.S. Census Bureau.
17. Groves, Robert M., and Robert L. Kahn. 1979. Surveys by Telephone: A National Comparison with Personal Interviews. New York: Academic Press.
18. Groves, Robert M., and James M. Lepkowski. 1985. "Dual Frame, Mixed Mode Survey Designs." Journal of Official Statistics 1(3): 263-86.
19. Hedges, Larry V. 1982. "Estimating Effect Size from a Series of Independent Experiments." Psychological Bulletin 92(2): 490-99.
20. Hedges, Larry V., and Ingram Olkin. 1985. Statistical Methods for Meta-Analysis. New York: Academic Press.
21. Israel, Glenn D. 2010. "Using Web-Hosted Surveys to Obtain Responses from Extension Clients: A Cautionary Tale." Journal of Extension 48(4). Available at http://www.joe.org/joe/2010august/a8.php.
22. Iyengar, Sheena S., and Mark R. Lepper. 2000. "When Choice Is Demotivating: Can One Desire Too Much of a Good Thing?" Journal of Personality and Social Psychology 79(6): 995-1006.
23. Lipsey, Mark W., and David B. Wilson. 2001. Practical Meta-Analysis. California: Sage.
24. Millar, Morgan M., and Don A. Dillman. 2011. "Improving Response to Web and Mixed-Mode Surveys." Public Opinion Quarterly 75(2): 249-69.
25. Millar, Morgan, M., Allison C. O'Neill, and Don A. Dillman. 2009. "Are Mode Preferences Real?" Technical Report 09-003, Social and Economic Sciences Research Center. Pullman: Washington State University.
26. Miller, Thomas I., Michelle M. Kobayashi, Erin Caldwell, Sarah Thurston, and Ben Collett. 2002. "Citizen Surveys on the Web: General Population Surveys of Community Opinion." Social Science Computer Review 20(2): 124-36.
27. Pew Internet Project Tracking Survey. 2012. Available at http://pewinternet.org/Static-Pages/Trend-Data-(Adults)/Internet-Adoption.aspx.
28. Radon, Katja, Mark Goldberg, Margaret Becklake, Ursula Pindur, Inga Hege, and Dennis Nowak. 2002. "Low Acceptance of an Internet-Based Online Questionnaire by Young Adults." Epidemiology 13(6): 748-49.
29. Rosenthal, Robert, and Donald R. Rubin. 1982. "Comparing Effect Sizes of Independent Studies." Psychological Bulletin 92(2): 500-504.
30. Schenker, Nathaniel, and Jane F. Gentleman. 2001. "On Judging the Significance of Differences by Examining the Overlap Between Confidence Intervals." American Statistician 55(3): 182-86.
31. Schmuhl, Patricia, Heather van Duker, Kristin Lauria Gurley, Angie Webster, and Lenora Olson. 2010. "Reaching Emergency Medical Services Providers: Is One Survey Mode Better Than Another?" Prehospital Emergency Care 14(3): 361-69.
32. Schneider, Sid J., David Cantor, Lawrence Malakhoff, Carlos Arieira, Paul Segel, Khanh-Luu Nguyen, and Jennifer Guarino Tancreto. 2005. "Telephone, Internet, and Paper Data Collection Modes for the Census 2000 Short Form." Journal of Official Statistics 21: 89-101.
33. Schwartz, Barry. 2004. The Paradox of Choice: Why More Is Less. New York: Harper Perennial. Shettle, C., and Geraldine Mooney. 1999. Monetary Incentives in U.S. Government Surveys. Journal of Official Statistics 15(2): 231-50.
34. Shih, Tse-Hua, and Xitao Fan. 2007. "Response Rates and Mode Preferences in Web-Mail Mixed-Mode Surveys: A Meta-Analysis." International Journal of Internet Science 2: 59-82.
35. Smith, Aaron. 2012. "46% of American Adults Are Smartphone Owners." Pew Internet and American Life Project. Available at http://pewinternet.org/~/media//Files/Reports/2012/ Smartphone%20ownership%202012.pdf.
36. Smyth, Jolene D., Don A. Dillman, Leah Melani Christian, and Allison C. O'Neill. 2010. "Using the Internet to Survey Small Towns and Communities: Limitations and Possibilities in the Early 21st Century." American Behavioral Scientist 53(9): 1423-48.
37. Tarnai, John, and M. Chris Paxson. 2004. "Survey Mode Preferences of Business Respondents." Paper presented at the Annual Meeting of the American Association for Public Opinion Research, Phoenix, AZ, USA.
38. Taylor, Shelley E., and Jonathon D. Brown. 1988. "Illusion and Well-Being: A Social Psychological Perspective on Mental Health." Psychological Bulletin 103(2): 193-210.
39. Turner, Scott, Luciano Viera, and Sean Marsh. 2010. "Offering a Web Option in a Mail Survey of Young Adults: Impact on Survey Quality." Poster presented at the Annual Meeting of the American Association for Public Opinion Research, Chicago.
40. Werner, Peter, and Gosta Forsman. 2005. "Mixed Mode Data Collection Using Paper and Web Questionnaires." Proceedings of the American Statistical Association, Section on Survey Research Methods, 4015-17.
41. Ziegenfuss, Jeanette Y., Timothy J. Beebe, Enrique Rey, Cathy Schleck, G. Richard Locke III, and Nicholas J. Talley. 2010. "Internet Option in a Mail Survey: More Harm Than Good?" Epidemiology 21(4): 585-86.