Questionnaire survey nonresponse: A comparison of postal mail and internet surveys

International Journal of Human-Computer Interaction

Volumn 25, Issue 5, 2009, Pages 348-373

  Hoonakker, Peter ^a   Carayon, Pascale ^a  

^a University of Wisconsin Madison   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER TECHNOLOGY; DATA COLLECTION; INTERNET SURVEY; MAIL SURVEYS; QUESTIONNAIRE SURVEYS; RESPONSE RATE; SURVEY MODES; WEB-BASED SURVEYS;

INTERNET;

SURVEYS;

EID: 70449674449     PISSN: 10447318     EISSN: 15327590     Source Type: Journal    
DOI: 10.1080/10447310902864951     Document Type: Article

References (106)

1. Albaum, G. S., Evangalista, F., & Medina, N. (1998). Role of response behavior theory in survey research: A cross-national study. Journal of Business Research, 42, 115-125.
2. Asch, D., Jedrziewski, M., & Christakis, N. (1997). Response rates to mail surveys published in medical journals. Journal of Clinical Epidemiology, 50(10), 1129-1136.
3. Azjen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179-211.
4. Azjen, I., & Fishbein, M. (1980). Understanding attitudes and predicting social behavior. Englewood Cliffs, NJ: Prentice Hall.
5. Babbie, E. (1990). Survey research methods (2nd ed.). Belmont, CA: Wadsworth.
6. Babbie, E. (1992). The practice of social research (6th ed.). Belmont, CA: Wadsworth.
7. Bachmann, D., Elfrink, J., & Vazzana, G. (1996). Tracking the progress of e-mail vs. snail-mail. Marketing Research, 8(2), 30-36.
8. Bachmann, D., Elfrink, J., & Vazzana, G. (1999). E-mail and snail mail face off in a rematch. Marketing Research, 11(4), 10-15.
9. Bachmann, D., Elfrink, J., & Vazzana, G. (2000). E-mail versus snail-mail face off in rematch. Marketing Research, 11(4), 10-15.
10. Baruch, Y. (1999). Response rate in academic studies-a comparative analysis. Human Relations, 52(4), 421-438.
11. Becker, H. S. (1960). Notes on the concept of commitment. American Journal of Sociology, 66, 32-40.
12. Bem, D. J. (1972). Self-perception theory. In L. Berkowiz (Ed.), Advances in experimental social psychology (Vol. 6, pp. 1-62). New York: Academic Press.
13. Best, S. J., & Krueger, B. S. (2004). Internet data collection (Vol. No. 07-141). Thousand Oaks, CA: Sage.
14. Blau, P. M. (1964). Exchange and power in social life. New York: Wiley.
15. Bosnjak, M., & Batinic, B. (2002). Understanding the willingness to participate in online-surveys. In B. Batinic, U. D. Reips, & M. Bosjnak (Eds.), Online social sciences (pp. 81-92). Seattle, WA: Hogrefe & Huber.
16. Bosnjak, M., & Tuten, T. L. (2001). Classifying response behaviors in Web-based Surveys. Journal of Computer-Mediated Communication (JCMC), 6(3). Retrieved from http://www.ascusc.org/jcmc/vol6/issue3/boznjak.html
17. Bosnjak, M., Tuten, T. L., & Wittman, W. W. (2005). Unit (non)response in Web-based access panel surveys: An extended planned-behavior approach. Psychology & Marketing, 22(6), 489-505.
18. Buchanan, T. (2003). Internet-based questionnaire assessment; appropriate use in clinical contexts. Cognitive Behavior Therapy, 32(3), 100-109.
19. Buchanan, T., & Smith, J. L. (1999). Using the Internet for psychological research: Personality testing on the World Wide Web. British Journal of Psychology, 1(1), 125-144.
20. Burns, E. (2005). Marketers Fret Over Deliverability. ClickZ Stats Retrieved October, 6, 2005, from http://www.clickz.com/stats/sectors/email/article.php/3531631
21. Clausen, J., & Ford, R. (1947). Controlling bias in mail questionnaires. Journal of the American Statistical Association, 42, 497-511.
22. Claycomb, C., Porter, S. S., & Martin, C. L. (2000). Riding the wave: response rates and the effects of time intervals between successive mail survey follow-up efforts. Journal of Business Research, 48, 157-162.
23. ClickZ Networks. (2005). Trends & statistics: The Web's richest source. New York: Author. Retrieved October 5, 2005, from http://www.clickz.com/stats/web_worldwide/
24. Cobanoglu, C., Warde, B., & Moreo, P. J. (2001). A comparison of mail, fax and web-based survey methods. The Market Research Society, 43(4), 441-452.
25. Connelly, N. A., Brown, T. L., & Decker, D. J. (2003). Factors affecting response rates to natural resource-focussed mail surveys: Empirical evidence of declining rates over time. Society and Natural Resources, 16, 541-549.
26. Cook, C., Heath, F., & Thompson, R. L. (2000). A meta-analysis of response rates in web- or Internet-based surveys. Educational and Psychological Measurement, 60(6), 821-836.
27. Cook, K. S., & Whitmeyer, J. M. (1992). Two approaches to social structure: Exchange theory and network analysis. Annual Review of Sociology, 18, 109-127.
28. Coomber, R. (1997). Using the Internet for survey research. Sociological Research Online, 2(2)
29. Couper, M. P. (2000). Web surveys: A review of issues and approaches. Public Opinion Quarterly, 64, 464-494.
30. Couper, M. P., Blair, J., & Triplett, T. (1999). A comparison of mail and e-mail for a survey of employees in federal statistical agencies. Journal of Official Statistics, 15, 39-56.
31. Couper, M. P., Traugott, M. W., & Lamias, M. J. (2001). Web survey design and administration. Public Opinion Quarterly, 65(2), 230-253.
32. Crawford, S. D., Couper, M. P., & Lamias, M. J. (2001). Web surveys: Perceptions of burden. Social Sciences Computer Review, 19(2), 146-162.
33. Davis, R., N. (1999). Web-based administration of a personality questionnaire: Comparison with traditional methods. Behav Res Methods Instrum Comput, 31(4), 572-577.
34. Dillman, D. A. (1978). Mail and telephone surveys: The total design method. New York: Wiley and Sons.
35. Dillman, D. A. (1991). The design and administration of mail surveys. Annual Reviews of Sociology, 17, 225-249.
36. Dillman, D. A. (2000). Mail and Internet surveys: The tailored design method (2nd ed.). New York: Wiley and Sons.
37. Dillman, D. A., Eltinge, J. L., Groves, R. M., & Little, R. J. A. (2002). Survey non response in design, data collection, and analysis. In Robert M. Groves, Don A. Dillman, John L. Eltinge & R. J. A. Little (Eds.), Survey Nonresponse (pp. 3-26). New York: John Wiley & Sons.
38. Dillman, D. A., Tortora, J. C., & Bowker, D. (1998, August). Influence of plain versus fancy design on response rates for Web surveys. Paper presented at the Annual Meeting of the American Statistical Association, Dallas, TX.
39. Dommeyer, C. J., & Moriarty, E. (2000). Comparing two forms of an e-mail survey: Embedded vs. attached. The Market Research Society, 42(1), 39-50.
40. Downes-Le Guin, T., Janowitz, P., Stone, R., & Khorram, S. (2002). Use of pre-incentives in an Internet survey. Retrieved September 27, 2005, from http://www.ijor.org/ijor_archives/ articles/use_of_pre-incentives_in_an_internet_survey.pdf
41. Fallows, D. (2005). CAN-SPAM a year later. Washington, DC: Pew/Internet.
42. Festinger, L. (1954). A theory of social comparison processes. Human Relations, 7, 117-140.
43. Festinger, L. (1957). A theory of cognitive dissonance. Stanford, CA: Stanford University Press.
44. Fishbein, M., & Azjen, I. (1975). Belief, attitude, intention and behavior: An introduction to theory and research. Reading, MA: Addison-Wesley.
45. Fox, R. J., Crask, M. R., & Kim, J. (1988). Mail survey response rate: A meta-analysis of selected techniques for inducing responses. Public Opinion Quarterly, 52, 467-491.
46. Frick, A., Bachtinger, M. T., & Reips, U.-D. (1999). Financial incentives, personal information and drop-out rates in online studies. In U.-D. Reips, B. Batinic, W. Bandilla, M. Bosnjak, L. Gräf, K. Moser, et al. (Eds.), Current Internet science: Trends, techniques, results (Aktuelle Online Forschung: Trends, Techniken, Ergebnisse). Zürich: Online Press.
47. Frick, A., Bachtinger, M. T., & Reips, U.-D. (2001). Financial incentives, personal information and drop-out rates in online studies. In U.-D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science (pp. 209-219). Lengerich: Pabst.
48. Green, D. M., & Swets, J. A. (1966). Signal detection theory and psychophysics. New York: Wiley.
49. Groves, R. M. (1989). Survey errors and survey costs. New York: Wiley and Sons.
50. Groves, R. M., Cialdini, R. B., & Couper, M. P. (1992). Understanding the decision to participate in a survey. Public Opinion Quarterly, 56, 475-495.
51. Groves, R. M., Singer, E., Corning, A. D., & Bowers, A. (1999). A laboratory approach to measuring the effects on survey participation in interview length, incentives, differential incentives, and refusal conversion. Journal of Official Statistics, 15(2), 251-268.
52. Guterbock, T. M., Meekins, B. J., Weaver, A. C., & Fries, J. C. (2000, May). Web versus paper: A mode experiment in a survey of university computing. Paper presented at the Annual meeting of the American Association for Public Opinion Research, Portland, OR.
53. Harewood, G., Yacavone, R., Locke, G., & Wiersema, M. (2001). Prospective comparison of endoscopy patient satisfaction surveys: E-mail versus standard mail versus telephone. American Journal of Gastroenterology, 96(12), 3312-3317.
54. Heberlein, T. A., & Baumgartner, R. (1978). Factors affecting response rates to mailed questionnaires: A quantitative analysis of the published literature. American Sociological Review, 43, 447-462.
55. Helgeson, J. G., Voss, K. E., & Terpening, W. D. (2002). Determinants of mail-survey response: Survey design factors and respondent factors. Psychology & Marketing, 19, 303-328.
56. Homans, G. (1961). Social behavior. New York: Harcourt, Brace & World.
57. Hox, J. J., & deLeeuw, E. D. (1994). A comparison of nonresponse in mail, telephone and face-to-face surveys-Applying multilevel modeling to meta-analysis. Quality and Quantity, 28, 329-344.
58. Internet World Stats. (2008, August 20). Internet usage statistics. Retrieved from http:// internetworldstats.com/stats.htm
59. Joinson, A. (1999). Social desirability, anonymity, and Internet-based questionnaires. Behavior Research Methods Instruments & Computers, 31(3), 433-438.
60. Kanuk, L., & Berenson, C. (1975). Mail surveys and response rates: A literature review. Journal of Marketing Research, 12, 440-453.
61. Kaye, B. K., & Johnson, T. J. (1999). Research methodology: Taming the cyber frontier: Techniques for improving online surveys. Social Science Computer Review, 17(3), 323-327.
62. Kiernan, N. E., Kiernan, M., Oyler, M. A., & Gilles, C. (2005). Is a Web survey as effective as a mail survey? A field experiment among computer users. American Journal of Evaluation, 26(2), 245-252.
63. Kiesler, S., & Sproull, L. S. (1986). Response effects in the electronic survey. Public Opinion Quarterly, 50, 402-413.
64. Kim, H., Gerber, G., Patel, R., Hollowell, C., & Bales, G. (2001). Practice patterns in the treatment of female urinary incontinence: A postal and internet survey. Urology, 57(1), 45-48.
65. Kittleson, M. J. (1997). Determining effective follow-up of e-mail surveys. Am J Health Behav, 21(3), 193-196.
66. Kwak, N., & Radler, B. (2002). A comparison between mail and web surveys: Response pattern, respondent profile, and data quality. Journal of Official Statistics, 18(2), 257-273.
67. Lansky, D., Whitworth, E., & Meyers, K. (2002). Scientific papers: Compare your care: A web-based strategy for consumer activation and physician performance rating. Technol. Health Care, 10(6), 520-521.
68. Leece, P., Bhandari, M., Sprague, S., Swiontkowski, M. F., Schemitsch, E. H., & Tornetta, P. (2004). Internet versus mailed questionnaires: a controlled comparison (2). Journal of Medical Internet Research, 6(4), e39.
69. Lozar Manfreda, K., & Vehovar, V. (2002, August). Survey Design Features Influencing Response Rates in Web Surveys. Paper presented at the The International Conference on Improving Surveys (ICIS), Copenhagen - Denmark.
70. Lubin, B., Levitt, E. E., & Zuckerman, M. (1962). Some personality differences between responders and nonresponders to a survey questionnaire. Journal of Consulting Psychology, 26, 192.
71. MacElroy, M. (2003). IMRO online survey satisfaction research: A pilot study of salience-based respondent experience modeling. Retrieved from http://www.ijor.org/ijor_archives/articles/survey%20sat%20article%2007.0 9.03.pdf
72. Martin, C. L. (1995). The impact of topic interest on mail survey response behavior. Journal of the Market Research Society, 36(4), 327-337.
73. Mavis, B. E., & Brocato, J. J. (1998). Postal surveys versus electronic mail surveys: the tortoise and the hare revisited. Evaluation & The Health Professionals, 21(3), 395-408.
74. McAbe, S. E., Boyd, C. J., Couper, M. P., Crawford, S., & D'Arcy, H. (2002). Mode effects for collecting alcohol and other drug use data: Web and U.S. mail. Journal of Studies on Alcohol, 63(6), 755-761.
75. McMahon, S., Iwamoto, M., Massoudi, M., Yusuf, H., Stevenson, J., David, F., et al. (2003). Comparison of e-mail, fax, and postal surveys of pediatricians. Pediatrics, 111(4), e299-e303.
76. Mehta, R., & Sivadas, E. (1995). Comparing response rates and response content in mail versus electronic mail surveys. Journal of the Market Research Society, 37(4), 429-439.
77. NUA. (2002). How many online. Retrieved October 11, 2005, from http://www.nua.ie/ surveys/how_many_online.
78. Paolo, A. M., Bonaminio, G. A., Gibson, C., Partridge, T., & Kallail, K. (2000). Response rate comparisons of e-mail and mail-distributed students evaluations. Teaching and Learning in Medicine, 12(2), 81-84.
79. Parker, L. (1992, July). Collecting data the e-mail way. Training & Development, pp. 52-54.
80. Rainie, L., & Fallows, D. (2004). The impact of CAN-SPAM legislation. Washington, DC: Pew/Internet.
81. Raziano, D. B., Jayadevappa, R., Valenzula, D., Weiner, M., & Lavizzo-Mourey, R. (2001). E- mail versus conventional postal mail survey of geriatric chiefs. Gerontologist, 41(6), 799-804.
82. Ritter, P., Lorig, K., Laurent, D., & Matthews, K. (2004). Internet versus mailed questionnaires: A randomized comparison. J Med Internet Res, 15(6), e29.
83. Riva, G., Teruzzi, T., & Anolli, L. (2003). The use of the Internet in psychological research: comparison of online and offline questionnaires. CyberPsychology & Behavior, 6(1), 73-80.
84. Roberson, M. T., & Sundstrom, E. (1990). Questionnaire design, return rates, and response favorableness in an employee attitude questionnaire. Journal of Applied Psychology, 75(3), 354-357.
85. Rogelberg, S. G., Conway, J. M., Sederburg, M. E., Spitzuller, C., Aziz, S., & Knight, W. E. (2003). Profiling active and passive nonrespondents to an organizational survey. Journal of Applied Psychology, 88, 1104-1114.
86. Schaefer, D. R., & Dillman, D. A. (1998). Development of standard e-mail methodology: Results of an experiment. Public Opinion Quarterly, 62, 378-397.
87. Schonlau, M., Fricker, R. D. J., & Elliott, M. N. (2002). Conducting research surveys via e-mail and the Web. Santa Monica, CA: RAND.
88. Schuldt, B. A., & Totten, J. W. (1994). Electronic mail versus mail survey response rates. Marketing Research, 6(1), 36-39.
89. Shannon, D., & Bradshaw, C. C. (2002). A comparison of response rate, response time, and costs of mail and electronic surveys. The Journal of Experimental Education, 70(2), 179-192.
90. Sheehan, K. M. (2001). E-mail survey response rates: A review. Journal of Computer Mediated Communication (JCMC), 6(2). Retrieved from http://jcmc.indiana.edu/vol6/issue2/ sheehan.html
91. Sheehan, K. M., & McMillan, S. J. (1999, July/August). Response variation in E-mail Surveys: An Exploration. Journal of Advertising Research, pp. 45-54.
92. Stanton, J. M. (1998). An empirical assessment of data collection using the Internet. Personnel Psychology, 51(3), 709-725.
93. Steele, T. J., Schwendig, W. L., & Kilpatrick, J. A. (1992). Duplicate responses to multiple survey mailings: A problem? Journal of Advertising Research, 32(2), 26-34.
94. Stolte, J., Fine, G., & Cook, K. S. (2001). Sociological miniaturism: Seeing the big through the small in social psychology. Annual Review of Sociology, 27, 387-413.
95. Thibaut, J., & Kelley, H. H. (1959). The social psychology of groups. New York: Wiley.
96. Tschabitscher, H. (2006). How many e-mails are sent every day? About. Retrieved April 28, 2009, from http://email.about.com/od/emailtrivia/f/emails_per_day.htm
97. Tse, A. C. B., Tse, K. C., Yin, C. H., Ting, C. B., Yi, K. W., Yee, K. P., et al. (1995). Comparing two methods of sending out questionnaires: E-mail versus mail. Journal of the Market Research Society, 37, 441-446.
98. Tuten, T. L. (1997). Getting a foot in the electronic door: Understanding why people read or delete electronic mail. ZUMA-Arbeitsbericht 97/08.
99. years of software. (2003, March 2003). PC World, 21, 101.
100. Vehovar, V., Batagelj, Z., Lozar, K., & Zaletel, M. (2002). Nonresponse in Web Surveys. In R. M. Groves, D. A. Dillman, J. L. Eltinge, & R. J. A. Little (Eds.), Survey nonresponse (pp. 229-242). New York: Wiley & Sons.
101. Vincent, C. (1964). Socioeconomic status and familial variables in mail questionnaire responses. American Journal of Sociology, 69, 647-653.
102. Wallace, D. (1954). A case for-and-against mail questionnaires. Public Opinion Quarterly, 18, 40-52.
103. Weible, R., & Wallace, J. (1998). The impact of the Internet on data collection. Marketing Research, 10(3), 19-27.
104. Woodall, G. (1998). Market research on the Internet. Great Falls, VA: Rockbridge. Retrieved October 4, 2005, from http://www.rockresearch.com/articles/nmr01/nmr01.html
105. Yammarino, F. J., Skinner, S. J., & Childers, T. L. (1991). Understanding mail survey response behavior: a meta-analysis. Public Opinion Quarterly, 55(4), 613-639.
106. Zhang, Y. (2000). Using the Internet for survey research: A case study. Journal of the American Society for Information Science, 51, 57-68.