Improving web survey efficiency: the impact of an extra reminder and reminder content on web survey response

International Journal of Social Research Methodology

Volumn 20, Issue 4, 2017, Pages 317-327

  Van Mol, Christof ^a,b  

^a NETHERLANDS INTERDISCIPLINARY DEMOGRAPHIC INSTITUTE   (Netherlands)

^b UNIVERSITY OF ANTWERP   (Belgium)

Author keywords

higher education; response rate; students; survey fatigue; Web surveys

Indexed keywords

EID: 84969234303     PISSN: 13645579     EISSN: 14645300     Source Type: Journal    
DOI: 10.1080/13645579.2016.1185255     Document Type: Article

References (45)

1. Adams, M. J. D., & Umbach, P. D., (2012). Nonresponse and online student evaluations of teaching:Understanding the influence of salience, fatigue, and academic environments. Research in Higher Education, 53, 576–591. doi:10.1007/s11162-011-9240-5
2. Albert, C., (2000). Higher education demand in Spain:The influence of labour market signals and family background. Higher Education, 40, 147–162. doi:10.1023/A:1004070925581
3. Avery, R. J., Bryant, W. K., Mathios, A., Kang, H., & Bell, D., (2006). Electronic course evaluations:Does an online delivery system influence student evaluations? The Journal of Economic Education, 37, 21–37. doi:10.3200/JECE.37.1.21-37
4. Callegaro, Mario, Lozar Manfreda, Katja, & Vehovar, Vasja, (2015). Web survey methodology. London:Sage.
5. Christian, L. M., Parsons, N. L., & Dillman, D. A., (2009). Designing scalar questions for web surveys. Sociological Methods & Research, 37, 393–425. doi:10.1177/0049124108330004
6. Cialdini, R. B., & Goldstein, N. J., (2004). Social influence:Compliance and conformity. Annual Review of Psychology, 55, 591–621. doi:10.1146/annurev.psych.55.090902.142015
7. Conrad, F. G., Couper, M. P., Tourangeau, R., & Peytchev, A., (2010). The impact of progress indicators on task completion. Interacting with Computers, 22, 417–427. doi:10.1016/j.intcom.2010.03.001
8. Couper, M. P., (2000). Web surveys. Public Opinion Quarterly, 64, 464–494. doi:10.1086/318641.
9. Couper, M. P., Kapteyn, A., Schonlau, M., & Winter, J., (2007). Noncoverage and nonresponse in an internet survey. Social Science Research, 36, 131–148. doi:10.1016/j.ssresearch.2005.10.002.
10. Couper, M. P., & Miller, P. V., (2008). Web survey methods:Introduction. Public Opinion Quarterly, 72, 831–835. doi:10.1093/poq/nfn066
11. Crawford, S. D., Couper, M. P., & Lamias, M. J., (2001). Web surveys:Perceptions of burden. Social Science Computer Review, 19, 146–162. doi:10.1177/089443930101900202
12. Durrant, M. B., & Dorius, C. R., (2007). Study abroad survey instruments:A comparison of survey types and experiences. Journal of Studies in International Education, 11, 33–53. doi:10.1177/1028315306286929
13. Fan, W., & Yan, Z., (2010). Factors affecting response rates of the web survey:A systematic review. Computers in Human Behavior, 26, 132–139. doi:10.1016/j.chb.2009.10.015
14. Fricker, R. D., (2008). Sampling methods for web and e-mail surveys. In N., Fielding, R. M., Lee, & G., Blank (Eds.), The Sage handbook of online research methods (pp. 195–216). Los Angeles, CA:Sage.10.4135/9780857020055
15. Galesic, M., & Bosnjak, M., (2009). Effects of questionnaire length on participation and indicators of response quality in a web survey. Public Opinion Quarterly, 73, 349–360. doi:10.1093/poq/nfp031
16. Groves, R. M., (1989). Survey errors and survey costs. New York, NY:Wiley.10.1002/0471725277
17. Groves, R. M., (2006). Nonresponse rates and nonresponse bias in household surveys. Public Opinion Quarterly, 70, 646–675. doi:10.1093/poq/nfl033
18. Groves, R. M., Couper, M. P., Presser, S., Singer, E., Tourangeau, R., Acosta, G. P., & Nelson, L., (2006). Experiments in producing nonresponse bias. Public Opinion Quarterly, 70, 720–736. doi:10.1093/poq/nfl036
19. Groves, R. M., & Peytcheva, E., (2008). The impact of nonresponse rates on nonresponse bias:A meta-analysis. Public Opinion Quarterly, 72, 167–189. doi:10.1093/poq/nfn011
20. Groves, R. M., Presser, S., & Dipko, S., (2004). The role of topic interest in survey participation decisions. Public Opinion Quarterly, 68, 2–31. doi:10.1093/poq/nfh002
21. Heerwegh, D., Abts, K., & Loosveldt, G., (2007). Minimizing survey refusal and noncontact rates:Do our efforts pay off? Survey Research Methods, 1, 3–10.
22. Heerwegh, D., Vanhove, T., Loosveldt, G., & Matthijs, K., (2004). Effects of personalization on web survey response rates and data quality. Paper presented at the 6th International conference on social science methodology, Amsterdam.
23. Kayongo, J., & Helm, C., (2010). Graduate students and the library:A survey of research practices and library use at the University of Notre Dame. Reference & User Services Quarterly, 49, 341–349.
24. Korupp, S. E, Ganzeboom, H. B G., & Van Der Lippe, T., (2002). Do mothers matter? A comparison of models of the influence of mothers’ and fathers’ educational and occupational status on children’s educational attainment. Quality and Quantity, 36, 17–42. doi:10.1023/A:1014393223522
25. Lauber, C., Ajdacic-Gross, V., Fritschi, N., Stulz, N., & Rössler, W., (2005). Mental health literacy in an educational elite–An online survey among university students. BMC Public Health, 5(1), 1–9. doi:10.1186/1471-2458-5-44
26. Lee, J. J., (2010). International students’ experiences and attitudes at a US host institution:Self-reports and future recommendations. Journal of Research in International Education, 9, 66–84. doi:10.1177/1475240909356382
27. Malhotra, N., (2008). Completion time and response order effects in web surveys. Public Opinion Quarterly, 72, 914–934. doi:10.1093/poq/nfn050
28. Muñoz-Leiva, F., Sánchez-Fernández, J., Montoro-Ríos, F., & Ibáñez-Zapata, J. A., (2010). Improving the response rate and quality in web-based surveys through the personalization and frequency of remainder mailings. Qualitative and Quantitative, 44, 1037–1052. doi:10.1007/s11135-009-9256-5
29. Nair, C. S., & Adams, P., (2009). Survey platform:A factor influencing online survey delivery and response rate. Quality in Higher Education, 15, 291–296. doi:10.1080/13538320903399091
30. Nair, C. S., Adams, P., & Mertova, P., (2008). Student engagement:The key to improving survey response rates. Quality in Higher Education, 14, 225–232. doi:10.1080/13538320802507505
31. Peytchev, A., (2009). Survey breakoff. Public Opinion Quarterly, 73, 74–97. doi:10.1093/poq/nfp014
32. Porter, S. R., (2004). Raising response rates:What works? New Directions for Institutional Research, 2004, 5–21. doi:10.1002/ir.97
33. Porter, S. R, & Umbach, P. D, (2006). Student survey response rates across institutions:Why do they vary? Research in Higher Education, 47, 229–247. doi:10.1007/s11162-005-8887-1
34. Porter, S. R., & Whitcomb, M. E., (2003). The impact of contact type on web survey response rates. Public Opinion Quarterly, 67, 579–588. doi:10.1086/378964
35. Porter, S. R, & Whitcomb, M. E., (2005). Non-response in student surveys:The role of demographics, engagement and personality. Research in Higher Education, 46, 127–152. doi:10.1007/s11162-004-1597-2
36. Porter, S. R., Whitcomb, M. E., & Weitzer, W. H., (2004). Multiple surveys of students and survey fatigue. New Directions for Institutional Research, 2004, 63–73. doi:10.1002/ir.101
37. Said, D., Kypri, K., & Bowman, J., (2013). Risk factors for mental disorder among university students in Australia:Findings from a web-based cross-sectional survey. Social Psychiatry and Psychiatric Epidemiology, 48, 935–944. doi:10.1007/s00127-012-0574-x
38. Sánchez-Fernández, J., Muñoz-Leiva, F., Montoro-Ríos, F. J., & Ibáñez-Zapata, J. Á., (2010). An analysis of the effect of pre-incentives and post-incentives based on draws on response to web surveys. Quality & Quantity, 44, 357–373. doi:10.1007/s11135-008-9197-4
39. Sax, L. J., Gilmartin, S. K., & Bryant, A. N., (2003). Assessing response rates and nonresponse bias in web and paper surveys. Research in Higher Education, 44, 409–432. doi:10.1023/A:1024232915870
40. Sheehan, K. B., (2001). E-mail survey response rates:A review. Journal of Computer-Mediated Communication, 6(2), doi:10.1111/j.1083-6101.2001.tb00117.x
41. Smyth, J. D., & Pearson, J. E., (2011). Internet survey methods:A review of strengths, weaknesses, and innovations. In M., Das, P., Ester, & L., Kaczmirek (Eds.), Social and behavioral research and the internet. Advances in applied methods and research strategies (pp. 11–44). New York, NY:Routledge.
42. Spitzmüller, C., Glenn, D. M., Barr, C. D., Rogelberg, S. G., & Daniel, P., (2006). “If you treat me right, I reciprocate”:Examining the role of exchange in organizational survey response. Journal of Organizational Behavior, 27, 19–35. doi:10.1002/job.363
43. Tourangeau, R., Couper, M. P., & Conrad, F., (2004). Spacing, position, and order:Interpretive heuristics for visual features of survey questions. Public Opinion Quarterly, 68, 368–393. doi:10.1093/poq/nfh035
44. Vehovar, V., & Lozar Manfreda, K., (2008). Overview:Online surveys. In N., Fielding, R. M., Lee, & G., Blank (Eds.), The sage handbook of online research methods (pp. 177–194). Los Angeles, CA:Sage.
45. Webber, M., Lynch, S., & Oluku, J., (2013). Enhancing student engagement in student experience surveys:A mixed methods study. Educational Research, 55, 71–86. doi:10.1080/00131881.2013.767026