Web-based questionnaires: The future in epidemiology?

American Journal of Epidemiology

Volumn 172, Issue 11, 2010, Pages 1292-1298

  Van Gelder, Marleen M H J ^a   Bretveld, Reini W ^a   Roeleveld, Nel ^a  

^a RADBOUD UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

data collection; epidemiologic methods; health surveys; Internet; medical informatics; questionnaires

Indexed keywords

COST-BENEFIT ANALYSIS; DATA ACQUISITION; EPIDEMIOLOGY; HEALTH SURVEY; INTERNET; QUESTIONNAIRE SURVEY;

ARTICLE; CLINICAL EVALUATION; DATA COLLECTION METHOD; HEALTH SURVEY; HUMAN; INTERNET; INTERVIEW; MEDICAL LITERATURE; QUESTIONNAIRE; RELIABILITY; VALIDITY; WEB BASED QUESTIONNAIRE;

DATA COLLECTION; EPIDEMIOLOGIC RESEARCH DESIGN; FORECASTING; INTERNET; POPULATION SURVEILLANCE; POSTAL SERVICE; QUESTIONNAIRES; REPRODUCIBILITY OF RESULTS;

EID: 78649651560     PISSN: 00029262     EISSN: 14766256     Source Type: Journal    
DOI: 10.1093/aje/kwq291     Document Type: Article

References (80)

1. Ekman A, Litton JE. New times, new needs; e-epidemiology. Eur J Epidemiol. 2007;22(5):285-292.
2. Morton LM, Cahill J, Hartge P. Reporting participation in epidemiologic studies: a survey of practice. Am J Epidemiol. 2006;163(3):197-203.
3. Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17(9):643-653.
4. Schleyer TK, Forrest JL. Methods for the design and administration of web-based surveys. J Am Med Inform Assoc. 2000;7(4):416-425.
5. Swoboda WJ, Mühlberger N, Weitkunat R, et al. Internet surveys by direct mailing: an innovative way of collecting data. Soc Sci Comput Rev. 1997;15(3):242-255.
6. McCabe SE, Boyd CJ, Couper MP, et al. Mode effects for collecting alcohol and other drug use data: Web and U.S. mail. J Stud Alcohol. 2002;63(6):755-761.
7. Smith B, Smith TC, Gray GC, et al. When epidemiology meets the Internet: Web-based surveys in the Millennium Cohort Study. Am J Epidemiol. 2007;166(11):1345-1354.
8. Turner C, Bain C, Schluter PJ, et al. Cohort profile: the Nurses and Midwives e-Cohort Study-a novel electronic longitudinal study. Int J Epidemiol. 2009;38(1):53-60.
9. Mikkelsen EM, Hatch EE, Wise LA, et al. Cohort profile: the Danish Web-based Pregnancy Planning Study-'Snart-Gravid'. Int J Epidemiol. 2009;38(4):938-943.
10. Dillman DA, Bowker DK. The web questionnaire challenge to survey methodologists. In: Reips UD, Bosnjak M, eds. Dimensions of Internet Science. Lengerich, Germany: Pabst Science Publishers; 2001:159-178.
11. Bech M, Kristensen MB. Differential response rates in postal and web-based surveys among older respondents. Survey Res Methods. 2009;3(1):1-6.
12. Göritz AS, Birnbaum MH. Generic HTML form processor: a versatile PHP script to save web-collected data into a MySQL database. Behav Res Methods. 2005;37(4):703-710.
13. Dillman DA, Smyth JD. Design effects in the transition to web-based surveys. Am J Prev Med. 2007;32(5 suppl): S90-S96.
14. Akl EA, Maroun N, Klocke RA, et al. Electronic mail was not better than postal mail for surveying residents and faculty. J Clin Epidemiol. 2005;58(4):425-429.
15. Kroth PJ, McPherson L, Leverence R, et al. Combining web-based and mail surveys improves response rates: a PBRN study from PRIME Net. Ann Fam Med. 2009;7(3): 245-248.
16. Coyne KS, Sexton CC, Kopp ZS, et al. Rationale for the study methods and design of the Epidemiology of Lower Urinary Tract Symptoms (EpiLUTS) study. BJU Int. 2009;104(3): 348-351.
17. Wyatt JC. When to use web-based surveys. J Am Med Inform Assoc. 2000;7(4):426-429.
18. Huntington A, Gilmour J, Schluter P, et al. The Internet as a research site: establishment of a web-based longitudinal study of the nursing and midwifery workforce in three countries. J Adv Nurs. 2009;65(6):1309-1317.
19. Kypri K, Gallagher SJ, Cashell-Smith ML. An Internet-based survey method for college student drinking research. Drug Alcohol Depend. 2004;76(1):45-53.
20. McAlindon T, Formica M, Kabbara K, et al. Conducting clinical trials over the Internet: feasibility study. BMJ. 2003; 327(7413):484-487.
21. Adams J, White M. Health behaviours in people who respond to a web-based survey advertised on regional news media. Eur J Public Health. 2008;18(3):335-338.
22. Rodriguez HP, von Glahn T, Rogers WH, et al. Evaluating patients' experiences with individual physicians: a randomized trial of mail, Internet, and interactive voice response telephone administration of surveys. Med Care. 2006;44(2):167-174.
23. Dillman DA. Mail and Internet Surveys: The Tailored Design Method. 2nd ed. Hoboken, NJ: John Wiley & Sons, Inc; 2007.
24. Braithwaite D, Emery J, De Lusignan S, et al. Using the Internet to conduct surveys of health professionals: a valid alternative? Fam Pract. 2003;20(5):545-551.
25. Greenlaw C, Brown-Welty S. A comparison of web-based and paper-based survey methods: testing assumptions of survey mode and response cost. Eval Rev. 2009;33(5):464-480.
26. Best SJ, Krueger B, Hubbard C, et al. An assessment of the generalizability of Internet surveys. Soc Sci Comput Rev. 2001; 19(2):131-145.
27. Rothman KJ, Greenland S, Lash TL. Validity in epidemiologic studies. In: Rothman KJ, Greenland S, Lash TL, eds. Modern Epidemiology. 3rd ed. Philadelphia, PA: Lippincott Williams & Wilkins; 2008:128-147.
28. Criqui MH. Response bias and risk ratios in epidemiologic studies. Am J Epidemiol. 1979;109(4):394-399.
29. Nohr EA, Frydenberg M, Henriksen TB, et al. Does low participation in cohort studies induce bias? Epidemiology. 2006; 17(4):413-418.
30. Laaksonen M, Aittomäki A, Lallukka T, et al. Register-based study among employees showed small nonparticipation bias in health surveys and check-ups. J Clin Epidemiol. 2008;61(9): 900-906.
31. McCabe SE. Comparison of web and mail surveys in collecting illicit drug use data: a randomized experiment. J Drug Educ. 2004;34(1):61-72.
32. Bälter KA, Bälter O, Fondell E, et al. Web-based and mailed questionnaires: a comparison of response rates and compliance. Epidemiology. 2005;16(4):577-579.
33. Leece P, Bhandari M, Sprague S, et al. Internet versus mailed questionnaires: a randomized comparison (2). J Med Internet Res. 2004;6(3):e30. (doi:10.2196/jmir.6.3.e30).
34. Fleming CM, Bowden M. Web-based surveys as an alternative to traditional mail methods. J Environ Manage. 2009;90(1): 284-292.
35. West R, Gilsenan A, Coste F, et al. The ATTEMPT cohort: a multi-national longitudinal study of predictors, patterns and consequences of smoking cessation; introduction and evaluation of Internet recruitment and data collection methods. Addiction. 2006;101(9):1352-1361. (Pubitemid 44199528)
36. Rankin KM, Rauscher GH, McCarthy B, et al. Comparing the reliability of responses to telephone-administered versus self-administered web-based surveys in a case-control study of adult malignant brain cancer. Cancer Epidemiol Biomarkers Prev. 2008;17(10):2639-2646.
37. Touvier M, Méjean C, Kesse-Guyot E, et al. Comparison between web-based and paper versions of a self-administered anthropometric questionnaire. Eur J Epidemiol. 2010;25(5): 287-296.
38. Edwards P, Roberts I, Clarke M, et al. Increasing response rates to postal questionnaires: systematic review. BMJ. 2002;324(7347):1183. (doi:10.1136/bmj.324.7347.1183).
39. Edwards PJ, Roberts I, Clarke MJ, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009;8(3):MR000008. (doi:10.1002/14651858.MR000008.pub4).
40. Ekman A, Dickman PW, Klint A, et al. Feasibility of using web-based questionnaires in large population-based epidemi-ological studies. Eur J Epidemiol. 2006;21(2):103-111.
41. Rothman KJ, Mikkelsen EM, Riis A, et al. Randomized trial of questionnaire length [letter]. Epidemiology. 2009;20(1):154.
42. Bosnjak M, Tuten TL. Classifying response behaviors in web-based surveys. J Comput Mediated Comm. 2001;6(3). (doi:10.1111/j.1083-6101.2001.tb00124.x).
43. Ekman A, Klint A, Dickman PW, et al. Optimizing the design of web-based questionnaires-experience from a population-based study among 50,000 women. Eur J Epidemiol. 2007; 22(5):293-300.
44. Manfreda KL, Batagelj Z, Vehovar V. Design of web survey questionnaires: three basic experiments. J Comput Mediated Comm. 2002;7(3). (doi:10.1111/j.1083- 6101.2002.tb00149.x).
45. Graham AL, Papandonatos GD, Bock BC, et al. Internet- vs. telephone-administered questionnaires in a randomized trial of smoking cessation. Nicotine Tob Res. 2006;8(suppl 1): S49-S57.
46. Brigham J, Lessov-Schlaggar CN, Javitz HS, et al. Test-retest reliability of web-based retrospective self-report of tobacco exposure and risk. J Med Internet Res. 2009;11(3):e35. (doi:10.2196/jmir.1248).
47. Miller ET, Neal DJ, Roberts LJ, et al. Test-retest reliability of alcohol measures: is there a difference between Internet-based assessment and traditional methods? Psychol Addict Behav. 2002;16(1):56-63.
48. Beasley JM, Davis A, Riley WT. Evaluation of a web-based, pictorial diet history questionnaire. Public Health Nutr. 2009;12(5):651-659.
49. Bliven BD, Kaufman SE, Spertus JA. Electronic collection of health-related quality of life data: validity, time benefits, and patient preference. Qual Life Res. 2001;10(1):15-22.
50. Spek V, Nykĺ?cek I, Cuijpers P, et al. Internet administration of the Edinburgh Depression Scale. J Affect Disord. 2008; 106(3):301-305.
51. Donker T, van Straten A, Marks I, et al. Brief self-rated screening for depression on the Internet. J Affect Disord. 2010;122(3):253-259.
52. Coles ME, Cook LM, Blake TR. Assessing obsessive compulsive symptoms and cognitions on the Internet: evidence for the comparability of paper and Internet administration. Behav Res Ther. 2007;45(9):2232-2240.
53. Austin DW, Carlbring P, Richards JC, et al. Internet administration of three commonly used questionnaires in panic research: equivalence to paper administration in Australian and Swedish samples of people with panic disorder. Int J Testing. 2006;6(1):25-39.
54. Buchanan T. Internet-based questionnaire assessment: appropriate use in clinical contexts. Cogn Behav Ther. 2003;32(3): 100-109.
55. Pealer LN, Weiler RM, Pigg RM Jr, et al. The feasibility of a web-based surveillance system to collect health risk behavior data from college students. Health Educ Behav. 2001;28(5): 547-559.
56. Kreuter F, Presser S, Tourangeau R. Social desirability bias in CATI, IVR, and web surveys: the effects of mode and question sensitivity. Public Opin Q. 2008;72(5):847-865.
57. Booth-Kewley S, Larson GE, Miyoshi DK. Social desirability effects on computerized and paper-and-pencil questionnaires. Comput Hum Behav. 2007;23(1):463-477.
58. Kiesler S, Siegel J, McGuire TW. Social psychological-aspects of computer-mediated communication. Am Psychol. 1984; 39(10):1123-1134.
59. Richman WL, Kiesler S, Weisband S, et al. A meta-analytic study of social desirability distortion in computer-administered questionnaires, traditional questionnaires, and interviews. J Appl Psychol. 1999;84(5):754-775.
60. Buchanan T, Smith JL. Using the Internet for psychological research: personality testing on the World Wide Web. Br J Psychol. 1999;90(1):125-144.
61. Toepoel V, Das M, van Soest A. Design of web questionnaires: the effects of the number of items per screen. Field Methods. 2009;21(2):200-213.
62. Matzat U, Snijders C, van der Horst W. Effects of different types of progress indicators on drop-out rates in web surveys. Soc Psychol. 2009;40(1):43-52.
63. Galesic M, Tourangeau R, Couper MP, et al. Eye-tracking data: new insights on response order effects and other cognitive shortcuts in survey responding. Public Opin Q. 2008; 72(5):892-913.
64. Smyth JD, Dillman DA, Melani Christian L, et al. Comparing check-all and forced-choice question formats in Web surveys. Public Opin Quart. 2006;70(1):66-77.
65. Melani Christian L, Dillman DA, Smyth JD. Helping respondents get it right the first time: the influence of words, symbols, and graphics in web surveys. Public Opin Quart. 2007;71(1): 113-125.
66. Eysenbach G, Wyatt J. Using the Internet for surveys and health research. J Med Internet Res. 2002;4(2):E13. (doi:10.2196/jmir.4.2.e13).
67. Bälter O, Bälter KA. Demands on web survey tools for epidemiological research. Eur J Epidemiol. 2005;20(2): 137-139.
68. Huybrechts KF, Mikkelsen EM, Christensen T, et al. A successful implementation of e-epidemiology: the Danish pregnancy planning study 'Snart-Gravid'. Eur J Epidemiol. 2010; 25(5):297-304.
69. Bowen AM, Daniel CM, Williams ML, et al. Identifying multiple submissions in Internet research: preserving data integrity. AIDS Behav. 2008;12(6):964-973.
70. Klovning A, Sandvik H, Hunskaar S. Web-based survey attracted age-biased sample with more severe illness than paper-based survey. J Clin Epidemiol. 2009;62(10):1068-1074.
71. Greenhalgh T, Taylor R. Papers that go beyond numbers (qualitative research). BMJ. 1997;315(7110):740-743.
72. Internet World Stats. Internet usage world stats - internet and population statistics. Bogota, Colombia: Miniwatts Marketing Group; 2009. (http://www.internetworldstats.com/stats14.htm#north (for Canada and the United States); http://www.internetworldstats.com/stats4.htm#europe (for European countries)). (Accessed September 16, 2010).
73. Pink B. Household Use of Information Technology: Australia, 2008-2009. Canberra, Australia: Australian Bureau of Statistics; 2009. (ABS catalogue no. 8146.0).
74. Statistics Denmark. Statistical yearbook 2010: table 294: access to computer and internet in the home. Copenhagen, Denmark: Statistics Denmark; 2010. (http://www.dst.dk/pukora/epub/upload/15198/headword/dk/294.pdf). (Accessed September 16, 2010).
75. Federal Statistics Office. Survey of households on the use of information and communication technologies.
76. Wiesbaden, Germany: Statistisches Bundesamt; 2009. (http://www.destatis. de/jetspeed/portal/cms/Sites/destatis/Internet/EN/Navigation/Statistics/ Wirtschaftsrechnungen-Zeitbudgets/PrivateHaushalteInfoGesellschaft/ PrivateHaushalteInfoGesellschaft.psml). (Accessed December 29, 2009).
77. StatLine Database. ICT use of persons by demographic characteristics [in Dutch]. The Hague/Heerlen, The Netherlands: Statistics Netherlands; 2009. (http://statline.cbs.nl/StatWeb/publication/DM¼SLNL&PA& frac14;71098ned&D1¼33-133&D2¼0- 2&D3¼a&HDR¼G1&STB¼T, G2&VW¼T). (Accessed December 29, 2009).
78. Statistics Norway. Use of the Internet, frequency and location of use last 3 months. Oslo, Norway: Statistics Norway; 2009. (http://www.ssb.no/ikthus- en/tab-2009-09-24-04-en.html). (Accessed December 29, 2009).
79. Office for National Statistics. Statistical bulletin: Internet access, households and individuals, 2009. Newport, RI: Office for National Statistics 2009. http://www.statistics.gov.uk/pdfdir/iahi0809.pdf). (Accessed December 29, 2009).
80. Pew Internet & American Life Project. Who's online: demographics of Internet users. Washington, DC: Pew Research Center; 2009. (http://www. pewinternet.org/Static-Pages/Trend-Data/Whos-Online.aspx). (Accessed December 29, 2009).