The influence of response mode on study results: Offering cigarette smokers a choice of postal or online completion of a survey

Journal of Medical Internet Research

Volumn 12, Issue 4, 2010, Pages

  Callas, Peter W ^a   Solomon, Laura J ^b   Hughes, John R ^b   Livingston, Amy E ^b  

^a UNIVERSITY OF VERMONT COLLEGE OF MEDICINE   (United States)

^b UNIVERSITY OF VERMONT   (United States)

Author keywords

Internet; Mail; Questionnaires; Smoking

Indexed keywords

ADULT; ARTICLE; ATTITUDE TO HEALTH; COMPARATIVE STUDY; DECISION MAKING; FEMALE; HEALTH STATUS; HEALTH SURVEY; HUMAN; INFORMATION PROCESSING; INTERNET; MALE; METHODOLOGY; MIDDLE AGED; MOTIVATION; POSTAL MAIL; QUESTIONNAIRE; SMOKING; SMOKING CESSATION; STATISTICS; UNITED STATES; UTILIZATION REVIEW;

ADULT; CHOICE BEHAVIOR; DATA COLLECTION; FEMALE; HEALTH KNOWLEDGE, ATTITUDES, PRACTICE; HEALTH STATUS; HUMANS; INTERNET; MALE; MIDDLE AGED; MOTIVATION; POPULATION SURVEILLANCE; POSTAL SERVICE; QUESTIONNAIRES; SMOKING; SMOKING CESSATION; UNITED STATES; YOUNG ADULT;

EID: 78651283964     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.1414     Document Type: Article

References (43)

1. Eysenbach G, Diepgen TL. Epidemiological data can be gathered with world wide web. BMJ 1998 Jan 3; 316(7124):7. [FREE Full text]
2. Birnbaum MH. Human research and data collection via the internet. Annu Rev Psychol 2004;55:803-832. [doi: 10.1146/annurev. psych.55.090902.141601]
3. Gosling SD, Vazire S, Srivastava S, John OP. Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. Am Psychol 2004;59(2):93-104. [doi: 10.1037/0003-066X.59.2.93] (Pubitemid 38318025)
4. Link MW, Mokdad AH. Effects of survey mode on self-reports of adult alcohol consumption: a comparison of mail, web and telephone approaches. J Stud Alcohol 2005 Mar; 66(2):239-245.
5. McCabe SE. Comparison of web and mail surveys in collecting illicit drug use data: a randomized experiment. J Drug Educ 2004;34(1):61-72.
6. McCabe SE, Boyd CJ, Couper MP, Crawford S, D'Arcy H. Mode effects for collecting alcohol and other drug use data: Web and U. S. mail. J Stud Alcohol 2002 Nov; 63(6):755-761.
7. McCabe SE, Diez A, Boyd CJ, Nelson TF, Weitzman ER. Comparing web and mail responses in a mixed mode survey in college alcohol use research. Addict Behav 2006 Sep; 31(9):1619-1627. [doi: 10.1016/j.addbeh.2005.12.009] (Pubitemid 44160742)
8. Miller ET, Neal DJ, Roberts LJ, Baer JS, Cressler SO, Metrik J, et al. Test-retest reliability of alcohol measures: is there a difference between internet-based assessment and traditional methods? Psychol Addict Behav 2002 Mar; 16(1):56-63.
9. Pealer LN, Weiler RM, Pigg RM, Miller D, Dorman SM. The feasibility of a web-based surveillance system to collect health risk behavior data from college students. Health Educ Behav 2001 Oct; 28(5):547-559.
10. Graham AL, Papandonatos GD. Reliability of internet-versus telephone-administered questionnaires in a diverse sample of smokers. J Med Internet Res 2008;10(1):e. [FREE Full text] [doi: 10.2196/jmir.987] (Pubitemid 351551025)
11. Graham AL, Papandonatos GD, Bock BC, Cobb NK, Baskin-Sommers A, Niaura R, et al. Internet-vs. telephone-administered questionnaires in a randomized trial of smoking cessation. Nicotine Tob Res 2006 Dec; 8 (Suppl 1): S49-S5. [FREE Full text]
12. Solomon LJ, Hughes JR, Livingston A, Naud S, Callas PW, Peters EN, et al. Cognitive barriers to calling a smoking quitline. Nicotine Tob Res 2009 Nov; 11(11):1339-1346. [doi: 10.1093/ntr/ntp143]
13. Heatherton TF, Kozlowski LT, Frecker RC, Fagerström KO. The Fagerström Test for Nicotine Dependence: a revision of the Fagerström Tolerance Questionnaire. Br J Addict 1991 Sep; 86(9):1119-1127.
14. McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychol Methods 1996;1(1):30-46.
15. Pew Internet & American Life Project. Demographics of Internet users. Washington, DC: Pew Internet & American Life Project; 2009 Oct. 30. URL: http://www.pewinternet.org/Static-Pages/Trend-Data/Whos-Online.aspx [accessed 2009-11-10] [WebCite Cache ID 5lBffHQLJ]
16. Stoddard JL, Augustson EM. Smokers who use internet and smokers who don't: data from the Health Information and National Trends Survey (HINTS). Nicotine Tob Res 2006 Dec; 8 (Suppl 1): S77-S85.
17. Ekman A, Dickman PW, Klint A, Weiderpass E, Litton JE. Feasibility of using web-based questionnaires in large population-based epidemiological studies. Eur J Epidemiol 2006;21(2):103-111. [doi: 10.1007/s10654-005-6030-4] (Pubitemid 43341198)
18. Bälter KA, Bälter O, Fondell E, Lagerros YT. Web-based and mailed questionnaires: a comparison of response rates and compliance. Epidemiology 2005 Jul; 16(4):577-579.
19. Harewood GC, Yacavone RF, Locke GR, Wiersema MJ. Prospective comparison of endoscopy patient satisfaction surveys: e-mail versus standard mail versus telephone. Am J Gastroenterol 2001 Dec; 96(12):3312-3317. [doi: 10.1111/j.1572-0241.2001.05331.x]
20. Jones R, Pitt N. Health surveys in the workplace: comparison of postal, email and World Wide Web methods. Occup Med (Lond) 1999 Nov; 49(8):556-55. [FREE Full text]
21. Kongsved SM, Basnov M, Holm-Christensen K, Hjollund NH. Response rate and completeness of questionnaires: a randomized study of Internet versus paper-and-pencil versions. J Med Internet Res 2007;9(3):e2. [FREE Full text] [doi: 10.2196/jmir.9.3.e25]
22. Raziano DB, Jayadevappa R, Valenzula D, Weiner M, Lavizzo-Mourey R. E-mail versus conventional postal mail survey of geriatric chiefs. Gerontologist 2001 Dec; 41(6):799-804.
23. Ritter P, Lorig K, Laurent D, Matthews K. Internet versus mailed questionnaires: a randomized comparison. J Med Internet Res 2004 Sep. 15; 6(3):e2. [FREE Full text] [doi: 10.2196/jmir.6.3.e29]
24. Truell AD, Bartlett JE, Alexander MW. Response rate, speed, and completeness: a comparison of Internet-based and mail surveys. Behav Res Methods Instrum Comput 2002 Feb; 34(1):46-49.
25. Lonsdale C, Hodge K, Rose EA. Pixels vs. paper: comparing online and traditional survey methods in sports psychology. J Sport Exerc Psychol 2006;28:100-108.
26. Manfreda KL, Bosnjak M, Berzelak J, Haas I, Vehovar V. Web surveys versus other survey modes: a meta-analysis comparing response rates. Int J Market Res 2008;50(1):79-104.
27. Shih T, Fan X. Comparing response rates from Web and mail surveys: a meta-analysis. Field Methods 2008;20(3):249-271.
28. Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev 2009(3):MR000008. [doi: 10.1002/14651858. MR000008.pub4]
29. Basnov M, Kongsved SM, Bech P, Hjollund NH. Reliability of short form-36 in an Internet-and a pen-and-paper version. Inform Health Soc Care 2009 Jan; 34(1):53-58. [doi: 10.1080/17538150902779527]
30. Bliven BD, Kaufman SE, Spertus JA. Electronic collection of health-related quality of life data: validity, time benefits, and patient preference. Qual Life Res 2001;10(1):15-22.
31. Boeckner LS, Pullen CH, Walker SN, Abbott GW, Block T. Use and reliability of the World Wide Web version of the Block Health Habits and History Questionnaire with older rural women. J Nutr Educ Behav 2002;34(Suppl 1): S20-S24.
32. Bressani RV, Downs AC. Youth independent living assessment: testing the equivalence of Web and paper/pencil versions of the Ansell-Casey Life Skills Assessment. Comput Human Behav 2002;18:453-464. [doi: 10.1016/S0747-5632 (01) 00053-X]
33. Buchanan T, Smith JL. Using the Internet for psychological research: personality testing on the World Wide Web. Br J Psychol 1999 Feb; 90 (Pt 1):125-144.
34. Fouladi RT, McCarthy CJ, Moller NP. Paper-and-pencil or online? Evaluating mode effects on measures of emotional functioning and attachment. Assessment 2002 Jun; 9(2):204-215.
35. Hewson C, Charlton JP. Measuring health beliefs on the Internet: A comparison of paper and Internet administrations of the Multidimensional Health Locus of Control Scale. Behav Res Methods 2005 Nov; 37(4):691-70. [FREE Full text]
36. Riva G, Teruzzi T, Anolli L. The use of the internet in psychological research: comparison of online and offline questionnaires. Cyberpsychol Behav 2003 Feb; 6(1):73-80. [doi: 10.1089/109493103321167983] (Pubitemid 36278471)
37. Vallejo MA, Jordán CM, Díaz MI, Comeche MI, Ortega J. Psychological assessment via the internet: a reliability and validity study of online (vs paper-and-pencil) versions of the General Health Questionnaire-28 (GHQ-28) and the Symptoms Check-List-90-Revised (SCL-90-R). J Med Internet Res 2007;9(1):e. [FREE Full text] [doi: 10.2196/jmir.9.1.e2] (Pubitemid 47450402)
38. Yu SC, Yu MN. Comparison of Internet-based and paper-based questionnaires in Taiwan using multisample invariance approach. Cyberpsychol Behav 2007 Aug; 10(4):501-507. [doi: 10.1089/cpb.2007.9998] (Pubitemid 47328662)
39. Im EO, Chee W, Bender M, Cheng CY, Tsai HM, Mi Kang N, et al. The psychometric properties of Pen-and-Pencil and Internet versions of the Midlife Women's Symptom Index (MSI). Int J Nurs Stud 2005 Feb; 42(2):167-177. [doi: 10.1016/j.ijnurstu.2004.06.005] (Pubitemid 40174803)
40. Smith B, Smith TC, Gray GC, Ryan MA, Millennium Cohort Study Team. When epidemiology meets the Internet: Web-based surveys in the Millennium Cohort Study. Am J Epidemiol 2007 Dec. 1; 166(11):1345-135. [FREE Full text] [doi: 10.1093/aje/kwm212] (Pubitemid 350129419)
41. McMahon SR, Iwamoto M, Massoudi MS, Yusuf HR, Stevenson JM, David F, et al. Comparison of e-mail, fax, and postal surveys of pediatricians. Pediatrics 2003 Apr; 111 (4 Pt 1): e299-e30. [FREE Full text]
42. Leece P, Bhandari M, Sprague S, Swiontkowski MF, Schemitsch EH, Tornetta P, et al. Internet versus mailed questionnaires: a controlled comparison (2). J Med Internet Res 2004 Oct. 29; 6(4):e3. [FREE Full text] [doi: 10.2196/jmir.6.4.e39]
43. Hughes JR, Callas PW. Data to assess the generalizability of samples from studies of adult smokers. Nicotine Tob Res 2010 Jan; 12(1):73-76. [doi: 10.1093/ntr/ntp168]