Comparison of web-based and paper-based administration of ADHD questionnaires for adults

Journal of Medical Internet Research

Volumn 15, Issue 3, 2013, Pages

  Hirsch, Oliver ^a   Hauschild, Franziska ^a   Schmidt, Martin H ^a   Baum, Erika ^a   Christiansen, Hanna ^a  

^a PHILIPPS UNIVERSITY MARBURG   (Germany)

Author keywords

Attention deficit hyperactivity disorder; Computers; Internet; Psychometrics; Questionnaires

Indexed keywords

ADULT; ARTICLE; ATTENTION DEFICIT DISORDER; COMPARATIVE STUDY; CROSS-SECTIONAL STUDY; FEMALE; HUMAN; INTERNET; MALE; MIDDLE AGED; PAPER; PSYCHOLOGICAL ASPECT; PSYCHOMETRY; QUESTIONNAIRE;

ADULT; ATTENTION DEFICIT DISORDER WITH HYPERACTIVITY; CROSS-SECTIONAL STUDIES; FEMALE; HUMANS; INTERNET; MALE; MIDDLE AGED; PAPER; PSYCHOMETRICS; QUESTIONNAIRES; YOUNG ADULT;

EID: 84877276374     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.2225     Document Type: Article

References (50)

1. Strickland OL, Moloney MF, Dietrich AS, Myerburg S, Cotsonis GA, Johnson RV. Measurement issues related to data collection on the World Wide Web. ANS Adv Nurs Sci 2003;26(4):246-256. [Medline: 14674574]
2. Gosling SD, Vazire S, Srivastava S, John OP. Should we trust Web-based studies? A comparative analysis of six preconceptions about internet questionnaires. Am Psychol 2004 Mar;59(2):93-104. [doi: 10.1037/0003-066X.59.2. 93] [Medline: 14992636]
3. Ekman A, Dickman PW, Klint A, Weiderpass E, Litton JE. Feasibility of using Web-based questionnaires in large population-based epidemiological studies. Eur J Epidemiol 2006;21(2):103-111. [doi: 10.1007/s10654-005-6030-4] [Medline: 16518678]
4. Ritter P, Lorig K, Laurent D, Matthews K. Internet versus mailed questionnaires: a randomized comparison. J Med Internet Res 2004 Sep 15;6(3):e29 [FREE Full text] [doi: 10.2196/jmir.6.3.e29] [Medline: 15471755]
5. Van De Looij-Jansen PM, De Wilde EJ. Comparison of Web-based versus paper-And-pencil self-Administered questionnaire: effects on health indicators in Dutch adolescents. Health Serv Res 2008 Oct;43(5 Pt 1):1708-1721 [FREE Full text] [doi: 10.1111/j.1475-6773.2008.00860.x] [Medline: 18479404]
6. Denscombe M. Web-based questionnaires and the mode effect. Social Science Computer Review 2006;24(2):246-254. [doi: 10.1177/0894439305284522]
7. Hardré PL, Crowson HM, Xie K, Ly C. Testing differential effects of computer-based, Web-based and paper-based administration of questionnaire research instruments. Br J Educ Technol 2007 Jan 2007;38(1):5-22. [doi: 10.1111/j.1467-8535.2006.00591.x]
8. Vallejo MA, Jordán CM, Díaz MI, Comeche MI, Ortega J. Psychological assessment via the internet: a reliability and validity study of online (vs paper-And-pencil) versions of the General Health Questionnaire-28 (GHQ-28) and the Symptoms Check-List-90-Revised (SCL-90-R). J Med Internet Res 2007;9(1):e2 [FREE Full text] [doi: 10.2196/jmir.9.1.e2] [Medline: 17478411]
9. Hardré PL, Crowson HM, Xie K. Differential Effects of Web-Based and Paper-Based Administration of Questionnaire Research Instruments in Authentic Contexts-of-Use. Journal of Educational Computing Research 2010 Jan 2010;42(1):103-133. [doi: 10.2190/EC.42.1.e]
10. Riva G, Teruzzi T, Anolli L. The use of the internet in psychological research: comparison of online and offline questionnaires. Cyberpsychol Behav 2003 Feb;6(1):73-80. [doi: 10.1089/109493103321167983] [Medline: 12650565]
11. Holländare F, Andersson G, Engström I. A comparison of psychometric properties between internet and paper versions of two depression instruments (BDI-II and MADRS-S) administered to clinic patients. J Med Internet Res 2010;12(5):e49 [FREE Full text] [doi: 10.2196/jmir.1392] [Medline: 21169165]
12. Carlbring P, Brunt S, Bohman S, Austin D, Richards J, Öst L, et al. Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research. Computers in Human Behavior 2007 May 2007;23(3):1421-1434. [doi: 10.1016/j.chb.2005.05.002]
13. Donker T, van Straten A, Marks I, Cuijpers P. A brief Web-based screening questionnaire for common mental disorders: development and validation. J Med Internet Res 2009;11(3):e19 [FREE Full text] [doi: 10.2196/jmir.1134] [Medline: 19632977]
14. Lin CC, Bai YM, Liu CY, Hsiao MC, Chen JY, Tsai SJ, et al. Web-based tools can be used reliably to detect patients with major depressive disorder and subsyndromal depressive symptoms. BMC Psychiatry 2007;7:12 [FREE Full text] [doi: 10.1186/1471-244X-7-12] [Medline: 17425774]
15. Buchanan T. Internet-based questionnaire assessment: appropriate use in clinical contexts. Cogn Behav Ther 2003;32(3):100-109. [doi: 10.1080/16506070310000957] [Medline: 16291542]
16. Whitehead L. Methodological issues in Internet-mediated research: a randomized comparison of internet versus mailed questionnaires. J Med Internet Res 2011;13(4):e109 [FREE Full text] [doi: 10.2196/jmir.1593] [Medline: 22155721]
17. Davidson MA. ADHD in adults: a review of the literature. J Atten Disord 2008 May;11(6):628-641. [doi: 10.1177/1087054707310878] [Medline: 18094324]
18. Ramsay JR, Rostain AL. Adult ADHD research: current status and future directions. J Atten Disord 2008 May;11(6):624-627. [doi: 10.1177/ 1087054708314590] [Medline: 18417728]
19. Weiss M, Murray C. Assessment and management of attention-deficit hyperactivity disorder in adults. CMAJ 2003 Mar 18;168(6):715-722 [FREE Full text] [Medline: 12642429]
20. Steenhuis MP, Serra M, Minderaa RB, Hartman CA. An Internet version of the Diagnostic Interview Schedule for Children (DISC-IV): correspondence of the ADHD section with the paper-And-pencil version. Psychol Assess 2009 Jun;21(2):231-234. [doi: 10.1037/a0015925] [Medline: 19485678]
21. Bhatara VS, Vogt HB, Patrick S, Doniparthi L, Ellis R. Acceptability of a Web-based attention-deficit/hyperactivity disorder scale (T-SKAMP) by teachers: a pilot study. J Am Board Fam Med 2006;19(2):195-200 [FREE Full text] [Medline: 16513909]
22. Swanson JM, Schuck S, Mann-Porter M, Carlson C, Hartman CA, Sergeant JA, et al. Categorical and Dimensional Definitions and Evaluations of Symptoms of ADHD: History of the SNAP and the SWAN Rating Scales. The International Journal of Educational and Psychological Assessment 2012;10:51-70.
23. Rösler M, Retz W, Stieglitz RD. Psychopathological rating scales as efficacy parameters in adult ADHD treatment investigations - benchmarking instruments for international multicentre trials. Pharmacopsychiatry 2010 May;43(3):92-98. [doi: 10.1055/s-0029-1242819] [Medline: 20127615]
24. Conners CK, Erhardt D, Sparrow E. Conner's Adult ADHD Rating Scales (CAARS). Technical manual. North Tonawanda, NY: Multi-Health Systems; 1999.
25. Christiansen H, Hirsch O, Philipsen A, Oades RD, Matthies S, Hebebrand J, et al. German Validation of the Conners Adult ADHD Rating Scale-Self-Report: Confirmation of Factor Structure in a Large Sample of Participants With ADHD. J Atten Disord 2012 Mar 21. [doi: 10.1177/1087054711435680] [Medline: 22441889]
26. Christiansen H, Kis B, Hirsch O, Matthies S, Hebebrand J, Uekermann J, et al. German validation of the Conners Adult ADHD Rating Scales (CAARS) II: reliability, validity, diagnostic sensitivity and specificity. Eur Psychiatry 2012 Jul;27(5):321-328. [doi: 10.1016/j.eurpsy.2010.12.010] [Medline: 21392946]
27. Christiansen H, Kis B, Hirsch O, Philipsen A, Henneck M, Panczuk A, et al. German validation of the Conners Adult ADHD Rating Scales-self-report (CAARS-S) I: factor structure and normative data. Eur Psychiatry 2011 Mar;26(2):100-107. [doi: 10.1016/j.eurpsy.2009.12.024] [Medline: 20619613]
28. Unipark. URL: http://www.unipark.info/1-0-online-befragungssoftware-fuer- studenten-und-universitaeten-unipark-home. htm [accessed 2013-02-19] [WebCite Cache ID 6EY9AVRHg]
29. Retz-Junginger P, Retz W, Blocher D, Weijers HG, Trott GE, Wender PH, et al. [Wender Utah rating scale. The short-version for the assessment of the attention-deficit hyperactivity disorder in adults]. Nervenarzt 2002 Sep;73(9):830-838. [doi: 10.1007/s00115-001-1215-x] [Medline: 12215873]
30. Retz-Junginger P, Retz W, Blocher D, Stieglitz RD, Georg T, Supprian T, et al. [Reliability and validity of the Wender-Utah-Rating-Scale short form. Retrospective assessment of symptoms for attention deficit/hyperactivity disorder]. Nervenarzt 2003 Nov;74(11):987-993. [doi: 10.1007/s00115-002-1447-4] [Medline: 14598035]
31. Rösler M, Retz W, Retz-Junginger P, Thome J, Supprian T, Nissen T, et al. [Tools for the diagnosis of attention-deficit/hyperactivity disorder in adults. Self-rating behaviour questionnaire and diagnostic checklist]. Nervenarzt 2004 Sep;75(9):888-895. [doi: 10.1007/s00115-003-1622-2] [Medline: 15378249]
32. Blunch N. Introduction to structural equation modeling using SPSS and AMOS. London: Sage; 2008.
33. Kline RB. Principles and practice of structural equation modeling. New York: Guilford; 2005.
34. Arbuckle JL. Amos 17.0 User's Guide. Chicago: SPSS Inc; 2008.
35. Weiber R, Mühlhaus D. Strukturgleichungsmodellierung Structural Equation Modeling. Berlin: Springer; 2009.
36. Raykov T, Marcoulides GA. A first course in structural equation modeling. Mahwah: Lawrence Erlbaum Associates; 2006.
37. George D, Mallery P. SPSS for Windows Step by Step: A Simple Guide and Reference, 18.0 Update. Boston: Allyn & Bacon; 2010.
38. Huber PJ, Ronchetti EM. Robust Statistics. Hoboken, NJ: John Wiley & Sons; 2009.
39. Grissom RJ, Kim JJ. Effect sizes for research. Univariate and multivariate applications. New York: Routledge; 2012.
40. Enders CK. Applied missing data analysis. New York: Guilford; 2010.
41. Donders AR, van der Heijden GJ, Stijnen T, Moons KG. Review: a gentle introduction to imputation of missing values. J Clin Epidemiol 2006 Oct;59(10):1087-1091. [doi: 10.1016/j.jclinepi.2006.01.014] [Medline: 16980149]
42. Sterne JA, White IR, Carlin JB, Spratt M, Royston P, Kenward MG, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ 2009;338:b2393 [FREE Full text] [Medline: 19564179]
43. O'Neil KM, Penrod SD, Bornstein BH. Web-based research: methodological variables' effects on dropout and sample characteristics. Behav Res Methods Instrum Comput 2003 May;35(2):217-226. [Medline: 12834076]
44. Kongsved SM, Basnov M, Holm-Christensen K, Hjollund NH. Response rate and completeness of questionnaires: a randomized study of Internet versus paper-And-pencil versions. J Med Internet Res 2007;9(3):e25 [FREE Full text] [doi: 10.2196/jmir.9.3.e25] [Medline: 17942387]
45. Leece P, Bhandari M, Sprague S, Swiontkowski MF, Schemitsch EH, Tornetta P, et al. Internet versus mailed questionnaires: a controlled comparison (2). J Med Internet Res 2004 Oct 29;6(4):e39 [FREE Full text] [doi: 10.2196/jmir.6.4.e39] [Medline: 15631963]
46. van den Berg MH, Overbeek A, van der Pal HJ, Versluys AB, Bresters D, van Leeuwen FE, et al. Using web-based and paper-based questionnaires for collecting data on fertility issues among female childhood cancer survivors: differences in response characteristics. J Med Internet Res 2011;13(3):e76 [FREE Full text] [doi: 10.2196/jmir.1707] [Medline: 21955527]
47. Rhodes SD, Bowie DA, Hergenrather KC. Collecting behavioural data using the world wide web: considerations for researchers. J Epidemiol Community Health 2003 Jan;57(1):68-73 [FREE Full text] [Medline: 12490652]
48. Joinson A. Social desirability, anonymity, and Internet-based questionnaires. Behav Res Methods Instrum Comput 1999 Aug;31(3):433-438. [Medline: 10502866]
49. Houston TK, Cooper LA, Vu HT, Kahn J, Toser J, Ford DE. Screening the public for depression through the Internet. Psychiatr Serv 2001 Mar;52(3):362-367. [Medline: 11239106]
50. Klovning A, Sandvik H, Hunskaar S. Web-based survey attracted age-biased sample with more severe illness than paper-based survey. J Clin Epidemiol 2009 Oct;62(10):1068-1074. [doi: 10.1016/j.jclinepi.2008.10.015] [Medline: 19246177]