Does self-selection affect samples'representativeness in online surveys an investigation in online video game research

Journal of Medical Internet Research

Volumn 16, Issue 7, 2014, Pages

  Khazaal, Yasser ^a   Van Singer, Mathias ^b   Chatton, Anne ^a   Achab, Sophia ^a   Zullino, Daniele ^b   Rothen, Stephane ^b   Khan, Riaz ^a   Billieux, Joel ^c   Thorens, Gabriel ^a  

^a GENEVA UNIVERSITY HOSPITALS   (Switzerland)

^b UNIVERSITY OF GENEVA   (Switzerland)

^c UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

Bias; Internet; Massively multiplayer online role playing; Online survey; Random sample; Self selection; World of Warcraft

Indexed keywords

ADULT; ANALYSIS OF VARIANCE; COMPUTER SIMULATION; HUMAN; INFORMATION PROCESSING; INTERNET; MALE; PROCEDURES; RECREATION; UTILIZATION;

ADULT; ANALYSIS OF VARIANCE; COMPUTER SIMULATION; DATA COLLECTION; HUMANS; INTERNET; MALE; VIDEO GAMES;

EID: 84906256384     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.2759     Document Type: Article

References (29)

1. Schonlau M. Will web surveys ever become part of mainstream research? J Med Internet Res 2004 Sep 23;6(3):e31 [FREE Full text] [doi: 10.2196/jmir.6.3.e31] [Medline: 15471757]
2. Rhodes SD, Bowie DA, Hergenrather KC. Collecting behavioural data using the world wide web: considerations for researchers. J Epidemiol Community Health 2003 Jan;57(1):68-73 [FREE Full text] [Medline: 12490652]
3. McCabe SE, Boyd CJ, Couper MP, Crawford S, D'Arcy H. Mode effects for collecting alcohol and other drug use data: Web and U.S. mail. J Stud Alcohol 2002 Nov;63(6):755-761. [Medline: 12529076]
4. McCabe SE, Boyd CJ, Young A, Crawford S. Feasibility study for collecting alcohol and other drug use data among secondary school students: a web-based survey approach. J Drug Educ 2004;34(4):373-383. [Medline: 16117249]
5. McCabe SE. Comparison of web and mail surveys in collecting illicit drug use data: a randomized experiment. J Drug Educ 2004;34(1):61-72. [Medline: 15468748]
6. Gosling SD, Vazire S, Srivastava S, John OP. Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. Am Psychol 2004;59(2):93-104. [doi: 10.1037/0003-066X.59.2.93] [Medline: 14992636]
7. Whitehead L. Methodological issues in Internet-mediated research: a randomized comparison of internet versus mailed questionnaires. J Med Internet Res 2011;13(4):e109 [FREE Full text] [doi: 10.2196/jmir.1593] [Medline: 22155721]
8. Ritter P, Lorig K, Laurent D, Matthews K. Internet versus mailed questionnaires: a randomized comparison. J Med Internet Res 2004 Sep 15;6(3):e29 [FREE Full text] [doi: 10.2196/jmir.6.3.e29] [Medline: 15471755]
9. Kypri K, Gallagher SJ, Cashell-Smith ML. An internet-based survey method for college student drinking research. Drug Alcohol Depend 2004 Oct 5;76(1):45-53. [doi: 10.1016/j.drugalcdep.2004.04.001] [Medline: 15380288]
10. McCabe SE. Screening for drug abuse among medical and nonmedical users of prescription drugs in a probability sample of college students. Arch Pediatr Adolesc Med 2008 Mar;162(3):225-231 [FREE Full text] [doi: 10.1001/ archpediatrics.2007.41] [Medline: 18316659]
11. Eysenbach G, Wyatt J. Using the Internet for surveys and health research. J Med Internet Res 2002;4(2):E13 [FREE Full text] [doi: 10.2196/jmir.4.2.e13] [Medline: 12554560]
12. Bethlehem J. Selection bias in web surveys. International Statistical Review 2010;78(2):161-188. [doi: 10.1111/j.1751-5823.2010.00112.x]
13. Ramo DE, Hall SM, Prochaska JJ. Reaching young adult smokers through the internet: comparison of three recruitment mechanisms. Nicotine Tob Res 2010 Jul;12(7):768-775 [FREE Full text] [doi: 10.1093/ntr/ntq086] [Medline: 20530194]
14. Ramo DE, Prochaska JJ. Broad reach and targeted recruitment using Facebook for an online survey of young adult substance use. J Med Internet Res 2012;14(1):e28 [FREE Full text] [doi: 10.2196/jmir.1878] [Medline: 22360969]
15. Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev 2009(3):MR000008. [doi: 10.1002/14651858.MR000008.pub4] [Medline: 19588449]
16. Fenner Y, Garland SM, Moore EE, Jayasinghe Y, Fletcher A, Tabrizi SN, et al. Web-based recruiting for health research using a social networking site: an exploratory study. J Med Internet Res 2012;14(1):e20 [FREE Full text] [doi: 10.2196/jmir.1978] [Medline: 22297093]
17. Ramo DE, Prochaska JJ. Prevalence and co-use of marijuana among young adult cigarette smokers: An anonymous online national survey. Addict Sci Clin Pract 2012;7(1):5 [FREE Full text] [doi: 10.1186/1940-0640-7-5] [Medline: 23186143]
18. Owen JE, Bantum EO, Criswell K, Bazzo J, Gorlick A, Stanton AL. Representativeness of two sampling procedures for an internet intervention targeting cancer-related distress: a comparison of convenience and registry samples. J Behav Med 2013 May 4:-. [doi: 10.1007/s10865-013-9509-6] [Medline: 23645145]
19. Mayr A, Gefeller O, Prokosch HU, Pirkl A, Fröhlich A, de Zwaan M. Web-based data collection yielded an additional response bias-but had no direct effect on outcome scales. J Clin Epidemiol 2012 Sep;65(9):970-977. [doi: 10.1016/j.jclinepi.2012.03.005] [Medline: 22742911]
20. Zanetta Dauriat F, Zermatten A, Billieux J, Thorens G, Bondolfi G, Zullino D, et al. Motivations to play specifically predict excessive involvement in massively multiplayer online role-playing games: evidence from an online survey. Eur Addict Res 2011;17(4):185-189. [doi: 10.1159/000326070] [Medline: 21494046]
21. Kuss DJ, Louws J, Wiers RW. Online gaming addiction? Motives predict addictive play behavior in massively multiplayer online role-playing games. Cyberpsychol Behav Soc Netw 2012 Sep;15(9):480-485. [doi: 10.1089/cyber.2012. 0034] [Medline: 22974351]
22. Billieux J, Van der Linden M, Achab S, Khazaal Y, Paraskevopoulos L, Zullino D. Why do you play World of Warcraft? An in-depth exploration of self-reported motivations to play online and in-game behaviours in the virtual world of Azeroth. Comput Human Behav 2013;29(1):103-109.
23. Yee N. Motivations for play in online games. Cyberpsychol Behav 2006 Dec;9(6):772-775. [doi: 10.1089/cpb.2006.9.772] [Medline: 17201605]
24. World of warcraft-Site officiel. URL: http://eu.battle.net/wow/fr/ [accessed 2014-06-26] [WebCite Cache ID 6Qd2EhVIB]
25. Billieux J, Chanal J, Khazaal Y, Rochat L, Gay P, Zullino D, et al. Psychological predictors of problematic involvement in massively multiplayer online role-playing games: illustration in a sample of male cybercafé players. Psychopathology 2011;44(3):165-171. [doi: 10.1159/000322525] [Medline: 21372629]
26. Jonathon R, Halbesleben B, Whitman M. Evaluating Survey Quality in Health Services Research: A Decision Framework for Assessing Nonresponse Bias. Health Serv Res 2013 Jun;48(3):913-930. [doi: 10.1111/1475-6773.12002]
27. WoW heroes. URL: http://www.wow-heroes.com/[accessed 2014-06-19] [WebCite Cache ID 6QRsUT2cG]
28. Research randomizer. URL: http://www.randomizer.org/[accessed 2014-06-19] [WebCite Cache ID 6QRsWJ2Bq]
29. Cranford JA, McCabe SE, Boyd CJ, Slayden J, Reed MB, Ketchie JM, et al. Reasons for nonresponse in a web-based survey of alcohol involvement among first-year college students. Addict Behav 2008 Jan;33(1):206-210 [FREE Full text] [doi: 10.1016/j.addbeh.2007.07.008] [Medline: 17728069]