Nonprobability web surveys to measure sexual behaviors and attitudes in the general population: A comparison with a probability sample interview survey

Journal of Medical Internet Research

Volumn 16, Issue 12, 2014, Pages

  Erens, Bob ^a   Burkill, Sarah ^b   Couper, Mick P ^c   Conrad, Frederick ^b   Clifton, Soazig ^b,d   Tanton, Clare ^b   Phelps, Andrew ^d   Datta, Jessica ^a   Mercer, Catherine H ^b   Sonnenberg, Pam ^b   Prah, Philip ^b   Mitchell, Kirstin R ^a   Wellings, Kaye ^a   Johnson, Anne M ^b   Copas, Andrew J ^b  

^a LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY OF MICHIGAN   (United States)

^d NATIONAL CENTRE FOR SOCIAL RESEARCH   (United Kingdom)

Author keywords

Internet survey; Sampling bias; Selection bias; Sexual behavior; Survey methods; Web survey

Indexed keywords

ADOLESCENT; ADULT; ATTITUDE; COMPARATIVE STUDY; EPIDEMIOLOGY; FEMALE; HEALTH SURVEY; HUMAN; INTERNET; LIFESTYLE; MALE; MIDDLE AGED; PREVALENCE; PROCEDURES; SEXUAL BEHAVIOR; YOUNG ADULT;

ADOLESCENT; ADULT; ATTITUDE; FEMALE; HEALTH SURVEYS; HUMANS; INTERNET; LIFE STYLE; MALE; MIDDLE AGED; PREVALENCE; SAMPLING STUDIES; SEXUAL BEHAVIOR; YOUNG ADULT;

EID: 84918549774     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.3382     Document Type: Review

References (40)

1. Touvier M, Méjean C, Kesse-Guyot E, Pollet C, Malon A, Castetbon K, et al. Comparison between web-based and paper versions of a self-administered anthropometric questionnaire. Eur J Epidemiol 2010 May; 25(5):287-296. [doi: 10.1007/s10654-010-9433-9] [Medline: 20191377]
2. Shah AD, Wood DM, Dargan PI. Internet survey of home storage of paracetamol by individuals in the UK. QJ Med 2013;106(3):253-259 [FREE Full text] [doi: 10.1093/qjmed/hcs232 253-259]
3. Charrance G, Legleye S, Razafindrastsima N. The use of an internet panel to monitor sexual and reproductive health in the general population. 2013. URL: http://www.europeansurveyresearch.org/conf/uploads/466/695/184/CHARRANCE-ONLINE-SURVEYS.pdf? [accessed 2014-03-03] [WebCite Cache ID 6Nnfhcawf]
4. Marcus U, Hickson F, Weatherburn P, Schmidt AJ, EMIS Network. Prevalence of HIV among MSM in Europe: comparison of self-reported diagnoses from a large scale internet survey and existing national estimates. BMC Public Health 2012;12:978 [FREE Full text] [doi: 10.1186/1471-2458-12-978] [Medline: 23151263]
5. Couper MP, Singer E, Conrad FG, Groves RM. Experimental Studies of Disclosure Risk, Disclosure Harm, Topic Sensitivity, and Survey Participation. J Off Stat 2010 Jun; 26(2):287-300 [FREE Full text] [Medline: 21765576]
6. Ekman A, Litton JE. New times, new needs; e-epidemiology. Eur J Epidemiol 2007;22(5):285-292. [doi: 10.1007/s10654-007-9119-0] [Medline: 17505896]
7. Ekman A, Dickman PW, Klint A, Weiderpass E, Litton JE. Feasibility of using web-based questionnaires in large population-based epidemiological studies. Eur J Epidemiol 2006;21(2):103-111. [doi: 10.1007/s10654-005-6030-4] [Medline: 16518678]
8. Link MW, Mokdad AH. Alternative modes for health surveillance surveys: an experiment with web, mail, and telephone. Epidemiology 2005 Sep; 16(5):701-704. [Medline: 16135951]
9. Hou SI, Wisenbaker J. Using a web-based survey to assess correlates of intention towards HIV testing among never-been-tested but sexually experienced college students. AIDS Care 2005 Apr; 17(3):329-334. [doi: 10.1080/09540120412331299816] [Medline: 15832880]
10. Link MW, Mokdad AH. Are web and mail modes feasible options for the behavioral risk factor surveillance system? In: Cohen SB, Lepkowski JM, editors. Eighth Conference on Health Survey Research Methods. 2004 Presented at: Eighth Conference on Health Survey Research Methods. Natl Cent Health Statistics; February 20-23, 2004; Peachtree City, GA URL: http://www.cdc.gov/nchs/data/hsrmc/hsrmc-8th-proceedings-2004.pdf [WebCite Cache]
11. Baker R, Zahs D, Popa G. Health surveys in the 21st century: telephone vs web. In: Cohen SB, Lepkowski JM, editors. Eighth Conference on Health Survey Research Methods. 2004 Presented at: Eighth Conference on Health Survey Research Methods. Natl Cent Health Statistics; February 20-23, 2004; Peachtree, GA URL: http://www.cdc.gov/nchs/data/hsrmc/hsrmc-8th-proceedings-2004.pdf [WebCite Cache]
12. Baer A, Saroiu S, Koutsky LA. Obtaining sensitive data through the Web: an example of design and methods. Epidemiology 2002 Nov; 13(6):640-645. [doi: 10.1097/01. EDE.0000032360.92664. BC] [Medline: 12410004]
13. AAPOR Report on Online Panels. 2010 Mar. URL: http://www.aapor.org/AM/Template.cfm?Section=AAPOR-Committee-and-Task-Force-Reports & Template=/CM/ContentDisplay. cfm & ContentID=2223 [WebCite Cache ID 6Nnji0q7q]
14. Craig BM, Hays RD, Pickard AS, Cella D, Revicki DA, Reeve BB. Comparison of US panel vendors for online surveys. J Med Internet Res 2013;15(11):e260 [FREE Full text] [doi: 10.2196/jmir.2903] [Medline: 24292159]
15. Yeager DS, Krosnick JA, Chang L, Javitz HS, Levendusky MS, Simpser A, et al. Comparing the accuracy of RDD telephone surveys and internet surveys conducted with probability and non-probability samples. Public Opin Q 2011;75(4):709-747. [doi: 10.1093/poqnfr020]
16. Chang LC, Krosnick JA. National surveys via RDD telephone interviewing versus the internet: comparing sample representativeness and response quality. Public Opin Q 2009;73(4):641-678. [doi: 10.1093/poqnfp075]
17. Loosveldt G, Sonck N. An evaluation of the weighting procedures for an online access panel survey. Surv Res Methods 2008;2(2):93-105 [FREE Full text] [WebCite Cache]
18. Smith P. SRA News. 2013. Surveying the UK general population through the web URL: http://the-sra.org.uk/wp-content/uploads/sra-research-matters-march-2013.pdf [accessed 2014-03-05] [WebCite Cache ID 6NqU4qGzI]
19. Duffy B, Smith K, Terhanian G, Bremer J. Comparing data from online and face-to-face surveys. Int J Mark Res 2005;47(6):615-639 [FREE Full text] [WebCite Cache]
20. Gosling SD, Vazire S, Srivastava S, John OP. Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. Am Psychol 2004;59(2):93-104. [doi: 10.1037/0003-066X.59.2.93] [Medline: 14992636]
21. Cabinet Office. Community Life Survey: Development of content and methodology for future survey years. URL: https://www.gov. uk/government/uploads/system/uploads/attachment-data/file/325868/Community-Life-Survey-consultation-November-2013-3-.pdf [accessed 2014-03-05] [WebCite Cache ID 6UBIfNW1Y]
22. Dayan Y, Paine CS, Johnson AJ. Responding to sensitive questions in surveys: a comparison with results from Online panels, face to face and self-completion interviews. URL: http://www.ipsos-mori.com/Assets/Docs/Publications/Ops-RMC-Responding-Sensitive-Questions-08-03-10.pdf [accessed 2014-03-03] [WebCite Cache ID 6NnhbsTSm]
23. Kreuter F, Presser S, Tourangeau R. Social desirability bias in CATI, IVR, and Web surveys: the effects of mode and question sensitivity. Public Opinion Quarterly 2008;72(5):847-865. [doi: 10.1093/poq/nfn063]
24. Erens B, Phelps A, Clifton S, Mercer CH, Tanton C, Hussey D, et al. Methodology of the third British National Survey of Sexual Attitudes and Lifestyles (Natsal-3). Sex Transm Infect 2014;90(2):84-89 [FREE Full text] [doi: 10.1136/sextrans-2013-051359] [Medline: 24277881]
25. Office for National Statistics. Labour Force Survey User Guide 2009-Volume 1: Background and Methodology. 2009. URL: http://www.ons.gov. uk/ons/guide-method/method-quality/specific/labour-market/labour-market-statistics/index.html [accessed 2014-03-03] [WebCite Cache ID 6NnglvlaO]
26. Payne RA, Abel GA. UK indices of multiple deprivation - a way to make comparisons across constituent countries easier. Health Stat Q 2012(53):22-37. [Medline: 22410690]
27. Office for National Statistics. Integrated Household Survey User Guide-Volume 1: IHS Background and Methodology. 2012. URL: http://www.ons.gov. uk/ons/guide-method/method-quality/specific/social-and-welfare-methodology/integrated-household-survey/index.html [accessed 2014-03-03] [WebCite Cache ID 6Nnh5cbFC]
28. Rofique J, Humphrey A, Pickering K, Tipping S. National Travel Survey 2010 Technical Report. 2011 Jun. URL: http://doc.ukdataservice.ac.uk/doc/5340/mrdoc/pdf/5340-technical-report-nts2010.pdf [accessed 2014-03-03] [WebCite Cache ID 6UUOEEBkl]
29. Mercer CH, Tanton C, Prah P, Erens B, Sonnenberg P, Clifton S, et al. Changes in sexual attitudes and lifestyles in Britain through the life course and over time: findings from the National Surveys of Sexual Attitudes and Lifestyles (Natsal). Lancet 2013 Nov. 30; 382(9907):1781-1794 [FREE Full text] [doi: 10.1016/S0140-6736 (13) 62035-8] [Medline: 24286784]
30. Sonnenberg P, Clifton S, Beddows S, Field N, Soldan K, Tanton C, et al. Prevalence, risk factors, and uptake of interventions for sexually transmitted infections in Britain: findings from the National Surveys of Sexual Attitudes and Lifestyles (Natsal). Lancet 2013 Nov. 30; 382(9907):1795-1806 [FREE Full text] [doi: 10.1016/S0140-6736 (13) 61947-9] [Medline: 24286785]
31. Wellings K, Jones KG, Mercer CH, Tanton C, Clifton S, Datta J, et al. The prevalence of unplanned pregnancy and associated factors in Britain: findings from the third National Survey of Sexual Attitudes and Lifestyles (Natsal-3). Lancet 2013 Nov. 30; 382(9907):1807-1816 [FREE Full text] [doi: 10.1016/S0140-6736 (13) 62071-1] [Medline: 24286786]
32. Mitchell KR, Mercer CH, Ploubidis GB, Jones KG, Datta J, Field N, et al. Sexual function in Britain: findings from the third National Survey of Sexual Attitudes and Lifestyles (Natsal-3). Lancet 2013 Nov. 30; 382(9907):1817-1829 [FREE Full text] [doi: 10.1016/S0140-6736 (13) 62366-1] [Medline: 24286787]
33. Efron B, Tibshirani R. An Introduction to the Bootstrap. New York: Chapman & Hall; 1993.
34. Office for National Statistics. Statistical Bulletin. 2012. Internet Access-Households and Individuals 2012 URL: http://www.ons.gov. uk/ons/dcp171778-275775.pdf [accessed 2014-03-04] [WebCite Cache ID 6NooqeMk3]
35. Chang L, Krosnick JA. Comparing oral interviewing with self-administered computerized questionnaires. An experiment. Public Opin Q 2010;74(1):154-167. [doi: 10.1093/nfp090]
36. Heerwegh D, Loosveldt G. Face-to-face versus Web surveying in a high-Internet-coverage population: differences in response quality. Public Opin Q 2008;72(5):836-846. [doi: 10.1093/poq/nfn045]
37. Cabinet Office. Community Life Survey: Summary of web experiment findings. 2013 Nov. URL: https://www.gov. uk/government/uploads/system/uploads/attachment-data/file/325872/Annex-B-Summary-of-web-experiment-findings-2012-13.pdf [accessed 2014-07-28] [WebCite Cache ID 6RP8yP1BH]
38. Schonlau M. Will web surveys ever become part of mainstream research? J Med Internet Res 2004 Sep. 23; 6(3):e31 [FREE Full text] [doi: 10.2196/jmir.6.3.e31] [Medline: 15471757]
39. Sugiura H, Ohkusa Y, Akahane M, Sano T, Okabe N, Imamura T. Development of a web-based survey for monitoring daily health and its application in an epidemiological survey. J Med Internet Res 2011;13(3):e66 [FREE Full text] [doi: 10.2196/jmir.1872] [Medline: 21946004]
40. Richiardi L, Pizzi C, Pearce N. Commentary: Representativeness is usually not necessary and often should be avoided. Int J Epidemiol 2013 Aug; 42(4):1018-1022 [FREE Full text] [doi: 10.1093/ije/dyt103] [Medline: 24062290]