Hidden Populations, Online Purposive Sampling, and External Validity: Taking off the Blindfold

Field Methods

Volumn 27, Issue 1, 2015, Pages 3-21

  Barratt, Monica J ^a   Ferris, Jason A ^b   Lenton, Simon ^a  

^a CURTIN UNIVERSITY   (Australia)

^b UNIVERSITY OF QUEENSLAND   (Australia)

Author keywords

hard to reach; hidden populations; Internet; representativeness; sampling

Indexed keywords

EID: 84961316660     PISSN: 1525822X     EISSN: 15523969     Source Type: Journal    
DOI: 10.1177/1525822X14526838     Document Type: Article

References (47)

1. Adèr H. J.,Mellenbergh G. J.,Hand D. J.Advising on research methods: A consultant’s companion. Huizen, the Netherlands: Johannes van Kessel Publishing; 2008:
2. 2001 National drug strategy household survey: First results. Canberra, Australia: AIHW; 2002:
3. 2004 National drug strategy household survey: First results. Canberra, Australia: AIHW; 2005:
4. 2007 National drug strategy household survey: First results. Canberra, Australia: AIHW; 2008:
5. Barratt M. J.The efficacy of interviewing young drug users through online chat.Drug and Alcohol Review. 2012;31:566-72
6. Barratt M. J.,Lenton S.Beyond recruitment? Participatory online research with people who use drugs.International Journal of Internet Research Ethics. 2010;3:69-86
7. Bauermeister J. A.,Zimmerman M. A.,Johns M. M.,Glowacki P.,Stoddard S.,Volz E.Innovative recruitment using online networks: Lessons learned from an online study of alcohol and other drug use utilizing a web-based, respondent-driven sampling (webRDS) strategy.Journal of Studies on Alcohol and Drugs. 2012;73:834-38
8. Bock T.,Sargeant J.Small sample market research.International Journal of Market Research. 2002;44:235-44
9. Bowen A.,Daniel C.,Williams M.,Baird G.Identifying multiple submissions in Internet research: Preserving data integrity.AIDS and Behavior. 2008;12:964-73
10. Braunstein M. S.Sampling a hidden population: Noninstitutionalized drug users.AIDS Education and Prevention. 1993;5:131-40
11. Caetano R.Non-response in alcohol and drug surveys: A research topic in need of further attention.Addiction. 2001;96:1541-45
12. Couper M. P.Web surveys: A review of issues and approaches.Public Opinion Quarterly. 2000;64:464-94
13. Crosby R. A.,Salazar L. F.,DiClemente R. J.,Lang D. L.Balancing rigor against the inherent limitations of investigating hard-to-reach populations.Health Education Research. 2010;25:1-5
14. Dillman D. A.Mail and Internet surveys. The tailored design method. Hoboken, NJ: Wiley; 2007:
15. Falzon M.-A.Multi-sited ethnography: Theory, praxis and locality in contemporary research. Falzon M.-A., ed. Surrey, UK: Ashgate; 2009:1-23.
16. Fricker R. D.The Sage handbook of online research methods. Fielding N.Lee R. M.Blank G., ed. London: Sage; 2008:195-216.
17. Gile K. J.,Handcock M. S.Respondent-driven sampling: An assessment of current methodology.Sociological Methodology. 2010;40:285-327
18. Groves R. M.Nonresponse rates and nonresponse bias in household surveys.Public Opinion Quarterly. 2006;70:646-75
19. Groves R. M.Three eras of survey research.Public Opinion Quarterly. 2011;75:861-71
20. Guarte J. M.,Barrios E. B.Estimation under purposive sampling.Communications in Statistics—Simulation and Computation. 2006;35:277-84
21. Hathaway A. D.Cannabis careers reconsidered: Transitions and trajectories of committed long-term users.Contemporary Drug Problems. 2004;31:401-23
22. Heckathorn D. D.Snowball versus respondent-driven sampling.Sociological Methodology. 2011;41:355-66
23. Hine C.The Sage handbook of online research methods. Fielding N.Lee R. M.Blank G., ed. London: Sage; 2008:257-70.
24. Kakinami L.,Conner K. R.Addiction research methods. Miller P. G.Strang J.Miller P. M., ed. Chichester, UK: Wiley-Blackwell; 2010:27-42.
25. Livingston M.,Dietze P.,Ferris J.,Pennay D.,Hayes L.,Lenton S.Surveying alcohol and other drug use through telephone sampling: A comparison of landline and mobile phone samples.BMC Medical Research Methods. 2013;:
26. Lohr S. L.Sampling: Design and analysis. Pacific Grove, CA: Brooks/Cole; 2010:
27. Lucas S. R.Beyond the existence proof: Ontological conditions, epistemological implications, and in-depth interview research.Quality and Quantity. 2014;48:387-408
28. Miller P. G.,Johnston J.,Dunn M.,Fry C. L.,Degenhardt L.Comparing probability and non-probability sampling methods in ecstasy research: Implications for the Internet as a research tool.Substance Use and Misuse. 2010;45:437-50
29. Miller P. G.,Johnston J.,McElwee P. R.,Noble R.A pilot study using the Internet to study patterns of party drug use: Processes, findings and limitations.Drug and Alcohol Review. 2007;26:169-74
30. Miller P. G.,Sønderlund A. L.Using the Internet to research hidden populations of illicit drug users: A review.Addiction. 2010;105:1557-67
31. Moore D.Key moments in the ethnography of drug-related harm: Reality checks for policy-makers?”.Preventing harmful substance use. The evidence base for policy and practice. 2005;:433-42
32. Peterson J. A.,Schacht Reisinger H.,Schwartz R. P.,Mitchell S. G., et al.Targeted sampling in drug abuse research: A review and case study.Field Methods. 2008;20:155-70
33. Potter G. R.,Chatwin C.Markets, methods and messages. Dynamics in European drug research. Fountain J.Frank V. A.Korf D. J., ed. Lengerich, Germany: Pabst Science; 2011:69-84.
34. Public Works and Government Services Canada. 2008. The Advisory Panel on Online Public Opinion Survey Quality. Ontario, Canada: Public Works and Government Services Canada. http://www.tpsgc-pwgsc.gc.ca/rop-por/rapports-reports/documents/comiteenligne-panelonline-eng.pdf (accessed February 13, 2014).
35. Rodgers J. L.The bootstrap, the jackknife, and the randomization test: A sampling taxonomy.Multivariate Behavioral Research. 1999;34:441-56
36. Salganik M.Variance estimation, design effects, and sample size calculations for respondent-driven sampling.Journal of Urban Health. 2006;83:98-112
37. Salganik M. J.,Heckathorn D. D.Sampling and estimation in hidden populations using respondent-driven sampling.Sociological Methodology. 2004;34:193-240
38. Sifaneck S. J.,Neaigus A.The ethnographic accessing, sampling and screening of hidden populations: Heroin sniffers in New York City.Addiction Research and Theory. 2001;9:519-43
39. Smith S. M.,Albaum G. S.Fundamentals of marketing research. London: Sage; 2005:
40. StaffordJ.DegenhardtL.AgaliotisM.ChanteloupF. 2005. Australian trends in ecstasy and related drug markets 2004. Findings from the Party Drugs Initiative (PDI). Sydney, Australia: National Drug and Alcohol Research Centre, University of New South Wales. http://ndarc.med.unsw.edu.au/resource/ecstasy-and-related-drugs-reporting-system-edrs-national-report-2004 (accessed February 13, 2014).
41. Sterne J. A. C.Meta-analysis in stata: An updated collection from the stata journal. College Station, TX: Stata Press; 2009:
42. Topp L.,Barker B.,Degenhardt L.The external validity of results derived from ecstasy users recruited using purposive sampling strategies.Drug and Alcohol Dependence. 2004;73:33-40
43. Topp L.,Breen C.,Kaye S.,Darke S.NSW party drug trends 2001. Findings of the Illicit Drug Reporting System (IDRS) party drugs module. Sydney, Australia: National Drug and Alcohol Research Centre, University of New South Wales; 2002:
44. Wang J.,Carlson R. G.,Falck R. S.,Siegal H. A.,Rahman A.,Li L.Respondent-driven sampling to recruit MDMA users: A methodological assessment.Drug and Alcohol Dependence. 2005;78:147-57
45. Wejnert C.,Heckathorn D. D.Web-based network sampling: Efficiency and efficacy of respondent-driven sampling for online research.Sociological Methods and Research. 2008;37:105-34
46. Williamson G. R.Misrepresenting random sampling? A systematic review of research papers in the Journal of Advanced Nursing.Journal of Advanced Nursing. 2003;44:278-88
47. Zhao J.,Stockwell T. I. M.,Macdonald S.Non-response bias in alcohol and drug population surveys.Drug and Alcohol Review. 2009;28:648-57