Advertising for Cognitive Interviews: A Comparison of Facebook, Craigslist, and Snowball Recruiting

Social Science Computer Review

Volumn 34, Issue 3, 2016, Pages 360-377

  Head, Brian F ^a   Dean, Elizabeth ^a   Flanigan, Timothy ^a   Swicegood, Jodi ^a   Keating, Michael D ^a  

^a RTI INTERNATIONAL   (United States)

Author keywords

cognitive interview; Craigslist; Facebook; online classified advertisements; professional participants; Second Life; social media; study recruitment

Indexed keywords

EID: 84966553367     PISSN: 08944393     EISSN: 15528286     Source Type: Journal    
DOI: 10.1177/0894439315578240     Document Type: Article

References (49)

1. S.AndersonS.WanderseeA.ArcenasL.Baumgartner (2013). Craigslist samples of convenience: Recruiting hard-to-reach populations. Unpublished paper. Retrieved fromhttp://fiesta.bren.ucsb.edu/˜sanderson/CraigslistSurvey.pdf
2. W.J.Au (2013). Second Life turns 10: What it did wrong, and why it may have its own Second Life. [Web log comment]. Retrieved fromhttp://gigaom.com/2013/06/23/second-life-turns-10-what-it-did-wrong-and-why-it-will-have-its-own-second-life/
3. J.BlairP.D.Brick (2009). Current practices in cognitive interviewing. Paper presented at the Annual Conference of the American Association for Public Opinion Research (AAPOR), Hollywood, FL.
4. J.BlairF.Conrad (2011). Sample size for cognitive interview pretesting. Public Opinion Quarterly, 75, 636–658.
5. J.BlairF.ConradA.C.AckermanG.Claxton (2006). The effect of sample size on cognitive interview findings. Paper presented at the American Association for Public Opinion Research Conference, Montreal, Quebec, Canada.
6. L.Bogart (1984). Strategy in advertising (2nd ed.). Chicago, IL: Crain Books.
7. R.CasparP.P.Biemer (1999). The use of cognitive laboratory interviews for estimating production survey costs and respondent burden. Proceedings of the Section on Survey Methods Research, American Statistical Association, 192–197. Retrieved fromhttp://www.amstat.org/sections/SRMS/Proceedings/
8. A.Y.ChanY.Pan (2011). The use of cognitive interviewing to explore the effectiveness of advance supplemental materials among five language groups. Field Methods, 23, 342–361.
9. J.L.ChuC.E.Snider (2013). Use of a social networking website for recruiting Canadian youth for medical research. Journal of Adolescent Health, 52, 792–794.
10. K.E.ClowK.E.James (2013). Essentials of marketing research: Putting research into practice. Thousands Oaks, CA: Sage.
11. comScore. (2012). comScore Media Metrix ranks top 50 U.S. web properties for August 2012. Retrieved fromhttp://www.comscore.com/Insights/Press_Releases/2012/9/comScore_Media_Metrix_Ranks_Top_50_US_Web_Properties_for_August_201
12. K.J.ConronB.Austin (2008). Everyone has a right to, like, check their box: Findings on a measure of gender identity from a cognitive testing study with adolescents. Journal of LGBT Health Research, 4, 1–9.
13. T.J.DeMaioJ.M.Rothgeb (1996). Cognitive interviewing techniques: In the lab and in the field. In (Eds.), Answering questions: Methodology for determining cognitive and communicative processes in survey research (pp. 177–195). San Francisco, CA: Jossey-Bass.
14. J.M.Dennis (2001). Are Internet panels creating professional respondents? A study of panel effects. Marketing Research, 13, 34–38.
15. M.DugganJ.Brenner (2013, 214). The demographics of social media users—2012, Pew Internet & American life project. Retrieved May 6, 2013, fromhttp://pewinternet.org/Reports/2013/Social-media-users/Social-Networking-Site-Users/Demo-portrait.aspx
16. Y.FennerS.M.GarlandE.E.MooreY.JayasingheA.FletcherS.N.Tabrizi,…J.D.Wark (2012). Web-based recruiting for health research using a social networking site: An exploratory study. Journal of Medical Internet Research, 14, e20.
17. G.H.FreemanJ.T.Halton (1951). Note on the exact treatment of contingency, goodness of fit and other problems of significance. Biometrika, 38, 141–149.
18. A.W.Ghent (1972). A method for exact testing of 2 × 2, 2 × 3, and 3 × 3, and other contingency tables, employing binomial coefficients. American Midland Naturalist, 88, 15–27.
19. C.M.GriloM.A.White (2011). A controlled evaluation of the distress criterion for binge eating disorder. Journal of Consulting and Clinical Psychology, 79, 509–514.
20. A.GrosskopfN.Frye (2011). Breaking it is one thing, fixing it is another: Responsibility attributions and support for the U.S. Presidency, Congress, and the Supreme Court. The Social Science Journal, 49, 24–32.
21. C.GrovA.VentuneacJ.RendinaR.H.JimenezJ.T.Parsons (2013). Recruiting men who have sex with men on Craigslist.org for face-to-face assessments: Implications for research. AIDS and Behavior, 17, 773–778.
22. M.HinsdaleE.McFarlaneS.WegerA.Schoua-GlusbergJ.Kerwin (2009). Cognitive testing of the American Community Survey content test items (Contract No. 50-YABC-2-66053 TO 13, Deliverable 19). Washington, DC: U.S. Census Bureau.
23. D.E.IrwinJ.W.VarniK.YeattsD.A.DeWalt (2009). Cognitive interviewing methodology in the development of a pediatric item bank: A patient reported outcomes measurement information system (PROMIS) study. Health and Quality of Life Outcomes, 7, 1–10.
24. S.Jones (2009, 522). Online classifieds, Pew Internet & American life project. Retrieved May 6, 2013, fromhttp://pewinternet.org/Reports/2009/7--Online-Classifieds.aspx
25. J.M.KappC.PetersD.P.Oliver (2013). Research recruitment using Facebook advertising: Big potential, big challenges. Journal of Cancer Education, 28, 134–137.
26. S.Katz-SchiavoneJ.S.LevensonA.R.Ackerman (2008). Myths and facts about sexual violence: Public perceptions and implications for prevention. Journal of Criminal Justice and Popular Culture, 15, 291–311.
27. R.Khurgin-BottB.A.Farber (2011). Patients’ disclosures about therapy: Discussing therapy with spouses, significant others, and best friends. Psychotherapy, 48, 330–335.
28. K.LevinG.B.WillisB.H.ForsythA.NorbergM.Stapleton KudelaD.StarkF.E.Thompson (2009). Using cognitive interviews to evaluate the Spanish-language translation of a dietary questionnaire. Survey Research Methods, 3, 13–25.
29. B.Lohse (2013). Facebook is an effective strategy to recruit low-income women to online nutrition education. Journal of Nutrition Education and Behavior, 45, 69–76.
30. J.McCabeA.E.TannerJ.R.Heiman (2010). The impact of gender expectations on meanings of sex and sexuality: Results from a cognitive interview study. Sex Roles, 62, 252–263.
31. P.A.MerriamY.MaB.C.OlendzkiK.L.SchneiderW.LiI.S.OkeneS.L.Pagoto (2009). Design and methods for testing a simple dietary message to improve weight loss and dietary quality. BMC Medical Research Methodology, 9, 87.
32. K.MillerR.FitgeraldJ.L.PadillaS.WillsonS.WiddopR.Caspar,…A.Schoua-Glusberg (2011). Design and analysis of cognitive interviews for comparative multinational testing. Field Methods, 23, 379–396.
33. A.J.MorganA.F.JormA.J.Mackinnon (2013). Internet-based recruitment to a depression prevention intervention: Lessons from the Mood Memos study. Journal of Medical Internet Research, 15, e31.
34. J.MurphyM.ShaT.FlaniganL.DeanJ.MortonJ.SnodgrassJ.Ruppenkamp (2007). Using craigslist for recruiting cognitive interview respondents. Presented at the Midwest Association for Public Opinion Research Conference, Chicago, IL.
35. M.J.NolinK.Chandler (1996). Use of cognitive laboratories and recorded interviews in the National Household Education Survey (NCES 96-332). Washington, DC: U.S. Department of Education, National Center for Education Statistics.
36. L.OksenbergC.CannellG.Kalton (1991). New strategies for pretesting survey questions. Journal of Official Statistics, 7, 349–365.
37. J.J.PalamarM.V.KiangP.N.Halkitis (2011). Development and psychometric evaluation of scales that assess stigma associated with illicit drug users. Substance Use & Misuse, 46, 1457–1467.
38. L.RainieA.SmithM.Duggan (2013). Coming and going on Facebook. Report by the Pew Internet & American Life Project. Retrieved fromhttp://pewinternet.org/∼/media//Files/Reports/2013/PIP_Coming_and_going_on_facebook.pdf
39. D.E.RamoJ.J.Prochaska (2012). Broad reach and targeted recruitment using Facebook for an online survey of young adults substance use. Journal of Medical Internet Research, 14, e28.
40. E.SaleskaA.Schoua-GlusbergH.AlvardoM.Hinsdale-ShouseY.PanH.Park,…M.Yuan (2009). Recruiting respondents with limited or no English competency: Lessons learned from American Community Survey (ACS) cognitive interviews. Presentation at the International Field Directors & Technologies Conference, Santa Monica, CA, May 18, 2009.
41. ® 9.22 User’s Guide. Chi-square tests and statistics. Retrieved fromhttp://support.sas.com/documentation/cdl/en/statug/63347/HTML/default/viewer.htm#statug_freq_a0000000658.htm
42. S.SchechterJ.BlairJ.Vande Hey (1996). Conducting cognitive interviews to test self-administered and telephone surveys: Which methods should we use?Proceedings of the Section on Survey Methods Research, American Statistical Association, 1–17. Retrieved fromhttp://www.amstat.org/sections/SRMS/Proceedings/
43. R.G.ShawT.Mitchell-Olds (1993). ANOVA for unbalanced data: An overview. Ecology, 74, 1638–1645.
44. Population Estimates. (2012). United States census bureau. Population Division. Retrieved January 6, 2014, fromhttp://www.census.gov/popest/data/metro/totals/2012/index.html
45. S.Van De WalleG.G.Van Ryzin (2011). The order of questions in a survey on citizen satisfaction with public services: Lessons from a Split-ballot experiment. Public Administration, 89, 1436–1450.
46. G.B.Willis (1999). Cognitive interviewing: A ‘how to’ guide. Rockville, MD: Research Triangle Institute. Retrieved November 30, 2012, fromhttp://www.appliedresearch.cancer.gov/areas/cognitive/interview.pdf
47. G.B.Willis (2005). Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage.
48. G.B.WillisD.LawrenceF.ThompsonM.KudelaK.LevinK.Miller (2005). The use of cognitive interviewing to evaluate translated survey questions: Lessons learned. Proceedings of the Federal Committee on Statistical Methodology Research conference. November 14–16, 2005. Arlington, VA.
49. K.Zickuhr (2010, 1216). Generations 2010, Pew Internet & American life project. Retrieved fromhttp://www.pewinternet.org/∼/media/Files/Reports/2010/PIP_Generations_and_Tech10.pdf