Using crowdsourcing technology for testing multilingual public health promotion materials

Journal of Medical Internet Research

Volumn 14, Issue 3, 2012, Pages

  Turner, Anne M ^a   Kirchhoff, Katrin ^b   Capurro, Daniel ^a,c  

^a UNIVERSITY OF WASHINGTON   (United States)

^b University of Washington   (United States)

^c PONTIFICIA UNIVERSIDAD CATÓLICA DE CHILE   (Chile)

Author keywords

Crowdsourcing; Health promotion; Limited English proficiency populations; Public health informatics

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; DENTAL PROCEDURE; FINANCIAL MANAGEMENT; HEALTH; HEALTH PROMOTION; HUMAN; INFORMATION PROCESSING; LANGUAGE; METHODOLOGY; PILOT STUDY; PUBLIC HEALTH; UNITED STATES; VALIDATION STUDY;

ADOLESCENT; ADULT; CONTRACT SERVICES; DENTAL HEALTH SERVICES; FOCUS GROUPS; HEALTH PROMOTION; HUMANS; MULTILINGUALISM; ORAL HEALTH; PILOT PROJECTS; PUBLIC HEALTH; UNITED STATES; YOUNG ADULT;

EID: 84864264138     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.2063     Document Type: Conference Paper

References (32)

1. McHorney CA, Kosinski M, Ware JE. Comparisons of the costs and quality of norms for the SF-36 health survey collected by mail versus telephone interview: results from a national survey. Med Care 1994 Jun;32(6):551-567. [Medline: 8189774]
2. Maibach E, Parrott R. Designing Health Messages: Approaches From Communication Theory and Public Health Practice. Thousand Oaks, CA: Sage Publications; 1995.
3. Knapp P, Raynor DK, Jebar AH, Price SJ. Interpretation of medication pictograms by adults in the UK. Ann Pharmacother 2005;39(7-8):1227-1233. [doi: 10.1345/aph.1E483] [Medline: 15897266] (Pubitemid 40943174)
4. Houts PS, Doak CC, Doak LG, Loscalzo MJ. The role of pictures in improving health communication: a review of research on attention, comprehension, recall, and adherence. Patient Educ Couns 2006 May;61(2):173-190. [doi: 10.1016/j.pec.2005.05.004] [Medline: 16122896]
5. Ayala GX, Elder JP, Campbell NR, Engelberg M, Olson S, Moreno C, et al. Nutrition communication for a Latino community: formative research foundations. Fam Community Health 2001 Oct;24(3):72-87. [Medline: 11563946] (Pubitemid 33602843)
6. American Community Survey. US Census Bureau. 2009. Language Spoken at Home URL: http://factfinder.census.gov/servlet/STTable?-bm=y&-bm=y&-qr- name=ACS-2009-1YR-G00-S1601&-ds-name=ACS-2009-1YR-G00-&-CONTEXT= st&-redoLog=false&-geo-id=01000US&-format=&-qrname= ACS20073YRG00S1601&-lang=en&-geoid=01000US [accessed 2011-09-19] [WebCite Cache ID 61owyreJ4]
7. Bartholomew LK. Planning Health Promotion Programs: An Intervention Mapping Approach. San Francisco, CA: John Wiley and Sons; 2006.
8. Hubley J, Copeman J. Practical health promotion. Cambridge: Polity; 2008.
9. Neuman WL. Social Research Methods: Qualitative and Quantitative Approaches. 6th edition. Boston, MA: Pearson/Allyn and Bacon; 2006.
10. Gosling SD, Vazire S, Srivastava S, John OP. Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. Am Psychol 2004;59(2):93-104. [doi: 10.1037/0003-066X.59.2.93] [Medline: 14992636] (Pubitemid 38318025)
11. Howe J. The rise of crowdsourcing. Wired 2006;14(6).
12. Whitla P. Crowdsourcing and its application in marketing activities. Contemp Manag Res 2009;5(1):15-28.
13. Marge M, Banerjee S, Rudnicky AI. Using the Amazon Mechanical Turk for transcriptions of spoken language. In: Proceedings. 2010 Presented at: International Conference on Acoustics, Speech and Signal Processing; Mar 14-19, 2010; Dallas, TX, USA.
14. Zaidan OF, Callison-Burch C. Crowdsourcing translation: professional quality from non-professionals. In: Proceedings. 2011 Presented at: 49th Annual Meeting of the Association for Computational Linguistics; June 19-24, 2011; Portland, OR, USA.
15. Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L. ImageNet: a large-scale hierarchical image database. In: Proceedings. 2009 Presented at: IEEE Computer Science Conference on Computer Vision and Pattern Recognition; June 20-25, 2009; Miami Beach, FL, USA.
16. Schmidt L. Crowdsourcing for human subjects research. 2010 Presented at: CrowdConf; Oct 4, 2010; San Francisco, CA, USA.
17. Mason W, Suri S. Conducting behavioral research on Amazon's Mechanical Turk. Behav Res Methods 2012 Mar;44(1):1-23. [doi: 10.3758/s13428-011-0124-6] [Medline: 21717266]
18. Berinsky AJ, Huber GA, Lenz GS. Using Mechanical Turk as a subject recruitment tool for experimental research. Political Analysis 2012 (forthcoming).
19. Buhrmester M, Kwang T, and Gosling SD. Amazon's Mechanical Turk: a new source of inexpensive, yet high-quality, data? Perspect Psychol Sci 2011;6(1):3-5.
20. Horton JJ, Rand DG, Zeckhauser RJ. The online laboratory: conducting experiments in a real labor market. Exp Econ 2011;14(3):399-425. [doi: 10.1007/s10683-011-9273-9]
21. Sprouse J. A validation of Amazon Mechanical Turk for the collection of acceptability judgments in linguistic theory. Behav Res Methods 2011 Mar;43(1):155-167. [doi: 10.3758/s13428-010-0039-7] [Medline: 21287108]
22. Ross J, Irani L, Silberman MS, Zaldivar A, Tomlinson B. Who are the crowdworkers?: Shifting demographics in Mechanical Turk. In: Proceedings. 2010 Presented at: 28th ACM Conference on Human Factors in Computing Systems; Apr 10-15, 2010; Atlanta, GA, USA.
23. Kittur A, Chi EH, Suh B. Crowdsourcing user studies with Mechanical Turk. 2008 Presented at: 26th Annual SIGCHI Conference on Human Factors in Computing Systems; Apr 5-10, 2008; Florence, Italy.
24. Gao H, Barbier G, Goolsby R. Harnessing the crowdsourcing power of social media for disaster response. IEEE Intell Syst 2011;26(3):10-14. [doi: 10.1109/MIS.2011.52]
25. Freifeld CC, Chunara R, Mekaru SR, Chan EH, Kass-Hout T, Ayala Iacucci A, et al. Participatory epidemiology: use of mobile phones for community-based health reporting. PLoS Med 2010;7(12):e1000376 [FREE Full text] [doi: 10.1371/journal.pmed.1000376] [Medline: 21151888]
26. Satcher D. US Department of Health and Human Services, National Institute of Dental and Craniofacial Research, National Institutes of Health. 2000. Oral Health in America: A Report of the Surgeon General (Executive Summary) URL: http://www.nidcr.nih.gov/DataStatistics/SurgeonGeneral/Report/ExecutiveSummary. htm [accessed 2012-05-15] [WebCite Cache ID 67gKQhBaY]
27. Downs JS, Holbrook MB, Sheng S, Cranor LF. Are your participants gaming the system? Screening Mechanical Turk workers. 2010 Presented at: 28th International Conference on Human Factors in Computing Systems (CHI '10); Apr 19-15, 2010; Atlanta, GA, USA.
28. Lopez MH. U.S. Hispanic country of origin counts for nation, top 30 metropolitan areas. Washington, DC: Pew Hispanic Center; 2011 May 26. URL: http://pewhispanic.org/reports/report.php?ReportID=142 [accessed 2011-09-19] [WebCite Cache ID 61p3ma71v]
29. Ipeirotis P. Social Science Research Network. 2010 Mar. Demographics of Mechanical Turk URL: http://papers.ssrn.com/sol3/papers.cfm?abstract-id=1585030 [accessed 2012-03-23] [WebCite Cache ID 66O5eIcR9]
30. Department of Health and Human Services. Guidance to federal financial assistance recipients regarding Title VI prohibition against national origin discrimination affecting limited English proficient persons. Federal Register 2003;68(153):47311-47323.
31. US Department of Health and Human Services, Office of Disease Prevention and Health Promotion. 2011. Quick Guide to Health Literacy: Strategies: Improve the Usability of Health Information URL: http://www.health.gov/communication/ literacy/quickguide/Quickguide.pdf [accessed 2011-09-19] [WebCite Cache ID 61p4IpHge]
32. Michielutte R, Bahnson J, Dignan MB, Schroeder EM. The use of illustrations and narrative text style to improve readability of a health education brochure. J Cancer Educ 1992;7(3):251-260. [doi: 10.1080/ 08858199209528176] [Medline: 1419592]