Cameras for public health surveillance: A methods protocol for crowdsourced annotation of point-of-sale photographs

JMIR Research Protocols

Volumn 3, Issue 2, 2014, Pages

  Ilakkuvan, Vinu ^a   Tacelosky, Michael ^b   Ivey, Keith C ^b   Pearson, Jennifer L ^c,d   Cantrell, Jennifer ^a,d   Vallone, Donna M ^a,d   Abrams, David B ^c,d,e   Kirchner, Thomas R ^c,d,e  

^a Department of Research and Evaluation Legacy ^*  (United States)

^b Survos   (United States)

^c Schroeder Institute for Tobacco Research and Policy   (United States)

^d JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

^e GEORGETOWN UNIVERSITY   (United States)

Author keywords

Annotation; Crowdsourcing; Image processing; Public health; Surveillance

Indexed keywords

EID: 84947739916     PISSN: None     EISSN: 19290748     Source Type: Journal    
DOI: 10.2196/resprot.3277     Document Type: Article

References (25)

1. Kirchner TR, Cantrell J, Anesetti-Rothermel A, Ganz O, Vallone DM, Abrams DB. Geospatial exposure to point-of-sale tobacco: Real-time craving and smoking-cessation outcomes. Am J Prev Med 2013; 45(4):379-385. [doi: 10.1016/j.amepre.2013.05.016] [Medline: 24050412]
2. Kerr J, Duncan S, Schipperijn J, Schipperjin J. Using global positioning systems in health research: A practical approach to data collection and processing. Am J Prev Med 2011; 41(5):532-540. [doi: 10.1016/j.amepre.2011.07.017] [Medline: 22011426]
3. Wang C, Burris MA. Photovoice: Concept, methodology, and use for participatory needs assessment. Health Educ Behav 1997; 24(3):369-387. [Medline: 9158980]
4. Gao H, Barbier G, Goolsby R. Harnessing the Crowdsourcing Power of Social Media for Disaster Relief. IEEE Intell. Syst 2011; 26(3):10-14. [doi: 10.1109/MIS.2011.52]
5. FEDweekIT. FEMA app aims to crowd-source emergency response.URL: http://m.fedweek.com/item-view.php?tbl=15 & ID=7 [accessed 2014-01-21] [WebCite Cache ID 6MnEtDIvq]
6. Gurrin C, Qiu Z, Hughes M, Caprani N, Doherty AR, Hodges SE, et al. The smartphone as a platform for wearable cameras in health research. Am J Prev Med 2013; 44(3):308-313. [doi: 10.1016/j.amepre.2012.11.010] [Medline: 23415130]
7. Cantrell J, Kreslake JM, Ganz O, Pearson JL, Vallone D, Anesetti-Rothermel A, et al. Marketing little cigars and cigarillos: Advertising, price, and associations with neighborhood demographics. Am J Public Health 2013; 103(10):1902-1909. [doi: 10.2105/AJPH.2013.301362] [Medline: 23948008]
8. Howe J. Wired. 2006. The rise of crowdsourcing.URL: http://www.wired.com/wired/archive/14.06/crowds.html [accessed 2014-03-28] [WebCite Cache ID 6OQ0maXNW]
9. Howe J. Crowdsourcing Blog. 2006 Jun 02. Crowdsourcing: A definition.URL: http://crowdsourcing.typepad.com/cs/2006/06/crowdsourcing_a.html [accessed 2014-01-21] [WebCite Cache ID 6MnI8V8OE]
10. Brabham DC, Ribisl KM, Kirchner TR, Bernhardt JM. Crowdsourcing applications for public health. Am J Prev Med 2014; 46(2):179-187. [doi: 10.1016/j.amepre.2013.10.016] [Medline: 24439353]
11. Rashtchian C, Young P, Hodosh M, Hockenmaier J. Collecting image annotations using Amazon's Mechanical Turk. 2010 Presented at: Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk; June 6, 2010; Los Angeles, California p. 139-147.
12. Sorokin A, Forsyth D. Utility Data Annotation with Amazon Mechanical Turk. 2008 Presented at: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops; June 24-26, 2008; Anchorage, Alaska p. 1-8. [doi: 10.1109/CVPRW.2008.4562953]
13. Luengo-Oroz MA, Arranz A, Frean J. Crowdsourcing malaria parasite quantification: An online game for analyzing images of infected thick blood smears. J Med Internet Res 2012; 14(6):e167 [FREE Full text] [doi: 10.2196/jmir.2338] [Medline: 23196001]
14. Brady CJ, Pearson JL, Villanti AC, Kirchner T, Gupta OP, Shah CP. Rapid grading of fundus photos for diabetic retinopathy using crowdsourcing. 2014 Presented at: Association for Research in Vision and Ophthalmology Annual Meeting; 2014; Orlando, FL.
15. Hipp JA, Adlakha D, Eyler AA, Chang B, Pless R. Emerging technologies: webcams and crowdsourcing to identify active transportation. Am J Prev Med 2013; 44(1):96-97. [doi: 10.1016/j.amepre.2012.09.051] [Medline: 23253658]
16. Noronha J, Hysen E, Zhang H, Gajos KZ. Platemate: Crowdsourcing Nutritional Analysis from Food Photographs. 2011 Presented at: Proceedings of the 24th Annual ACM Symposium on User Interface Software Technology; Oct 16-19, 2011; Santa Barbara, CA p. 1-12. [doi: 10.1145/2047196.2047198]
17. Amazon Mechanical Turk. 2013. FAQ - Amazon Mechanical Turk.URL: https://www.mturk.com/mturk/help?helpPage=main [accessed 2014-01-21] [WebCite Cache ID 6MnGtLYsx]
18. Amazon Mechanical Turk. 2014. Overivew of Mechanical Turk.URL: http://docs.aws.amazon.com/AWSMechTurk/latest/RequesterUI/Overviewof Mturk.html [accessed 2014-03-26] [WebCite Cache ID 6OMeH3ERE]
19. QUENOUILLE MH. Notes on bias in estimation. Biometrika 1956; 43(3-4):353-360. [doi: 10.1093/biomet/43.3-4.353]
20. Pepe MS. The Statistical Evaluation of Medical Tests for Classification and Prediction. Oxford, UK: Oxford University Press, 2004; 2004.
21. Selvin E, Steffes MW, Gregg E, Brancati FL, Coresh J. Performance of A1C for the classification and prediction of diabetes. Diabetes Care 2011; 34(1):84-89 [FREE Full text] [doi: 10.2337/dc10-1235] [Medline: 20855549]
22. Estrin D. Participatory sensing: Applications and architecture [Internet Predictions]. IEEE Internet Comput 2010; 14(1):12-42. [doi: 10.1109/MIC.2010.12]
23. Doan A, Ramakrishnan R, Halevy AY. Crowdsourcing systems on the World-Wide Web. Commun ACM 2011; 54(4):86-96. [doi: 10.1145/1924421.1924442]
24. Horton JJ, Chilton LB. The Labor Economics of Paid Crowdsourcing. 2010 Presented at: The 11th ACM conference on Electronic Commerce; June 7-11, 2010; Harvard University, Massachusetts p. 209-218.
25. Zhang Y, van der Schaar M. Reputation-Based Incentive Protocols in Crowdsourcing Applications. 2012 Presented at: IEEE International Conference on Computer Communications; March 25-30, 2012; Orlando, Florida p. 2140-2148.