Crowdsourcing malaria parasite quantification: An online game for analyzing images of infected thick blood smears

Journal of Medical Internet Research

Volumn 14, Issue 6, 2012, Pages

  Luengo Oroz, Miguel Angel ^a,b   Arranz, Asier ^c   Frean, John ^d,e  

^a UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^b BIOMATERIALES Y NANOMEDICINA CIBER BBN   (Spain)

^c Nebutek Soluciones SL   (Spain)

^d NATIONAL INSTITUTE FOR COMMUNICABLE DISEASES   (South Africa)

^e UNIVERSITY OF THE WITWATERSRAND   (South Africa)

Author keywords

Crowdsourcing; Games for health; Image analysis; Malaria; Telepathology

Indexed keywords

ANIMAL; ARTICLE; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; CROWDSOURCING; ISOLATION AND PURIFICATION; PLASMODIUM FALCIPARUM; RANDOMIZED CONTROLLED TRIAL;

ANIMALS; CROWDSOURCING; PLASMODIUM FALCIPARUM;

EID: 84872434718     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.2338     Document Type: Article

References (36)

1. Thompson K. All hands on deck. Sci Am 2012 Feb;306(2):56-59. [Medline: 22295679].
2. Lintott C, Schawinski K, Slosar A, Land K, Bamford S. Galaxy zoo: morphologies derived from visual inspection of galaxies from the sloan digital sky survey. Monthly Notices of the Royal Astronomical Society 2008;389:1179-1189. [doi: 10.4401/ag-5324].
3. Abt C. Serious Games. Lanham, MD: University Press of America; 1987.
4. Deterding S, Dixon D, Khaled R, Nacke L. From game design elements to gamefulness: defining gamification. 2011 Sep 28 Presented at: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments; 2011; Tampere, Finland p. 9-15. [doi: 10.1145/2181037.2181040].
5. Good B, Su A. Games with a scientific purpose. Genome Biol 2011;12(12):135. [doi: 10.1186/gb-2011-12-12-135] [Medline: 22204700].
6. Nielsen M. Reinventing Discovery: The New Era of Networked Science. Princeton, NJ: Princeton University Press; 2011.
7. McGonigal J. Reality Is Broken: Why Games Make Us Better and How They Can Change the World. New York: Penguin (Non-Classics); 2011.
8. Cooper S, Khatib F, Treuille A, Barbero J, Lee J, Beenen M, et al. Predicting protein structures with a multiplayer online game. Nature 2010 Aug 5;466(7307):756-760 [FREE Full text] [doi: 10.1038/nature09304] [Medline: 20686574].
9. Eiben C, Siegel J, Bale J, Cooper S, Khatib F, Shen B, et al. Increased Diels-Alderase activity through backbone remodeling guided by Foldit players. Nat Biotechnol 2012 Feb;30(2):190-192. [doi: 10.1038/nbt.2109] [Medline: 22267011].
10. Lessl M, Bryans J, Richards D, Asadullah K. Crowd sourcing in drug discovery. Nat Rev Drug Discov 2011 Apr;10(4):241-242. [doi: 10.1038/nrd3412] [Medline: 21455221].
11. Swan M. Crowdsourced health research studies: an important emerging complement to clinical trials in the public health research ecosystem. J Med Internet Res 2012;14(2):e46 [FREE Full text] [doi: 10.2196/jmir.1988] [Medline: 22397809].
12. Barrington L, Ghosh S, Greene M, Har-Noy S, Berger J. Crowdsourcing earthquake damage assessment using remote sensing imagery. Annals of Geophysics 2012;54(6). [doi: 10.4401/ag-5324].
13. WHO Global Malaria Programme. World Malaria Report 2011. Geneva, Switzerland: World Health Organization; 2011. URL: http://www.who.int/malaria/ world-malaria-report-2011/9789241564403-eng.pdf [accessed 2012-11-27] [WebCite Cache ID 6CUNPBCwf].
14. Murray C, Rosenfeld L, Lim S, Andrews K, Foreman K, Haring D, et al. Global malaria mortality between 1980 and 2010: a systematic analysis. Lancet 2012 Feb 4;379(9814):413-431. [doi: 10.1016/S0140-6736(12)60034-8] [Medline: 22305225].
15. Shute G. The microscopic diagnosis of malaria. In: Wernsdorfer W, McGregor I, editors. Malaria: Principles and Practice of Malariology. Edinburgh: Churchill Livingstone; 1988:781-814.
16. malERA Consultative Group on Diagnoses and Diagnostics. A research agenda for malaria eradication: diagnoses and diagnostics. PLoS Med 2011;8(1):e1000396 [FREE Full text] [doi: 10.1371/journal.pmed.1000396] [Medline: 21311583].
17. Angulo J, Flandrin G. Automated detection of working area of peripheral blood smears using mathematical morphology. Anal Cell Pathol 2003;25(1):37-49. [Medline: 12590176]. (Pubitemid 36188604)
18. Luengo-Oroz M, Angulo J, Flandrin G, Klossa J. Mathematical morphology in polar-logarithmic coordinates application to erythrocyte shape analysis. In: Marques J, editor. Pattern Recognition and Image Analysis: Second Iberian Conference, IbPRIA 2005, Estoril, Portugal, June 7-9, 2005, Proceedings, Part 1 (Lecture Notes in... Pattern Recognition, and Graphics) (Pt. 1). Berlin: Springer Berlin Heidelberg; 2005:199-206. [doi: 10.1007/11492542-25].
19. Prescott W, Jordan R, Grobusch M, Chinchilli V, Kleinschmidt I, Borovsky J, et al. Performance of a malaria microscopy image analysis slide reading device. Malar J 2012;11:155 [FREE Full text] [doi: 10.1186/1475-2875-11-155] [Medline: 22559294].
20. Frean J. Reliable enumeration of malaria parasites in thick blood films using digital image analysis. Malar J 2009;8:218 [FREE Full text] [doi: 10.1186/1475-2875-8-218] [Medline: 19775454].
21. Purwar Y, Shah S, Clarke G, Almugairi A, Muehlenbachs A. Automated and unsupervised detection of malarial parasites in microscopic images. Malar J 2011;10:364 [FREE Full text] [doi: 10.1186/1475-2875-10-364] [Medline: 22165867].
22. Sio S, Sun W, Kumar S, Bin W, Tan S, Ong S, et al. MalariaCount: an image analysis-based program for the accurate determination of parasitemia. J Microbiol Methods 2007 Jan;68(1):11-18. [doi: 10.1016/j.mimet.2006.05.017] [Medline: 16837087]. (Pubitemid 46054312)
23. Tek F, Dempster A, Kale I. Computer vision for microscopy diagnosis of malaria. Malar J 2009;8:153 [FREE Full text] [doi: 10.1186/1475-2875-8-153] [Medline: 19594927].
24. Tek F, Dempster A, Kale I. Parasite detection and identification for automated thin blood film malaria diagnosis. Computer Vision and Image Understanding 2010;114:21-32. [doi: 10.1016/j.cviu.2009.08.003].
25. Mavandadi S, Dimitrov S, Feng S, Yu F, Sikora U, Yaglidere O, et al. Distributed medical image analysis and diagnosis through crowd-sourced games: a malaria case study. PLoS One 2012;7(5):e37245 [FREE Full text] [doi: 10.1371/journal.pone.0037245] [Medline: 22606353].
26. World Health Organization. Basic Malaria Microscopy: Part I. Learner's Guide. Geneva: World Health Organization; 2010.
27. Miller A, Davis G, Oden Z, Razavi M, Fateh A, Ghazanfari M, et al. Portable, battery-operated, low-cost, bright field and fluorescence microscope. PLoS One 2010;5(8):e11890 [FREE Full text] [doi: 10.1371/journal.pone.0011890] [Medline: 20694194].
28. Breslauer D, Maamari R, Switz N, Lam W, Fletcher D. Mobile phone based clinical microscopy for global health applications. PLoS One 2009;4(7):e6320 [FREE Full text] [doi: 10.1371/journal.pone.0006320] [Medline: 19623251].
29. Schmidt M, Lipson H. Distilling free-form natural laws from experimental data. Science 2009 Apr 3;324(5923):81-85 [FREE Full text] [doi: 10.1126/science.1165893] [Medline: 19342586].
30. Barrington L, Turnbull D, Lanckriet G. Game-powered machine learning. Proc Natl Acad Sci U S A 2012 Apr 24;109(17):6411-6416 [FREE Full text] [doi: 10.1073/pnas.1014748109] [Medline: 22460786].
31. Raykar V, Yu S, Zhao L, Valadez G, Florin C. Learning from crowds. The Journal of Machine Learning Research 2010;11:1297-1322 [FREE Full text] [WebCite Cache].
32. Stein J, Asman A, Landman B. Characterizing and Optimizing Rater Performance for Internet-based Collaborative Labeling. Proc Soc Photo Opt Instrum Eng 2011 Mar 3;7966 [FREE Full text] [doi: 10.1117/12.878412] [Medline: 21857775].
33. Khatib F, Cooper S, Tyka M, Xu K, Makedon I, Popovic Z, et al. Algorithm discovery by protein folding game players. Proc Natl Acad Sci U S A 2011 Nov 22;108(47):18949-18953 [FREE Full text] [doi: 10.1073/pnas.1115898108] [Medline: 22065763].
34. edX. URL: https://www.edx.org/[accessed 2012-09-03] [WebCite Cache ID 6API7u8jc].
35. Taddei F, Sasco L. Proposing measures to promote the education of creative and collaborative knowledge-builders. In: Measuring Creativity: The Book. Brussels: European Commission; 2010:369-389.
36. Tuijn C, Hoefman B, van Beijma H, Oskam L, Chevrollier N. Data and image transfer using mobile phones to strengthen microscopy-based diagnostic services in low and middle income country laboratories. PLoS One 2011;6(12):e28348 [FREE Full text] [doi: 10.1371/journal.pone.0028348] [Medline: 22194829].