Crowdsourcing: An overview and applications to ophthalmology

Current Opinion in Ophthalmology

Volumn 27, Issue 3, 2016, Pages 256-261

  Wang, Xueyang ^a   Mudie, Lucy ^a   Brady, Christopher J ^a  

^a JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

Amazon mechanical turk; Crowdsourcing; Ophthalmology

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLINICAL RESEARCH; COST BENEFIT ANALYSIS; CROWDSOURCING; DATA PROCESSING; DIABETIC RETINOPATHY; GOLD STANDARD; IMAGE ANALYSIS; IMAGE PROCESSING; INFORMATION PROCESSING; INTERRATER RELIABILITY; LANGUAGE PROCESSING; MEDICAL RESEARCH; OPHTHALMOLOGY; OPTIC DISK; OPTICAL COHERENCE TOMOGRAPHY; PRIORITY JOURNAL; PROTEIN FOLDING; PUBLIC HEALTH; RETINA IMAGE; REVIEW; SENSITIVITY AND SPECIFICITY; SEQUENCE ALIGNMENT; TELEHEALTH; EYE DISEASE; HUMAN; PROCEDURES;

CROWDSOURCING; EYE DISEASES; HUMANS; OPHTHALMOLOGY; OPTIC DISK;

EID: 84954338718     PISSN: 10408738     EISSN: 15317021     Source Type: Journal    
DOI: 10.1097/ICU.0000000000000251     Document Type: Review

References (20)

1. Brabham DC, Ribisl KM, Kirchner TR, Bernhardt JM. Crowdsourcing applications for public health. Am J Prev Med 2014; 46:179-187.
2. Brady CJ, Villanti AC, Pearson JL, et al. Rapid grading of fundus photographs for diabetic retinopathy using crowdsourcing. J Med Internet Res 2014; 16:e233.
3. Brabham DC. Crowdsourcing. MA: MIT Press; 2013.
4. Ipeirotis PG. mturk tracker. http://www.mturk-tracker.com/#/general. [Accessed 11 June 2015]
5. Ipeirotis PG. Demographics of mechanical turk. New York University; 2010; CeDER Working Paper-10-01.
6. Good BM, Nanis M, Wu C, Su A. Microtask crowdsourcing for disease mention annotation in PubMed abstracts. Pac Symp Biocomput 2015; 20:282-293.
7. Garcia Seco de Herrera A, Foncubierta-Rodríguez A, Markonis D, et al. Crowdsourcing for medical image classification. Swiss Med Inform 2014; 30
8. Maier-Hein L, Kondermann D, Ross T, et al. Crowdtruth validation: a new paradigm for validating algorithms that rely on images correspondences. Int J CARS 2015; 10:1201-1212.
9. Cooper S, Khatib F, Treuille A, et al. Predicting protein structures with a multiplayer online game. Nature 2015; 466:756-760.
10. Luengo-Oroz MA, Arranz A, Frean J. Crowdsourcing malaria parasite quantification: an online game for analyzing images of infected thick blood smears. J Med Internet Res 2012; 14:e167.
11. Waldispuhl J, Kam A, Gardner P. Crowdsourcing RNA structural alignments with an online computer game. Pac Symp Biocomput 2015; 20:330-341.
12. Kim JS, Greene MJ, Zlateski A, et al. Eyewirers Space-time wiring specificity supports direction selectivity in the retina. Nature 2014; 509:331-336.
13. White LW, Kowalewski TM, Dockter RL, et al. Crowd-sourced assessment of technical skill: a valid method for discriminating basic robotic surgery skills. J Endourol 2015; 29:1295-1301.
14. Mason W, Suri S. Conducting behavioural research on Amazon's Mechanical Turk. Behav Res Methods 2012; 44:1-23.
15. Azzam T, Harman E. Crowdsourcing for quantifying transcripts: an exploratory study. Eval Prog Plan 2015; 54:63-73.
16. Holst D, Kowalewski TM, White LW, et al. Crowd-sourced assessment of technical skills: differentiating animate surgical skills through the wisdom of crowds. J Endourol 2015; 29:1183-1188.
17. Peabody J, Miller D, Lane B, et al. Wisdom of the crowds: use of crowdsourcing to assess surgical skill of robot-assisted radical prostatectomy in a statewide surgical collaborative. J Urol 2015; 193:e655-e656.
18. Mitry D, Peto T, Hayat S, et al. Crowdsourcing as a novel technique for retinal fundus photography classification: analysis of images in the EPIC Norfolk cohort on behalf of the UK Biobank Eye and Vision Consortium. PLoS One 2013; 8:e71154.
19. Mitry D, Peto T, Hayat S, et al. Crowdsourcing as a screening tool to detect clinical features of glaucomatous optic neuropathy from digital photography. PLoS One 2015; 10:e0117401.
20. Lee AY, Tufail A. Mechanical Turk based system for macular OCT segmentation. IOVS 2014; 55:4787.