A Mathematical Framework for Combining Decisions of Multiple Experts toward Accurate and Remote Diagnosis of Malaria Using Tele-Microscopy

PLoS ONE

Volumn 7, Issue 10, 2012, Pages

  Mavandadi, Sam ^a,b   Feng, Steve ^a,b   Yu, Frank ^a,b   Dimitrov, Stoyan ^a,b   Nielsen Saines, Karin ^c   Prescott, William R ^d   Ozcan, Aydogan ^a,b,c  

^a University of California   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d Hydas World Health   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLASSIFICATION ALGORITHM; CONCEPTUAL FRAMEWORK; DIAGNOSTIC ACCURACY; DIAGNOSTIC IMAGING; ERYTHROCYTE; HUMAN; HUMAN CELL; MALARIA; MATHEMATICAL MODEL; MEDICAL DECISION MAKING; MEDICAL EXPERT; METHODOLOGY; MICROSCOPY; PROBABILITY; SIMULATION; TELEMEDICINE; TELEMICROSCOPY;

ALGORITHMS; HUMANS; MALARIA; MATHEMATICS; MICROSCOPY; MODELS, THEORETICAL; TELEMEDICINE;

EID: 84867409526     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0046192     Document Type: Article

References (34)

1. Cordella LP, Foggia P, Sansone C, Tortorella F, Vento M, (1999) Reliability parameters to improve combination strategies in multi-expert systems. Pattern Analysis & Applications 2: 205-214.
2. Jin R, Ghahramani Z (2002) Learning with multiple labels. In: Advances in Neural Information Processing Systems 15, Cambridge, MA: MIT Press. pp. 897-904.
3. Zhu X, Ghahramani Z (2002) Learning from labeled and unlabeled data with label propagation. Technical Report CMU-CALD-02-107, Carnegie Mellon University.
4. Hüllermeier E, Beringer J, (2006) Learning from ambiguously labeled examples. Intell Data Anal 10: 419-439.
5. Zhou ZH, Zhang ML (2007) Multi-instance multi-label learning with application to scene classification. In: Schölkopf B, Platt J, Hoffman T, editors, Advances in Neural Information Processing Systems 19, Cambridge, MA: MIT Press. pp. 1609-1616.
6. Dekel O, Shamir O (2009) Vox populi: Collecting high-quality labels from a crowd. In: COLT 2009- The 22nd Conference on Learning Theory.
7. Ji S, Sun L, Jin R, Ye J (2008) Multi-label multiple kernel learning. In: Advances in Neural Information Processing Systems 21, Cambridge, MA: MIT Press. pp. 777-784.
8. Cour T, Sapp B, Jordan C, Taskar B (2009) Learning from ambiguously labeled images. In: 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2009). pp. 919-926. doi:10.1109/CVPRW.2009.5206667.
9. Yan Y, Rosales R, Fung G, Dy J (2010) Modeling multiple annotator expertise in the semisupervised learning scenario. In: Proceedings of the Twenty-Sixth Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI-10). Corvallis, Oregon: AUAI Press, pp. 674-682.
10. Raykar VC, Yu S, Zhao LH, Valadez GH, Florin C, et al. (2010) Learning from crowds. J Mach Learn Res 11: 1297-1322.
11. Cour T, Sapp B, Taskar B, (2011) Learning from partial labels. J Mach Learn Res 12: 1501-1536.
12. Mulrane L, Rexhepaj E, Penney S, Callanan JJ, Gallagher WM, (2008) Automated image analysis in histopathology: a valuable tool in medical diagnostics. Expert Review of Molecular Diagnostics 8: 707-725.
13. Raykar VC, Yu S, Zhao LH, Jerebko A, Florin C, et al. (2009) Supervised learning from multiple experts: whom to trust when everyone lies a bit. In: Proceedings of the 26th Annual International Conference on Machine Learning. New York, NY, USA: ACM, ICML '09, pp. 889-896. doi:10.1145/1553374.1553488. URL http://doi.acm.org/10.1145/1553374.1553488.
14. Warfield SK, Zou KH, Wells WM, (2004) Simultaneous truth and performance level estimation (staple): An algorithm for the validation of image segmentation. IEEE Trans Med Imaging 23: 903-921.
15. Fuchs TJ, Buhmann JM, (2011) Computational pathology: Challenges and promises for tissue analysis. Computerized Medical Imaging and Graphics 35: 515-530.
16. Simonyan K, Zisserman A, Criminisi A (2011) Immediate structured visual search for medical images. In: Medical Image Computing and Computer-Assisted Intervention - MICCAI 2011, Springer Berlin/Heidelberg, volume 6893 of Lecture Notes in Computer Science. pp. 288-296.
17. Margeta J, Geremia E, Criminisi A, Ayache N (2012) Layered spatio-temporal forests for left ventricle segmentation from 4d cardiac mri data. In: Statistical Atlases and Computational Models of the Heart. Imaging and Modelling Challenges, Springer Berlin/Heidelberg, volume 7085 of Lecture Notes in Computer Science. pp. 109-119.
18. Montillo A, Shotton J, Winn J, Iglesias JE, Metaxas D, et al. (2011) Entangled decision forests and their application for semantic segmentation of ct images. In: Information Processing in Medical Imaging, Springer Berlin/Heidelberg, volume 6801 of Lecture Notes in Computer Science. pp. 184-196.
19. Iglesias JE, Konukoglu E, Montillo A, Tu Z, Criminisi A (2011) Combining generative and discriminative models for semantic segmentation of ct scans via active learning. In: Proceedings of the 22nd international conference on Information processing in medical imaging. IPMI'11, pp. 25-36.
20. Menze BH, Langs G, Tu Z, Criminisi A, editors (2011) Medical Computer Vision. Recognition Techniques and Applications in Medical Imaging- International MICCAI Workshop, MCV 2010, Beijing, China, September 20, 2010, Revised Selected Papers. Springer.
21. Prescott W, Jordan R, Grobusch M, Chinchilli V, Kleinschmidt I, et al. (2012) Performance of a malaria microscopy image analysis slide reading device. Malaria Journal 11: 155.
22. Valenstein P, (1990) Evaluating diagnostic tests with imperfect standards. American Journal of Clinical Pathology 93: 252-258.
23. Obuchowski NA, Zepp RC, (1996) Simple steps for improving multiple-reader studies in radiology. American Journal of Roentgenology 166: 517-521.
24. Hui SL, Zhou XH, (1998) Evaluation of diagnostic tests without gold standards. Statistical Methods in Medical Research 7: 354-370.
25. Hripcsak G, Kuperman GJ, Friedman C, Heitjan DF, (1999) A reliability study for evaluating information extraction from radiology reports. Journal of the American Medical Informatics Association 6: 143-150.
26. Obuchowski NA, (1996) New methodological tools for multiple-reader roc studies. Radiology 243: 10-12.
27. Reitsma JB, Rutjes AW, Khan KS, Coomarasamy A, Bossuyt PM, (2009) A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. Journal of Clinical Epidemiology 62: 797-806.
28. Jones CM, Ashrafian H, Skapinakis P, Arora S, Darzi A, et al. (1996) Diagnostic accuracy metaanalysis: A review of the basic principles of interpretation and application. International Journal of Cardiology 140: 138-144.
29. WHO World Malaria Report 2011, World Health Organization.
30. Mavandadi S, Dimitrov S, Feng S, Yu F, Sikora U, et al. (2012) Distributed medical image analysis and diagnosis through crowd-sourced games: A malaria case study. PLoS ONE 7: e37245.
31. Dempster AP, Laird NM, Rubin DB, (1977) Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society Series B (Methodological) 39: 1-38.
32. Bishop CM (2006) Pattern Recognition and Machine Learning (Information Science and Statistics). Secaucus, NJ, USA: Springer-Verlag New York, Inc.
33. Papoulis A, Pillai SU (2002) Probability, Random Variables, and Stochastic Processes. McGraw-Hill, 4th edition.
34. Amexo M, Tolhurst R, Barnish G, Bates I, (2004) Malaria misdiagnosis: e_ects on the poor and vulnerable. The Lancet 364: 1896-1898.