Performance of a Deep-Learning Algorithm vs Manual Grading for Detecting Diabetic Retinopathy in India

JAMA Ophthalmology

Volumn 137, Issue 9, 2019, Pages 987-993

  Gulshan, Varun ^a   Rajan, Renu P ^b   Widner, Kasumi ^a   Wu, Derek ^a   Wubbels, Peter ^c   Rhodes, Tyler ^d   Whitehouse, Kira ^c   Coram, Marc ^a   Corrado, Greg ^a   Ramasamy, Kim ^b   Raman, Rajiv ^a   Peng, Lily ^a   Webster, Dale R ^a  

^a GOOGLE INC   (United States)

^b ARAVIND EYE HOSPITAL   (India)

^c VERILY LIFE SCIENCES   (United States)

^d SANKARA NETHRALAYA   (India)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ALGORITHM; ARTICLE; AUTOMATION; DEEP LEARNING; DIABETIC MACULAR EDEMA; DIABETIC RETINOPATHY; EYE CARE; FEMALE; HUMAN; INDIA; MAJOR CLINICAL STUDY; MALE; MIDDLE AGED; OBSERVATIONAL STUDY; PRIORITY JOURNAL; PROSPECTIVE STUDY; RECEIVER OPERATING CHARACTERISTIC; SENSITIVITY AND SPECIFICITY;

EID: 85067366274     PISSN: 21686165     EISSN: None     Source Type: Journal    
DOI: 10.1001/jamaophthalmol.2019.2004     Document Type: Article

References (25)

1. Kaveeshwar SA, Cornwall J. The current state of diabetes mellitus in India. Australas Med J. 2014; 7 (1): 45-48. doi: 10.4066/AMJ.2014.1979 24567766
2. Rani PK, Raman R, Sharma V, Analysis of a comprehensive diabetic retinopathy screening model for rural and urban diabetics in developing countries. Br J Ophthalmol. 2007; 91 (11): 1425-1429. doi: 10.1136/bjo.2007.120659 17947265
3. World Health Organization. Prevention of blindness from diabetes mellitus: report of a WHO consultation in Geneva, Switzerland, 9-11 November 2005. https://www.who.int/blindness/Prevention%20of%20Blindness%20from%20Diabetes%20Mellitus-with-cover-small.pdf. Accessed May 12, 2019.
4. Narendran V, John RK, Raghuram A, Ravindran RD, Nirmalan PK, Thulasiraj RD. Diabetic retinopathy among self reported diabetics in southern India: a population based assessment. Br J Ophthalmol. 2002; 86 (9): 1014-1018. doi: 10.1136/bjo.86.9.1014 12185129
5. Namperumalsamy P, Kim R, Vignesh TP, Prevalence and risk factors for diabetic retinopathy: a population-based assessment from Theni District, south India. Br J Ophthalmol. 2009; 93 (4): 429-434. 19091856
6. Rema M, Premkumar S, Anitha B, Deepa R, Pradeepa R, Mohan V. Prevalence of diabetic retinopathy in urban India: the Chennai Urban Rural Epidemiology Study (CURES) eye study, I. Invest Ophthalmol Vis Sci. 2005; 46 (7): 2328-2333. doi: 10.1167/iovs.05-0019 15980218
7. Chakrabarti R, Harper CA, Keeffe JE. Diabetic retinopathy management guidelines. Expert Rev Ophthalmol. 2012; 7 (5): 417-439. doi: 10.1586/eop.12.52
8. Ramasamy K, Raman R, Tandon M. Current state of care for diabetic retinopathy in India. Curr Diab Rep. 2013; 13 (4): 460-468. doi: 10.1007/s11892-013-0388-6 23657764
9. Liesenfeld B, Kohner E, Piehlmeier W, A telemedical approach to the screening of diabetic retinopathy: digital fundus photography. Diabetes Care. 2000; 23 (3): 345-348. doi: 10.2337/diacare.23.3.345 10868863
10. Rachapelle S, Legood R, Alavi Y, The cost-utility of telemedicine to screen for diabetic retinopathy in India. Ophthalmology. 2013; 120 (3): 566-573. doi: 10.1016/j.ophtha.2012.09.002 23211635
11. Esteva A, Kuprel B, Novoa RA, Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017; 542: 115-118. doi: 10.1038/nature21056
12. Liu Y, Gadepalli K, Norouzi M, Detecting cancer metastases on gigapixel pathology images. http://arxiv.org/abs/1703.02442. Accessed May 12, 2019.
13. Ehteshami Bejnordi B, Veta M, Johannes van Diest P,; the CAMELYON16 Consortium. Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. JAMA. 2017; 318 (22): 2199-2210. doi: 10.1001/jama.2017.14585 29234806
14. Gulshan V, Peng L, Coram M, Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016; 316 (22): 2402-2410. doi: 10.1001/jama.2016.17216 27898976
15. Ting DSW, Cheung CY-L, Lim G, Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA. 2017; 318 (22): 2211-2223. doi: 10.1001/jama.2017.18152 29234807
16. Krause J, Gulshan V, Rahimy E, Grader variability and the importance of reference standards for evaluating machine learning models for diabetic retinopathy. Ophthalmology. 2018; 125 (8): 1264-1272. doi: 10.1016/j.ophtha.2018.01.034 29548646
17. Gargeya R, Leng T. Automated identification of diabetic retinopathy using deep learning. Ophthalmology. 2017; 124 (7): 962-969. doi: 10.1016/j.ophtha.2017.02.008 28359545
18. Burlina PM, Joshi N, Pekala M, Pacheco KD, Freund DE, Bressler NM. Automated grading of age-related macular degeneration from color fundus images using deep convolutional neural networks. JAMA Ophthalmol. 2017; 135 (11): 1170-1176. doi: 10.1001/jamaophthalmol.2017.3782 28973096
19. Abràmoff MD, Lavin PT, Birch M, Shah N, Folk JC. Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. NPJ Digital Med. 2018; 1: 39. doi: 10.1038/s41746-018-0040-6
20. American Academy of Ophthalmology. International clinical diabetic retinopathy disease severity scale, detailed table. http://www.icoph.org/dynamic/attachments/resources/diabetic-retinopathy-detail.pdf. Accessed 14 Oct, 2016.
21. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. Paper presented at the 2016 IEEE Conference on Computer Vision and Pattern Recognition; June 27-30, 2016; Las Vegas, NV. https://ieeexplore.ieee.org/document/7780677. Accessed May 12, 2019.
22. Clopper CJ, Pearson ES. The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika. 1934; 26 (4): 404-413. doi: 10.1093/biomet/26.4.404
23. Abràmoff MD, Folk JC, Han DP, Automated analysis of retinal images for detection of referable diabetic retinopathy. JAMA Ophthalmol. 2013; 131 (3): 351-357. doi: 10.1001/jamaophthalmol.2013.1743 23494039
24. Scanlon PH. Screening intervals for diabetic retinopathy and implications for care. Curr Diab Rep. 2017; 17 (10): 96. doi: 10.1007/s11892-017-0928-6 28875458
25. Wang YT, Tadarati M, Wolfson Y, Bressler SB, Bressler NM. Comparison of prevalence of diabetic macular edema based on monocular fundus photography vs optical coherence tomography. JAMA Ophthalmol. 2016; 134 (2): 222-228. doi: 10.1001/jamaophthalmol.2015.5332 26719967