Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes

JAMA - Journal of the American Medical Association

Volumn 318, Issue 22, 2017, Pages 2211-2223

  Ting, Daniel Shu Wei ^a,b   Cheung, Carol Yim Lui ^a,c   Lim, Gilbert ^b   Tan, Gavin Siew Wei ^a,b   Quang, Nguyen D ^a   Gan, Alfred ^a   Hamzah, Haslina ^a   Garcia Franco, Renata ^d   Yeo, Ian Yew San ^a,b   Lee, Shu Yen ^a,b   Wong, Edmund Yick Mun ^a,b   Sabanayagam, Charumathi ^a,b   Baskaran, Mani ^a,b   Ibrahim, Farah ^b   Tan, Ngiap Chuan ^b,e   Finkelstein, Eric A ^f   Lamoureux, Ecosse L ^a,b   Wong, Ian Y ^g   Bressler, Neil M ^h   Sivaprasad, Sobha ⁱ   Varma, Rohit ^j   Jonas, Jost B ^k   He, Ming Guang ^l   Cheng, Ching Yu ^a,b   Cheung, Gemmy Chui Ming ^a,b   Aung, Tin ^b   Hsu, Wynne ^b   Lee, Mong Li ^b   Wong, Tien Yin ^a,b   more..

^a SINGAPORE EYE RESEARCH INSTITUTE   (Singapore)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^d Centro Sur   (Mexico)

^e SINGHEALTH POLYCLINICS   (Singapore)

^f DUKE NUS MEDICAL SCHOOL   (Singapore)

^g UNIVERSITY OF HONG KONG   (Hong Kong)

^h JOHNS HOPKINS UNIVERSITY   (United States)

ⁱ MOORFIELDS EYE HOSPITAL   (United Kingdom)

^j UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^k UNIVERSITY OF HEIDELBERG   (Germany)

^l SUN YAT SEN UNIVERSITY   (China)

more..

Author keywords

[No Author keywords available]

Indexed keywords

ACCREDITATION; ADULT; AGE RELATED MACULAR DEGENERATION; AREA UNDER THE CURVE; ARTICLE; COHORT ANALYSIS; CONTROLLED STUDY; DEEP LEARNING SYSTEM; DIABETIC RETINOPATHY; DIAGNOSTIC PROCEDURE; DIAGNOSTIC TEST ACCURACY STUDY; DISEASE SEVERITY; FEMALE; GLAUCOMA; HUMAN; MACHINE LEARNING; MAJOR CLINICAL STUDY; MALE; OPHTHALMOLOGIST; OPTOMETRIST; PRIORITY JOURNAL; RETINA EXAMINATION; RETINA IMAGE; SENSITIVITY AND SPECIFICITY; STANDARD; VALIDATION PROCESS; COMPARATIVE STUDY; DIABETES MELLITUS; DIAGNOSTIC IMAGING; ETHNOLOGY; EYE DISEASE; INFORMATION PROCESSING; MIDDLE AGED; PATHOLOGY; RECEIVER OPERATING CHARACTERISTIC; RETINA; VALIDATION STUDY;

AREA UNDER CURVE; DATASETS AS TOPIC; DIABETES MELLITUS; DIABETIC RETINOPATHY; EYE DISEASES; FEMALE; GLAUCOMA; HUMANS; MACHINE LEARNING; MALE; MIDDLE AGED; RETINA; ROC CURVE; SENSITIVITY AND SPECIFICITY;

EID: 85038438910     PISSN: 00987484     EISSN: 15383598     Source Type: Journal    
DOI: 10.1001/jama.2017.18152     Document Type: Article

References (40)

1. Yau JW, Rogers SL, Kawasaki R, et al.; Meta-Analysis for Eye Disease (META-EYE) Study Group. Global prevalence and major risk factors of diabetic retinopathy. Diabetes Care. 2012; 35(3): 556-564.
2. Ting DS, Cheung GC, Wong TY. Diabetic retinopathy: global prevalence, major risk factors, screening practices and public health challenges: a review. Clin Exp Ophthalmol. 2016; 44(4):260-277.
3. Cheung N, Mitchell P, Wong TY. Diabetic retinopathy. Lancet. 2010; 376(9735):124-136.
4. Wang LZ, Cheung CY, Tapp RJ, et al. Availability and variability in guidelines on diabetic retinopathy screening in Asian countries. Br J Ophthalmol. 2017; 101(10):1352-1360.
5. Burgess PI, Msukwa G, Beare NA. Diabetic retinopathy in sub-Saharan Africa: meeting the challengesofanemerging epidemic. BMC Med. 2013; 11:157.
6. Hazin R, Colyer M, Lum F, Barazi MK. Revisiting Diabetes 2000: challenges in establishing nationwide diabetic retinopathy prevention programs. Am J Ophthalmol. 2011; 152(5):723-729.
7. Ting DS, Ng JQ, Morlet N, et al. Diabetic retinopathy managementbyAustralian optometrists. Clin Exp Ophthalmol. 2011; 39(3):230-235.
8. LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015; 521(7553):436-444.
9. Lim G, Lee ML, Hsu W, Wong TY. Transformed representations for convolutional neural networks in diabetic retinopathy screening. In: MAIHA, Workshops at the Twenty-Eighth AAAI Conference on Artificial Intelligence. 2014; 34-38.
10. Gulshan V, Peng L, Coram M, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016; 316(22): 2402-2410.
11. Gargeya R, Leng T. Automated identification of diabetic retinopathy using deep learning. Ophthalmology. 2017; 124(7):962-969.
12. Abràmoff MD, Lou Y, Erginay A, et al. Improved automated detection of diabetic retinopathy on a publicly available dataset through integration of deep learning. Invest Ophthalmol Vis Sci. 2016; 57 (13):5200-5206.
13. Wong TY, Bressler NM. Artificial intelligence with deep learning technology looks into diabetic retinopathy screening. JAMA. 2016; 316(22):2366-2367.
14. Abramoff MD, Niemeijer M, Russell SR. Automated detection of diabetic retinopathy: barriers to translation into clinical practice. Expert Rev Med Devices. 2010; 7(2):287-296.
15. Chew EY, Schachat AP. Should we add screening of age-related macular degeneration to current screening programs for diabetic retinopathy? Ophthalmology. 2015; 122(11):2155-2156.
16. Nguyen HV, Tan GS, Tapp RJ, et al. Cost-effectiveness of a national telemedicine diabetic retinopathy screening program in singapore. Ophthalmology. 2016; 123(12):2571-2580.
17. Huang OS, Tay WT, Ong PG, et al. Prevalence and determinants of undiagnosed diabetic retinopathy and vision-threatening retinopathy in a multiethnic Asian cohort: the Singapore Epidemiology of Eye Diseases (SEED) study. Br J Oph thalmol. 2015; 99(12):1614-1621.
18. Wong TY, Cheung N, Tay WT, et al. Prevalence and riskfactors for diabetic retinopathy: the Singapore Malay Eye Study. Ophthalmology. 2008; 115(11):1869-1875.
19. Shi Y, Tham YC, Cheung N, et al. Is aspirin associated with diabetic retinopathy? the Singapore Epidemiology of Eye Disease (SEED) study. PLoS One. 2017; 12(4):e0175966.
20. Chong YH, Fan Q, Tham YC, et al. Type 2 diabetes genetic variants and risk of diabetic retinopathy. Ophthalmology. 2017; 124(3):336-342.
21. Jonas JB, Xu L, Wang YX. The Beijing Eye Study. Acta Ophthalmol. 2009; 87(3):247-261.
22. Varma R. African American Eye Disease Study. National Institutes of Health website. http://grantome.com/grant/NIH/U10-EY023575-03.2017. Accessed September 25, 2017
23. Lamoureux EL, Fenwick E, Xie J, et al. Methodology and early findings of the Diabetes Management Project: a cohort study investigating the barriers to optimal diabetes care in diabetic patients with and without diabetic retinopathy. Clin Exp Ophthalmol. 2012; 40(1):73-82.
24. Tang FY, Ng DS, Lam A, et al. Determinants of quantitative optical coherence tomography angiography metrics in patients with diabetes. Sci Rep. 2017; 7(1):2575.
25. Chua J, Baskaran M, Ong PG, et al. Prevalence, risk factors, and visual features of undiagnosed glaucoma: the Singapore Epidemiology of Eye Diseases study. JAMA Ophthalmol. 2015; 133(8): 938-946.
26. Cheung CM, Li X, Cheng CY, et al. Prevalence, racial variations, and risk factors of age-related macular degeneration in Singaporean Chinese, Indians, and Malays. Ophthalmology. 2014; 121(8): 1598-1603.
27. Cheung CM, Bhargava M, Laude A, et al. Asian age-related macular degeneration phenotyping study: rationale, design and protocol of a prospective cohort study. Clin Exp Ophthalmol. 2012; 40(7):727-735.
28. Ting DSW, Yanagi Y, Agrawal R, et al. Choroidal remodeling in age-related macular degeneration and polypoidal choroidal vasculopathy: a 12-month prospective study. Sci Rep. 2017; 7(1):7868.
29. Ting DS, Ng WY, Ng SR, et al. Choroidal thickness changes in age-related macular degeneration and polypoidal choroidal vasculopathy: a 12-month prospective study. Am J Ophthalmol. 2016; 164:128-136.
30. Wilkinson CP, Ferris FL III, Klein RE, et al; Global Diabetic Retinopathy Project Group. Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales. Ophthalmology. 2003; 110(9):1677-1682.
31. Klein R, Davis MD, Magli YL, Segal P, Klein BE, Hubbard L. The Wisconsin age-related maculopathy grading system. Ophthalmology. 1991; 98(7):1128-1134.
32. Chakrabarti R, Harper CA, Keefe JE. Diabetic retinopathy management guidelines. Expert Rev Ophthalmol. 2012; 7(5):417-439. doi:10.1586/eop.12.52
33. National Health Service (NHS) Diabetic Eye Screening Programme and Population Screening Programmes. Diabetic eye screening: commission and provide. https://www.gov.uk/government/collections/diabetic-eye-screening-commission-and-provide. 2015. Accessed September 24, 2017.
34. Tufail A, Rudisill C, Egan C, et al. Automated diabetic retinopathy image assessment software: diagnostic accuracy and cost-effectiveness compared with human graders. Ophthalmology. 2017; 124(3):343-351.
35. Ting DSW, Tan GSW. Telemedicine for diabetic retinopathy screening. JAMA Ophthalmol. 2017; 135 (7):722-723.
36. Ren S, Lai H, Tong W, Aminzadeh M, Hou X, Lai S. Nonparametric bootstrapping for hierarchical data. J Appl Stat. 2010; 37(9):1487-1498. doi:10.1080/02664760903046102
37. Abràmoff MD, Niemeijer M, Suttorp-Schulten MS, Viergever MA, Russell SR, van Ginneken B. Evaluation of a system for automatic detection of diabetic retinopathy from color fundus photographs in a large population of patients with diabetes. Diabetes Care. 2008; 31(2):193-198.
38. Abràmoff MD, Reinhardt JM, Russell SR, et al. Automated early detection of diabetic retinopathy. Ophthalmology. 2010; 117(6):1147-1154.
39. Sivaprasad S, Gupta B, Crosby-Nwaobi R, Evans J. Prevalence of diabetic retinopathy in various ethnic groups: a worldwide perspective. Surv Ophthalmol. 2012; 57(4):347-370.
40. Bhargava M, Cheung CY, Sabanayagam C, et al. Accuracy of diabetic retinopathy screening by trained non-physician graders using non-mydriatic fundus camera. Singapore Med J. 2012; 53(11):715-719.