Results of the 2016 International Skin Imaging Collaboration International Symposium on Biomedical Imaging challenge: Comparison of the accuracy of computer algorithms to dermatologists for the diagnosis of melanoma from dermoscopic images

Journal of the American Academy of Dermatology

Volumn 78, Issue 2, 2018, Pages 270-277.e1

  Marchetti, Michael A ^a   Codella, Noel C F ^b   Dusza, Stephen W ^a   Gutman, David A ^c   Helba, Brian ^d   Kalloo, Aadi ^a   Mishra, Nabin ^e   Carrera, Cristina ^f   Celebi, M Emre ^g   DeFazio, Jennifer L ^a   Jaimes, Natalia ^h,i   Marghoob, Ashfaq A ^a   Quigley, Elizabeth ^a   Scope, Alon ^a,j   Yélamos, Oriol ^a   Halpern, Allan C ^a  

^a MEMORIAL SLOAN KETTERING CANCER CENTER   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

^c EMORY UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d KITWARE INC   (United States)

^e Stoecker Associates   (United States)

^f UNIVERSITY OF BARCELONA   (Spain)

^g UNIVERSITY OF CENTRAL ARKANSAS   (United States)

^h Dermatology Service   (Colombia)

ⁱ UNIVERSITY OF MIAMI MILLER SCHOOL OF MEDICINE   (United States)

^j TEL AVIV UNIVERSITY   (Israel)

more..

Author keywords

computer algorithm; computer vision; dermatologist; International Skin Imaging Collaboration; International Symposium on Biomedical Imaging; machine learning; melanoma; reader study; skin cancer

Indexed keywords

CLINICAL PRACTICE; COMPUTER HEURISTICS; CONFERENCE PAPER; CONTROLLED STUDY; CROSS-SECTIONAL STUDY; DERMATOLOGIST; DIAGNOSTIC ACCURACY; DIAGNOSTIC IMAGING; DIAGNOSTIC TEST ACCURACY STUDY; DISEASE CLASSIFICATION; EPILUMINESCENCE MICROSCOPY; HUMAN; MAJOR CLINICAL STUDY; MELANOMA; PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL; RECEIVER OPERATING CHARACTERISTIC; SENSITIVITY AND SPECIFICITY; SYMPOSIUM; ALGORITHM; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; LENTIGO; MACHINE LEARNING; NEVUS; ORGANIZATION; PATHOLOGY; SKIN TUMOR;

ALGORITHMS; CONGRESSES AS TOPIC; CROSS-SECTIONAL STUDIES; DERMATOLOGISTS; DERMOSCOPY; DIAGNOSIS, COMPUTER-ASSISTED; HUMANS; LENTIGO; MACHINE LEARNING; MELANOMA; NEVUS; ROC CURVE; SKIN NEOPLASMS;

EID: 85030173579     PISSN: 01909622     EISSN: 10976787     Source Type: Journal    
DOI: 10.1016/j.jaad.2017.08.016     Document Type: Conference Paper

References (25)

1. Marghoob, A.A., Scope, A., The complexity of diagnosing melanoma. J Invest Dermatol 129 (2009), 11–13.
2. Malvehy, J., Hauschild, A., Curiel-Lewandrowski, C., et al. Clinical performance of the Nevisense system in cutaneous melanoma detection: an international, multicentre, prospective and blinded clinical trial on efficacy and safety. Br J Dermatol 171 (2014), 1099–1107.
3. Monheit, G., Cognetta, A.B., Ferris, L., et al. The performance of MelaFind: a prospective multicenter study. Arch Dermatol 147 (2011), 188–194.
4. Brady, M.S., Oliveria, S.A., Christos, P.J., et al. Patterns of detection in patients with cutaneous melanoma. Cancer 89 (2000), 342–347.
5. Bibbins-Domingo, K., Grossman, D.C., Curry, S.J., et al. Screening for skin cancer: US Preventive Services Task Force recommendation statement. JAMA 316 (2016), 429–435.
6. Celebi, M.E., Kingravi, H.A., Uddin, B., et al. A methodological approach to the classification of dermoscopy images. Comput Med Imaging Graph 31 (2007), 362–373.
7. Iyatomi, H., Oka, H., Celebi, M.E., et al. An improved Internet-based melanoma screening system with dermatologist-like tumor area extraction algorithm. Comput Med Imaging Graph 32 (2008), 566–579.
8. Ferris, L.K., Harkes, J.A., Gilbert, B., et al. Computer-aided classification of melanocytic lesions using dermoscopic images. J Am Acad Dermatol 73 (2015), 769–776.
9. Zortea, M., Schopf, T.R., Thon, K., et al. Performance of a dermoscopy-based computer vision system for the diagnosis of pigmented skin lesions compared with visual evaluation by experienced dermatologists. Artif Intell Med 60 (2014), 13–26.
10. Blum, A., Luedtke, H., Ellwanger, U., Schwabe, R., Rassner, G., Garbe, C., Digital image analysis for diagnosis of cutaneous melanoma. Development of a highly effective computer algorithm based on analysis of 837 melanocytic lesions. Br J Dermatol 151 (2004), 1029–1038.
11. Menzies, S.W., Bischof, L., Talbot, H., et al. The performance of SolarScan: an automated dermoscopy image analysis instrument for the diagnosis of primary melanoma. Arch Dermatol 141 (2005), 1388–1396.
12. Rajpara, S.M., Botello, A.P., Townend, J., Ormerod, A.D., Systematic review of dermoscopy and digital dermoscopy/artificial intelligence for the diagnosis of melanoma. Br J Dermatol 161 (2009), 591–604.
13. Rubegni, P., Cevenini, G., Sbano, P., et al. Evaluation of cutaneous melanoma thickness by digital dermoscopy analysis: a retrospective study. Melanoma Res 20 (2010), 212–217.
14. International Skin Imaging Collaboration archive. Available at: https://isic-archive.com/. Accessed September 2, 2016.
15. International Symposium on Biomedical Imaging website. ISBI 2016: skin lesion analysis towards melanoma detection. Available at: https://challenge.kitware.com/#challenge/n/ISBI_2016%3A_Skin_Lesion_Analysis_Towards_Melanoma_Detection. Accessed September 2, 2016.
16. International Symposium on Biomedical Imaging website. ISBI 2016 challenges: International Symposium on Biomedical Imaging: from nano to macro. Available at: http://biomedicalimaging.org/2016/?page_id=416. Accessed September 2, 2016.
17. Codella, N., Nguyen, Q.B., Pankanti, S., et al. Deep learning ensembles for melanoma recognition in dermoscopy images. IBM J Res Develop, 61, 2017 Available at: https://arxiv.org/ftp/arxiv/papers/1610/1610.04662.pdf Accessed August 17, 2017.
18. Gutman D, Codella NC, Celebi E, et al. Skin lesion analysis toward melanoma detection: a challenge at the International Symposium on Biomedical Imaging (ISBI) 2016, hosted by the International Skin Imaging Collaboration (ISIC). Available at: https://arxiv.org/abs/1605.01397. Accessed August 17, 2017.
19. Scope, A., Marchetti, M.A., Marghoob, A.A., et al. The study of nevi in children: principles learned and implications for melanoma diagnosis. J Am Acad Dermatol 756 (2016), 813–823.
20. Yan, R., Fleury, M.O., Merler, M., Natsev, A., Smith, J.R., Large-scale multimedia semantic concept modeling using robust subspace bagging and MapReduce. Proceedings of the First ACM Workshop on Large-scale Multimedia Retrieval and Mining, 2009, LS-MMRM, Beijing, China.
21. Chang, C.C., Lin, C.J., LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2 (2011), 1–27.
22. Esteva, A., Kuprel, B., Novoa, R.A., et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542 (2017), 115–118.
23. Binder, M., Kittler, H., Dreiseitl, S., Ganster, H., Wolff, K., Pehamberger, H., Computer-aided epiluminescence microscopy of pigmented skin lesions: the value of clinical data for the classification process. Melanoma Res 10 (2000), 556–561.
24. Dreiseitl, S., Binder, M., Hable, K., Kittler, H., Computer versus human diagnosis of melanoma: evaluation of the feasibility of an automated diagnostic system in a prospective clinical trial. Melanoma Res 19 (2009), 180–184.
25. International Skin Imaging Collaboration 2017: skin lesion analysis towards melanoma detection. Available at: https://challenge.kitware.com/#challenge/n/ISIC_2017%3A_Skin_Lesion_Analysis_Towards_Melanoma_Detection. Accessed December 21, 2016.