Deep learning ensembles for melanoma recognition in dermoscopy images

IBM Journal of Research and Development

Volumn 61, Issue 4, 2017, Pages

  Codella, N C F ^a   Nguyen, Q B ^a   Pankanti, S ^a   Gutman, D A ^b   Helba, B ^c   Halpern, A C ^d   Smith, J R ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b EMORY UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c KITWARE INC   (United States)

^d MEMORIAL SLOAN KETTERING CANCER CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; DEEP LEARNING; DIAGNOSIS; LEARNING ALGORITHMS; LEARNING SYSTEMS; ONCOLOGY; STATISTICAL TESTS;

AUTOMATED SYSTEMS; BENCHMARK DATASETS; DERMOSCOPIC IMAGES; DERMOSCOPY IMAGES; MACHINE LEARNING APPROACHES; MELANOMA DETECTION; RECEIVER OPERATING CHARACTERISTIC CURVES; STATE-OF-THE-ART PERFORMANCE;

DERMATOLOGY;

EID: 85023165265     PISSN: 00188646     EISSN: 21518556     Source Type: Journal    
DOI: 10.1147/JRD.2017.2708299     Document Type: Article

References (51)

1. "Cancer facts & figures 2016," Amer. Cancer Soc., Atlanta, GA, USA. [Online]. Available: http://www.cancer.org/acs/groups/content/@research/documents/document/acspc-047079.pdf
2. "Melanoma research gathers momentum," Lancet, vol. 385, p. 2323, 2015. [Online]. Available: http://www.thelancet.com/pdfs/journals/lancet/PIIS0140-6736(15)61087-X.pdf
3. "US skin cancer costs rise from 2002 through 2011," Centers Disease Control Prevention, Atlanta, GA, USA, Nov. 10, 2014. [Online]. Available: http://www.cdc.gov/media/releases/2014/p1110-skin-cancer.html
4. "Melanoma of the skin statistics," Aust. Government, Cancer Australia, Surry Hills, NSW, Australia. [Online]. Available: https://melanoma.canceraustralia.gov.au/statistics
5. A.M. Forsea, V. del Marmol, E. de Vries, E. E. Bailey, and A. C. Geller, "Melanoma incidence and mortality in Europe: New estimates, persistent disparities," Br. J. Dermatol., vol. 146, no. 5, pp. 1124-1130, 2012. [Online]. Available: http://onlinelibrary.wiley.com/wol1/doi/10.1111/j.1365-2133.2012.11125.x/full
6. "Market profile of U.S. dermatologists: One key market insight report," Cegedim Relationship Manage., Bedminster, NJ, USA. [Online]. Available: http://us.imshealth.com/Marketing/GTMN/Market-Profile-of-Dermatologists.pdf
7. A. A. Abder-Rahman and T. M. Deserno, "A systematic review of automated melanoma detection in dermatoscopic images and its ground truth data," Proc. SPIE, vol. 8318, 2012, Art. no. 83181I.
8. H. Kittler, H. Pehamberger, K. Wolff, and M. Binder, "Diagnostic accuracy of dermoscopy," Lancet Oncol., vol. 3, no. 3, pp. 159-65, 2002.
9. M. Binder, M. Schwarz, A. Winkler, A. Steiner, A. Kaider, K. Wolff, and H. Pehamberger, "Epiluminescence microscopy. A useful tool for the diagnosis of pigmented skin lesions for formally trained dermatologists," Arch. Dermatol., vol. 131, no. 3, pp. 286-291, 1995.
10. "Productivity commission submission: Health workforce," Aust. Government Productivity Commission, Melbourne, VIC, Australia. [Online]. Available: http://www.pc.gov.au/inquiries/completed/health-workforce/submissions/sub104/sub104.pdf
11. K. Brown, "Shortage of dermatologists in public hospitals," Radio New Zealand, Wellington, New Zealand, Oct. 5, 2015. [Online]. Available: http://www.radionz.co.nz/news/national/286093/shortage-of-dermatologists-in-public-hospitals
12. N. K. Mishra and M. E. Celebi, "An overview of melanoma detection in dermoscopy images using image processing and machine learning," arXiv: 1601.07843, 2016. [Online]. Available: http://arxiv.org/abs/1601.07843
13. V. Stoecker, N. Mishra, R. LeAnder, R. Rader, and R. Stanley, "Automatic detection of skin cancer-Current status, path for the future," in Proc. Int. Conf. Comput. Vis. Theory Appl., 2013, pp. 504-508. [Online]. Available: https://www.researchgate.net/profile/Ryan-Rader/publication/263236282-Automatic-Detection-of-Skin-Cancer-Current-Status-Path-for-the-Future/links/00b7d53a362d31c62d000000.pdf
14. M. Fornaciali, M. Carvalho, F. V. Bittencourt, S. Avila, and E. Valle, "Towards automated melanoma screening: proper computer vision & reliable results," arXiv:1604.04024.
15. M. E. Celebi, T. Mendonca, and J. S. Marques, Dermoscopy Image Analysis. Boca Raton, FL, USA: CRC Press, 2015.
16. R. Garnavi, M. Aldeen, and J. Bailey, "Computer-aided diagnosis of melanoma using border and wavelet-based texture analysis," IEEE Trans. Inf. Technol. Biomed. vol. 16, no. 6, pp. 1239-1252, Nov. 2012.
17. H. Ganster, A. Pinz, R. Rohrer, E. Wildling, M. Binder, and H. Kittler, "Automated melanoma recognition," IEEE Trans. Med. Imag., vol. 20, no. 3, pp. 233-239, Apr. 2001.
18. O. Colot, R. Devinoy, A. Sombo, and D. deBrucq, "A colour image processing method for melanoma detection," in MICCAI 1998 (Lecture Notes in Computer Science, vol. 1496), W. M. Wells, A. C. F. Colchester, S. L. Delp, Eds. Heidelberg, Germany: Springer, 1998, p. 562.
19. M. E. Celebi, H. Iyatomi, G. Schaefer, and W. V. Stoecker, "Lesion border detection in dermoscopy images," Comput. Med. Imag. Graph., vol. 33, no. 2, pp 148-153. 2009.
20. H. Iyatomi, H. Oka, M. E. Celebi, M. Hashimoto, M. Hagiwara, M. Tanaka, and K. Ogawa, "An improved internet-based melanoma screening system with dermatologist-like tumor area extraction algorithm," Comput. Med. Imag. Graph., vol. 32, no. 7, pp. 566-579, 2008.
21. M. E. Celebi, H. Kingravi, B. Uddin, H. Iyatomi, A. Aslandogan, W. V. Stoecker, and R. H. Moss, "A methodological approach to the classification of dermoscopy images," Comput. Med. Imag. Graph., vol. 31, no. 6, pp. 362-373, 2007.
22. 2-A dermoscopic image database for research and benchmarking," in Proc. Annul. Int. Conf. IEEE Eng. Med. Biol. Soc., 2013, pp. 5437-5440.
23. C. Barata, M. Ruela, M. Francisco, T. Mendonça, and J. S. Marques, "Two systems for the detection of melanomas in dermoscopy images using texture and color features," IEEE Syst. J., vol. 8, no. 3, pp. 965-969, Sep. 2014.
24. T. F. Mendonca, P. M. Ferreira, A. R. S. Marcal, C. Barata, J. S. Marques, J. Rocha, and J. Rozeira, "PH2: A public database for the analysis of dermoscopic images," in Dermoscopy Image Analysis, M. E. Celebi, T. Mendonca, and J. S. Marques, Eds. Boca Raton, FL, USA: CRC Press, 2015, pp. 419-439.
25. G. Schaefer, B. Krawczyk, M. E. Celebi, and H. Iyatomi, "An ensemble classification approach for melanoma diagnosis," Memetic Comput., vol. 6, no. 4, pp. 233-240, 2014.
26. M. Rastgoo, O. Morel, F. Marzani, and R. Garcia, "Ensemble approach for differentiation of malignant melanoma," Proc. SPIE, vol. 9534, 2015, Art. no. 953415. [Online]. Available: http://dx.doi.org/10.1117/12.2182799
27. F. Ercal, A. Chawla, W. V. Stoecker, H-C. Lee, and R. H. Moss, "Neural network diagnosis of malignant melanoma from color images," IEEE Trans. Biomed. Eng., vol. 41, no. 9, pp. 837-845, Sep. 1994.
28. C. Marín, G. H. Alférez, J. Córdova, and V. González, "Detection of melanoma through image recognition and artificial neural networks," in World Congress on Medical Physics and Biomedical Engineering (International Federation for Medical and Biological Engineering Proceedings, vol. 51). New York, NY, USA: Springer, 2015, pp. 832-835.
29. J. A. Jaleel, S. Salim, and R. B. Aswin, "Artificial neural network based detection of skin cancer," Int. J. Adv. Res. Elect., Electron. Instrum. Eng., vol. 1, no. 3, pp. 200-205, 2012.
30. M. Binder, A. Steiner, M. Schwarz, S. Knollmayer, K. Wolff, and H. Pehamberger, "Application of an artificial neural network in epiluminescence microscopy pattern analysis of pigmented skin lesions: A pilot study," Brit. J. Dermatol., vol. 130, no. 4, pp. 460-465, 1994.
31. T. Yoshida and H. Iyatomi, "Alignment of major axis for automated melanoma diagnosis with deep learning approach," in Proc. 31st Fuzzy Syst. Symp., 2015.
32. N. Codella, J. Cai, M. Abedini, R. Garnavi, A. Halpern, and J. Smith. "Deep learning, sparse coding, and SVM for melanoma recognition in dermoscopy images," in Proc. 6th Int. Workshop Mach. Learn. Med. Imag., 2015, pp. 118-126.
33. H. Liao, "A deep learning approach to universal skin disease classification," CSC 400 Graduate Project Rep. [Online]. Available: https://www.cs.rochester.edu/u/hliao6/projects/other/skin-project-report.pdf
34. International Skin Imaging Collaboration (ISIC) Archive. [Online]. Available: https://isic-archive.com
35. D. Gutman, N. Codella, E. Celebi, B. Helba, M. Marchetti, N. Mishra, and A. Halpern, "Skin lesion analysis toward melanoma detection: A challenge at the International Symposium on Biomedical Imaging (ISBI) 2016, hosted by the International Skin Imaging Collaboration (ISIC)," arXiv:1605.01397, 2016. [Online]. Available: https://arxiv.org/abs/1605.01397
36. K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," IEEE Conf. Comput. Vis. Pattern Recognit., 2016, pp. 770-778.
37. O. Ronneberger, P. Fischer, and T. Brox, "U-net: Convolutional networks for biomedical image segmentation," in Medical Image Computing and Computer-Assisted Intervention (MICCAI) (Lecture Notes in Computer Science, vol. 9351). New York, NY, USA: Springer, 2015, pp. 234-241. [Online]. Available: http://arxiv.org/abs/1505.04597
38. J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation," arXiv:1411.4038, 2015. [Online]. Available: https://arxiv.org/abs/1411.4038
39. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 1106-1114. [Online]. Available: https://papers.nips.cc/paper/4824-imagenetclassification-with-deep-convolutional-neural-networks.pdf
40. J. R. Kender, "Separability and refinement of hierarchical semantic video labels and their ground truth," in Proc. 2008 IEEE Int. Conf. Multimedia Expo., 2008, pp. 673-676.
41. L. Brown, L. Cao, S. F. Chang, Y. Cheng, A. Choudhary, N. Codella, C. Cotton, D. Ellis, Q. Fan, R. Feris, L. Gong, M. Hill, G. Hua, J. Kender, M. Merler, Y. Mu, S. Pankanti, J. R. Smith, and F. X. Yu, "IBM research and Columbia University TRECVID-2013 multimedia event detection (MED), multimedia event recounting (MER), surveillance event detection (SED), and semantic indexing (SIN) systems," in Proceedings of the TRECVID Workshop, 2013. [Online]. Available: http://wwwnlpir.nist.gov/projects/tvpubs/tv13.papers/ibm.pdf
42. N. Codella, J. Connell, S. Pankanti, M. Merler, and J. R. Smith, "Automated medical image modality recognition by fusion of visual and text information," in MICCAI 2014, Part II (Lecture Notes in Computer Science, vol. 8674). Heidelberg, Germany: Springer, 2014, pp. 487-495.
43. C. Zhu, C. Bichot, and L. Chen, "Multi-scale color local binary patterns for visual object classes recognition," in Proc. 20th Int. Conf. Pattern Recognit., 2010, pp. 3065-3068.
44. J. Mairal, F. Bach, and J. Ponce, "Sparse modeling for image and vision processing," Found. Trends Comput. Graph. Vis., vol. 8, no. 2/3, pp. 85-283, 2014.
45. Y. JiaE. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: Convolutional architecture for fast feature embedding," arXiv:1408.509, 2014.
46. N. C. Codella, D. Gutman, S. Dusza, M. Marchetti, A. Marghoob, B. Helba, N. Mishra, A. Kalloo, and A. Halpern, "Skin lesion analysis toward melanoma detection," in Proc. Soc. Melanoma Res., 2016.
47. R. Yan, M. O. Fleury, M. Merler, A. Natsev, and J. R. Smith, "Large-scale multimedia semantic concept modeling using robust subspace bagging and MapReduce," in Proc. 1st ACM Workshop Large-Scale Multimedia Retrieval Mining, 2009, pp. 35-42.
48. P. Over, J. Fiscus, G. Sanders, D. Joy, M. Michel, G. Awad, A. F. Smeaton, and W. Kraaij "TRECVID 2013-An overview of the goals, tasks, data, evaluation mechanisms, and metrics," in Proceedings TRECVID, 2013. [Online]. Available: http://wwwnlpir.nist.gov/projects/tvpubs/tv13.papers/tv13overview.pdf
49. O. M. Parkhi, A. Vedaldi, and A. Zisserman, "Deep face recognition," in Proc. Br. Mach. Vis. Conf., 2015, pp. 41.1-41.12.
50. Y. Taigman, M. Yang, M. Ranzato, and L. Wolf, "Deepface: Closing the gap to human-level performance in face verification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 1701-1708.
51. F. Schroff, D. Kalenichenko, and J. Philbin, "Facenet: A unified embedding for face recognition and clustering," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015.