Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation

IEEE Transactions on Medical Imaging

Volumn 35, Issue 5, 2016, Pages 1170-1181

  Roth, Holger R ^a   Lu, Le ^a   Liu, Jiamin ^a   Yao, Jianhua ^a   Seff, Ari ^a   Cherry, Kevin ^a   Kim, Lauren ^a   Summers, Ronald M ^a  

^a NATIONAL INSTITUTES OF HEALTH   (United States)

Author keywords

artificial neural networks; computed tomography; Computer aided diagnosis; deep learning; machine learning; medical diagnostic imaging; multi layer neural network; object detection

Indexed keywords

ARTIFICIAL INTELLIGENCE; BODY FLUIDS; COMPUTER AIDED INSTRUCTION; COMPUTER NETWORKS; COMPUTERIZED TOMOGRAPHY; CONVOLUTION; DIAGNOSIS; LEARNING SYSTEMS; MEDICAL IMAGING; NETWORK LAYERS; NEURAL NETWORKS; OBJECT DETECTION; PATHOLOGY;

COLONIC POLYP DETECTION; COMPUTER AIDED DETECTION; CONVOLUTIONAL NEURAL NETWORK; DEEP LEARNING; LYMPH NODE DETECTIONS; MEDICAL DIAGNOSTIC IMAGING; SCALE TRANSFORMATION; STATE-OF-THE-ART METHODS;

COMPUTER AIDED DIAGNOSIS;

ADENOMATOUS POLYP; ADOLESCENT; ADULT; AGED; ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; BONE LESION; CHILD; COLON POLYP; COMPUTED TOMOGRAPHIC COLONOGRAPHY; COMPUTER AIDED DESIGN; COMPUTER AIDED DETECTION; CONTROLLED STUDY; DIAGNOSTIC IMAGING; FEMALE; HUMAN; LYMPH NODE METASTASIS; MAJOR CLINICAL STUDY; MALE; PROBABILITY; COMPUTER ASSISTED DIAGNOSIS; FACTUAL DATABASE; LYMPH NODE; MACHINE LEARNING; MIDDLE AGED; PROCEDURES; SPINE TUMOR; X-RAY COMPUTED TOMOGRAPHY; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; CHILD; COLONIC POLYPS; DATABASES, FACTUAL; FEMALE; HUMANS; LYMPH NODES; MACHINE LEARNING; MALE; MIDDLE AGED; NEURAL NETWORKS (COMPUTER); RADIOGRAPHIC IMAGE INTERPRETATION, COMPUTER-ASSISTED; SPINAL NEOPLASMS; TOMOGRAPHY, X-RAY COMPUTED; YOUNG ADULT;

EID: 84969916782     PISSN: 02780062     EISSN: 1558254X     Source Type: Journal    
DOI: 10.1109/TMI.2015.2482920     Document Type: Article

References (60)

1. W. H. Organization, Cancer Fact Shee N297. Geneva, Switzerland: WHO, 2014.
2. P. Msaouel, N. Pissimissis, A. Halapas, and M. Koutsilieris, "Mechanisms of bone metastasis in prostate cancer: Clinical implications," Best Practice Res. Clin. Endocrinol. Metabol., vol. 22, no. 2, pp. 341-355, 2008.
3. T. Wiese, J. Yao, J. E. Burns, and R. M. Summers, "Detection of sclerotic bone metastases in the spine using watershed algorithm and graph cut," SPIE Med. Imag., p. 831512, 2012.
4. J. E. Burns et al., "Automated detection of sclerotic metastases in the thoracolumbar spine at CT," Radiology, vol. 268, no. 1, pp. 69-78, 2013.
5. M. Hammon et al., "Automatic detection of lytic and blastic thoracolumbar spine metastases on computed tomography," Eur. Radiol., vol. 23, no. 7, pp. 1862-1870, 2013.
6. A. Seff et al., "2D view aggregation for lymph node detection using a shallow hierarchy of linear classifiers," in MICCAI. New York: Springer, 2014, pp. 544-552.
7. M. Toews and T. Arbel, "A statistical parts-based model of anatomical variability," IEEE Trans. Med. Imag., vol. 26, no. 4, pp. 497-508, Apr. 2007.
8. D. Wu et al., "Stratified learning of local anatomical context for lung nodules in CT images," in Proc. IEEE Conf. IEEE Comput. Vis. Pattern Recognit., 2010, pp. 2791-2798.
9. R. M. Summers, A. K. Jerebko, M. Franaszek, J. D. Malley, and C. D. Johnson, "Colonic polyps: Complementary role of computer-aided detection in CT colonography," Radiology, vol. 225, no. 2, pp. 391-399, 2002.
10. V. Ravesteijn et al., "Computer aided detection of polyps in CT colonography using logistic regression," IEEE Trans. Med. Imag., vol. 29, no. 1, pp. 120-131, Jan. 2010.
11. B. van Ginneken, A. Setio, C. Jacobs, and F. Ciompi, "Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans," in IEEE Int. Symp. Biomed. Imag. From Nano to Macro, 2015, pp. 286-289.
12. M. Firmino et al., "Computer-aided detection system for lung cancer in computed tomography scans: Review and future prospects," Biomed. Eng. Online, vol. 13, no. 1, p. 41, 2014.
13. H.-D. Cheng, X. Cai, X. Chen, L. Hu, and X. Lou, "Computer-aided detection and classification of microcalcifications in mammograms: A survey," Pattern Recognit., vol. 36, no. 12, pp. 2967-2991, 2003.
14. A. Krizhevsky, I. Sutskever, and G. Hinton, "Image Net classification with deep convolutional neural networks," NIPS, 2012.
15. Y. LeCun et al., "Backpropagation applied to handwritten zip code recognition," Neural Computat., vol. 1, no. 4, 1989.
16. N. Jones, "Computer science: The learning machines," Nature, vol. 505, no. 7482, pp. 146-8, 2014.
17. D. C. Ciresan, A. Giusti, L. M. Gambardella, and J. Schmidhuber, "Mitosis detection in breast cancer histology images with deep neural networks," MICCAI, 2013.
18. D. Ciresan, A. Giusti, L. M. Gambardella, and J. Schmidhuber, "Deep neural networks segment neuronal membranes in electron microscopy images," Adv. Neural Inf. Process. Syst., pp. 2843-2851, 2012.
19. A. Prasoon et al., "Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network," MICCAI, 2013.
20. H. R. Roth and L. Lu, "A new 2.5D representation for lymph node detection using random sets of deep convolutional neural network observations," in Medical Image Computing and Comput.-Assisted Intervention-MICCAI 2014, ser. Lecture Notes in Computer Science, P. Golland, N. Hata, C. Barillot, J. Hornegger, and R. Howe, Eds. New York: Springer, 2014, vol. 8673, pp. 520-527.
21. H. Roth, J. Yao, L. Lu, J. Stieger, J. Burns, and R. Summers, "Detection of sclerotic spine metastases via random aggregation of deep convolutional neural network classifications," in Recent Advances in Computational Methods and Clinical Applicant. for Spine Imaging, ser. Lecture Notes in Computational Vision and Biomechanics, J. Yao, B. Glocker, T. Klinder, and S. Li, Eds. New York: Springer International Publishing, 2015, vol. 20, pp. 3-12.
22. Q. Li, W. Cai, X. Wang, Y. Zhou, D. D. Feng, and M. Chen, "Medical image classification with convolutional neural network," ICARCV, 2014.
23. S. C. Turaga et al., "Convolutional networks can learn to generate affinity graphs for image segmentation," Neural Computat., vol. 22, no. 2, 2010.
24. L. Lu, M. Liu, X. Ye, S. Yu, and H. Huang, "Coarse-to-fine classification via parametric and nonparametric models for computer-aided diagnosis," in Proc. ACM Conf. CIKM, 2011, pp. 2509-2512.
25. K. M. Cherry, S. Wang, E. B. Turkbey, and R. M. Summers, "Abdominal lymphadenopathy detection using random forest," SPIE Med. Imag., 2014.
26. J. Liu et al., "Mediastinal lymph node detection on thoracic CT scans using spatial prior from multi-atlas label fusion," SPIE Med. Imag., 2014.
27. R. M. Summers et al., "Computed tomographic virtual colonoscopy computer-aided polyp detection in a screening population," Gastroenterology, vol. 129, no. 6, pp. 1832-1844, 2005.
28. L. Wan, M. Zeiler, S. Zhang, Y. L. Cun, and R. Fergus, "Regularization of neural networks using Drop Connect," in Proc. Int. Conf. Mach. Learn., 2013.
29. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. R. Salakhutdinov, "Improving neural networks by preventing co-adaptation of feature detectors," ArXiv Preprint ArXiv:1207.0580, 2012.
30. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting," J. Mach. Learn. Res., vol. 15, no. 1, pp. 1929-1958, Jan. 2014.
31. A. Krizhevsky, "One weird trick for parallelizing convolutional neural networks," ArXiv Preprint ArXiv:1404.5997, 2014.
32. S. B. Göktürk et al., "A statistical 3-D pattern processing method for computer-aided detection of polyps in CT colonography," IEEE Trans. on Med. Imag., vol. 20, no. 12, pp. 1251-1260, Dec. 2001.
33. T. Wiese, J. Burns, J. Yao, and R. M. Summers, "Computer-aided detection of sclerotic bone metastases in the spine using watershed algorithm and support vector machines," in Proc. IEEE Int. Symp. Biomed. Imag. From Nano to Macro, 2011, pp. 152-155.
34. J. Yao, S. D. O'Connor, and R. M. Summers, "Automated spinal column extraction and partitioning," in Proc. IEEE Int. Symp. IEEE Biomed. Imag., Nano to Macro, 2006, pp. 390-393.
35. J. Yao, S. D. O'Connor, and R. Summers, "Computer aided lytic bone metastasis detection using regular CT images," in Proc. SPIE Med. Imag., 2006, p. 614459.
36. J. Yao, R. M. Summers, and A. K. Hara, "Optimizing the support vector machines (SVM) committee configuration in a colonic polyp CAD system," in Proc. SPIE Med. Imag., 2005, pp. 384-392.
37. L. Lu, J. Bi, M. Wolf, and M. Salganicoff, "Effective 3D object detection and regression using probabilistic segmentation features in CT images," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 1049-1056.
38. G. Slabaugh, X. Yang, X. Ye, R. Boyes, and G. Beddoe, "A robust and fast system for CTC computer-aided detection of colorectal lesions," Algorithms, vol. 3, no. 1, pp. 21-43, 2010.
39. J. Yao, J. Li, and R. M. Summers, "Employing topographical height map in colonic polyp measurement and false positive reduction," Pattern Recognit., vol. 42, no. 6, pp. 1029-1040, 2009.
40. L. Lu, "Computer aided diagnosis using multilevel image features on large-scale evaluation," in Medical Comput. Vision. Large Data in Medical Imaging. New York: Springer, 2014, pp. 161-174.
41. A. Barbu, L. Bogoni, and D. Comaniciu, "Hierarchical part-based detection of 3D flexible tubes: Application to CT colonoscopy," Medical Image Computing and Comput.-Assisted Intervention-MICCAI, vol. 2, pp. 462-470, 2006.
42. L. Lu et al., "Simultaneous detection and registration for ileo-cecal valve detection in 3D CT colonography," in Proc. Eur. Conf. Comput. Vis., 2008, vol. 4, pp. 465-478.
43. L. Lu et al., "A two-level approach towards semantic colon segmentation: Removing extra-colonic findings," Medical Image Computing and Comput.-Assisted Intervention MICCAI, vol. 1, pp. 1009-1016, 2009.
44. A. Barbu et al., "Automatic detection and segmentation of lymph nodes from CT data," IEEE Trans. Med. Imag., vol. 31, no. 2, pp. 240-250, Feb. 2012.
45. J. Feulner, S. Kevin Zhou, M. Hammon, J. Hornegger, and D. Comaniciu, "Lymph node detection and segmentation in chest CT data using discriminative learning and a spatial prior," MedIA, vol. 17, no. 2, 2013.
46. Y. Nakamura et al., "Automatic abdominal lymph node detection method based on local intensity structure analysis from 3D x-ray CT images," SPIE Med. Imag., 2013.
47. C. Chang and C. Lin, "Libsvm: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, pp. 21-27, 2011.
48. V. Raykar, B. Krishnapuram, J. Bi, M. Dundar, and R. Rao, "Bayesian multiple instance learning: Automatic feature selection and inductive transfer," ICML, pp. 808-815, 2008.
49. M. Feuerstein et al., "Automatic mediastinal lymph node detection in chest CT," SPIE Med. Imag., p. 72600V, 2009.
50. K. Simonyan and A. Zisserman, "Two-stream convolutional networks for action recognition in videos," Adv. Neural Inform. Process. Syst., pp. 568-576, 2014.
51. A. Karpathy et al., "Large-scale video classification with convolutional neural networks," in Proc. IEEE Conf. CVPR, 2014, pp. 1725-1732.
52. N. Tajbakhsh, M. B. Gotway, and J. Liang, "Computer-aided pulmonary embolism detection using a novel vessel-aligned multi-planar image representation and convolutional neural networks," Proc. MICCAI, 2015.
53. W. Shen, M. Zhou, F. Yang, C. Yang, and J. Tian, "Multi-scale convolutional neural networks for lung nodule classification," Inform. Process. Med. Imag., 2015.
54. S. Park, M. Lee, and N. Kwak, "Polyp detection in colonoscopy videos using deeply-learned hierarchical features," Seoul Nat. Univ., 2015.
55. N. Tajbakhsh, S. Gurudu, and J. Liang, "A comprehensive computeraided polyp detection system for colonoscopy videos," Inf. Process. Med. Imag., 2015.
56. C. D. Johnson et al., "Accuracy of CT colonography for detection of large adenomas and cancers," N. Eng. J. Med., vol. 359, no. 12, pp. 1207-1217, 2008.
57. J. Yosinski, J. Clune, Y. Bengio, and H. Lipson, "How transferable are features in deep neural networks?," Adv. Neural Inform. Process. Syst., pp. 3320-3328, 2014.
58. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 580-587.
59. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," ArXiv Preprint ArXiv:1409.1556, 2014.
60. C. Szegedy et al., "Going deeper with convolutions," CoRR Abs/1409. 4842, 2014.