ChestX-ray8: Hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases

Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017

Volumn 2017-January, Issue , 2017, Pages 3462-3471

  Wang, Xiaosong ^a   Peng, Yifan ^b   Lu, Le ^a   Lu, Zhiyong ^b   Bagheri, Mohammadhadi ^a   Summers, Ronald M ^a  

^a CLINICAL CENTER   (United States)

^b NATIONAL INSTITUTES OF HEALTH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTER AIDED INSTRUCTION; COMPUTER VISION; DEEP LEARNING; DEEP NEURAL NETWORKS; DIAGNOSIS; HOSPITALS; MEDICAL APPLICATIONS; NATURAL LANGUAGE PROCESSING SYSTEMS; NEURAL NETWORKS; PATTERN RECOGNITION; PICTURE ARCHIVING AND COMMUNICATION SYSTEMS; X RAY ANALYSIS;

COMPUTER AIDED DIAGNOSIS(CAD); DEEP CONVOLUTIONAL NEURAL NETWORKS; IMAGING INFORMATICS; KNOWLEDGE DATABASE; LEARNING PARADIGMS; PICTURE ARCHIVING AND COMMUNICATION SYSTEMS (PACS); QUANTITATIVE RESULT; SUPERVISED CLASSIFICATION;

COMPUTER AIDED DIAGNOSIS;

EID: 85042155331     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2017.369     Document Type: Conference Paper

References (53)

1. Open-i: An open access biomedical search engine. https://openi.nlm.nih.gov. 2, 3, 4
2. S. Antol, A. Agrawal, J. Lu, M. Mitchell, D. Batra, and L. Zitnick. Vqa: Visual question answering. In ICCV, 2015. 1, 2
3. A. R. Aronson and F.-M. Lang. An overview of MetaMap: historical perspective and recent advances. Journal of the American Medical Informatics Association, 17(3):229-236, may 2010. 3
4. J. Ba, K. Swersky, S. Fidler, and R. Salakhutdinov. Predicting deep zero-shot convolutional neural networks using textual descriptions. In ICCV, 2015. 1
5. S. Bird, E. Klein, and E. Loper. Natural language processing with Python. "O'Reilly Media, Inc.", 2009. 4
6. W.W. Chapman, W. Bridewell, P. Hanbury, G. F. Cooper, and B. G. Buchanan. A simple algorithm for identifying negated findings and diseases in discharge summaries. Journal of Biomedical Informatics, 34(5):301-310, oct 2001. 3
7. E. Charniak and M. Johnson. Coarse-to-fine n-best parsing and MaxEnt discriminative reranking. In Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics (ACL), pages 173-180, 2005. 4
8. M.-C. De Marneffe and C. D. Manning. Stanford typed dependencies manual. Stanford University, apr 2015. 4
9. D. Demner-Fushman, M. D. Kohli, M. B. Rosenman, S. E. Shooshan, L. Rodriguez, S. Antani, G. R. Thoma, and C. J. McDonald. Preparing a collection of radiology examinations for distribution and retrieval. Journal of the American Medical Informatics Association, 23(2):304-310, July 2015. 4
10. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In Computer Vision and Pattern Recognition, pages 248-255. IEEE, 2009. 5
11. Q. Dou, H. Chen, L. Yu, L. Zhao, J. Qin, D. Wang, V. Mok, L. Shi, and P. Heng. Automatic detection of cerebral microbleeds from mr images via 3d convolutional neural networks. IEEE Trans. Medical Imaging, 35(5):1182-1195, 2016. 2
12. T. Durand, N. Thome, and M. Cord. Weldon: Weakly supervised learning of deep convolutional neural networks. IEEE CVPR, 2016. 5
13. M. Everingham, S. M. A. Eslami, L. J. Van Gool, C. Williams, J. Winn, and A. Zisserman. The pascal visual object classes challenge: A retrospective. International Journal of Computer Vision, pages 111(1): 98-136, 2015. 1, 2, 7
14. H. Greenspan, B. van Ginneken, and R. M. Summers. Guest editorial deep learning in medical imaging: Overview and future promise of an exciting new technique. IEEE Trans. Medical Imaging, 35(5):1153-1159, 2016. 2
15. B. Hariharan and R. Girshick. Low-shot visual object recognition. arXiv preprint arXiv:1606.02819, 2016. 5
16. M. Havaei, N. Guizard, N. Chapados, and Y. Bengio. Hemis: Hetero-modal image segmentation. In MICCAI, pages (2): 469-477. Springer, 2016. 2
17. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385, 2015. 5, 7
18. S. Hwang and H.-E. Kim. Self-transfer learning for weakly supervised lesion localization. In MICCAI, pages (2): 239-246, 2015. 5
19. S. Jaeger, S. Candemir, S. Antani, Y.-X. J. Wng, P.-X. Lu, and G. Thoma. Two public chest x-ray datasets for computeraided screening of pulmonary diseases. Quantitative Imaging in Medicine and Surgery, 4(6), 2014. 4
20. A. Jamaludin, T. Kadir, and A. Zisserman. Spinenet: Automatically pinpointing classification evidence in spinal mris. In MICCAI. Springer, 2016. 2
21. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093, 2014. 7
22. J. Johnson, A. Karpathy, and L. Fei-Fei. Densecap: Fully convolutional localization networks for dense captioning. In CVPR, 2016. 1, 2, 3
23. A. Karpathy and L. Fei-Fei. Deep visual-semantic alignments for generating image descriptions. In CVPR, 2015. 1, 2
24. R. Krishna, Y. Zhu, O. Groth, J. Johnson, K. Hata, J. Kravitz, S. Chen, Y. Kalantidis, L.-J. Li, D. A. Shamma, M. Bernstein, and L. Fei-Fei. Visual genome: Connecting language and vision using crowdsourced dense image annotations. 2016. 2, 3
25. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097-1105, 2012. 1, 5, 7
26. R. Leaman, R. Khare, and Z. Lu. Challenges in clinical natural language processing for automated disorder normalization. Journal of Biomedical Informatics, 57:28-37, 2015. 3
27. T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollr, and L. Zitnick. Microsoft coco: Common objects in context. ECCV, pages (5): 740-755, 2014. 1, 2, 7
28. D. McClosky. Any domain parsing: automatic domain adaptation for natural language parsing. Thesis, Department of Computer Science, Brown University, 2009. 4
29. P. Moeskops, J. Wolterink, B. van der Velden, K. Gilhuijs, T. Leiner, M. Viergever, and I. Isgum. Deep learning for multi-task medical image segmentation in multiple modalities. In MICCAI. Springer, 2016. 2
30. M. Oquab, L. Bottou, I. Laptev, and J. Sivic. Is object localization for free?-weakly-supervised learning with convolutional neural networks. In IEEE CVPR, pages 685-694, 2015. 5
31. P. O. Pinheiro and R. Collobert. From image-level to pixellevel labeling with convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1713-1721, 2015. 6
32. B. Plummer, L. Wang, C. Cervantes, J. Caicedo, J. Hockenmaier, and S. Lazebnik. Flickr30k entities: Collecting regionto-phrase correspondences for richer image-to-sentence models. In ICCV, 2015. 1, 2, 3
33. R. Qiao, L. Liu, C. Shen, and A. van den Hengel. Less is more: zero-shot learning from online textual documents with noise suppression. In CVPR, 2016. 1
34. O. Ronneberger, P. Fischer, and T. Brox. U-net: Convolutional networks for biomedical image segmentation. In MICCAI, pages 234-241. Springer, 2015. 2
35. H. Roth, L. Lu, A. Farag, H.-C. Shin, J. Liu, E. B. Turkbey, and R. M. Summers. Deeporgan: Multi-level deep convolutional networks for automated pancreas segmentation. In MICCAI, pages 556-564. Springer, 2015. 2
36. H. R. Roth, L. Lu, A. Seff, K. M. Cherry, J. Hoffman, S. Wang, J. Liu, E. Turkbey, and R. M. Summers. A new 2.5D representation for lymph node detection using random sets of deep convolutional neural network observations. In MICCAI, pages 520-527. Springer, 2014. 2
37. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. Berg, and L. Fei-Fei. Imagenet large scale visual recognition challenge. International Journal of Computer Vision, pages 115(3): 211-252, 2015. 1, 2
38. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, et al. Imagenet large scale visual recognition challenge. International Journal of Computer Vision, 115(3):211-252, 2015. 5
39. A. Setio, F. Ciompi, G. Litjens, P. Gerke, C. Jacobs, S. van Riel, M. Wille, M. Naqibullah, C. Snchez, and B. van Ginneken. Pulmonary nodule detection in ct images: False positive reduction using multi-view convolutional networks. IEEE Trans. Medical Imaging, 35(5):1160-1169, 2016. 2
40. H. Shin, L. Lu, L. Kim, A. Seff, J. Yao, and R. Summers. Interleaved text/image deep mining on a large-scale radiology database for automated image interpretation. Journal of Machine Learning Research, 17:1-31, 2016. 2
41. H. Shin, K. Roberts, L. Lu, D. Demner-Fushman, J. Yao, and R. Summers. Learning to read chest x-rays: Recurrent neural cascade model for automated image annotation. In CVPR, 2016. 2
42. H. Shin, H. Roth, M. Gao, L. Lu, Z. Xu, I. Nogues, J. Yao, D. Mollura, and R. Summers. Deep convolutional neural networks for computer-aided detection: Cnn architectures, dataset characteristics and transfer learnings. IEEE Trans. Medical Imaging, 35(5):1285-1298, 2016. 2
43. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014. 5, 7
44. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 1-9, 2015. 5, 7
45. M. Tapaswi, Y. Zhu, R. Stiefelhagen, A. Torralba, R. Urtasun, and S. Fidler. Movieqa: Understanding stories in movies through question-answering. In ICCV, 2015. 1
46. I. Vendrov, R. Kiros, S. Fidler, and R. Urtasun. Orderembeddings of images and language. In ICLR, 2016. 1
47. O. Vinyals, A. Toshev, S. Bengio, and D. Erhan. Show and tell: A neural image caption generator. In CVPR, pages 3156-3164, 2015. 1, 2
48. H.-J. Wilke, M. Kmin, and J. Urban. Genodisc dataset: The benefits of multi-disciplinary research on intervertebral disc degeneration. In European Spine Journal, 2016. 2
49. Q. Wu, P. Wang, C. Shen, A. Dick, and A. van den Hengel. Ask me anything: free-form visual question answering based on knowledge from external sources. In CVPR, 2016. 1, 2, 3
50. J. Yao and et al. A multi-center milestone study of clinical vertebral ct segmentation. In Computerized Medical Imaging and Graphics, pages 49(4): 16-28, 2016. 2
51. P. Young, A. Lai, M. Hodosh, and J. Hockenmaier. From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions. In TACL, 2014. 2
52. B. Zhou, A. Khosla, A. Lapedriza, A. Oliva, and A. Torralba. Learning deep features for discriminative localization. arXiv preprint arXiv:1512.04150, 2015. 5
53. Y. Zhu, O. Groth, M. Bernstein, and L. Fei-Fei. Visual7w: Grounded question answering in images. In CVPR, 2016. 1, 2, 3