Multimodal entity coreference for cervical dysplasia diagnosis

IEEE Transactions on Medical Imaging

Volumn 34, Issue 1, 2015, Pages 229-245

  Song, Dezhao ^a   Kim, Edward ^b   Huang, Xiaolei ^c   Patruno, Joseph ^d   Muñoz Avila, Héctor ^c   Heflin, Jeff ^c   Long, L Rodney ^e   Antani, Sameer ^e  

^a Research and Development   (United States)

^b Department of Computing Sciences and Center of Excellence in Enterprise Technology   (United States)

^c Lehigh University   (United States)

^d LEHIGH VALLEY HOSPITAL   (United States)

^e NATIONAL INSTITUTES OF HEALTH   (United States)

Author keywords

Cervical dysplasia; cervical image analysis; disease classification; entity coreference; patient case retrieval

Indexed keywords

ALGORITHMS; COMPUTER AIDED DIAGNOSIS; DISEASES; STATISTICAL TESTS; TESTING;

CERVICAL DYSPLASIA; CERVICAL IMAGES; COREFERENCE; DISEASE CLASSIFICATION; PATIENT CASE;

DIAGNOSIS;

ARTICLE; CANCER DIAGNOSIS; CANCER SCREENING; CLASSIFICATION ALGORITHM; DIAGNOSTIC ACCURACY; DIAGNOSTIC IMAGING; DIAGNOSTIC TEST ACCURACY STUDY; DISEASE CLASSIFICATION; FEMALE; HUMAN; HUMAN PAPILLOMAVIRUS DNA TEST; PAPANICOLAOU TEST; SENSITIVITY AND SPECIFICITY; UTERINE CERVIX DYSPLASIA; ALGORITHM; COMPUTER ASSISTED DIAGNOSIS; PATHOLOGY; PHOTOGRAPHY; PROCEDURES; UTERINE CERVICAL DYSPLASIA; UTERINE CERVIX; VIROLOGY;

ALGORITHMS; CERVIX UTERI; DIAGNOSIS, COMPUTER-ASSISTED; FEMALE; HUMAN PAPILLOMAVIRUS DNA TESTS; HUMANS; PAPANICOLAOU TEST; PHOTOGRAPHY; SENSITIVITY AND SPECIFICITY; UTERINE CERVICAL DYSPLASIA;

EID: 84937543520     PISSN: 02780062     EISSN: 1558254X     Source Type: Journal    
DOI: 10.1109/TMI.2014.2352311     Document Type: Article

References (84)

1. Atlanta: American Cancer Society "Global cancer facts and figures," 2011.
2. D. G. Ferris, "Cervicography-An adjunct to Papanicolaou screening," Am. Fam. Phys., vol. 50, pp. 363-370, 1994.
3. L. Denny, L. Kuhn, A. Pollack, H. Wainwright, and J. T. C. Wright, "Evaluation of alternative methods of cervical cancer screening for resource-poor settings," Cancer, vol. 89, pp. 826-833, 2000.
4. Am. Cancer Soc. "Cancer facts and figures," 2010.
5. Cancer facts-The pap test: Questions and answers [Online]. Available: http://www.cancer.gov/cancertopics/factsheet/detec-tion/Pap-test, 2011
6. R. Sankaranarayanan, L. Gaffikin, M. Jacob, J. Sellors, and S. Robles, "A critical assessment of screening methods for cervical neoplasia," Int. J. Gynecol. Obstetr., vol. 89, pp. 4-12, 2005.
7. C. Ferreccio, M. I. Barriga, M. Lagos, C. Ibez, H. Poggi, F. Gonzlez, S. Terrazas, H. A. Katki, F. Nez, J. Cartagena, V. Van De Wyngard, D. Viales, and J. Braes, "Screening trial of human papillomavirus for early detection of cervical cancer in Santiago, Chile," Int. J. Cancer, vol. 132, no. 4, pp. 916-923, 2013.
8. M. Arbyn, R. Sankaranarayanan, R. Muwonge, N. Keita, A. Dolo, C. G. Mbalawa, H. Nouhou, B. Sakande, R. Wesley, T. Somanathan, A. Sharma, S. Shastri, and P. Basu, "Pooled analysis of the accuracy of five cervical cancer screening tests assessed in eleven studies in Africa and India," Int. J. Cancer, vol. 123, no. 1, pp. 153-160, 2008.
9. M. Almonte, C. Ferreccio, J. L. Winkler, J. Cuzick, V. Tsu, S. Robles, R. Takahashi, and P. Sasieni, "Cervical screening by visual inspection, HPV testing, liquid-based and conventional cytology in Amazonian Peru," Int. J. Cancer, vol. 121, no. 4, pp. 796-802, 2007.
10. M.-H. Mayrand, E. Duarte-Franco, I. Rodrigues, S. D. Walter, J. Hanley, A. Ferenczy, S. Ratnam, F. Coutle, and E. L. Franco, "Human papillomavirus DNA versus Papanicolaou screening tests for cervical cancer," N. Eng. J. Med., vol. 357, no. 16, pp. 1579-1588, 2007.
11. R. Sankaranarayanan, P. Basu, R. S. Wesley, C. Mahe, N. Keita, C. C. G. Mbalawa, R. Sharma, A. Dolo, S. S. Shastri, M. Nacoulma, M. Nayama, T. Somanathan, E. Lucas, R. Muwonge, L. Frappart, and D. M. Parkin, "Accuracy of visual screening for cervical neoplasia: Results from an IARC multicentre study in India and Africa," Int. J. Cancer, vol. 110, no. 6, pp. 907-913, 2004.
12. C. Ferreccio et al., "A comparison of single and combined visual, cyto-logic, and virologic tests as screening strategies in a region at high risk of cervical cancer," Cancer Epidemiol., Biomark. Prevent., vol. 12, no. 9, pp. 815-823, Sep. 2003.
13. J. Cuzick, A. Szarewski, H. Cubie, G. Hulman, H. Kitchener, D. Luesley, E. McGoogan, U. Menon, G. Terry, R. Edwards, C. Brooks, M. Desai, C. Gie, L. Ho, I. Jacobs, C. Pickles, and P. Sasieni, "Management of women who test positive for high-risk types of human papillomavirus: The HART study," Lancet, vol. 362, no. 9399, pp. 1871-1876, 2003.
14. A. Schneider, H. Hoyer, B. Lotz, S. Leistritza, R. Khne-Heid, I. Nindl, B. Mller, J. Haerting, and M. Drst, "Screening for high-grade cervical intra-epithelial neoplasia and cancer by testing for high-risk HPV, routine cytology or colposcopy," Int. J. Cancer, vol. 89, no. 6, pp. 529-534, 2000.
15. C. V. Biscotti, A. E. Dawson, B. Dziura, L. Galup, T. Darragh, A. Rahemtulla, and L. Wills-Frank, "Assisted primary screening using the automated thinprep imaging system," Am. J. Clin. Pathol., vol. 123, no. 2, pp. 281-287, 2005.
16. D. C. Wilbur, W. S. Black-Schaffer, R. D. Luff, K. P. Abraham, C. Kemper, J. T. Molina, and W. D. Tench, "The becton dickinson fo-calpoint GS imaging system: Clinical trials demonstrate significantly improved sensitivity for the detection of important cervical lesions," Am. J. Clin. Pathol., vol. 132, no. 5, pp. 767-775, 2009.
17. E. Davey, J. d'Assuncao, L. Irwig, P. Macaskill, S. F. Chan, A. Richards, and A. Farnsworth, "Accuracy of reading liquid based cytology slides using the thinprep imager compared with conventional cytology: Prospective study," Br. Med. J., vol. 335, no. 7609, p. 31, Jul. 2007.
18. M. Arbyn, C. Bergeron, P. Klinkhamer, P. Martin-Hirsch, A. Siebers, and J. Bulten, "Liquid compared with conventional cervical cytology: A systematic review and meta-analysis," Obstet. Gynecol., vol. 111, no. 1, pp. 167-177, 2008.
19. E. P. Whitlock, K. K. Vesco, M. Eder, J. S. Lin, C. A. Senger, and B. U. Burda, "Liquid-based cytology and human papillomavirus testing to screen for cervical cancer: A systematic review for the U.S. preventive services task force," Ann. Internal Med., vol. 155, no. 10, pp. 687-697, 2011.
20. H. C. Kitchener, R. Blanks, G. Dunn, L. Gunn, M. Desai, R. Albrow, J. Mather, D. N. Rana, H. Cubie, C. Moore, R. Legood, A. Gray, and S. Moss, "Automation-assisted versus manual reading of cervical cytology (mavaric): A randomised controlled trial," Lancet Oncol., vol. 12, no. 1, pp. 56-64, 2011.
21. A. G. Siebers et al., "Comparison of liquid-based cytology with conventional cytology for detection of cervical cancer precursors: A randomized controlled trial," J. Amer. Med. Assoc., vol. 302, no. 16, pp. 1757-1764, 2009.
22. J. M. Roberts and J. K. Thurloe, "Comparative sensitivities of thinprep and Papanicolaou smear for adenocarcinoma in situ (AIS) and combined AIS/high-grade squamous intraepithelial lesion (HSIL): Comparison with HSIL," Cancer Cytopathol., vol. 111, no. 6, pp. 482-486, 2007.
23. G. Ronco, J. Cuzick, P. Pierotti, M. P. Cariaggi, P. D. Palma, C. Nal-doni, B. Ghiringhello, P. Giorgi-Rossi, D. Minucci, F. Parisio, A. Pojer, M. L. Schiboni, C. Sintoni, M. Zorzi, N. Segnan, and M. Confortini, "Accuracy of liquid based versus conventional cytology: Overall results of new technologies for cervical cancer screening: Randomised controlled trial," Br. Med. J., vol. 335, no. 7609, p. 28, 2007.
24. M. Saraiya, V. Benard, and J. Miller, "Liquid-based cytology vs conventional cytology in detecting cervical cancer," J. Am. Med. Assoc., vol. 303, no. 11, pp. 1034-1035, 2010.
25. K. Hartmann et al., "Screening for cervical cancer: Systematic evidence review," Agency Healthcare Res. Quality: U.S. Preventive Service Task Force 2002.
26. A. Stafl, "Cervicography: A new method for cervical cancer detection," Am. J. Obstet. Gynecol., vol. 139, pp. 815-825, 1981.
27. S. Gordon, G. Zimmerman, and H. Greenspan, "Image segmentation of uterine cervix images for indexing in PACS," in Prov. 17th IEEE Symp. Comput.-Based Med. Syst., 2004, pp. 298-303.
28. S. Yang, J. Guo, P. King, Y. Sriraja, S. Mitra, B. Nutter, D. Ferris, R. L. M. Schiffman, and J. Jeronimo, "A multi-spectral digital cervi-gramtm analyzer in the wavelet domain for early detection of cervical cancer," in Proc. SPIE Image Process., 2004, vol. 5370, pp. 1833-1844.
29. M. Anderson, J. Jordon, A. Morse, and F. Sharp, A Text and Atlas of Integrated Colposcopy. New York: Mosby Year Book, 1991.
30. Y. Srinivasana, D. Hernesa, B. Tulpulea, S. Yanga, J. Guoa, S. Mitraa, S. Yagneswarana, B. Nuttera, J. Jeronimob, B. Phillipsc, R. Long, and D. Ferris, "A multi-spectral digital cervigramtm analyzer in the wavelet domain for early detection of cervical cancer," in Proc. SPIE, Med. Imag., Image Process., 2005, vol. 5747.
31. D. Ferris, M. Schiffman, and L. M. S., "Cervicography for triage of women with mildly abnormal cervical cytology results," Am. J. Ob-stetr. Gynecol., vol. 185, no. 4, pp. 939-943, 2001.
32. C. Eskridge, W. Begneaud, and C. Landwehr, "Cervicography combined with repeated Papanicolaou test as triage for low-grade cyto-logic abnormalities," Obstetr. Gynecol., vol. 92, no. 3, pp. 351-355, 1998.
33. L. S. Massad, J. Jeronimo, H. A. Katki, and M. Schiffman, "The accuracy of colposcopic grading for detection of high-grade cervical in-traepithelial neoplasia," J. Lower Genital Tract Disease, vol. 13, no. 3, pp. 137-144, 2009.
34. L. S. Massad, J. Jeronimo, and M. Schiffman, "Interobserver agreement in the assessment of components of colposcopic grading," Ob-stetr. Gynecol., vol. 111, no. 6, pp. 1279-1284, 2008.
35. W. Li, J. Gu, D. Ferris, and A. Poirson, "Automated image analysis of uterine cervical images," in Proc. SPIE, 2007, vol. 6514, p. 65 142P-1.
36. G. Zimmerman-Moreno and H. Greenspan, "Automatic detection of specular reflections in uterine cervix images," in Proc. SPIE Med. Imag., 2006, vol. 6144, p. 61 446E-61 446E-9.
37. Z. Xue, S. Antani, R. Long, and G. Thoma, "Comparative performance analysis of cervix ROI extraction and specular reflection removal algorithms for uterine cervix image analysis," in Proc. SPIE, 2007, vol. 6512, pp. 4I1-4I9.
38. Q. Ji, J. Engel, and E. Craine, "Classifying cervix tissue patterns with texture analysis," Pattern Recognit., vol. 33, no. 9, pp. 1561-1574, 2000.
39. Y. Srinivasan, B. Nutter, S. Mitra, B. Phillips, and E. Sinzinger, "Classification of cervix lesions using filter bank-based texture mode," in Proc. 9th IEEE Int. Symp. Comput.-Based Med. Syst., 2006, pp. 832-840.
40. B. Apgar, G. Brotzman, and M. Spitzer, Colposcopy: Principles and Practice. Philadelphia, PA: Saunders Elsevier, 2008.
41. J. Jeronimo, L. R. Long, L. Neve, B. Michael, S. Antani, and M. Schiffman, "Digital tools for collecting data from cervigrams for research and training in colposcopy.," J. Lower Genital Tract Dis., vol. 10, no. 1, pp. 16-25, 2006.
42. R. Herrero, M. Schiffman, C. Bratti, A. Hildesheim, I. Balmaceda, and M. Sherman, "Design and methods of a population-based natural history study of cervical neoplasia in a rural province of Costa Rica: The guanacaste project," Rev. Panam. Salud. Publica., vol. 1, pp. 362-375, 1997.
43. D. Song and J. Heflin, "Domain-independent entity coreference for linking ontology instances," J. Data Inf. Quality, vol. 4, no. 2, p. 7, 2013.
44. C. Xiao, W. Wang, X. Lin, J. X. Yu, and G. Wang, "Efficient similarity joins for near-duplicate detection," ACM Trans. Database Syst., vol. 36, no. 3, pp. 15:1-15:41, Aug. 2011.
45. D. Song and J. Heflin, "Domain-independent entity coreference in RDF graphs," in Proc. 19th ACM Conf. Inf. Knowl. Manage., 2010, pp. 1821-1824.
46. D. Dey, V. S. Mookerjee, and D. Liu, "Efficient techniques for online record linkage," IEEE Trans. Knowl. Data Eng., vol. 23, no. 3, pp. 373-387, Mar. 2011.
47. D. Song and J. Heflin, "Automatically generating data linkages using a domain-independent candidate selection approach," in Proc. 10th Int. Semantic Web Conf., 2011, pp. 649-664.
48. N. Aswani, K. Bontcheva, and H. Cunningham, "Mining information for instance unification," in Proc. Int. Semantic Web Conf., 2006, pp. 329-342.
49. X. Huang, W. Wang, Z. Xue, S. Antani, L. Long, and J. Jeronimo, "Tissue classification using cluster features for lesion detection in digital cervigrams," in Proc. SPIE, 2008, vol. 6914, p. 69 141Z-1.
50. W. Wang, Y. Zhu, X. Huang, D. P. Lopresti, Z. Xue, L. R. Long, S. Antani, and G. R. Thoma, "A classifier ensemble based on performance level estimation," in Proc. 2009 IEEE Int. Symp. Biomed. Imag., From Nano to Macro, 2009, pp. 342-345.
51. E. Kim, X. Huang, G. Tan, L. R. Long, and S. Antani, "A hierarchical SVG image abstraction layer for medical imaging," in Proc. SPIE Med. Imag., 2010, vol. 7628, p. 762 809-762 809-9.
52. E. Kim, S. Antani, X. Huang, L. R. Long, and D. Demner-Fushman, "Using relevant regions in image search and query refinement for medical CBIR," in Proc. SPIE, 2011, vol. 7967, p. 796 707-796 707-8.
53. E. Kim and X. Huang, "A data driven approach to cervigram image analysis and classification," in Color Medical Image Analysis, ser. Lecture Notes in Comput. Vis. Biomechan., M. E. Celebi and G. Schaefer, Eds. Amsterdam, The Netherlands: Springer, 2013, vol. 6, pp. 1-13.
54. S. Gordon, G. Zimmerman, R. Long, S. Antani, J. Jeronimo, and H. Greenspan, "Content analysis of uterine cervix images: Initial steps towards content based indexing and retrieval of cervigrams," in Proc. SPIE, 2006, vol. 6144, p. 61 444U-61 444U-8.
55. H. Greenspan, S. Gordon, G. Zimmerman, S. Lotenberg, J. Jeronimo, S. Antani, and L. R. Long, "Automatic detection of anatomical landmarks in uterine cervix images," IEEE Trans. Med. Imag., vol. 28, no. 3, pp. 454-468, Mar. 2009.
56. A. Bosch, A. Zisserman, and X. Muñoz, "Representing shape with a spatial pyramid kernel," in Proc. 6th ACM Int. Conf. Image Video Re-triev., 2007, pp. 401-408.
57. M. Tuceryan, "Moment-based texture segmentation," Pattern Recognit. Lett., vol. 15, no. 7, pp. 659-668, 1994.
58. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001.
59. A. Friedman, "Framing pictures: The role of knowledge in automatized encoding of memory for gist," J. Exp. Psychol.: General, vol. 108, no. 3, pp. 316-355, 1979.
60. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
61. A. Divakaran, Multimedia Content Analysis: Theory and Applications. New York: Springer, 2009.
62. M. Maire, P. Arbelaez, C. Fowlkes, and J. Malik, "Using contours to detect and localize junctions in natural images," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
63. J. Shotton, J. M. Winn, C. Rother, and A. Criminisi, "TextonBoost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation," in Proc. 9th Eur. Conf. Comput. Vis., 2006, pp. 1-15.
64. T. M. Mitchell, Machine Learning, ser. McGraw Hill Series in Computer Science. New York: McGraw-Hill, 1997.
65. D. W. Aha, "Lazy learning: Special issue editorial," Artif. Intell. Rev., vol. 11, pp. 1-5, 1997.
66. T. DeSantis, N. Chakhtoura, L. Twiggs, D. Ferris, M. Lashgari, L. Flowers, M. Faupel, S. Bambot, S. Raab, and E. Wilkinson, "Spec-troscopic imaging as a triage test for cervical disease: A prospective multicenter clinical trial," J. Lower Genital Tract Disease, vol. 11, no. 1, pp. 18-24, 2007.
67. S. Chang, Y. Mirabal, E. Atkinson, D. Cox, A. Malpica, M. Follen, and R. Richards-Kortum, "Combined reflectance and fluorescence spec-troscopy for in vivo detection of cervical pre-cancer," J. Lower Genital Tract Disease, vol. 10, no. 2, p. 024031, 2005.
68. N. Thekkek and R. Richards-Kortum, "Optical imaging for cervical cancer detection: Solutions for a continuing global problem," Nature Rev. Cancer, vol. 8, no. 9, pp. 725-731, 2008.
69. S. Zhang, J. Huang, H. Li, and D. N. Metaxas, "Automatic image annotation and retrieval using group sparsity," IEEE Trans. Syst., Man, Cybern., Part B, vol. 42, no. 3, pp. 838-849, 2012.
70. P. V. Gehler and S. Nowozin, "On feature combination for multiclass object classification," in Proc. IEEE 12th Int. Conf. Comput. Vis., 2009, pp. 221-228.
71. A. Alush, H. Greenspan, and J. Goldberger, "Automated and interactive lesion detection and segmentation in uterine cervix images," IEEE Trans. Med. Imag., vol. 29, no. 2, pp. 488-501, Feb. 2010.
72. S. Y. Park, D. Sargent, R. W. Lieberman, and U. Gustafsson, "Domain-specific image analysis for cervical neoplasia detection based on conditional random fields," IEEE Trans. Med. Imag., vol. 30, no. 3, pp. 867-878, Mar. 2011.
73. Y. Yu, J. Huang, S. Zhang, C. Restif, X. Huang, and D. N. Metaxas, "Group sparsity based classification for cervigram segmentation," in Proc. 8th IEEE Int. Symp. Biomed. Imag.: From Nano to Macro, 2011, pp. 1425-1429.
74. S. Zhang, J. Huang, D. N. Metaxas, W. Wang, and X. Huang, "Discriminative sparse representations for cervigram image segmentation," in Proc. IEEE Int. Symp. Biomed. Imag., From Nano to Macro, 2010, pp. 133-136.
75. S. Gordon and H. Greenspan, "Segmentation of non-convex regions within uterine cervix images," in Proc. IEEE Int. Symp. Biomed. Imag., From Nano to Macro, 2007, pp. 312-315.
76. M. Batet, D. Sánchez, and A. Valls, "An ontology-based measure to compute semantic similarity in biomedicine," J. Biomed. Inform., vol. 44, no. 1, pp. 118-125, 2011.
77. J. Zhang and Y. Liu, "Cervical cancer detection using SVM based feature screening," in Proc. MICCAI, 2004, pp. 873-880.
78. D. Saslow et al., "American Cancer Society, American Society for Col-poscopy and Cervical Pathology, and American Society for Clinical Pathology Screening Guidelines for the Prevention and Early Detection of Cervical Cancer," CA: A Cancer J. Clin., vol. 62, no. 3, pp. 147-172, 2012.
79. ACOG Committee on Practice Bulletins-Gynecology, "Acog practice bulletin no. 109: Cervical cytology screening," Obstet. Gynecol., vol. 114, no. 6, pp. 1409-1420, 2009.
80. D. Song and J. Heflin, "A pruning based approach for scalable entity coreference," in Proc. 25th Int. Florida Artif. Intell. Res. Soc. Conf., 2012, pp. 98-103.
81. D. Song, C. G. Chute, and C. Tao, "Semantator: Annotating clinical narratives with semantic web ontologies," in Proc. AMIA Summits Transl. Sci., 2012, pp. 20-29.
82. G. K. Savova, J. J. Masanz, P. V. Ogren, J. Zheng, S. Sohn, K. K. Schuler, and C. G. Chute, "Mayo clinical text analysis and knowledge extraction system (cTAKES): Architecture, component evaluation and applications," J. Am. Med. Inform. Assoc., vol. 17, no. 5, pp. 507-513, 2010.
83. C. Tao, D. Song, D. K. Sharma, and C. G. Chute, "Semantator: Semantic annotator for converting biomedical text to linked data," J. Biomed. Inform., vol. 46, no. 5, pp. 882-893, 2013.
84. H. Xu, S. P. Stenner, S. Doan, K. B. Johnson, L. R. Waitman, and J. C. Denny, "Application of information technology: Medex: A medication information extraction system for clinical narratives," J. Amer. Med. Inf. Assoc., vol. 17, no. 1, pp. 19-24, 2010.