A smart atlas for endomicroscopy using automated video retrieval

Medical Image Analysis

Volumn 15, Issue 4, 2011, Pages 460-476

  André, Barbara ^a,b   Vercauteren, Tom ^b   Buchner, Anna M ^c   Wallace, Michael B ^d   Ayache, Nicholas ^a  

^a INRIA   (France)

^b Mauna Kea Technologies   (France)

^c HOSPITAL OF THE UNIVERSITY OF PENNSYLVANIA   (United States)

^d MAYO CLINIC   (United States)

Author keywords

Bag of Visual Words (BoW); Content Based Video Retrieval (CBVR); Endomicroscopy; Video mosaicing

Indexed keywords

AFFINE TRANSFORMATIONS; AUTOMATED VIDEO; BAG-OF-VISUAL-WORDS; BINARY CLASSIFICATION; CANCER DIAGNOSIS; COARSE REGISTRATION; CONTENT BASED IMAGE RETRIEVAL; CONTENT-BASED VIDEO RETRIEVAL; CROSS VALIDATION; ENDOMICROSCOPY; FIELD OF VIEWS; IN-VIVO; INPLANE ROTATION; LARGE FIELD OF VIEWS; LOCAL FEATURE; MOSAIC IMAGES; MULTI-CLASS CLASSIFICATION; MULTISCALES; NEAREST NEIGHBORS; SINGLE IMAGES; SPATIAL OVERLAP; SPATIAL RELATIONSHIPS; STATE OF THE ART; STATISTICAL DESCRIPTIONS; STATISTICAL SIGNIFICANCE; TIME-CONSUMING PARTS; VIDEO RETRIEVAL; VIDEO-MOSAICING;

MEDICAL IMAGING;

IMAGE RETRIEVAL;

ARTICLE; BAG OF VISUAL WORDS; CANCER DIAGNOSIS; CONFOCAL LASER MICROSCOPY; CONTENT BASED VIDEO RETRIEVAL; DATA BASE; DIAGNOSTIC ACCURACY; DIAGNOSTIC TEST ACCURACY STUDY; HUMAN; IMAGE RETRIEVAL; IN VIVO STUDY; MAJOR CLINICAL STUDY; PRIORITY JOURNAL; SENSITIVITY AND SPECIFICITY; SPATIAL AUTOCORRELATION ANALYSIS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COLONIC POLYPS; ENDOSCOPY, GASTROINTESTINAL; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MICROSCOPY, VIDEO; MODELS, ANATOMIC; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE;

EID: 79958773258     PISSN: 13618415     EISSN: 13618423     Source Type: Journal    
DOI: 10.1016/j.media.2011.02.003     Document Type: Article

References (43)

1. Agarwal A., Triggs B. Multilevel image coding with hyperfeatures. Int. J. Comput. Vis. 2008, 78(1):15-27.
2. André, B., Vercauteren, T., Perchant, A., Wallace, M.B., Buchner, A.M., Ayache, N., 2009. Endomicroscopic image retrieval and classification using invariant visual features. In: Proc. ISBI'09, pp. 346-349.
3. André, B., Vercauteren, T., Perchant, A., Wallace, M.B., Buchner, A.M., Ayache, N., 2009. Introducing space and time in local feature-based endomicroscopic image retrieval. In: Proceedings of the MICCAI 2009 Workshop - Medical Content-based Retrieval for Clinical Decision (MCBR-CDS'09).
4. André, B., Vercauteren, T., Perchant, A., Wallace, M.B., Buchner, A.M., Ayache, N., 2010. Endomicroscopic video retrieval using mosaicing and visual words. In: Proc. ISBI'10.
5. Bay, H., Tuytelaars, T., Van Gool, L.J., 2006. SURF: speeded up robust features. In: Proc. ECCV'06, pp. 404-417.
6. Becker V., Vercauteren T., von Weyern C.H., Prinz C., Schmid R.M., Meining A. High resolution miniprobe-based confocal microscopy in combination with video-mosaicing. Gastrointest. Endosc. 2007, 66(5):1001-1007.
7. Boiman, O., Shechtman, E., Irani, M., 2008. In defense of nearest-neighbor based image classification. In: Proc. CVPR'08, pp. 1-8.
8. Buchner A.M., Ghabril M.S., Krishna M., Wolfsen H.C., Wallace M.B. High-resolution confocal endomicroscopy probe system for in vivo diagnosis of colorectal neoplasia. Gastroenterology 2008, 135(1):295.
9. Buchner A.M., Gomez V., Gill K.R., Ghabril M., Scimeca D., Shahid M.W., Achem S.R., Picco M.F., Riegert-Johnson D., Raimondo M., Wolfsen H.C., Woodward T.A., Hasan M.K., Wallace M.B. The learning curve for in vivo probe based confocal laser endomicroscopy (pCLE) for prediction of colorectal neoplasia. Gastrointest. Endosc. 2009, 69(5):AB364-AB365.
10. Buchner A.M., Shahid M.W., Heckman M.G., Krishna M., Ghabril M., Hasan M., Crook J.E., Gomez V., Raimondo M., Woodward T., Wolfsen H., Wallace M.B. Comparison of probe based confocal laser endomicroscopy with virtual chromoendoscopy for classification of colon polyps. Gastroenterology 2010, 138(7):834-842.
11. Descombes X., Morris R., Zerubia J., Berthod M. Estimation of Markov random field prior parameters using Markov chain Monte Carlo maximum likelihood. IEEE Trans. Image Process. 1999, 8(7):954-963.
12. Doyle, S., Madabhushi, A., Feldman, M.D., Tomaszeweski, J.E., 2006. A boosting cascade for automated detection of prostate cancer from digitized histology. In: Proc. MICCAI'06, pp. 504-511.
13. Dundar M., Fung G., Bogoni L., Macari M., Megibow A., Rao R.B. A methodology for training and validating a cad system and potential pitfalls. Int. J. Comput. Assisted Radiol. Surg. 2004, 1010-1014.
14. Gomez V., Buchner A.M., Dekker E., van den Broek F.J., Meining A., Shahid M.W., Ghabril M., Fockens P., Wallace M.B. Interobserver agreement and accuracy among international experts of probe-based confocal laser microscopy (pCLE) in predicting colorectal neoplasia. Gastroenterology 2009, 136(5):A-514.
15. Häfner, M., Gangl, A., Kwitt, R., Uhl, A., Vécsei, A., Wrba, F., 2009. Improving pit-pattern classification of endoscopy images by a combination of experts. In: Proc. MICCAI'09, pp. 247-254.
16. Haralick R.M. Statistical and structural approaches to texture. Proc. IEEE 1979, 67:786-804.
17. Jegou, H., Douze, M., Schmid, C., October 2008. Hamming embedding and weak geometric consistency for large scale image search. In: Proc. ECCV'08, vol. I, pp. 304-317.
18. Kong J., Sertel O., Shimada H., Boyer K.L., Saltz J.H., Gurcan M.N. Computer-aided evaluation of neuroblastoma on whole-slide histology images: classifying grade of neuroblastic differentiation. Pattern Recognit. 2009, 42(6):1080-1092.
19. Le Goualher, G., Perchant, A., Genet, M., Cavé, C., Viellerobe, B., Berier, F., Abrat, B., Ayache, N., 2004. Towards optical biopsies with an integrated fibered confocal fluorescence microscope. In: Proc. MICCAI'04, pp. 761-768.
20. Leung T., Malik J. Representing and recognizing the visual appearance of materials using three-dimensional textons. Int. J. Comput. Vis. 2001, 43:29-44.
21. Lowe D.G. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 2004, 60:91-110.
22. Matas, J., Chum, O., Urban, M., Pajdla, T., 2002. Robust wide baseline stereo from maximally stable extremal regions. In: Proc. British Mach. Vision Conf.
23. Mikolajczyk K., Tuytelaars T., Schmid C., Zisserman A., Matas J., Schaffalitzky F., Kadir T., Van Gool L.J. A comparison of affine region detectors. Int. J. Comput. Vis. 2005, 65:43-72.
24. Müller H., Michoux N., Bandon D., Geissbühler D. A review of content-based image retrieval systems in medical applications - clinical benefits and future directions. Int. J. Med. Informat. 2004, 73(1):1-23.
25. Müller, H., Kalpathy-Cramer, J., Kahn, C.E., Hatt, W., Bedrick, S., Hersh, W.R., 2008. Overview of the ImageCLEFmed 2008 medical image retrieval task. In: CLEF, pp. 512-522.
26. Nister, D., Stewenius, H., 2006. Scalable recognition with a vocabulary tree. In: Proc. CVPR'06, pp. 2161-2168.
27. Pele, O., Werman, M., 2009. Fast and robust earth mover's distances. In: Proc. ICCV'09.
28. Perronnin, F., Dance, C., 2007. Fisher kernels on visual vocabularies for image categorization. In: Proc. CVPR'07, pp. 1-8.
29. Petrou M., Piroddi R., Talepbour A. Texture recognition from sparsely and irregularly sampled data. Comput. Vis. Image Underst. 2006, 102(1):95-104.
30. Pohl H., Rosch T., Vieth M., Koch M., Becker V., Anders M., Khalifa A., Meining A. Miniprobe confocal laser microscopy for the detection of invisible neoplasia in patients with Barrett's esophagus. Gut 2008, 57(12):1648-1653.
31. Rubner Y., Tomasi C., Guibas L.J. The earth mover's distance as a metric for image retrieval. Int. J. Comput. Vis. 2000, 40(2):99-121.
32. Sheskin D.J. Handbook of Parametric and Nonparametric Statistical Procedures 2004, Chapman & Hall/CRC, Boca Raton, Florida, USA. third ed.
33. Shotton, J., Winn, J.M., Rother, C., Criminisi, A., 2006. TextonBoost: joint appearance, shape and context modeling for multi-class object recognition and segmentation. In: Proc. ECCV'06, pp. 1-15.
34. Sivic, J., Zisserman, A., 2006. Video google: efficient visual search of videos. In: Toward Category-Level Object Recognition, pp. 127-144.
35. Sivic J., Zisserman A. Efficient visual search of videos cast as text retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 2009, 31(4):591-606.
36. Smeulders A.W.M., Worring M., Santini S., Gupta A., Jain R. Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22(12):1349-1380.
37. Srivastava S., Rodriguez J.J., Rouse A.R., Brewer M.A., Gmitro A.F. Computer-aided identification of ovarian cancer in confocal microendoscope images. J. Biomed. Opt. 2008, 13(2):024021.
38. Tuytelaars, T., Van Gool, L.J., 2000. Wide baseline stereo matching based on local, affinely invariant regions. In: Proc. British Mach. Vision Conf.
39. Vercauteren T., Perchant A., Malandain G., Pennec X., Ayache N. Robust mosaicing with correction of motion distortions and tissue deformation for in vivo fibered microscopy. Med. Image Anal. 2006, 10(5):673-692.
40. Wallace M.B., Fockens P. Probe-based confocal laser endomicroscopy. Gastroenterology 2009, 136(5):1509-1513.
41. Wang, H., Ullah, M.M., Kläser, A., Laptev, I., Schmid, C., September 2009. Evaluation of local spatio-temporal features for action recognition. In: Proc. British Mach. Vision Conf., p. 127.
42. Zhang J., Lazebnik S., Schmid C. Local features and kernels for classification of texture and object categories: a comprehensive study. Int. J. Comput. Vis. 2007, 73:213-238.
43. Zhang, S., Tian, Q., Hua, G., Huang, Q., Li, S., 2009. Descriptive visual words and visual phrases for image applications, In: IEEE Multimedia, pp. 75-84.