A partial intensity invariant feature descriptor for multimodal retinal image registration

IEEE Transactions on Biomedical Engineering

Volumn 57, Issue 7, 2010, Pages 1707-1718

  Chen, Jian ^a   Tian, Jie ^b   Lee, Noah ^c   Zheng, Jian ^b   Smith, R Theodore ^d   Laine, Andrew F ^c  

^a IBM CHINA RESEARCH LAB   (China)

^b INSTITUTE OF AUTOMATION   (China)

^c Department of Biomedical Engineering Columbia University ^*  (United States)

^d New York Presbyterian Hospital   (United States)

Author keywords

Harris detector; local feature; multimodal registration; partial intensity invariance; retinal images

Indexed keywords

BIFURCATION (MATHEMATICS); COMPUTATIONAL EFFICIENCY; IMAGE REGISTRATION; NONLINEAR FILTERING; OPHTHALMOLOGY;

AFFINE TRANSFORMATIONS; CONTROL POINT; CORNER POINT; HARRIS DETECTOR; IMAGE DOMAIN; IMAGE INTENSITIES; IMAGE PAIRS; IMAGE ROTATION; INTENSITY INVARIANT; LOCAL FEATURE; LOCAL FEATURE DESCRIPTOR; MATCHING TECHNIQUES; MULTI-MODAL; MULTIMODAL REGISTRATION; RETINAL IMAGE;

IMAGE MATCHING;

ACCURACY; ALGORITHM; ANALYTIC METHOD; ARTICLE; AUTOMATION; HUMAN; IMAGE QUALITY; MATHEMATICAL COMPUTING; RETINA IMAGE; ANATOMY AND HISTOLOGY; CLUSTER ANALYSIS; COMPUTER ASSISTED DIAGNOSIS; FLUORESCENCE ANGIOGRAPHY; PATHOLOGY; PROCEDURES; RETINA; RETINA BLOOD VESSEL; VISUAL SYSTEM EXAMINATION;

ALGORITHMS; CLUSTER ANALYSIS; DIAGNOSTIC TECHNIQUES, OPHTHALMOLOGICAL; FLUORESCEIN ANGIOGRAPHY; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; RETINA; RETINAL VESSELS;

EID: 77953785694     PISSN: 00189294     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBME.2010.2042169     Document Type: Article

References (60)

1. Early Treatment Diabetic Retinopathy Study Research Group, "Fundus photographic risk factors for progression of diabetic retinopathy-ETDRS report number 12," Ophthalmology, vol.98, pp. 823-833, 1991.
2. P. J. Saine and M. E. Tyler, Retinal Photography, Angiography, and Electronic Imaging. Boston, MA: Butterworth-Heinemann, 1997.
3. C. Sanchez-Galeana, C. Bowd, E. Z. Blumenthal, P. A. Gokhale, L. M. Zangwill, and R. N. Weinreb, "Using optical imaging summary data to detect glaucoma," Ophthalmology, vol.108, no.10, pp. 1812-1818, 2001.
4. L. Zhou, M. S. Rzeszotarski, L. J. Singerman, and J. M. Chokreff, "The detection and quantification of retinopathy using digital angiograms," IEEE Trans. Med. Imag., vol.13, no.4, pp. 619-626, Dec. 1994.
5. B. Zitova and J. Flusser, "Image registration methods: A survey," Image Vis. Comput., vol.21, no.11, pp. 977-1000, Oct. 2003.
6. W. R. Crum, T. Hartkens, and D. L. G. Hill, "Non-rigid image registration: theory and practice," Br. J. Radiol., vol.77, pp. 140-153, 2004.
7. D. L. G. Hill, P. G. Batchelor, M. Holden, and D. J. Hawkes, "Medical image registration," Phys. Med. Biol., vol.46, pp. R1-R45, 2001.
8. J. V. Hajnal, D. L. G. Hill, and D. J. Hawkes, Medical Image Registration. Boca Raton, FL: CRC Press, 2001.
9. J. B. A. Maintz and M. A. Viergever, "A survey of medical image registration," Med. Image Anal., vol.2, no.1, pp. 1-36, Mar. 1998.
10. L. G. Brown, "A survey of image registration techniques," ACM Comput. Surv., vol.24, no.4, pp. 325-376, Dec. 1992.
11. H. Lester and S. Arridge, "A survey of hierarchical nonlinear medical image registration," Pattern Recognit., vol.32, no.1, pp. 129-149, 1999.
12. V. Cideciyan, "Registration of ocular fundus images," IEEE Eng. Med. Biol. Mag., vol.14, no.1, pp. 52-58, Jan. 1995.
13. G. K. Matsopoulos,N.A.Mouravliansky, K. K. Delibasis, and K. S. Nikita, "Automatic retinal image registration scheme using global optimization techniques," IEEE Trans. Inf. Technol. Biomed., vol.3, no.1, pp. 47-60, Mar. 1999.
14. N. Mourvliansky, G. Matsopoulos, K. Delibasis, and K. Nikita, "Automatic retinal registration using global optimization techniques," Proc. Int. Conf. Eng. Med. Biol. Soc., vol.2, pp. 567-570, Nov. 1998.
15. E. Peli, R. A. Augliere, and G. T. Timberlake, "Feature-based registration of retinal images," IEEE Trans.Med. Imag., vol.MI-6, no.2, pp. 272-278, Sep. 1987.
16. N. Ritter, R. Owens, J. Cooper, R. Eikelboom, and P. van Saarloos, "Registration of stereo and temporal images of the retina," IEEE Trans. Med. Imag., vol.18, no.5, pp. 404-418, May 1999.
17. D. Lloret, J. Serrat, A. M. Lopez, A. Soler, and J. J. Villaneuva, "Retinal image registration using creases as anatomical landmarks," in Proc. IEEE Proc. Int. Conf. Pattern Recognit., Sep. 2000, vol.3, pp. 203-206.
18. L. Ballerini, "Temporal matched filters for integration of ocular fundus images," in Proc. IEEE Conf. Digital Signal Process., Jul. 1997, vol.2, pp. 1161-1164.
19. M. Skokan, A. Skoupy, and J. Jan, "Registration of multimodal images of retina," in Proc. IEEE Conf. Eng. Med. Biol., Oct. 2002, vol.2, pp. 1094-1096.
20. F. Maes, A. Collignon, D. Vandermeulen, G. Marchal, and P. Suetens, "Multimodality image registration by maximization of mutual information," IEEE Trans. Med. Imag., vol.16, no.2, pp. 187-198, Apr. 1997.
21. P. Thevenaz and M. Unser, "Optimization of mutual information for multiresolution image registration," IEEE Trans. Imag. Proc., vol.9, no.19, pp. 2083-2099, Dec. 2000.
22. J. P.W. Pluim, J. B. A. Maintz, andM.A.Viergever, "Mutual- informationbased registration of medical images: a survey," IEEE Trans.Med. Imag., vol.22, no.8, pp. 986-1004, Aug. 2003.
23. M. P. Wachowiak, R. Smolikova, Y. F. Zheng, J. M. Zurada, and A. S. Elmaghraby, "An approach to multimodal biomedical image registration utilizing particle swarm optimization," IEEE Trans. Evol. Comput., vol.8, no.3, pp. 289-301, Jun. 2004.
24. J. Orchard, "Efficient least squaresmultimodal registration with a globally exhaustive alignment search," IEEE Trans. Imag. Proc., vol.16, no.10, pp. 2526-2534, Oct. 2007.
25. D. E. Becker, A. Can, H. L. Tanenbaum, J. N. Turner, and B. Roysam, "Image processing algorithms for retinal montage synthesis, mapping, and real-time location determination," IEEE Trans. Biomed. Eng., vol.45, no.1, pp. 105-118, Jan. 1998.
26. A. Can, C. V. Stewart, B. Roysam, and H. L. Tanenbaum, "A featurebased, robust, hierarchical algorithm for registering pairs of images of the curved human retina," IEEE Trans. Pattern Anal. Mach., vol.24, no.3, pp. 347-364, Mar. 2002.
27. B. Ege, T. Dahl, T. Sndergaard, O. Larsen, T. Bek, and O. Hejlesen, "Automatic registration of ocular fundus images," presented at the Workshop Computer Assist. Fundus Image Anal., Copenhagen, Denmark, 2000.
28. W. Hart and M. Goldbaum, "Registering retinal images using automatically selected control point pairs," in Proc. IEEE Int. Conf. Image Process., 1994, vol.3, pp. 576-581.
29. R. Jagoe, C. Blauth, P. Smith, J. Arnold, K. Taylor, and R. Wootton, "Automatic geometrical registration of fluorescein retinal angiograms," Comput. Biomed. Res., vol.23, no.5, pp. 403-409, Oct. 1990.
30. A. A. Mahurkar, M. A. Vivino, B. L. Trus, E. M. Kuehl, M. B. Datiles III, and M. I. Kaiser-Kupfer, "Constructing retinal fundus photomontages. A new computer-based method," Investigat. Ophthalmol. Visual Sci., vol.37, no.8, pp. 1675-1683, Jul. 1996.
31. A. Mendonca, J. Campilho, and A. Nunes, "A new similarity criterion for retinal image registration," in Proc. IEEE Int. Conf. Image Process., 1994, pp. 696-700.
32. A. Pinz, S. Bernogger, P. Datlinger, and A. Kruger, "Mapping the human retina," IEEE Trans. Med. Imag., vol.17, no.4, pp. 606-620, Aug. 1998.
33. H. Shen, C. Stewart, B. Roysam, G. Lin, and H. Tanenbaum, "Framerate spatial referencing based on invariant indexing and alignment with application to laser retinal surgery," IEEE Trans. Pattern Anal. Mach., vol.25, no.3, pp. 379-384, Mar. 2003.
34. J. Yu, C. Hung, and B. N. Liou, "Fast algorithm for digital retinal image alignment," in Proc. 11th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., 1989, pp. 0734-0735.
35. C. V. Stewart, C. L. Tsai, and B. Roysam, "The dual-bootstrap iterative closest point algorithm with application to retinal image registration," IEEE Trans. Med. Imag., vol.22, no.11, pp. 1379-1394, Nov. 2003.
36. F. Laliberte, L. Gagnon, and Y. Sheng, "Registration and fusion of retinal images-An evaluation study," IEEE Trans. Med. Imag., vol.22, no.5, pp. 661-673, May 2003.
37. C. L. Tsai, C. V. Stewart, B. Roysam, and H. L. Tanenbaum, "Covariance driven retinal image registration initialized from small sets of landmark correspondences," in Proc. IEEE Int. Symp. Biomed. Imag., Jul., 2002, pp. 333-336.
38. E. H. Zhang, Y. Zhang, and T. X. Zhang, "Automatic retinal image registration based on blood vessels feature point," in Proc. IEEE Int. Conf. Mach. Learning Cybern., Nov. 2002, vol.4, pp. 2010-2015.
39. C. Heneghan, P. Maguire, N. Ryan, and P. de Chazal, "Retinal image registration using control points," in Proc. IEEE Int. Symp. Biomed. Imag., Jul. 2002, pp. 349-352.
40. J. Park, J.M. Keller, P. D. Gader, and R. A. Schuchard, "Hough-based registration of retinal images," in Proc. IEEE Int. Conf. Syst., Man, Cybern., Oct. 1998, vol.5, pp. 4550-4555.
41. P. Jasiobedzki, "Registration of retinal images using adaptive adjacency graphs," in Proc. IEEE Symp. Comput. Based Med. Syst., Jun. 1993, pp. 40-45.
42. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol.60, no.2, pp. 91-110, 2004.
43. D. G. Lowe, "Object recognition from local scale-invariant features," in Proc. Int. Conf. Comput. Vis., 1999, pp. 1150-1157.
44. K. Mikolajczyk and C. Schmid, "A performance evaluation of local descriptors," IEEE Trans. Pattern Anal. Mach., vol.10, no.27, pp. 1615-1630, Oct. 2005.
45. S. Se, D. G. Lowe, and J. Little, "Vision-based mobile robot localization and mapping using scale-invariant features," in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), 2001, pp. 2051-2058.
46. T. Lindeberg, "Feature detection with automatic scale selection," Int. J. Comput. Vis., vol.30, no.2, pp. 77-116, 1998.
47. C. Harris and M. J. Stephens, "A combined corner and edge detector," in Proc. Alvey Vis. Conf., 1988, pp. 147-152.
48. A. M. Bazen and S. H. Gerez, "Systematic methods for the computation of the directional fields and singular points of fingerprints," IEEE Trans. Pattern Anal. Mach. Intell., vol.24, no.7, pp. 905-919, Jul. 2002.
49. L. Hong,Y.Wan, andA. Jain, "Fingerprint image enhancement: Algorithm and performance evaluation," IEEE Trans. Pattern Anal. Mach. Intell., vol.20, no.8, pp. 777-789, Aug. 1998.
50. J. Beis andD.G. Lowe, "Shape indexing using approximate nearest neighbor search in high dimensional spaces," in Proc.Conf.Comput.Vis. Pattern Recognit., Puerto Rico, 1997, pp. 1000-1006.
51. N. Ryan, C. Heneghan, and P. de Chazal, "Registration of digital retinal images using landmark correspondence by expectation maximization," Image Vis. Comput., vol.22, pp. 883-898, 2004.
52. G.Yang,C.V. Stewart, M. Sofka, andC. Tsai, "Registration of challenging image pairs: Initialization, estimation, and decision," IEEE Trans. Pattern Anal. Mach. Intell., vol.29, no.11, pp. 1973-1989, Nov. 2007.
53. C. V. Stewart and G. Yang. (2008, Jan.). The generalized dual bootstrap-ICP executable. [Online]. Available: http://www.vision.cs.rpi.edu/ download.html
54. A. Sabat́e-Cequier, M. Dumskyj, D. Usher, M. Himaga, T. Williamson, Boyce, and S. Nussey, "Accurate registration of paired macular and nasal digital retinal images: A potential aid to diabetic retinopathy screening," Tech. Rep., 2000.
55. T. Chanwimaluang, G. Fan, and S. R. Fransen, "Hybrid retinal image registration," IEEE Trans. Info. Tech. Biomed., vol.10, no.1, pp. 129-142, Jan. 2006.
56. D. Lowe. (2005, Jul.). The SIFT executable. [Online]. Available: http://www.cs.ubc.ca/?lowe/keypoints/
57. H. Bay, T. Tuytelaars, and L . V. Gool, "Surf: Speeded up robust features," in Proc. 9th Eur. Conf. Comput. Vis., 2006, pp. 404-417.
58. J. Chen, R. T. Smith, J. Tian, and A . F. Laine, "A novel registration method for retinal images based on local features," in Proc. IEEE EMBS, Vancouver, Canada, Aug. 2008, pp. 2242-2245.
59. P. C. Cattin, H. Bay, L. V. Gool, and G. Szekely, "Retina mosaicing using local features," Med. Image Comput. Comput.-Assist. Intervent. (MICCAI), vol.4191, pp. 185-192, Sep. 2006.
60. C.-L. Tsai, C.-Y. Li, and G. Yang, "The edge-driven dual-bootstrap iterative closest point algorithm for registration of multimodal fluorescein angiogram sequence," IEEE Trans.Med. Imag., vol.29, no.3, Mar. 2009.