The dual-bootstrap iterative closest point algorithm with application to retinal image registration

IEEE Transactions on Medical Imaging

Volumn 22, Issue 11, 2003, Pages 1379-1394

  Stewart, Charles V ^a   Tsai, Chia Ling ^a   Roysam, Badrinath ^b  

^a Rensselaer Polytechnic Institute   (United States)

^b RENSSELAER POLYTECHNIC INSTITUTE   (United States)

Author keywords

Iterative closest point; Medical imaging; Registration; Retinal imaging; Robust estimation

Indexed keywords

ALGORITHMS; BLOOD VESSELS; ESTIMATION; ITERATIVE METHODS; MATHEMATICAL TRANSFORMATIONS; MATRIX ALGEBRA;

IMAGE REGISTRATION; ITERATIVE CLOSEST POINT; RETINAL IMAGING;

MEDICAL IMAGING;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; CLINICAL TRIAL; COMPUTER ASSISTED DIAGNOSIS; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; FLUORESCENCE ANGIOGRAPHY; HISTOLOGY; HUMAN; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; METHODOLOGY; REPRODUCIBILITY; RETINA; RETINA BLOOD VESSEL; RETINA DISEASE; SENSITIVITY AND SPECIFICITY; VALIDATION STUDY;

ALGORITHMS; FLUORESCEIN ANGIOGRAPHY; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; RETINA; RETINAL DISEASES; RETINAL VESSELS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE;

EID: 0345327826     PISSN: 02780062     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMI.2003.819276     Document Type: Article

References (88)

1. K. Al-Kofahi, S. Lasek, S. D., C. Nagy, J. N. Turner, and B. Roysam, "Rapid automated three-dimensional tracing of neurons from confocal image stacks," IEEE Trans. Inform. Technol. Biomed., pp. 171-187, June 2002.
2. S. Aylward and E. Bullitt, "Initialization, noise, singularities, and scale in height-ridge traversal for tubular object centerline extraction," IEEE Trans. Med. Imag., vol. 21, pp. 61-75, Feb. 2002.
3. S. Aylward, J. Jomier, S. Weeks, and E. Bullitt, "Registration of vascular images," Int. J. Comput. Vis., 2003, to be published.
4. D. E. Becker, A. Can, H. L. Tanenbaum, J. N. Turner, and B. Roysam, "Image processing algorithms for retinal montage synthesis, mapping, and real-time location determination," IEEE Trans. Biomed. Eng., vol. 45, pp. 105-118, Jan. 1998.
5. J. Bergen, P. Anandan, K. Hanna, and R. Hingorani, "Hierarchical model-based motion estimation," in Proc. 2nd Eur. Conf. Computer Vision, 1992, pp. 237-252.
6. J. Berkow, R. Flower, D. Orth, and J. Kelley, Fluorescein and Indocyanine Green Angiography, Technique and Interpretation, 2nd ed. San Francisco, CA: American Academy of Ophthalmology, 1997.
7. P. Besl and N. McKay, "A method for registration of 3-D shapes," IEEE Trans. Pattern Anal. Machine Intell., vol. 14, pp. 239-256, Feb. 1992.
8. T. Binford and T. Levitt, "Quasiinvariants: Theory and exploitation," in Proc. DARPA Image Understanding Workshop, 1993, pp. 819-829.
9. G. Borgefors, "Distance transformations in digital images," Comput. Vis., Graph., Image Processing, vol. 34, no. 3, pp. 344-371, June 1986.
10. L. G. Brown, "A survey of image registration techniques," ACM Computing Surveys, vol. 24, no. 4, pp. 325-376, Dec. 1992.
11. K. Bubna and C. V. Stewart, "Model selection techniques and merging rules for range data segmentation algorithms," Comput. Vis. Image Understanding, vol. 80, pp. 215-245, 2000.
12. A. Can, H. Shen, J. N. Turner, H. L. Tanenbaum, and R. Roysam, "Rapid automated tracing and feature extraction from retinal fundus images using direct exploratory algorithms," IEEE Trans. Inform. Technol. Biomed., vol. 3, pp. 125-138, June 1999.
13. A. Can, C. Stewart, and B. Roysam, "Robust hierarchical algorithm for constructing a mosaic from images of the curved human retina," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 286-292, 1999.
14. A. Can, C. Stewart, B. Roysam, and H. Tanenbaum, "A feature-based algorithm for joint, linear estimation of high-order estimation of high-order image-to-mosaic transformations: Mosaicing the curved human retina," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, pp. 412-419, Mar. 2002.
15. ____, "A feature-based, robust, hierarchical algorithm for registering pairs of images of the curved human retina," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, pp. 347-364, Mar. 2002.
16. G. Champleboux, S. Lavallee, R. Szeliski, and L. Brunie, "From accurate range imaging sensor calibration to accurate model-based 3-d object localization," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 83-89, 1992.
17. Y. Chen and G. Medioni, "Object modeling by registration of multiple range images," Image Vis. Computing, vol. 10, no. 3, pp. 145-155, 1992.
18. C. Chua and R. Jarvis, "3d free-form surface registration and object recognition," Int. J. Comput. Vis., vol. 17, no. 1, pp. 77-99, 1996.
19. H. Chui and A. Rangarajan, "A new algorithm for nonrigid point matching," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. II, pp. 44-51, 2000.
20. A. V. Cideciyan, "Registration of ocular fundus images," IEEE Eng. Med. Biol. Mag., vol. 14, pp. 52-58, Jan. 1995.
21. A. Collignon, D. Vandermeulen, P. Suetens, and G. Marchal, "Registration of 3d multimodality medical images using surfaces and point landmarks," Pattern Recogn. Lett., vol. 15, no. 5, pp. 461-467, 1994.
22. P.E. Danielsson, "Euclidean distance mapping," Comput. Graphic. Image Processing, vol. 14, pp. 227-248, 1980.
23. M. DeGrezia and M. Robinson, "Ophthalmic manifestations of HIV: An update," J. Assoc. Nurses in AIDS Care, vol. 12, no. 3, pp. 22-32, May-June 2001.
24. Diabetic Retinography Research Group, "A modification of the airlie house classification of diabetic retinopathy," Investigat. Ophthalmol. Visual Sci., vol. 21, Tech. Rep. 7, pp. 210-226, Dec. 1981.
25. J. S. Duncan and N. Ayache, "Medical image analysis: Progress over two decades and the challenges ahead," IEEE Trans. Pattern Anal. Machine Intell., vol. 22, pp. 85-105, Jan. 2000.
26. B. Ege, T. Dahl, T. Sndergaard, O. Larsen, T. Bek, and O. Hejlesen, "Automatic registration of ocular fundus images," presented at the Workshop on Computer Assisted Fundus Image Analysis, Copenhagen, Denmark, May 2000.
27. J. Feldmar, J. Declerck, G. Malandain, and N. Ayache, "Extension of the ICP algorithm to nonrigid intensity-based registration of 3d volumes," Comput. Vis. Image Understanding, vol. 66, no. 2, pp. 193-206, May 1997.
28. M.A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, pp. 381-395, 1981.
29. K. Fritzche, A. Can, H. Shen, C. Tsai, J. Turner, H. Tanenbuam, C. Stewart, and B. Roysam, "Automated model based segmentation, tracing and analysis of retinal vasculature from digital fundus images," in State-of-The-Art Angiography, Applications and Plaque Imaging Using MR, CT, Ultrasound and X-rays, J. S. Suri and S. Laxminarayan, Eds. New York: Academic, 2002.
30. W. Grimson, T. Lozano-Perez, W. Wells, G. Ettinger, and S. White, "An automatic registration method for frameless stereotaxy, image, guided surgery and enhanced reality visualization," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994, pp. 430-436.
31. J. V. Hajnal, D. L. G. Hill, and D. J. Hawkes, Eds., Medical Image Registration. Boca Raton, FL: CRC, 2001.
32. F. R. Hampel, P. J. Rousseeuw, E. Ronchetti, and W. A. Stahel, Robust Statistics: The Approach Based on Influence Functions. New York: Wiley, 1986.
33. W. Hart and M. Goldbaum, "Registering retinal images using automatically selected control point pairs," Proc. IEEE Int. Conf. Image Processing, vol. 3, pp. 576-581, 1994.
34. R. Hartley and A. Zisserman, Multiple View Geometry. Cambridge, U.K.: Cambridge Univ. Press, 2000.
35. C. Heneghan, P. Maguire, N. Ryan, and P. de Chazal, "Retinal image registration using control points," in IEEE Int. Symp. Biomedical Imaging, July 2002, pp. 349-352.
36. K. Higuchi, M. Hebert, and K. Ikeuchi, "Building 3-d models from unregistered range images," Graphical Models Image Processing, vol. 57, no. 4, pp. 315-333, 1995.
37. P. W. Holland and R. E. Welsch, "Robust regression using iteratively reweighted least-squares," Commun. Statist.-Theor. Meth., vol. A6, pp. 813-827, 1977.
38. A. Hoover, V. Kouznetsova, and M. Goldbaum, "Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response," IEEE Trans. Med. Imag., vol. 19, pp. 203-210, Mar. 2000.
39. R. Jagoe, C. Blauth, P. Smith, J. Arnold, K. Taylor, and R. Wootton, "Automatic geometrical registration of fluorescein retinal angiograms," Comput. Biomed. Res., vol. 23, no. 5, pp. 403-9, Oct. 1990.
40. A. Johnson and M. Hebert, "Surface matching for object recognition in complex 3-dimensional scenes," Image Vis. Computing, vol. 16, no. 9-10, pp. 635-651, July 1998.
41. H. Lester and S. Arridge, "A survey of hierarchical nonlinear medical image registration," Pattern Recogn., vol. 32, no. 1, pp. 129-149, 1999.
42. M. Levoy, K. Pulli, B. Curless, S. Rusinkiewicz, S. Anderson, J. Davis, J. Ginsberg, J. Shade, and D. Fulk, "The digital michelango project: 3D scanning of large statues," in Computer Graphics Proceedings (SIGGRAPH), July 2000, pp. 131-144.
43. D. Lloret, J. Serrat, A. Lopez, A. Soler, and J. Villanueva, "Retinal image registration using creases as anatomical landmarks," in Proc. IEEE Int. Conf. Image Processing, vol. 3, 2000, pp. 203-207.
44. D. Lowe, "Three-dimensional object recognition from single two-dimensional images," Artif. Intell., vol. 31, no. 3, pp. 355-395, 1987.
45. F. Maes, A. Collignon, D. Vandermeulen, G. Marchal, and P. Suetens, "Multimodality image registration by maximization of mutual information," IEEE Trans. Med. Imag., vol. 16, pp. 187-198, Apr. 1997.
46. A. A. Mahurkar, M. A. Vivino, B. L. Trus, E. M. Kuehl, M. B. Datiles, and M. I. Kaiser-Kupfer, "Constructing retinal fundus photomontages," Investigat. Ophthalmol. Visual Sci., vol. 37, no. 8, pp. 1675-1683, July 1996.
47. J. A. Maintz and M. A. Viergever, "A survey of medical image registration," Med. Image Anal., vol. 2, no. 1, pp. 1-36, 1998.
48. G. K. Matsopoulos, N. A. Mouravliansky, K. K. Delibasis, and K. S. Nikita, "Automatic retinal image registration scheme using global optimization techniques," IEEE Trans. Inform. Technol. Biomed., vol. 3, pp. 47-60, Mar. 1999.
49. T. McInerney and D. Terzopoulos, "Deformable models in medical image analysis: A survey," Med. Image Anal., vol. 1, no. 2, pp. 91-108, 1996.
50. A. Mendonca, J. Campilho, and A. Nunes, "A new similarity criterion for retinal image registration," in Proc. IEEE Int. Conf. Image Processing, 1994, pp. 696-700.
51. C.-H. Menq, H.-T. Yau, and G.-Y. Lai, "Automated precision measurement of surface profile in CAD-directed inspection," IEEE Trans. Robot. Automat., vol. 8, pp. 268-278, Apr. 1992.
52. J. V. Miller, "Regression-base surface reconstruction: Coping with noise, outliers, and discontinuities," Ph.D. dissertation, Rensselaer Polytechnic Inst., Troy, NY, 1997.
53. J. V. Miller and C. V. Stewart, "Muse: Robust surface fitting using unbiased scale estimates," in Proc IEEE Conf. Computer Vision and Pattern Recognition, June 1996, pp. 300-306.
54. N. Mourvliansky, G. Matsopoulos, K. Delibasis, and K. Nikita, "Automatic retinal registration using global optimization techniques," in Proc. 20th IEEE Int. Conf. Engineering in Medicine and Biology, vol. 2, 1998.
55. J. Mundy and A. Zisserman, Eds., Geometric Invariance in Computer Vision. Cambridge: MIT Press, 1992.
56. V.-D. Nguyen, V. Nzomigni, and C. Stewart, "Fast and robust registration of 3d surfaces using low curvature patches," in Proc. 2nd Int. Conf. 3-D Digital Imaging Modeling, 1999, pp. 201-208.
57. J. Park, J. Keller, P. Gader, and R. Schuchard, "Hough-based registration of retinal images," in Proc. IEEE Int. Conf. Systems, Man, Cybernetics, vol. 5, 1998, pp. 4550-4555.
58. E. Peli, R. A. Augliere, and G. T. Timberlake, "Feature-based registration of retinal images," IEEE Trans. Med. Imag., vol. MI-6, pp. 272-278, Sept. 1987.
59. G. P. Penny, J. Weese, J. A. Little, P. Desmedt, D. L. Hill, and D. J. Hawkes, "A comparison of similarity measures for used in 2-D-3-D medical image registration," IEEE Trans. Med. Imag., vol. 17, pp. 586-594, Apr. 1998.
60. A. Pinz, S. Bernogger, P. Datlinger, and A. Kruger, "Mapping the human retina," IEEE Trans. Med. Imag., vol. 17, pp. 606-620, Aug. 1998.
61. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical Recipes in C: The Art of Scientific Computing. Cambridge, U.K.: Cambridge Univ. Press, 1992.
62. N. Ritter, R. Owens, J. Cooper, R. Eikelboom, and P. van Saarloos, "Registration of stereo and temporal images of the retina," IEEE Trans. Med. Imag., vol. 18, pp. 404-418, May 1999.
63. P. J. Rousseeuw, "Least median of squares regression," J. Amer. Statist. Assoc., vol. 79, pp. 871-880, 1994.
64. P. J. Rousseeuw and C. Croux, "Alternatives to the median absolute deviation," J. Amer. Statist. Assoc., vol. 88, pp. 1273-1283, 1993.
65. P. J. Saine and M. E. Tyler, Ophthalmic Photography. London, U.K.: Butterworth Heinemann, 2002.
66. H. Sawhney, S. Hsu, and R. Kumar, "Robust video mosaicing through topology inference and local to global alignment," in Proc. 5th Eur. Conf. Computer Vision, vol. II, 1998, pp. 103-119.
67. H. Sawhney and R. Kumar, "True multi-image alignment and its application to mosaicing and lens distortion correction," IEEE Trans. Pattern Anal. Machine Intell., vol. 21, pp. 235-243, Mar. 1999.
68. C. Schmid, R. Mohr, and C. Bauckhage, "Comparing and evaluating evaluating interest points," in Proc. IEEE Int. Conf. Computer Vision, 1998, pp. 230-235.
69. H. Shen, C. Stewart, B. Roysam, G. Lin, and H. Tanenbaum, "Frame-rate spatial referencing based on invariant indexing and alignment with application to laser retinal surgery," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, 2001, pp. 79-86.
70. ____, "Frame-rate spatial referencing based on invariant indexing and alignment with application to laser retinal surgery," IEEE Trans. Pattern Anal. Machine Intell., vol. 25, pp. 379-384, Mar. 2003.
71. H. Shum and R. Szeliski, "Systems and experiment paper: Construction of panoramic image mosaics with global and local alignment," Int. J. Computer Vision, vol. 36, no. 2, pp. 101-130, 2000.
72. C. Sinthanayothin, J. Boyce, H. Cook, and T. Williamson, "Automated localization of the optic disc fovea, and retinal blood vessels from digital color fundus images," Br. J. Ophthalmol., vol. 83, no. 3, pp. 902-10, Aug. 1999.
73. C. V. Stewart, "Robust parameter estimation in computer vision," SIAM Rev., vol. 41, no. 3, pp. 513-537, 1999.
74. W. Tan, Y. Wang, and S. Lee, "Retinal blood vessel detection using frequency analysis and local-mean-interpolation filters," in Proc. SPIE Conf. Medical Imaging: Image Processing, vol. 1322, 2001, pp. 1373-1384.
75. J. Thirion, "New feature points based on geometric invariants for 3d image registration," Int. J. Comput. Vis., vol. 18, no. 2, pp. 121-137, 1996.
76. P. Torr, "An assessment of information criteria for motion model selection," in Proc. IEEE Conf. Computer Vision Pattern Recognition, 1997, pp. 47-52.
77. ____, "Bayesian model estimation and selection for epipolar geometry and generic manifold fitting," Int. J. Comput. Vis., vol. 50, no. 1, pp. 271-300, 2002.
78. P. Torr and D. Murray, "The development and comparison of robust methods for estimating the fundamental matrix," Int. J. Comput. Vis., vol. 24, no. 3, pp. 271-300, 1997.
79. P. Torr and A. Zisserman, "MLESAC: A new robust estimator with application to estimating image geometry," Comput. Vis. Image Understanding, vol. 78, no. 1, pp. 138-156, Apr. 2000.
80. C.-L. Tsai, C. Stewart, B. Roysam, and H. Tanenbaum, "Covariance-driven retinal image registration initialized from small sets of landmark correspondences," presented at the IEEE Int. Symp. Biomedical Imaging, Washington, DC, July 2002.
81. ____, "Repeatable vascular landmark extraction from retinal fundus images using local vascular traces," IEEE Trans. Inform. Technol. Biomed., 2003, to be published.
82. P. Viola and W. M. Wells III, "Alignment by maximization of mutual information," Int. J. Comput. Vis., vol. 24, no. 2, pp. 137-154, 1997.
83. R. Weleber and K. Gregory-Evans, "Retinis pigmentosa and allied disorders," in Retina. St. Louis, MO: Mosby, 2001, ch. 18, pp. 362-460.
84. J. Yu, C. Hung, and B. N. Liou, "Fast algorithm for digital retinal image alignment," in Proc. 11th Annu. Int. Conf. IEEE Engineering in Medicine and Biology Soc., 1989, pp. 0734-7035.
85. F. Zana and J. C. Klein, "A multimodal registration algorithm of eye fundus images using vessels detection and hough transform," IEEE Trans. Med. Imag., vol. 18, pp. 419-428, May 1999.
86. ____, "Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation," IEEE Trans. Image Processing, vol. 10, pp. 1010-1019, July 2001.
87. Z. Zhang, "Iterative point matching for registration of free-form curves and surfaces," Int. J. Comput. Vis., vol. 13, no. 2, pp. 119-152, 1994.
88. ____, "Determining the epipolar geometry and its uncertainty: A review," Int. J. Comput. Vis., vol. 27, no. 2, pp. 161-195, 1998.