Second-order optimization of mutual information for real-time image registration

IEEE Transactions on Image Processing

Volumn 21, Issue 9, 2012, Pages 4190-4203

  Dame, Amaury ^a   Marchand, Eric ^b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITÉ DE RENNES 1   (France)

Author keywords

Mutual information (MI); optimization; registration; tracking

Indexed keywords

ACCURATE ESTIMATION; HESSIAN MATRICES; ILLUMINATION CHANGES; IMAGE SEQUENCE; INFORMATION SHARED; MOTION PARAMETERS; MULTI-MODALITY; MUTUAL INFORMATIONS; OBJECT TRACKING; OPTIMIZATION APPROACH; OPTIMIZATION EFFICIENCY; OPTIMIZATION METHOD; OPTIMIZATION PROBLEMS; PARTIAL OCCLUSIONS; PRACTICAL SOLUTIONS; REAL TIME; REAL TIME TRACKING; REGISTRATION; SECOND ORDERS; SPATIO-TEMPORAL IMAGE REGISTRATION;

ALIGNMENT; IMAGE REGISTRATION; STEREO VISION; SURFACE DISCHARGES;

OPTIMIZATION;

EID: 84865420465     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2199124     Document Type: Article

References (40)

1. L. Brown, "A survey of image registration techniques," ACM Comput. Surv., vol. 24, no. 4, pp. 325-376, Dec. 1992.
2. B. Zitová and J. Flusser, "Image registration methods: A survey," Image Vis. Comput., vol. 21, no. 11, pp. 977-1000, 2003.
3. C. Shannon, "A mathematical theory of communication," SIGMOBILE Mob. Comput. Commun. Rev., vol. 5, no. 1, pp. 3-55, Jan. 2001.
4. P. Viola and W. Wells, "Alignment by maximization of mutual information," Int. J. Comput. Vis., vol. 24, no. 2, pp. 137-154, 1997. (Pubitemid 127506551)
5. T. Drummond and R. Cipolla, "Real-time visual tracking of complex structures," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 932-946, Jul. 2002. (Pubitemid 34835468)
6. A. Comport, E. Marchand, M. Pressigout, and F. Chaumette, "Real-time markerless tracking for augmented reality: The virtual visual servoing framework," IEEE Trans. Visualizat. Comput. Graph., vol. 12, no. 4, pp. 615-628, Jul.-Aug. 2006. (Pubitemid 43824572)
7. D. Comaniciu, V. Ramesh, and P. Meer, "Real-time tracking of non-rigid objects using mean shift," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2000, pp. 142-149.
8. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Jan. 2004.
9. V. Lepetit and P. Fua, "Keypoint recognition using randomized trees," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 9, pp. 1465-1479, Sep. 2006. (Pubitemid 44132652)
10. C. Bibby and I. Reid, "Robust real-time visual tracking using pixel-wise posteriors," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 831-844.
11. B. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. 7th Int. Joint Conf. Artif. Intell., 1981, pp. 674-679. (Pubitemid 14478744)
12. J.-M. Odobez and P. Bouthemy, "Robust multiresolution estimation of parametric motion models," J. Visual Commun. Image Represent., vol. 6, no. 4, pp. 348-365, Dec. 1995.
13. G. Hager and P. Belhumeur, "Efficient region tracking with parametric models of geometry and illumination," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 10, pp. 1025-1039, Oct. 1998. (Pubitemid 128741363)
14. S. Baker and I. Matthews, "Equivalence and efficiency of image alignment algorithms," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Dec. 2001, pp. 1090-1097.
15. S. Baker and I. Matthews, "Lucas-Kanade 20 years on: A unifying framework," Int. J. Comput. Vis., vol. 56, no. 3, pp. 221-255, 2004.
16. F. Jurie and M. Dhome, "Hyperplane approximation for template matching," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 996-1000, Jul. 2002. (Pubitemid 34835473)
17. S. Benhimane and E. Malis, "Homography-based 2-D visual tracking and servoing," Int. J. Robot. Res., vol. 26, no. 7, pp. 661-676, Jul. 2007. (Pubitemid 46934724)
18. G. Silveira and E. Malis, "Real-time visual tracking under arbitrary illumination changes," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Minneapolis, MN, Jun. 2007, pp. 1-6.
19. M. Irani and P. Anandan, "Robust multi-sensor image alignment," in Proc. IEEE Int. Conf. Comput. Vis., Bombay, India, Jan. 1998, pp. 959-966.
20. A. Collignon, F. Maes, D. Delaere, D. Vandermeulen, P. Suetens, and G. Marchal, "Automated multi-modality image registration based on information theory," in Proc. Int. Conf. Inf. Process. Med. Imag., Ile de Berder, France, Jun. 1995, pp. 263-274.
21. C. Studholme, D. Hill, and D. J. Hawkes, "Automated 3-D registration of truncated MR and CT images of the head," in Proc. Brit. Mach. Vis. Conf., Birmingham, U.K., Sep. 1995, pp. 27-36.
22. P. Viola and W. Wells, "Alignment by maximization of mutual information," in Proc. Int. Conf. Comput. Vis., Washington, DC, 1995, pp. 16-23.
23. J. Pluim, J. Maintz, and M. Viergever, "Mutual-information-based registration of medical images: A survey," IEEE Trans. Med. Imag., vol. 22, no. 8, pp. 986-1004, Aug. 2003.
24. H. Chen, P. Varshney, and M.-A. Slamani, "On registration of regions of interest (ROI) in video sequences," in Proc. IEEE Conf. Adv. Video Signal Based Surveill., Jul. 2003, pp. 313-318.
25. N. Dowson and R. Bowden, "A unifying framework for mutual information methods for use in non-linear optimisation," in Proc. Eur. Conf. Comput. Vis., vol. 1. Jun. 2006, pp. 365-378. (Pubitemid 44029792)
26. N. Dowson and R. Bowden, "Mutual information for Lucas-Kanade tracking (MILK): An inverse compositional formulation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 1, pp. 180-185, Jan. 2008. (Pubitemid 350168365)
27. G. Panin and A. Knoll, "Mutual information-based 3-D object tracking," Int. J. Comput. Vis., vol. 78, no. 1, pp. 107-118, 2008. (Pubitemid 351354427)
28. N. Ritter, R. Owens, J. Cooper, R. Eikelboom, and P. Van Saarloos, "Registration of stereo and temporal images of the retina," IEEE Trans. Med. Imag., vol. 18, no. 5, pp. 404-418, May 1999.
29. F. Maes, A. Collignon, D. Vandermeulen, G. Marchal, and P. Suetens, "Multimodality image registration by maximization of mutual information," IEEE Trans. Med. Imag., vol. 16, no. 2, pp. 187-198, Apr. 1997. (Pubitemid 127762930)
30. C. Meyer, J. Boes, B. Kim, P. Bland, K. Zasadny, P. Kison, K. Koral, K. Frey, and R.Wahl, "Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin-plate spline warped geometric deformations," Med. Image Anal., vol. 1, no. 3, pp. 195-206, Apr. 1997.
31. F. Maes, D. Vandermeulen, and P. Suetens, "Comparative evaluation of multiresolution optimization strategies for multimodality image registration by maximization of mutual information," Med. Image Anal., vol. 3, no. 4, pp. 373-386, 1999.
32. P. Thévenaz and M. Unser, "Optimization of mutual information for multiresolution image registration," IEEE Trans. Image Process., vol. 9, no. 12, pp. 2083-2099, Dec. 2000.
33. P. Thévenaz and M. Unser, "Optimization of mutual information for multiresolution image registration," IEEE Trans. Image Process., vol. 9, no. 12, pp. 2083-2099, Dec. 2000.
34. A. Dame, "A unified direct approach for visual servoing and visual tracking using mutual information," Ph.D. thesis, Dept. Comput. Sci., Univ. de Rennes 1, Rennes, France, Dec. 2010.
35. G. Caron, A. Dame, and E. Marchand, "L'information mutuelle pour l'estimation visuelle directe de pose," in Proc. 18th Congr. Francophone AFRIF-AFIA Reconnaissance Formes et Intell. Artif., Lyon, France, Jan. 2012, pp. 1-8.
36. S. Lieberknecht, S. Benhimane, P. Meier, and N. Navab, "A dataset and evaluation methodology for template-based tracking algorithms," in Proc. 8th IEEE Int. Symp. Mixed Augmented Reality, Oct. 2009, pp. 145-151.
37. R. Szeliski, "Image alignment and stitching: A tutorial," Found. Trends Comput. Graph. Vis., vol. 2, no. 1, pp. 1-104, Jan. 2006.
38. M. Brown and D. Lowe, "Automatic panoramic image stitching using invariant features," Int. J. Comput. Vis., vol. 74, no. 1, pp. 59-73, Aug. 2007. (Pubitemid 46673104)
39. M. Irani, P. Anandan, and S. Hsu, "Mosaic based representations of video sequences and their applications," in Proc. 5th IEEE Int. Conf. Comput. Vis., Jun. 1995, pp. 605-611.
40. N. Gracias and J. Santos-Victor, "Underwater video mosaics as visual navigation maps," Comput. Vis. Image Understand., vol. 79, no. 1, pp. 66-91, 2000.