Deformable medical image registration: Setting the state of the art with discrete methods

Annual Review of Biomedical Engineering

Volumn 13, Issue , 2011, Pages 219-244

  Glocker, Ben ^a,d   Sotiras, Aristeidis ^b   Komodakis, Nikos ^c   Paragios, Nikos ^b  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b ECOLE CENTRALE PARIS   (France)

^c UNIVERSITY OF CRETE   (Greece)

^d MICROSOFT RESEARCH   (United Kingdom)

Author keywords

Discrete labeling; Geometric registration; Iconic registration; Linear programming; Markov random fields

Indexed keywords

3-D DEFORMATION; COMPUTATION TIME; COMPUTATIONALLY EFFICIENT; CONTINUOUS METHODS; CRITICAL ISSUES; DEFORMABLE IMAGE REGISTRATION; DEFORMABLE REGISTRATION; DISCRETE LABELING; DISCRETE METHOD; DISCRETE OPTIMIZATION; GEOMETRIC REGISTRATION; GRAPHICAL MODEL; ICONIC REGISTRATION; INTRA-OPERATIVE; LOCAL DEFORMATION MODEL; MARKOV RANDOM FIELDS; MEDICAL IMAGE REGISTRATION; MINIMAL COST; MULTI-MODAL; OPTIMIZATION PROBLEMS; OPTIMIZATION STRATEGY; REGISTRATION METHODS; STATE OF THE ART; TWO-GRAPHS;

COMPUTATIONAL COMPLEXITY; DEFORMATION; IMAGE MATCHING; IMAGE SEGMENTATION; LINEAR PROGRAMMING; MEDICAL IMAGING; OPTIMIZATION; POPULATION STATISTICS;

IMAGE REGISTRATION;

ALGORITHM; ARTICLE; COUPLED REGISTRATION; DEFORMABLE MEDICAL IMAGE REGISTRATION; DIAGNOSTIC IMAGING; GEOMETRIC REGISTRATION; GEOMETRY; ICONIC REGISTRATION; IMAGE PROCESSING; INTRAOPERATIVE PERIOD; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; PROBABILITY; PROCESS OPTIMIZATION; SYSTEM ANALYSIS; VALIDATION PROCESS;

ALGORITHMS; FOUR-DIMENSIONAL COMPUTED TOMOGRAPHY; HUMANS; IMAGE ENHANCEMENT; IMAGE PROCESSING, COMPUTER-ASSISTED; LINEAR MODELS; MARKOV CHAINS; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SUBTRACTION TECHNIQUE; THORAX;

EID: 79960532075     PISSN: 15239829     EISSN: 15454274     Source Type: Book Series    
DOI: 10.1146/annurev-bioeng-071910-124649     Document Type: Article

References (93)

1. Osman N, KerwinW,McVeigh E, Prince J. 1999. Cardiac motion tracking using CINE harmonic phase (HARP) magnetic resonance imaging.Magn. Reson. Med. 42(6):1048-60
2. F̈utterer J,Heijmink S, Scheemen T, Veltman J,HuismanH, et al. 2006. Prostate cancer localization with dynamic contrast-enhanced MR imaging and proton MR spectroscopic imaging. Radiology 241:449-58
3. Pelizzari CA, Chen GT, Spelbring DR,Weichselbaum RR, Chen CT. 1989. Accurate three-dimensional registration of CT, PET, and/or MR images of the brain. J. Comput. Assist. Tomogr. 35(1):20-26 (Pubitemid 19042086)
4. Kyriacou SK, Davatzikos C, Zinreich SJ, Bryan RN. 1999. Nonlinear elastic registration of brain images with tumor pathology using a biomechanical model. IEEE Trans. Med. Imaging 18(7):580-92 (Pubitemid 32080523)
5. Mohamed A, Zacharaki EI, Shen D, Davatzikos C. 2006. Deformable registration of brain tumor images via a statistical model of tumor-induced deformation. Med. Image Anal. 10(5):752-63 (Pubitemid 44375496)
6. Collins DL, Neelin P, Peters TM, Evans AC. 1994. Automatic 3D intersubject registration of MR volumetric data in standardized Talairach space. J. Comput. Assist. Tomogr. 18(2):192-205 (Pubitemid 24100002)
7. Fox NC, Freeborough PA. 1997. Brain atrophy progression measured from registered serial MRI: validation and application to Alzheimer's disease. J. Magn. Reson. Imaging 7:1069-75
8. Crum WR, Scahill RI, Fox NC. 2001. Automated hippocampal segmentation by regional fluid registration of serial MRI: validation and application in Alzheimer's disease. NeuroImage 13(5):847-55 (Pubitemid 32848330)
9. Risser L, Vialard F, Wolz R, Holm D, Rueckert D. 2010. Simultaneous fine and coarse diffeomorphic registration: application to the atrophy measurement in Alzheimer's disease. Proc. Med. Image Comput. Comput. Assist. Interv., 13th, Part II, Beijing, pp. 610-17. Berlin/Heidelberg: Springer-Verlag
10. Kessler ML. 2006. Image registration and data fusion in radiation therapy. Br. J. Radiol. 79:S99-108
11. Nimsky C, Ganslandt O, Hastreiter P, Fahlbusch R. 2001. Intraoperative compensation for brain shift. Surg. Neurol. 56(6):357-64 (Pubitemid 34076471)
12. Hajnal JV, Hill DLG, Hawkes DJ, eds. 2001. Medical Image Registration. Boca Raton, FL: CRC
13. Modersitzki J. 2004. Numerical Methods for Image Registration. Oxford, UK: Oxford Univ. Press
14. Maintz JBA, Viergever MA. 1998. A survey of medical image registration. Med. Image Anal. 2(1):1-36 (Pubitemid 128500719)
15. Zitova B, Flusser J. 2003. Image registration methods: a survey. Image Vis. Comput. 21(11):977-1000
16. Szeliski R. 2006. Image alignment and stitching: a tutorial. Found. Trends Comput. Graph. Vis. 2(1):1-104
17. Rueckert D, Sonoda LI, Hayes C, Hill DLG, Leach MO, Hawkes DJ. 1999. Nonrigid registration using free-form deformations: application to breast MR images. IEEE Trans. Med. Imaging 18:712-21 (Pubitemid 32262025)
18. Rohr K, Stiehl H, Sprengel R, Buzug T, Weese J, Kuhn M. 2001. Landmark-based elastic registration using approximating thin-plate splines. IEEE Trans. Med. Imaging 20:526-34 (Pubitemid 32657856)
19. Fornefett M, Rohr K, Stiehl HS. 1999. Elastic registration of medical images using radial basis functions with compact support. Proc. Comput. Vis. Pattern Recognit., June 23-25, Fort Collins, Colo., pp. 402-7. Piscataway, NJ: IEEE
20. Xuan J, Wang Y, Freedman MT, Adali T, Shields P. 2006. Nonrigid medical image registration by finite-element deformable sheet-curve models. Int. J. Biomed. Imaging 2006:1-9
21. Arsigny V, Pennec X, Ayache N. 2003. Polyrigid and polyaffine transformations: a new class of diffeomorphisms for locally rigid or affine registration. Proc. Med. Image Comput. Comput. Assist. Interv., 6th, Part II, Montreal, pp. 829-37. Berlin/Heidelberg: Springer-Verlag
22. Lowe DG. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2):91-110
23. Joshi SC, Miller MI. 2000. Landmark matching via large deformation diffeomorphisms. IEEE Trans. Image Process. 9(8):1357-70
24. Shen D, Davatzikos C. 2002. HAMMER: hierarchical attribute matching mechanism for elastic registration. IEEE Trans. Med. Imaging 21(11):1421-39
25. Chui H, Rangarajan A. 2003. A new point matching algorithm for non-rigid registration. Comput. Vis. Image Underst. 89(2-3):114-41
26. Bookstein FL. 1989. Principal warps: thin-plate splines and the decomposition of deformations. IEEE Trans. Pattern Anal. Mach. Intell. 11:567-85
27. Roche A, Malandain G, Pennec X, Ayache N. 1998. The correlation ratio as a new similarity measure for multimodal image registration. Proc. Med. Image Comput. Comput. Assist. Interv., 1st, Cambridge, Mass., pp. 1115-24. Berlin/Heidelberg: Springer-Verlag
28. Maes F, Collignon A, Vandermeulen D, Marchal G, Suetens P. 1997. Multimodality image registration by maximization of mutual information. IEEE Trans. Med. Imaging 16:187-98 (Pubitemid 127762930)
29. Viola P, Wells W. 1997. Alignment bymaximization ofmutual information. Int. J. Comput. Vis. 24:137-54
30. Chung ACS,WellsWMIII, Norbash A, GrimsonWEL. 2002. Multi-modal image registration by minimizing Kullback-Leibler distance. Proc. Med. Image Comput. Comput. Assist. Interv., 5th, Part II, Tokyo, pp. 525-32. Berlin/Heidelberg: Springer-Verlag
31. Ou Y, Sotiras A, ParagiosN,Davatzikos C. 2010. DRAMMS: deformable registration via attributematching and mutual-saliency weighting. Med. Image Anal. In press
32. Lee D, Hofmann M, Steinke F, Altun Y, Cahill ND, Scholkopf B. 2009. Learning similarity measure for multi-modal 3D image registration. Proc. Comput. Vis. Pattern Recognit., June 20-25, Miami, pp. 186-93. Piscataway, NJ: IEEE
33. BronsteinM,Bronstein A, Michel F, Paragios N. 2010. Data fusion through cross-modalitymetric learning using similarity-sensitive hashing. Proc. Comput. Vis. Pattern Recognit., June 13-18, San Francisco, pp. 3594-
34. Jeyakumar V, Rubinov A, eds. 2005. Continuous Optimization: Current Trends andModern Applications. New York: Springer
35. Papadimitriou CH, Steiglitz K. 1998. Combinatorial Optimization: Algorithms and Complexity. Mineola, NY: Dover
36. Li SZ. 2009. Markov Random Field Modeling in Image Analysis. New York: Springer. 3rd ed.
37. Lee JD, Huang CH, Wang ST, Lin CW, Lee ST. 2010. Fast-MICP for frameless image-guided surgery. Med. Phys. 37(9):4551-59
38. Chui H, Win L, Schultz R, Duncan JS, Rangarajan A. 2003. A unified non-rigid feature registration method for brain mapping. Med. Image Anal. 7:113-30 (Pubitemid 36546735)
39. Maurer CR, Maciunas RJ, Fitzpatrick JM. 1998. Registration of head CT images to physical space using a weighted combination of points and surfaces. IEEE Trans. Med. Imaging 17(5):753-61
40. Papademetris X, Sinusas AJ, DioneDP, ConstableRT, Duncan JS. 2002. Estimation of 3-D left ventricular deformation from medical images using biomechanical models. IEEE Trans. Med. Imaging 21(7):786-800 (Pubitemid 35250492)
41. Makela T, Clarysse P, Sipila O, Pauna N, Pham QC, et al. 2002. A review of cardiac image registration methods. IEEE Trans. Med. Imaging 21(9):1011-21
42. Joshi S, Davis B, JornierM, Gerig G. 2004. Unbiased diffeomorphic atlas construction for computational anatomy. NeuroImage 23(1):S151-60 (Pubitemid 39421714)
43. Lorenzen P, Prastawa M, Davis B, Gerig G, Bullitt E, Joshi S. 2006. Multi-modal image set registration and atlas formation. Med. Image Anal. 10(3):440-51
44. Vercauteren T, Ayache N, Savoire N, Malandain G, Perchant A. 2008. Processing of in vivo fibered confocal microscopy video sequences. In Microscopic Image Analysis for Life Science Applications, ed. J Rittscher, R Machiraju, STCWong, pp. 441-63. Norwood, MA: Artech
45. Rogelj P, Kovacic S, Gee JC. 2003. Point similarity measures for non-rigid registration of multi-modal data. Comput. Vis. Image Underst. 92(1):112-40
46. Loeckx D, Maes F, Vandermeulen D, Suetens P. 2004. Nonrigid image registration using free-form deformations with a local rigidity constraint. Proc. Med. Image Comput. Comput. Assist. Interv., 7th, Part I, Saint-Malo, Fr., pp. 639-46. Berlin/Heidelberg: Springer-Verlag (Pubitemid 40787434)
47. Rohlfing T, Maurer CR, Bluemke DA, Jacobs MA. 2003. Volume-preserving nonrigid registration of MR breast images using free-form deformation with an incompressibility constraint. IEEE Trans. Med. Imaging 22(6):730-41
48. Thirion J. 1998. Image matching as a diffusion process: an analogy with Maxwell's demons. Med. Image Anal. 2(3):243-60 (Pubitemid 128499389)
49. Hermosillo G, Chefd'Hotel C, Faugeras O. 2002. Variational methods for multimodal image matching. Int. J. Comput. Vis. 50(3):329-43 (Pubitemid 35377419)
50. Klein S, Staring M, Pluim JPW. 2007. Evaluation of optimization methods for nonrigid medical image registration using mutual information and B-splines. IEEE Trans. Image Process. 16(12):2879-90
51. Vercauteren T, Pennec X, Perchant A, AyacheN. 2009. Diffeomorphic demons: efficient non-parametric image registration. NeuroImage 45(1):S61-72
52. Godley A, Ahunbay E, Peng C, Li XA. 2009. Automated registration of large deformations for adaptive radiation therapy of prostate cancer. Med. Phys. 36(4):1433-41
53. Heimann T, Meinzer HP. 2009. Statistical shape models for 3D medical image segmentation: a review. Med. Image Anal. 13(4):543-63
54. Johnson HJ, Christensen GE. 2002. Consistent landmark and intensity-based image registration. IEEE Trans. Med. Imaging 21(5):450-61 (Pubitemid 34979822)
55. Cachier P, Mangin JF, Pennec X, Rivíere D, Papadopoulos-Orfanos D, R̀egis J. 2001. Multisubject nonrigid registration of brain MRI using intensity and geometric features. Proc. Med. Image Comput. Comput. Assist. Interv., 4th, Utrecht, Neth., pp. 734-42. Berlin/Heidelberg: Springer-Verlag (Pubitemid 33352477)
56. Biesdorf A, Ẅorz S, Kaiser HJ, Stippich C, Rohr K. 2009. Hybrid spline-based multimodal registration using local measures for joint entropy and mutual information. Proc. Med. Image Comput. Comput. Assist. Interv., 12th, Part I, London, pp. 607-15. Berlin/Heidelberg: Springer-Verlag
57. Papademetris X, Jakowski AP, Schultz RT, Staib LH, Duncan JS. 2004. Integrated intensity and pointfeature non-rigid registration. Proc. Med. Image Comput. Comput. Assist. Interv., 7th, Part I, Saint-Malo, Fr., pp. 763-70. Berlin/Heidelberg: Springer-Verlag (Pubitemid 40787449)
58. Hellier P, Barillot C. 2003. Coupling dense and landmark-based approaches for non-rigid registration. IEEE Trans. Med. Imaging 22(2):217-27
59. Sotiras A,Ou Y,Glocker B, Davatzikos C, Paragios N. 2010. Simultaneous geometric-iconic registration. Proc. Med. Image Comput. Comput. Assist. Interv., 13th, Part II, Beijing, pp. 676-83. Berlin/Heidelberg: Springer-Verlag
60. Sederberg TW, Parry SR. 1986. Free-form deformation of solid geometric models. Proc. Annu. Conf. Comput. Graph. Interact. Tech. (SIGGRAPH), 13th, Dallas, pp. 151-60. New York: Assoc. Comput.Mach.
61. Glocker B, Komodakis N, Tziritas G, Navab N, Paragios N. 2008. Dense image registration through MRFs and efficient linear programming. Med. Image Anal. 12(6):731-41
62. Besag J. 1986. On the statistical analysis of dirty pictures. J. R. Stat. Soc. Ser. B 48:259-302
63. Chou PBL. 1988. The Theory and Practice of Bayesian Image Labeling. New York: Univ. Rochester
64. Chellappa R, Jain A, eds. 1993. Markov Random Fields: Theory and Application. San Diego, CA: Academic
65. Kirkpatrick S, Gelatt CD, Vecchi MP. 1983. Optimization by simulated annealing. Science 220:671-80
66. Greig DM, Porteous BT, Seheult AJ. 1989. Exact minimum a posteriori estimation for binary images. J. R. Stat. Soc. Ser. B 51(2):271-79
67. Pearl J. 1988. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Francisco: Morgan Kaufmann
68. KomodakisN, Tziritas G. 2007. Approximate labeling via graph cuts based on linear programming. IEEE Trans. Pattern Anal. Mach. Intell. 29(8):1436-53
69. Ford LR Jr, Fulkerson DR. 1962. Flows in Networks. Princeton, NJ: Princeton Univ. Press
70. Goldberg AV, Tarjan RE. 1988. A new approach to the maximum-flow problem. J. Assoc. Comput. Mach. 35(4):921-40
71. Boykov Y, Veksler O, Zabih R. 2001. Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23(11):1222-39
72. Woodford O, Torr P, Reid I, Fitzgibbon A. 2009. Global stereo reconstruction under second-order smoothness priors. IEEE Trans. Pattern Anal. Mach. Intell. 31(12):2115-28
73. Kohli P, Torr PHS. 2007. Dynamic graph cuts for efficient inference in Markov random fields. IEEE Trans. Pattern Anal. Mach. Intell. 29(12):2079-88
74. Kolmogorov V, Zabih R. 2004. What energy functions can be minimized via graph cuts? IEEE Trans. Pattern Anal. Mach. Intell. 26(2):147-59
75. Frey BJ,MacKay DJC. 1997. A revolution: belief propagation in graphs with cycles. In Advances in Neural Information Processing Systems 10, ed. MI Jordan,MJ Kearns, SA Solla, pp. 479-85. Cambridge,MA: MIT Press
76. Felzenszwalb P, Huttenlocher D. 2006. Efficient belief propagation for early vision. Int. J. Comput. Vis. 70:41-54 (Pubitemid 43855866)
77. Kolmogorov V. 2006. Convergent tree-reweighted message passing for energyminimization. IEEE Trans. Pattern Anal. Mach. Intell. 28(10):1568-83
78. Komodakis N, Paragios N, Tzirita G. 2011. MRF energy minimization and beyond via dual decomposition. IEEE Trans. Pattern Anal. Mach. Intell. 33(3):531-52
79. KomodakisN, Tziritas G, Paragios N. 2008. Performance versus computational efficiency for optimizing single and dynamic MRFs: setting the state of the art with primal dual strategies. Comput. Vis. Image Underst. 112(1):14-29
80. KomodakisN, ParagiosN. 2008. Beyond loose LP-relaxations: optimizingMRFs by repairing cycles. Proc. Eur. Conf. Comput. Vis., 10th, Part III, Marseille, Fr., pp. 806-20. Berlin/Heidelberg: Springer-Verlag
81. Glocker B,KomodakisN, ParagiosN,Tziritas G, NavabN. 2007. Inter-and intra-modal deformable registration: continuous deformations meet efficient optimal linear programming. Inf. Process. Med. Imaging 20:408-20
82. Glocker B, KomodakisN, ParagiosN,Glaser C, Tziritas G, NavabN. 2007. Primal/dual linear programming and statistical atlases for cartilage segmentation. Proc. Med. Image Comput. Comput. Assist. Interv., 10th, Part II, Brisbane, Aust., pp. 536-43. Berlin/Heidelberg: Springer-Verlag
83. Wachinger C, Glocker B, Zeltner J, Paragios N, Komodakis N, et al. 2008. Deformable mosaicing for whole-body MRI. Proc. Med. Image Comput. Comput. Assist. Interv., 11th, Part II, New York, pp. 113-21. Berlin/Heidelberg: Springer-Verlag
84. Sotiras A, Neji R, Deux J-F, Komodakis N, Fleury G, Paragios N. 2010. A kernel-based graphical model for diffusion tensor registration. Proc. IEEE Int. Symp. Biomed. Imaging, Apr. 14-17, Rotterdam, pp. 524-27. Piscataway, NJ: IEEE
85. Sotiras A, Komodakis M, Glocker B, Deux JF, Paragios N. 2009. Graphical models and deformable diffeomorphic population registration using global and local metrics. Proc. Med. Image Comput. Comput. Assist. Interv., 12th, Part I, London, pp. 672-79. Berlin/Heidelberg: Springer-Verlag
86. Rueckert D, Aljabar P, Heckemann R, Hajnal J, Hammers A. 2006. Diffeomorphic registration using B-splines. Proc. Med. Image Comput. Comput. Assist. Interv., 9th, Part II, Copenhagen, pp. 702-9. Berlin/Heidelberg: Springer-Verlag (Pubitemid 44609282)
87. Vandemeulebroucke J, SarrutD,Clarysse P. 2007. ThePOPI-model, a point-validated pixel-based breathing thorax model. Proc. Int. Conf. Use Comput. Radiat. Ther., 15th, Toronto, pp. 1-8. Oakville, Can.: Novel Digital
88. Sarrut D, Boldea V, Miguet S, Ginestet C. 2006. Simulation of four-dimensional CT images from deformable registration between inhale and exhale breath-hold CT scans. Med. Phys. 33(3):605-17
89. Delhay B, Clarysse P, Pera C, Magnin IE. 2006. A spatio-temporal deformation model for dense motion estimation in periodic cardiac image sequences. Proc.Med. Image Comput. Comput. Assist. Interv. Workshop, 9th, Copenhagen, pp. 87-90. Berlin/Heidelberg: Springer-Verlag
90. Baker S, ScharsteinD, Lewis J, Roth S, Black M, Szeliski R. 2010. A database and evaluationmethodology for optical flow. Int. J. Comput. Vis. 92:1-31
91. Glocker B, Paragios N, Komodakis N, Tziritas G, Navab N. 2008. Optical flow estimation with uncertainties through dynamicMRFs. Proc. Comput. Vis. Pattern Recognit., June 23-28, Anchorage, Alsk. pp. 1-8. Piscataway, NJ: IEEE
92. Glocker B, Komodakis N, Navab N, Tziritas G, Paragios N. 2009. Dense registration with deformation priors. Inf. Process. Med. Imaging 21:540-51
93. Kwon D, LeeK,Yun I, Lee S. 2008. Nonrigid image registration using dynamic higher-orderMRFmodel. Proc. Eur. Conf. Comput. Vis., 10th, Part I, Marseille, Fr., pp. 373-86. Berlin/Heidelberg: Springer-Verlag