Multimodality image registration with software: State-of-the-art

European Journal of Nuclear Medicine and Molecular Imaging

Volumn 36, Issue SUPPL. 1, 2009, Pages 44-55

  Slomka, Piotr J ^a,b   Baum, Richard P ^c  

^a CEDARS SINAI MEDICAL CENTER   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c Center for PET   (Germany)

Author keywords

Image fusion; Image registration; Nonlinear registration mutual information; PET CT; PET MRI; Software registration

Indexed keywords

CARDIOLOGY; COMPUTER ASSISTED TOMOGRAPHY; COMPUTER PROGRAM; IMAGE DISPLAY; IMAGE PROCESSING; IMAGE QUALITY; IMAGING SYSTEM; NEUROIMAGING; NUCLEAR MAGNETIC RESONANCE IMAGING; ONCOLOGY; POSITRON EMISSION TOMOGRAPHY; REVIEW; SINGLE PHOTON EMISSION COMPUTER TOMOGRAPHY; SOFT TISSUE; VALIDATION STUDY; WHOLE BODY IMAGING;

BRAIN; DIAGNOSTIC IMAGING; HEART; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; SOFTWARE; WHOLE BODY IMAGING;

EID: 60549104575     PISSN: 16197070     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00259-008-0941-8     Document Type: Review

References (101)

1. DW Townsend 2001 A combined PET/CT scanner: the choices J Nucl Med 42 3 533 534
2. O Schillaci 2005 Hybrid SPECT/CT: a new era for SPECT imaging? Eur J Nucl Med Mol Imaging 32 5 521 524
3. G Antoch J Kanja S Bauer H Kuehl K Renzing-Koehler J Schuette 2004 Comparison of PET, CT, and dual-modality PET/CT imaging for monitoring of imatinib (STI571) therapy in patients with gastrointestinal stromal tumors J Nucl Med 45 3 357 365
4. PJ Slomka 2004 Software approach to merging molecular with anatomic information J Nucl Med 45 1 Suppl 36S 45S
5. SR Cherry AY Louie RE Jacobs 2008 The integration of positron emission tomography with magnetic resonance imaging Proc IEEE 96 3 416 438
6. CA Pelizzari GT Chen DR Spelbring RR Weichselbaum CT Chen 1989 Accurate three-dimensional registration of CT, PET, and/or MR images of the brain J Comput Assist Tomogr 13 1 20 26
7. NM Alpert 1990 The principal axes transformation-a method for image registration J Nucl Med 31 10 1717 1722
8. P Besl N McKay 1992 A method for registration of 3D shapes IEEE Trans Pattern Anal Machine Intell 14 239 256
9. F Maes A Collignon D Vandermeulen G Marchal P Suetens 1997 Multimodality image registration by maximization of mutual information IEEE Trans Med Imaging 16 2 187 198
10. WM Wells P Viola H Atsumi S Nakajima R Kikinis 1996 Multi-modal volume registration by maximization of mutual information Med Image Anal 1 1 35 51
11. CR Meyer JL Boes B Kim PH Bland KR Zasadny PV Kison 1997 Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin-plate spline warped geometric deformations Med Image Anal 1 3 195 206
12. M Holden 2008 A review of geometric transformations for nonrigid body registration IEEE Trans Med Imag 27 1 111
13. FL Bookstein 1989 Principal warps: thin-plate splines and the decomposition of deformations IEEE Trans Pattern Anal Machine Intell 11 6 567 585
14. D Rueckert LI Sonoda C Hayes DL Hill MO Leach DJ Hawkes 1999 Nonrigid registration using free-form deformations: application to breast MR images IEEE Trans Med Imaging 18 8 712 1
15. JL Barron DJ Fleet SS Beauchemin 1994 Performance of optical flow techniques Int J Comput Vis 12 1 43 77
16. GJ Klein BW Reutter RH Huesman 1997 Non-rigid summing of gated PET via optical flow IEEE Trans Nucl Sci 44 4 1509 1511
17. BC Vemuri S Huang S Sahni CM Leonard C Mohr R Gilmore J Fitzsimmons 1998 An efficient motion estimator with application to medical image registration Med Image Anal 2 1 79 98
18. N Strehl S Tomei J Rosenman S Joshi 2005 Large deformation three-dimensional image registration in image-guided radiation therapy Phys Med Biol 50 5869 5892
19. H Wang L Dong J O'Daniel R Mohan AS Garden KK Ang 2005 Validation of an accelerated 'demons' algorithm for deformable image registration in radiation therapy Phys Med Biol 50 12 2887 2905
20. J Tsao 2003 Interpolation artifacts in multimodality image registration based on maximization of mutual information IEEE Trans Med Imaging 22 7 854 864
21. G Wolz A Namayr T Hothorn J Hornegger W Ramer W Bautz 2007 Comparison of performance between rigid and non-rigid software registering CT to FDG-PET Int J Comput Assist Radiol Surg. 2 3-4 183 190
22. PJ Slomka D Dey C Przetak UE Aladl RP Baum 2003 Automated 3-dimensional registration of stand-alone (18)F-FDG whole-body PET with CT J Nucl Med. 44 7 1156 1167
23. D Levin D Dey PJ Slomka 2004 Acceleration of nonlinear warping using standard video graphics hardware: implementation and initial validation Comput Med Imaging Graph 28 471 483
24. W Lu M-L Chen GH Olivera KJ Ruchala TR Mackie 2004 Fast free-form deformable registration via calculus of variations Phys Med Biol 49 14 3067 3087
25. GW Goerres E Kamel B Seifert C Burger A Buck TF Hany 2002 Accuracy of image coregistration of pulmonary lesions in patients with non-small cell lung cancer using an integrated PET/CT system J Nucl Med 43 11 1469 1475
26. SA Nehmeh YE Erdi T Pan A Pevsner KE Rosenzweig E Yorke 2004 Four-dimensional (4D) PET/CT imaging of the thorax Med Phys 31 12 3179 3186
27. JH Kim J Czernin MS Allen-Auerbach BS Halpern BJ Fueger JR Hecht 2005 Comparison between 18F-FDG PET, in-line PET/CT, and software fusion for restaging of recurrent colorectal cancer J Nucl Med 46 4 578 595
28. J West JM Fitzpatrick MY Wang BM Dawant CR Maurer RM Kessler 1999 Retrospective intermodality registration techniques for images of the head: surface-based versus volume-based IEEE Trans Med Imaging 18 2 144 150
29. J West JM Fitzpatrick MY Wang BM Dawant CR Maurer RM Kessler 1997 Comparison and evaluation of retrospective intermodality brain image registration techniques J Comput Assist Tomogr 21 4 554 566
30. RP Woods ST Grafton CJ Holmes SR Cherry JC Mazziotta 1998 Automated image registration: I. General methods and intrasubject, intramodality validation J Comput.Assist.Tomogr 22 1 139 152
31. RP Woods JC Mazziotta SR Cherry 1993 MRI-PET registration with automated algorithm J Comput Assist Tomogr 17 4 536 546
32. SC Strother JR Anderson XL Xu JS Liow DC Bonar DA Rottenberg 1994 Quantitative comparisons of image registration techniques based on high-resolution MRI of the brain J Comput Assist Tomogr 18 6 954 962
33. DN Levin CA Pelizzari GT Chen CT Chen MD Cooper 1988 Retrospective geometric correlation of MR, CT, and PET images Radiology 169 3 817 823
34. TG Turkington JM Hoffman RJ Jaszczak JR MacFall CC Harris CD Kilts 1995 Accuracy of surface fit registration for PET and MR brain images using full and incomplete brain surfaces J Comput.Assist Tomogr 19 1 117 124
35. JL Andersson A Sundin S Valind 1995 A method for coregistration of PET and MR brain images J Nucl Med 36 7 1307 1315
36. C Studholme DL Hill DJ Hawkes 1996 Automated 3-D registration of MR and CT images of the head Med Image Anal 1 2 163 175
37. DJ Hawkes 1998 Algorithms for radiological image registration and their clinical application J Anat 193 Pt 3 347 361
38. JB Maintz MA Viergever 1998 A survey of medical image registration Med Image Anal 2 1 1 36
39. DL Hill PG Batchelor M Holden DJ Hawkes 2001 Medical image registration Phys Med Biol 46 3 R1 45
40. BF Hutton M Braun 2003 Software for image registration: algorithms, accuracy, efficacy Semin Nucl Med 33 3 180 192
41. JPW Pluim JBA Maintz MA Viergever 2003 Mutual-information-based registration of medical images: a survey IEEE Trans Med Imaging 22 8 986 1004
42. C Studholme DJ Hawkes DL Hill 1998 A normalized entropy measure for multimodality image alignment SPIE Phys Med Imaging 3338 132 143
43. DL Collins P Neelin TM Peters AC Evans 1994 Automatic 3D intersubject registration of MR volumetric data in standardized Talairach space J Comput Assist Tomogr 18 2 192 205
44. RP Woods ST Grafton JD Watson NL Sicotte JC Mazziotta 1998 Automated image registration: II. Intersubject validation of linear and nonlinear models J Comput Assist Tomogr 22 1 153 165
45. PE Radau PJ Slomka 2001 Constrained localized warping reduced registration errors due to lesions in functional neuroimages SPIE Proc SPIE Med Imaging 4322 588 601
46. PE Radau PJ Slomka P Julin L Svensson LO Wahlund 2001 Evaluation of linear registration algorithms for brain SPECT and the errors due to hypoperfusion lesions Med Phys 28 8 1660 1668
47. PE Radau R Linke PJ Slomka K Tatsch 2000 Optimization of automated quantification of 123I-IBZM uptake in the striatum applied to parkinsonism J Nucl Med 41 2 220 227
48. CC Meltzer PE Kinahan PJ Greer TE Nichols C Comtat MN Cantwell 1999 Comparative evaluation of MR-based partial-volume correction schemes for PET J Nucl Med 40 12 2053 2065
49. I Fried VI Nenov SG Ojemann RP Woods 1995 Functional MR and PET imaging of Rolandic and visual cortices for neurosurgical planning J Neurosurg 83 5 854 861
50. PJ Lewis A Siegel AM Siegel C Studholme J Sojkova DW Roberts 2000 Does performing image registration and subtraction in ictal brain SPECT help localize neocortical seizures? J Nucl Med 41 10 1619 1626
51. Ledezma CJ, Chen W, Sai V, Freitas B, Cloughesy T, Czernin J, Pope W. 18F-FDOPA PET/MRI fusion in patients with primary/recurrent gliomas: initial experience. Eur J Radiol 2008;(in press).
52. S Hesse H Barthel J Schwarz O Sabri U Müller 2004 Advances in in vivo imaging of serotonergic neurons in neuropsychiatric disorders Neurosci Biobehav Rev 28 6 547 563
53. T Pan O Mawlawi SA Nehmeh YE Erdi D Luo HH Liu 2005 Attenuation correction of PET images with respiration-averaged CT images in PET/CT J Nucl Med 46 9 1481 1487
54. J Cai JC Chu D Recine M Sharma C Nguyen R Rodebaugh 1999 CT and PET lung image registration and fusion in radiotherapy treatment planning using the chamfer-matching method Int J Radiat Oncol Biol Phys 43 4 883 891
55. JN Yu FH Fahey BA Harkness HD Gage CG Eades JW Keyes 1994 Evaluation of emission-transmission registration in thoracic PET J Nucl Med 35 11 1777 1780
56. JN Yu FH Fahey HD Gage CG Eades BA Harkness CA Pelizzari JW Keyes 1995 Intermodality, retrospective image registration in the thorax J Nucl Med 36 12 2333 2338
57. RL Wahl LE Quint RD Cieslak AM Aisen RA Koeppe CR Meyer 1993 Anatometabolic tumor imaging: fusion of FDG PET with CT or MRI to localize foci of increased activity J Nucl Med 34 7 1190 1197
58. AK Erdi YC Hu CS Chui 2000 Using mutual information (MI) for automated 3D registration in the pelvis and thorax region for radiotherapy treatment planning SPIE Med Imaging 2000: Image Proc 3979 416 425
59. D Dey PJ Slomka LJ Hahn R Kloiber 1999 Automatic three-dimensional multimodality registration using radionuclide transmission CT attenuation maps: a phantom study J Nucl Med 40 3 448 455
60. R Shekhar V Walimbe S Raja V Zagrodsky M Kanvinde G Wu 2005 Automated 3-dimensional elastic registration of whole-body PET and CT from separate or combined scanners J Nucl Med 46 9 1488 1496
61. BS Halpern C Schiepers WA Weber TL Crawford BJ Fueger ME Phelps 2005 Presurgical staging of non-small cell lung cancer*positron emission tomography, integrated positron emission tomography/CT, and software image fusion Chest 128 4 2289 2297
62. JWH Wolthaus M van Herk SH Muller JSA Belderbos JV Lebesque JA de Bois 2005 Fusion of respiration-correlated PET and CT scans: correlated lung tumour motion in anatomical and functional scans Phys Med Biol 50 7 1569 1583
63. D Mattes DR Haynor H Vesselle TK Lewellen W Eubank 2003 PET-CT image registration in the chest using free-form deformations IEEE Trans Med Imag 22 1 120 128
64. S Nimmagadda EC Ford JW Wong MG Pomper 2008 Targeted molecular imaging in oncology: focus on radiation therapy Semin Radiat Oncol 18 2 136
65. T Nishioka T Shiga H Shirato E Tsukamoto K Tsuchiya T Kato 2002 Image fusion between 18FDG-PET and MRI/CT for radiotherapy planning of oropharyngeal and nasopharyngeal carcinomas Int J Radiat Oncol Biol Phys 53 4 1051 1057
66. KK Brock MB Sharpe LA Dawson SM Kim DA Jaffray 2005 Accuracy of finite element model-based multi-organ deformable image registration Med Phys 32 6 1647 1659
67. D Jaffray 2005 Emergent technologies for 3-dimensional image-guided radiation delivery Semin Radiat Oncol 15 3 208 216
68. YE Erdi K Rosenzweig AK Erdi HA Macapinlac YC Hu LE Braban 2002 Radiotherapy treatment planning for patients with non-small cell lung cancer using positron emission tomography (PET) Radiother Oncol 62 1 51 60
69. M Koshy AC Paulino R Howell D Schuster R Halkar LW Davis 2005 F-18 FDG PET-CT fusion in radiotherapy treatment planning for head and neck cancer Head Neck 27 6 494 502
70. J Bradley WL Thorstad S Mutic TR Miller F Dehdashti BA Siegel 2004 Impact of FDG-PET on radiation therapy volume delineation in non-small-cell lung cancer Int J Radiat Oncol Biol Phys 59 1 78 86
71. L Seiboth D Van Nostrand L Wartofsky Y Ousman J Jonklaas C Butler 2008 Utility of PET/Neck MRI digital fusion images in the management of recurrent or persistent thyroid cancer Thyroid 18 2 103 111
72. PJ Slomka DS Berman G Germano 2008 Applications and software techniques for integrated cardiac multimodality imaging Expert Rev Cardiovasc Ther 6 1 27 41
73. DS Berman R Hachamovitch LJ Shaw JD Friedman SW Hayes LEJ Thomson 2006 Roles of nuclear cardiology, cardiac computed tomography, and cardiac magnetic resonance: assessment of patients with suspected coronary artery disease J Nucl Med 47 1 74 82
74. O Gaemperli T Schepis I Valenta L Husmann H Scheffel V Duerst 2007 Cardiac image fusion from stand-alone SPECT and CT: clinical experience J Nucl Med 48 5 696 703
75. Slomka P, Suzuki Y, Elad Y, S VK, Kavanagh P, Gutstein A, Karlsberg R, Berman DS, Germano G. Software fusion of 64-slice CT angiography and myocardial perfusion SPECT: evidence of synergy [abstract]. J Nucl Med. Washington, DC: Journal of Nuclear Medicine; 2007.
76. S Rispler Z Keidar E Ghersin A Roguin A Soil R Dragu 2007 Integrated single-photon emission computed tomography and computed tomography coronary angiography for the assessment of hemodynamically significant coronary artery lesions J Am Coll Cardiol 49 10 1059 1067
77. TG Flohr CH McCollough H Bruder M Petersilka K Gruber C Süß 2006 First performance evaluation of a dual-source CT (DSCT) system Eur Radiol 16 2 256 268
78. Dewey M, Zimmermann E, Laule M, Rutsch W, Hamm B. Three-vessel coronary artery disease examined with 320-slice computed tomography coronary angiography. Eur Heart J 2008;(In press).
79. Garcia EV, Gropler RJ. Eighth nuclear cardiology invitational conference Annapolis, MD 2008. J Nucl Cardiol 2008;(in press).
80. T Schepis O Gaemperli P Koepfli C Rüegg C Burger S Leschka 2007 Use of coronary calcium score scans from stand-alone multislice computed tomography for attenuation correction of myocardial perfusion SPECT Eur J Nucl Med Mol Imaging. 34 1 11 19
81. Behloul F, Janier M, Croisille P, Poirier C, Boudraa A, Unterreiner R, et al. Automatic assessment of myocardial viability based on PET-MRI datafusion. Engineering in Medicine and Biology Society, 1998. Proceedings of the 20th Annual International Conference of the IEEE, p 492-495.
82. PJ Slomka D Fieno L Thomson JD Friedman SW Hayes G Germano 2005 Automatic detection and size quantification of infarcts by myocardial perfusion SPECT: clinical validation by delayed-enhancement MRI J Nucl Med 46 5 728 735
83. UE Aladl GA Hurwitz D Dey D Levin M Drangova PJ Slomka 2004 Automated image registration of gated cardiac single-photon emission computed tomography and magnetic resonance imaging J Magn Reson Imaging 19 3 283 290
84. JH Rudd EA Warburton TD Fryer HA Jones JC Clark N Antoun 2002 Imaging atherosclerotic plaque inflammation with [18F]-fluorodeoxyglucose positron emission tomography Circulation 105 23 2708 2711
85. D Dey P Slomka D Chien D Fieno A Abidov R Saouaf 2006 Direct quantitative in vivo comparison of calcified atherosclerotic plaque on vascular MRI and CT by multimodality image registration J Magn Reson Imaging 23 3 345 354
86. JV Hajnal N Saeed A Oatridge EJ Williams IR Young GM Bydder 1995 Detection of subtle brain changes using subvoxel registration and subtraction of serial MR images J Comput Assist Tomogr 19 5 677
87. NC Fox WR Crum RI Scahill JM Stevens JC Janssen MN Rossor 2001 Imaging of onset and progression of Alzheimer's disease with voxel-compression mapping of serial magnetic resonance images Lancet 358 9277 201 205
88. TR Mackie J Kapatoes K Ruchala W Lu C Wu G Olivera 2003 Image guidance for precise conformal radiotherapy Int J Radiat Oncol Biol Phys 56 1 89 105
89. J Shi B Sahiner HP Chan L Hadjiiski C Zhou PN Cascade 2007 Pulmonary nodule registration in serial CT scans based on rib anatomy and nodule template matching Med Phys 34 1336
90. MR Benz V Evilevitch MS Allen-Auerbach FC Eilber ME Phelps J Czernin 2008 Treatment monitoring by 18F-FDG PET/CT in patients with sarcomas: interobserver variability of quantitative parameters in treatment-induced changes in histopathologically responding and nonresponding tumors J Nucl Med 49 7 1038
91. TL Faber J Modersitzki RD Folks EV Garcia 2005 Detecting changes in serial myocardial perfusion SPECT: a simulation study J Nucl Cardiol 12 3 302 310
92. UA Zifko PJ Slomka RH Reid GB Young H Remtulla CF Bolton 1996 The cortical representation of somatosensory evoked potentials of the phrenic nerve J Neurol Sci 139 2 197 202
93. MS Siddique HM Fernandes TD Wooldridge JD Fenwick P Slomka AD Mendelow 2002 Reversible ischemia around intracerebral hemorrhage: a single-photon emission computerized tomography study J Neurosurg 96 4 736 741
94. LNP Voruganti P Slomka P Zabel A Mattar AG Awad 2001 Cannabis induced dopamine release: an in-vivo SPECT study Psychiatry Res: Neuroimaging. 107 3 173 177
95. T Schepis O Gaemperli P Koepfli C Rüegg C Burger S Leschka 2007 Use of coronary calcium score scans from stand-alone multislice computed tomography for attenuation correction of myocardial perfusion SPECT Eur J Nucl Med Mol Imaging 34 1 11 19
96. T Beyer M Weigert HH Quick U Pietrzyk F Vogt C Palm 2008 MR-based attenuation correction for torso-PET/MR imaging: pitfalls in mapping MR to CT data Eur J Nucl Med Mol Imaging 35 6 1142 1146
97. KL Gould T Pan C Loghin NP Johnson A Guha S Sdringola 2007 Frequent diagnostic errors in cardiac PET/CT due to misregistration of CT attenuation and emission PET images: a definitive analysis of causes, consequences, and corrections J Nucl Med 48 7 1112
98. EJ Emanuel VR Fuchs 2008 The perfect storm of overutilization JAMA 299 23 2789
99. PN Cascade 2004 Unnecessary imaging and radiation risk: the perfect storm for radiologists J Am Coll Radiol 1 10 709 711
100. AJ Einstein KW Moser RC Thompson MD Cerqueira MJ Henzlova 2007 Radiation dose to patients from cardiac diagnostic imaging Circulation 116 11 1290 1305
101. C Franzius KU Juergens O Schober 2006 Is PET/CT necessary in paediatric oncology? Eur J Nucl Med Mol Imaging 33 8 960 965