Robust 3D-2D image registration: Application to spine interventions and vertebral labeling in the presence of anatomical deformation

Physics in Medicine and Biology

Volumn 58, Issue 23, 2013, Pages 8535-8553

  Otake, Yoshito ^a,b   Wang, Adam S ^a   Webster Stayman, J ^a   Uneri, Ali ^b   Kleinszig, Gerhard ^c   Vogt, Sebastian ^c   Khanna, A Jay ^d   Gokaslan, Ziya L ^e   Siewerdsen, Jeffrey H ^a,b  

^a Johns Hopkins University   (United States)

^b Johns Hopkins University   (United States)

^c SIEMENS AG   (Germany)

^d JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^e JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

3D-2D IMAGE REGISTRATIONS; COVARIANCE MATRIX ADAPTATION EVOLUTION STRATEGIES; INTERVENTIONAL RADIOLOGY; NORMALIZED GRADIENT; ORDERS-OF-MAGNITUDE; PROJECTION DISTANCE; REGISTRATION ACCURACY; TARGET LOCALIZATION;

DEFORMATION; EVOLUTIONARY ALGORITHMS; EXPERIMENTS; FLUORESCENT SCREENS; GLOBAL OPTIMIZATION; MUSCULOSKELETAL SYSTEM;

THREE DIMENSIONAL;

ARTICLE; COMPUTER ASSISTED TOMOGRAPHY; CONGENITAL MALFORMATION; FLUOROSCOPY; HUMAN; METHODOLOGY; RADIOGRAPHY; SPINE; THREE DIMENSIONAL IMAGING;

FLUOROSCOPY; HUMANS; IMAGING, THREE-DIMENSIONAL; SPINE; TOMOGRAPHY, X-RAY COMPUTED;

EID: 84888580227     PISSN: 00319155     EISSN: 13616560     Source Type: Journal    
DOI: 10.1088/0031-9155/58/23/8535     Document Type: Article

References (59)

1. Auger A and Hansen N 2005a Performance evaluation of an advanced local search evolutionary algorithm IEEE Congress on Evolutionary Computation vol 2 pp 1777-84 (Pubitemid 41496064)
2. Auger A and Hansen N 2005b A restart CMA evolution strategy with increasing population size IEEE Congress on Evolutionary Computation vol 2 pp 1769-76 (Pubitemid 41496063)
3. Bentley J L 1975 Multidimensional binary search trees used for associative searching Commun. ACM 18 509-17
4. Besl P J and Mckay N D 1992 A method for registration of 3-D shapes IEEE Trans. Pattern Analysis and Machine Intelligence 14 239-56
5. Birkfellner W, Seemann R, Figl M, Hummel J, Ede C, Homolka P, Yang X, Niederer P and Bergmann H 2005 Fast DRR generation for 2D/3D registration Med. Image Comput. Comput. Assist. Interv. 8 960-7 (Pubitemid 43828457)
6. Birkfellner W, Stock M, Figl M, Gendrin C, Hummel J, Dong S, Kettenbach J, Georg D and Bergmann H 2009 Stochastic rank correlation: a robust merit function for 2D/3D registration of image data obtained at different energies Med. Phys. 36 3420-8
7. Birkfellner W, Wirth J, Burgstaller W, Baumann B, Staedele H, Hammer B, Gellrich N C, Jacob A L, Regazzoni P and Messmer P 2003 A faster method for 3D/2D medical image registration - a simulation study Phys. Med. Biol. 48 2665-79 (Pubitemid 37069374)
8. Cabral B, Cam N and Foran J 1994 Accelerated volume rendering and tomographic reconstruction using texture mapping hardware Proceedings of the 1994 Symposium on Volume visualization (Tysons Corner, VA: ACM) pp 91-8
9. De Silva T, Fenster A, Cool D W, Gardi L, Romagnoli C, Samarabandu J and Ward A D 2013 2D-3D rigid registration to compensate for prostate motion during 3D TRUS-guided biopsy Med. Phys. 40 022904
10. Dennis D A, Mahfouz M R, Komistek R D and Hoff W 2005 In vivo determination of normal and anterior cruciate ligament-deficient knee kinematics J. Biomech. 38 241-53 (Pubitemid 39642944)
11. Dey J and Napel S 2006 Targeted 2D/3D registration using ray normalization and a hybrid optimizer Med. Phys. 33 4730-8 (Pubitemid 44868110)
12. Dorgham O M, Laycock S D and Fisher M H 2012 GPU accelerated generation of digitally reconstructed radiographs for 2-D/3-D image registration IEEE Trans. Biomed. Eng. 59 2594-603
13. Fisher M, Dorgham O and Laycock S 2013 Fast reconstructed radiographs from octree-compressed volumetric data Int. J. Comput. Assist. Radiol. Surg. 8 313-22
14. Florack L M J, Haar Romeny B M, Koenderink J J and Viergever M A 1994 General intensity transformations and differential invariants J. Math. Imaging Vis. 4 171-87
15. Gendrin C et al 2012 Monitoring tumor motion by real time 2D/3D registration during radiotherapy Radiother. Oncol. 102 274-80
16. Groher M, Zikic D and Navab N 2009 Deformable 2D-3D registration of vascular structures in a one view scenario IEEE Trans. Med. Imaging 28 847-60
17. Hansen N 2006 The CMA evolution strategy: a comparing review Towards a New Evolutionary Computation ed J Lozano, P Larrañaga, I Inza and E Bengoetxea (Berlin: Springer) pp 75-102
18. Hansen N and Kern S 2004 Evaluating the CMA evolution strategy on multimodal test functions Parallel Problem Solving from Nature - PPSN VIII. ed X Yao, E Burke, J Lozano, J Smith, J Merelo-Guervós, J Bullinaria, J Rowe, P Tiňo, A Kabán and H-P Schwefel (Berlin: Springer) pp 282-91 (Pubitemid 39750229)
19. Hipwell J H, Penney G P, Mclaughlin R A, Rhode K, Summers P, Cox T C, Byrne J V, Noble J A and Hawkes D J 2003 Intensity-based 2-D-3-D registration of cerebral angiograms IEEE Trans. Med. Imaging 22 1417-26
20. Hopp T, Dietzel M, Baltzer P A, Kreisel P, Kaiser W A, Gemmeke H and Ruiter N V 2012 Automatic multimodal 2D/3D breast image registration using biomechanical FEM models and intensity-based optimization Med. Image Anal. 17 209-18
21. Jenkinson M, Bannister P, Brady M and Smith S 2002 Improved optimization for the robust and accurate linear registration and motion correction of brain images Neuroimage 17 825-41 (Pubitemid 35317016)
22. Jerbi T, Burdin V, Leboucher J, Stindel E and Roux C 2012 2D-3D frequency registration using a low-dose radiographic system for knee motion estimation IEEE Trans. Biomed. Eng. 60 813-20
23. Lunacek M and Whitley D 2006 The dispersion metric and the CMA evolution strategy Proc. 8th Annu. Conf. on Genetic and Evolutionary Computation (Seattle, DC: ACM) pp 477-84 (Pubitemid 44611361)
24. Maes F, Collignon A, Vandermeulen D, Marchal G and Suetens P 1997 Multimodality image registration by maximization of mutual information IEEE Trans. Med. Imaging 16 187-98 (Pubitemid 127762930)
25. Mahfouz M R, Hoff W A, Komistek R D and Dennis D A 2003 A robust method for registration of three-dimensional knee implant models to two-dimensional fluoroscopy images IEEE Trans. Med. Imaging 22 1561-74
26. Markelj P, Tomazevic D, Likar B and Pernus F 2012 A review of 3D/2D registration methods for image-guided interventions Med. Image Anal. 16 642-61
27. Mclaughlin R A, Hipwell J, Hawkes D J, Noble J A, Byrne J V and Cox T C 2005 A comparison of a similarity-based and a feature-based 2-D-3-D registration method for neurointerventional use IEEE Trans. Med. Imaging 24 1058-66 (Pubitemid 41178505)
28. Mitrovic U, Spiclin Z, Likar B and Pernus F 2013 3D-2D registration of cerebral angiograms: a method and evaluation on clinical images IEEE Trans. Med. Imaging 32 1550-63
29. Mody M G, Nourbakhsh A, Stahl D L, Gibbs M, Alfawareh M and Garges K J 2008 The prevalence of wrong level surgery among spine surgeons Spine (Phila Pa, 1976) 33 194-8
30. Munbodh R, Tagare H D, Chen Z, Jaffray D A, Moseley D J, Knisely J P and Duncan J S 2009 2D-3D registration for prostate radiation therapy based on a statistical model of transmission images Med. Phys. 36 4555-68
31. Navab N, Bani-Hashemi A, Nadar M S, Wiesent K, Durlak P, Brunner T, Barth K and Graumann R 1998 3D reconstruction from projection matrices in a C-arm based 3D-angiography system MICCAI'98: Medical Image Computing and Computer-Assisted Interventation ed W Wells, A Colchester and S Delp (Berlin: Springer) pp 119-29 (Pubitemid 128152708)
32. Nelder J A and Mead R 1965 A simplex method for function minimization Comput. J. 7 308-13
33. Otake Y, Armand M, Armiger R S, Kutzer M D, Basafa E, Kazanzides P and Taylor R H 2012a Intraoperative image-based multiview 2D/3D registration for image-guided orthopaedic surgery: incorporation of fiducial-based C-arm tracking and GPU-acceleration IEEE Trans. Med. Imaging 31 948-62
34. Otake Y, Schafer S, Stayman J W, Zbijewski W, Kleinszig G, Graumann R, Khanna A J and Siewerdsen J H 2012b Automatic localization of target vertebrae in spine surgery using fast CT-to-fluoroscopy (3D-2D) image registration Medical Imaging 2012: Image-Guided Procedures, Robotic Interventions, and Modeling p 8316
35. Otake Y, Schafer S, Stayman J W, Zbijewski W, Kleinszig G, Graumann R, Khanna A J and Siewerdsen J H 2012c Automatic localization of vertebral levels in x-ray fluoroscopy using 3D-2D registration: a tool to reduce wrong-site surgery Phys. Med. Biol. 57 5485-508
36. Otake Y, Wang A S, Stayman J W, Kleinszig G, Vogt S, Khanna A J, Wolinsky J P, Gokaslan Z L and Siewerdsen J H 2013 Verification of surgical product and detection of retained foreign bodies using 3D-2D registration in intraoperative mobile radiographs Proc. Computer Assisted Radiology and Surgery pp S185-6
37. Palumbo M A, Bianco A J, Esmende S and Daniels A H 2013 Wrong-site spine surgery J. Am. Acad. Orthop. Surg. 21 312-20
38. Penney G, Varnavas A, Dastur N and Carrell T 2011 An image-guided surgery system to aid endovascular treatment of complex aortic aneurysms: description and initial clinical experience Information Processing in Computer-Assisted Interventions ed R Taylor and G-Z Yang (Berlin: Springer) pp 13-24
39. Penney G P, Weese J, Little J A, Desmedt P, Hill D L and Hawkes D J 1998 A comparison of similarity measures for use in 2-D-3-D medical image registration IEEE Trans. Med. Imaging 17 586-95 (Pubitemid 128747714)
40. Pluim J P, Maintz J B and Viergever M A 2000 Image registration by maximization of combined mutual information and gradient information IEEE Trans. Med. Imaging 19 809-14 (Pubitemid 32031207)
41. Powell M J D 1964 An efficient method for finding the minimum of a function of several variables without calculating derivatives Comput. J. 7 155-62
42. Qi W, Gu L and Xu J 2008 Non-rigid 2D-3D registration based on support vector regression estimated similarity metric Medical Imaging and Augmented Reality ed T Dohi, I Sakuma and H Liao (Berlin: Springer) pp 339-48
43. Rinnooy Kan A H G and Timmer G T 1987 Stochastic global optimization methods part I: clustering methods Math. Program. 39 27-56 (Pubitemid 18550735)
44. Rivest-Henault D, Sundar H and Cheriet M 2012 Nonrigid 2D/3D registration of coronary artery models with live fluoroscopy for guidance of cardiac interventions IEEE Trans. Med. Imaging 31 1557-72
45. Rogelj P, Stanislav K and James C G 2003 Point similarity measures for non-rigid registration of multi-modal data Comput. Vis. Image Und. 92 112-40
46. Russakoff D, Rohlfing T, Ho A, Kim D, Shahidi R, Adler J Jr and Maurer C Jr 2003 Evaluation of Intensity-based 2D-3D spine image registration using clinical gold-standard data Biomedical Image Registration ed J Gee, J B A Maintz and M Vannier (Berlin: Springer) pp 151-60
47. Russakoff D B, Rohlfing T, Mori K, Rueckert D, Ho A, Adler J R Jr and Maurer C R Jr 2005 Fast generation of digitally reconstructed radiographs using attenuation fields with application to 2D-3D image registration IEEE Trans. Med. Imaging 24 1441-54 (Pubitemid 41619221)
48. Spoerk J et al 2012 High-performance GPU-based rendering for real-time, rigid 2D/3D-image registration and motion prediction in radiation oncology Z. Med. Phys. 22 13-20
49. Steininger P, Neuner M, Weichenberger H, Sharp G C, Winey B, Kametriser G, Sedlmayer F and Deutschmann H 2012 Auto-masked 2D/3D image registration and its validation with clinical cone-beam computed tomography Phys. Med. Biol. 57 4277-92
50. Suganthan P N, Hansen N, Liang J J, Deb K, Chen Y, Auger A and Tiwari S 2005 Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization KanGAL Report (Kanpur: Indian Institute of Technology)
51. Tomazevic D, Likar B and Pernus F 2004 'Gold standard' data for evaluation and comparison of 3D/2D registration methods Comput. Aided Surg. 9 137-44 (Pubitemid 41071508)
52. Tornai G J, Cserey G and Pappas I 2012 Fast DRR generation for 2D to 3D registration on GPUs Med. Phys. 39 4795-9
53. Turgeon G A, Lehmann G, Guiraudon G, Drangova M, Holdsworth D and Peters T 2005 2D-3D registration of coronary angiograms for cardiac procedure planning and guidance Med. Phys. 32 3737-49
54. Van De Kraats E B, Penney G P, Tomazevic D, Van Walsum T and Niessen W J 2005 Standardized evaluation methodology for 2-D-3-D registration IEEE Trans. Med. Imaging 24 1177-89 (Pubitemid 41337157)
55. Varnavas A, Carrell T and Penney G 2013 Increasing the automation of a 2D-3D registration system IEEE Trans. Med. Imaging 32 387-99
56. Wang H, Stout D B and Chatziioannou A F 2013 A method of 2D/3D registration of a statistical mouse atlas with a planar x-ray projection and an optical photo Med. Image Anal. 17 401-16
57. Xin C, Graham J, Hutchinson C and Muir L 2013 Automatic inference and measurement of 3D carpal bone kinematics from single view fluoroscopic sequences IEEE Trans. Med. Imaging 32 317-28
58. Yan S, Nie S and Zheng B 2011 Improving accuracy of XRII image distortion correction using a new hybrid image processing method: performance assessment Med. Phys. 38 5921-32
59. Zhu Z, Massimini D F, Wang G, Warner J J and Li G 2012 The accuracy and repeatability of an automatic 2D-3D fluoroscopic image-model registration technique for determining shoulder joint kinematics Med. Eng. Phys. 34 1303-9