Intraoperative image-based multiview 2D/3D registration for image-Guided orthopaedic surgery: Incorporation of fiducial-Based C-Arm tracking and GPU-Acceleration

IEEE Transactions on Medical Imaging

Volumn 31, Issue 4, 2012, Pages 948-962

  Otake, Yoshito ^a   Armand, Mehran ^b   Armiger, Robert S ^b   Kutzer, Michael D ^b   Basafa, Ehsan ^a   Kazanzides, Peter ^a   Taylor, Russell H ^a  

^a Johns Hopkins University   (United States)

^b JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

C arm pose tracking; GPU acceleration; image guided surgery; intraoperative 2D 3D registration

Indexed keywords

2D/3D REGISTRATION; COMPUTATIONAL COSTS; DATA SETS; DIRECT CONTACT METHOD; EXPERIMENTAL VALIDATIONS; GEOMETRIC CALIBRATIONS; GOLD STANDARDS; GPU-ACCELERATION; GRAPHICS PROCESSING UNIT; IMAGE GUIDED SURGERY; IMAGE-BASED; IMAGE-GUIDED; IMAGE-GUIDED RADIATION THERAPY; INTENSITY-BASED; INTRA-OPERATIVE; MULTI-VIEWS; ORTHOPAEDIC SURGERY; PATIENT REGISTRATION; POINT-BASED; POSE TRACKING; RELATIVE POSE; TARGET REGISTRATION ERRORS; TECHNICAL CHALLENGES; X-RAY IMAGE; X-RAY IMAGERS;

COMPUTER GRAPHICS; PATIENT REHABILITATION; PROGRAM PROCESSORS; ROBOTIC ARMS; X RAY ANALYSIS;

COMPUTER GRAPHICS EQUIPMENT;

ALGORITHM; ARTICLE; COMPUTER ASSISTED SURGERY; COMPUTER ASSISTED TOMOGRAPHY; FEMUR; HUMAN; IMAGE QUALITY; INSTRUMENTATION; METHODOLOGY; ORTHOPEDIC SURGERY; RADIOGRAPHY; REPRODUCIBILITY; THREE DIMENSIONAL IMAGING;

ALGORITHMS; FEMUR; HUMANS; IMAGING, THREE-DIMENSIONAL; ORTHOPEDIC PROCEDURES; PHANTOMS, IMAGING; REPRODUCIBILITY OF RESULTS; SURGERY, COMPUTER-ASSISTED; TOMOGRAPHY, X-RAY COMPUTED;

EID: 84859771725     PISSN: 02780062     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMI.2011.2176555     Document Type: Article

References (67)

1. G. Widmann, R. Stoffner, and R. Bale, "Errors and error management in image-guided craniomaxillofacial surgery," Oral Surg., Oral Med., Oral Pathol., Oral Radiol., Endodontol., vol. 107, pp. 701-715, 2009.
2. M. L. Kessler, "Image registration and data fusion in radiation therapy," Br. J. Radiol., vol. 79, pp. S99-108, Sep. 2006.
3. J. M. Balter and M. L. Kessler, "Imaging and alignment for imageguided radiation therapy," J. Clin. Oncol., vol. 25, pp. 931-937, Mar. 2007. (Pubitemid 350002858)
4. L. A. Dawson and D. A. Jaffray, "Advances in image-guided radiation therapy," J. Clin. Oncol., vol. 25, pp. 938-946, Mar. 2007. (Pubitemid 350002859)
5. D. B. Russakoff, T. Rohlfing, J. R. Adler Jr., and C. R. Maurer Jr., "Intensity-based 2D-3D spine image registration incorporating a single fiducial marker," Acad. Radiol., vol. 12, pp. 37-50, Jan. 2005. (Pubitemid 40187286)
6. M. J. Daly, J. H. Siewerdsen, Y. B. Cho, D. A. Jaffray, and J. C. Irish, "Geometric calibration of a mobile C-arm for intraoperative cone-beam CT," Med. Phys., vol. 35, pp. 2124-2136, May 2008. (Pubitemid 351614827)
7. Y. Otake, M. Armand, O. Sadowsky, R. S. Armiger, M. D. Kutzer, S. C. Mears, P. Kazanzides, and R. H. Taylor, "An image-guided femoroplasty system: Development and initial cadaver studies," Proc. SPIE, vol. 7625, pp. 76250P-76250P, Mar. 2010.
8. J. Jomier, E. Bullitt, M. Van Horn, C. Pathak, and S. R. Aylward, "3D/2D model-to-image registration applied to TIPS surgery," in Med. Image Comput. Comput. Assist. Interv. Int. Conf. Med. Image Comput. Comput. Assist. Interv., 2006, vol. 9, pp. 662-669. (Pubitemid 44609277)
9. A. Khamene, P. Bloch, W. Wein, M. Svatos, and F. Sauer, "Automatic registration of portal images and volumetric CT for patient positioning in radiation therapy," Med. Image Anal., vol. 10, pp. 96-112, Feb. 2006. (Pubitemid 41754730)
10. G. A. Turgeon, G. Lehmann, G. Guiraudon, M. Drangova, D. Holdsworth, and T. Peters, "2D-3D registration of coronary angiograms for cardiac procedure planning and guidance," Med. Phys., vol. 32, pp. 3737-3749, Dec. 2005.
11. J. Weese, G. P. Penney, P. Desmedt, T. M. Buzug, D. L. Hill, and D. J. Hawkes, "Voxel-based 2-D/3-D registration of fluoroscopy images and CT scans for image-guided surgery," IEEE Trans. Inf. Technol. Biomed., vol. 1, pp. 284-293, Dec. 1997. (Pubitemid 127771013)
12. G. P. Penney, J. Weese, J. A. Little, P. Desmedt, D. L. G. Hill, and D. J. hawkes, "A comparison of similarity measures for use in 2-D-3-D medical image registration," IEEE Trans. Med. Imag., vol. 17, no. 4, pp. 586-595, Aug. 1998. (Pubitemid 128747714)
13. X. Chen, R. C. Gilkeson, and B. Fei, "Automatic 3D-to-2D registration for CT and dual-energy digital radiography for calcification detection," Med. Phys., vol. 34, pp. 4934-4943, Dec. 2007. (Pubitemid 350197728)
14. G. Zheng, S. Steppacher, X. Zhang, and M. Tannast, "Precise estimation of postoperative cup alignment from single standard X-ray radiograph with gonadal shielding," in Med. Image Comput. Comput. Assist. Interv. Int. Conf. Med. Image Comput. Comput. Assist. Interv., 2007, vol. 10, pp. 951-959.
15. G. Zheng, "Statistical shape model-based reconstruction of a scaled, patient-specific surface model of the pelvis from a single standard AP X-ray radiograph," Med. Phys., vol. 37, pp. 1424-1439, Apr. 2010.
16. H. Livyatan, Z. Yaniv, and L. Joskowicz, "Gradient-based 2-D/3-D rigid registration of fluoroscopic X-ray to CT," IEEE Trans. Med. Imag., vol. 22, no. 11, pp. 1395-1406, Nov. 2003.
17. O. Sadowsky, G. Chintalapani, and R. H. Taylor, "Deformable 2D-3D registration of the pelvis with a limited field of view, using shape statistics," in Med. Image Comput. Comput. Assist. Interv. Int. Conf. Med. Image Comput. Comput. Assist. Interv., 2007, vol. 10, pp. 519-526.
18. R. H. Taylor, L. Joskowicz, B. Williamson, A. Gueziec, A. Kalvin, P. Kazanzides, R. Van Vorhis, J. Yao, R. Kumar, A. Bzostek, A. Sahay, M. Borner, and A. Lahmer, "Computer-integrated revision total hip replacement surgery: Concept and preliminary results," Med. Image Anal., vol. 3, pp. 301-319, Sep. 1999. (Pubitemid 129641650)
19. A. Jain and G. Fichtinger, "C-arm tracking and reconstruction without an external tracker," in Med. Image Comput. Comput. Assist. Interv. Int. Conf. Med. Image Comput. Comput. Assist. Interv., 2006, vol. 9, pp. 494-502. (Pubitemid 44609142)
20. A. K. Jain, T. Mustafa, Y. Zhou, C. Burdette, G. S. Chirikjian, and G. Fichtinger, "FTRAC-A robust fluoroscope tracking fiducial," Med. Phys., vol. 32, pp. 3185-3198, Oct. 2005. (Pubitemid 41513108)
21. D. A. Russakoff, T. Rohlfing, and C. R. Maurer Jr., "Fast intensitybased 2D-3D image registration of clinical data using light fields," in Proc. 9th IEEE Int. Conf. Comput. Vis. (ICCV), 2003, pp. 416-423.
22. D. B. Russakoff, T. Rohlfing, K. Mori, D. Rueckert, A. Ho, J. R. Adler, Jr., and C. R. Maurer, Jr., "Fast generation of digitally reconstructed radiographs using attenuation fields with application to 2D-3D image registration," IEEE Trans. Med. Imag., vol. 24, no. 11, pp. 1441-1454, Nov. 2005. (Pubitemid 41619221)
23. D. LaRose, J. Bayouth, and T. Kanade, "Transgraph: Interactive intensity-based 2D/3D registration of X-ray and CT data," Proc. SPIE, vol. 3979, pp. 385-396, Jun. 2000.
24. D. Tomazevic, B. Likar, T. Slivnik, and F. Pernus, "3-D/2-D registration of CT and MR to X-ray images," IEEE Trans. Med. Imag., vol. 22, no. 11, pp. 1407-1416, Nov. 2003.
25. D. Tomazevic, B. Likar, and F. Pernus, "3D/2D image registration: The impact of X-ray views and their number," in Med. Image Comput. Comput. Assist. Interv. Int. Conf. Med. Image Comput. Comput. Assist. Interv., 2007, vol. 10, pp. 450-457.
26. D. Ruijters, B. M. T. Haar-Romeny, and P. Suetens, "GPU-accelerated digitally reconstructed radiographs," in Proc. 6th IASTED Int. Conf. Biomed. Eng., Innsbruck, Austria, 2008, pp. 431-435.
27. A. Cardoso, "Generation of planar radiographs from 3D anatomical models using the GPU,"M.S. thesis, Univ. Porto, Porto, Portugal, 2010.
28. F. Xu, "Fast implementation of iterative reconstruction with exact raydriven projector on GPUs," Tsinghua Sci. Technol., vol. 15, pp. 30-35, 2010.
29. Y.Yang, Z. Zhong, G. Rong, X. Guo, J.Wang, T. Solberg, and W. Mao, "Real-time GPU-aided lung tumor tracking," in Proc. 4th Pacific-Rim Symp. Image Video Technol. (PSIVT), 2010, pp. 495-500.
30. B. Cabral, N. Cam, and J. Foran, "Accelerated volume rendering and tomographic reconstruction using texture mapping hardware," in Proc. 1994 Symp. Volume Visualizat., 1994, pp. 91-98.
31. A. Kubias, F. Deinzer, T. Feldmann, D. Paulus, B. Schreiber, and T. Brunner, "2D/3D image registration on the GPU," Pattern Recognit. Image Anal., vol. 18, pp. 381-389, 2008.
32. Plastimatch [Online]. Available: http://plastimatch.org
33. VTK User's Guide Version 11. Clifton Park, NY: Kitware, 2010.
34. R. L. Siddon, "Fast calculation of the exact radiological path for a threedimensional CT array," Med. Phys., vol. 12, pp. 252-255, Mar.-Apr. 1985. (Pubitemid 15089015)
35. M. de Greef, J. Crezee, J. C. van Eijk, R. Pool, and A. Bel, "Accelerated ray tracing for radiotherapy dose calculations on a GPU," Med. Phys., vol. 36, pp. 4095-4102, Sep. 2009.
36. J. H. Siewerdsen, D. J. Moseley, S. Burch, S. K. Bisland, A. Bogaards, B. C.Wilson, and D. A. Jaffray, "Volume CT with a flat-panel detector on a mobile, isocentric C-arm: Pre-clinical investigation in guidance of minimally invasive surgery," Med. Phys., vol. 32, pp. 241-254, Jan. 2005. (Pubitemid 40165536)
37. O. Sadowsky, "Image registration and hybrid volume reconstruction of bone anatomy using a statistical shape atlas," Ph.D. dissertation, Johns Hopkins Univ., Baltimore, 2008.
38. O. Sadowsky, J. Lee, E. G. Sutter, S. J. Wall, J. L. Prince, and R. H. Taylor, "Hybrid cone-beam tomographic reconstruction: Incorporation of prior anatomical models to compensate for missing data," IEEE Trans. Med. Imag., vol. 30, no. 1, pp. 69-83, Jan. 2011.
39. D. A. Jaffray, J. H. Siewerdsen, J. W. Wong, and A. A. Martinez, "Flat-panel cone-beam computed tomography for image-guided radiation therapy," Int. J. Radiat. Oncol. Biol. Phys., vol. 53, pp. 1337-1349, 2002. (Pubitemid 34787872)
40. P. Fallavollita, E. C. Burdette, D. Y. Song, P. Abolmaesumi, and G. Fichtinger, "Technical note: Unsupervised C-arm pose tracking with radiographic fiducial," Med. Phys., vol. 38, pp. 2241-2245, 2011.
41. P. Fallavollita, C. Burdette, D. Song, P. Abolmaesumi, and G. Fichtinger, C-Arm Tracking by Intensity-Based Registration of a Fiducial in Prostate Brachytherapy. Berlin, Germany: Springer, 2010, vol. 6135, pp. 45-55.
42. D. F. Dementhon and L. S. Davis, "Model-based object pose in 25 lines of code," Int. J. Comput. Vis., vol. 1415, pp. 123-141, 1995.
43. J. A. Nelder and R. Mead, "A simplex method for function minimization," Comput. J., vol. 7, pp. 308-313, Jan. 1965.
44. F. Maes, A. Collignon, D. Vandermeulen, G. Marchal, and P. Suetens, "Multimodality image registration by maximization of mutual information," IEEE Trans. Med. Imag., vol. 16, no. 2, pp. 187-198, Apr. 1997. (Pubitemid 127762930)
45. J. L. Prince and J. M. Links, Medical Imaging Signals and Systems. Upper Saddle River, NJ: Pearson Prentice Hall, 2006.
46. L. Zollei, E. Grimson, A. Norbash, and W. Wells, "2D-3D rigid registration of X-ray fluoroscopy and CT images using mutual information and sparsely sampled histogram estimators," in Comput. Vis. Pattern Recognit., 2001, vol. 2, pp. II-696-II-703. (Pubitemid 34096783)
47. J. Spoerk, H. Bergmann, F. Wanschitz, S. Dong, and W. Birkfellner, "Fast DRR splat rendering using common consumer graphics hardware," Med. Phys., vol. 34, pp. 4302-4308, Nov. 2007. (Pubitemid 350029652)
48. C. Studholme, D. L. G. Hill, and D. J. Hawkes, "An overlap invariant entropy measure of 3D medical image alignment," Pattern Recognit., vol. 32, pp. 71-86, 1999.
49. J. P. Pluim, J. B. Maintz, and M. A. Viergever, "Image registration by maximization of combined mutual information and gradient information," IEEE Trans. Med. Imag., vol. 19, no. 8, pp. 809-814, Aug. 2000. (Pubitemid 32031207)
50. Y. Otake, M. Armand, O. Sadowsky, R. Armiger, P. Kazanzides, and R. Taylor, "An iterative framework for improving the accuracy of intraoperative intensity-based 2D/3D registration for image-guided orthopedic surgery," Lecture Notes in Computer Science, vol. 6135, pp. 23-33, 2010.
51. N. Hansen and S. Kern, "Evaluating the CMA evolution strategy on multimodal test functions," in Parallel Problem Solving From Nature {PPSN VIII}. New York: Springer, 2004, pp. 282-291. (Pubitemid 39750229)
52. N. Hansen, A. S. P. Niederberger, L. Guzzella, and P. Koumoutsakos, "A method for handling uncertainty in evolutionary optimization with an application to feedback control of combustion," IEEE Trans. Evolutionary Computat., vol. 13, no. 1, pp. 180-197, Feb. 2009.
53. N. Hansen, "The CMA evolution strategy: A comparing review," in Towards a New Evolutionary Computation. Advances on Estimation of Distribution Algorithms, J. A. Lozano, P. Larranaga, I. Inza, and E. Bengoetxea, Eds. New York: Springer, 2006, pp. 75-102. (Pubitemid 44856937)
54. S.Winter, B. Brendel, I. Pechlivanis, K. Schmieder, and C. Igel, "Registration of CT and intraoperative 3-D ultrasound images of the spine using evolutionary and gradient-based methods," IEEE Trans. Evolutionary Computat., vol. 12, no. 3, pp. 284-296, Jun. 2008.
55. R. H. Gong and P. Abolmaesumi, "2D/3D registration with the CMA-ES method," Proc. SPIE, vol. 6918, pp. 69181M-69181M,Mar. 2008.
56. R. Fletcher, Practical Methods of Optimization. New York: Wiley, 1981.
57. C. Gendrin, P. Markelj, S. A. Pawiro, J. Spoerk, C. Bloch, C.Weber,M. Figl, H. Bergmann, W. Birkfellner, B. Likar, and F. Pernus, "Validation for 2D/3D registration II: The comparison of intensity-and gradientbased merit functions using a new gold standard data set," Med. Phys., vol. 38, pp. 1491-1512, 2011.
58. E. B. van de Kraats, G. P. Penney, D. Tomazevic, T. van Walsum, and W. J. Niessen, "Standardized evaluation methodology for 2-D-3-D registration," IEEE Trans. Med. Imag., vol. 24, no. 9, pp. 1177-1189, Sep. 2005. (Pubitemid 41337157)
59. W. Birkfellner, M. Stock, M. Figl, C. Gendrin, J. Hummel, S. Dong, J. Kettenbach, D. Georg, and H. Bergmann, "Stochastic rank correlation: A robust merit function for 2D/3D registration of image data obtained at different energies," Med. Phys., vol. 36, pp. 3420-3428, Aug. 2009.
60. S. A. Pawiro, P. Markelj, F. Pernus, C. Gendrin, M. Figl, C. Weber, F. Kainberger, I. Nöbauer-Huhmann, H. Bergmeister,M. Stock, D. Georg, H. Bergmann, and W. Birkfellner, "Validation for 2D/3D registration I: A new gold standard data set," Med. Phys., vol. 38, pp. 1481-1510, 2011.
61. B. K. P. Horn, "Closed-form solution of absolute orientation using unit quaternions," J. Opt. Soc. Am. A, vol. 4, pp. 629-642, 1987.
62. J. Wu, M. Kim, J. Peters, H. Chung, and S. S. Samant, "Evaluation of similarity measures for use in the intensity-based rigid 2D-3D registration for patient positioning in radiotherapy," Med. Phys., vol. 36, pp. 5391-5403, Dec. 2009.
63. L. Lemieux, R. Jagoe, D. R. Fish, N. D. Kitchen, and D. G. Thomas, "A patient-to-computed-tomography image registration method based on digitally reconstructed radiographs," Med. Phys., vol. 21, pp. 1749-1760, Nov. 1994. (Pubitemid 24356296)
64. C. Bodensteiner, C. Darolti, H. Schumacher, L. Matthaus, and A. Schweikard, "Motion and positional error correction for cone beam 3D-reconstruction with mobile C-arms," in Med. Image Comput. Comput. Assist. Interv. Int. Conf. Med. Image Comput. Comput. Assist. Interv., 2007, vol. 10, pp. 177-185.
65. G. Chintalapani, L. M. Ellingsen, O. Sadowsky, J. L. Prince, and R. H. Taylor, "Statistical atlases of bone anatomy: Construction, iterative improvement and validation," in Med. Image Comput. Comput. Assist. Interv. Int. Conf. Med. Image Comput. Comput. Assist. Interv., 2007, vol. 10, pp. 499-506.
66. M. E. Leventon, W. M. Wells, III, and W. E. L. Grimson, "Multiple view 2D-3D mutual information registration," in Proc. Image Understand. Workshop, 1997, pp. 625-630.
67. F. Maes, D. Vandermeulen, and P. Suetens, "Comparative evaluation of multiresolution optimization strategies for multimodality image registration by maximization of mutual information," Med. Image Anal., vol. 3, pp. 373-386, 1999.