Image-guided intraoperative cortical deformation recovery using game theory: Application to neocortical epilepsy surgery

IEEE Transactions on Medical Imaging

Volumn 29, Issue 2, 2010, Pages 322-338

  Delorenzo, Christine ^a   Papademetris, Xenophon ^b   Staib, Lawrence H ^b   Vives, Kenneth P ^c   Spencer, Dennis D ^c   Duncan, James S ^b  

^a Yale University   (United States)

^b YALE UNIVERSITY   (United States)

^c YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Biomedical image processing; Brain; Game theory; Image registration; Surgery

Indexed keywords

BIOMECHANICAL MODEL; BIOMEDICAL IMAGE PROCESSING; BRAIN DEFORMATIONS; BRAIN IMAGES; BRAIN SURFACE; CALIBRATION ERROR; CAMERA CALIBRATION; COMPETITIVE ENVIRONMENT; CORTICAL DEFORMATION; CORTICAL SURFACES; EPILEPSY SURGERY; IMAGE-GUIDED; IN-VIVO; INITIAL CONDITIONS; INTRA-OPERATIVE; PHYSICAL PROCESS; STEREO SYSTEM; STEREO VISION SYSTEM; SURFACE DEFORMATION; SURFACE DISPLACEMENT;

BIOLOGY; BIOMECHANICS; CALIBRATION; CAMERAS; DECISION MAKING; DECISION THEORY; DEFORMATION; IMAGE REGISTRATION; IMAGING SYSTEMS; NEUROSURGERY; STEREO VISION; SURFACE CHEMISTRY;

GAME THEORY;

ADOLESCENT; ADULT; ALGORITHM; ARTICLE; BAYES THEOREM; CALIBRATION; COMPUTER ASSISTED SURGERY; EPILEPSY; FEMALE; GAME; HISTOLOGY; HUMAN; IMAGE PROCESSING; IMAGE QUALITY; MALE; METHODOLOGY; MIDDLE AGED; NEOCORTEX; NUCLEAR MAGNETIC RESONANCE IMAGING; REPRODUCIBILITY; SURFACE PROPERTY;

ADOLESCENT; ADULT; ALGORITHMS; BAYES THEOREM; CALIBRATION; EPILEPSY; FEMALE; GAME THEORY; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; NEOCORTEX; PHANTOMS, IMAGING; REPRODUCIBILITY OF RESULTS; SURFACE PROPERTIES; SURGERY, COMPUTER-ASSISTED;

EID: 76249122625     PISSN: 02780062     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMI.2009.2027993     Document Type: Article

References (68)

1. N. Archip, A. Fedorov, B. Lloyd, N. Chrisochoides, A. Golby, P. M. Black, and S. K. Warfield, "Integration of patient specific modeling and advanced image processing techniques for image-guided neurosurgery, " in Med. Imag. 2006: Visualization, Image-Guided Procedures, Display, Proc. SPIE, San Diego, CA, Feb. 12-14, 2006, vol.6141, pp. 422-429.
2. M. A. Audette, K. Siddiqi, F. P. Ferrie, and T. M. Peters, "An integrated range-sensing, segmentation and registration framework for the characterization of intra-surgical brain deformations in image-guided surgery, " Comput. Vis. Image Understand., vol.89, no.2-3, pp. 226-251, Feb. 2003.
3. T. Başar and G. J. Olsder, Dynamic Noncooperative Game Theory, 2nd ed. New York: Academic, 1995.
4. S. Baker and S. K. Nayar, "Parametric feature detection, " Int. J. Comput. Vis., vol.27, no.1, pp. 27-50, 1998.
5. L. M. Bates, S. J. Goerss, and R. A. Robb, "A method for quantitative validation of image based correction for intraoperative brain shift, " in Med. Imag. 2000: Image Display Visualizat., Proc. SPIE, San Diego, CA, Feb. 13-15, 2000, vol.3976, pp. 58-69.
6. P. M. Black, T. Moriarty, A. Eben, III, P. Stieg, E. J. Woodard, P. L. Gleason, C. H. Martin, R. Kikinis, R. B. Schwartz, and F. A. Jolesz, "Development and implementation of intraoperative Magnetic Resonance Imaging and its neurosurgical applications, " Neurosurgery, vol.41, no.4, pp. 831-845, Oct. 1997.
7. T. Blumenthal, A. Hartov, K. Lunn, F. E. Kennedy, D. W. Roberts, and K. D. Paulsen, "Quantifying brain shift during neurosurgery using spatially tracked ultrasound, " in Med. Imag. 2005: Visualizat., Image-Guided Procedures, Display, Proc. SPIE, San Diego, CA, Feb. 13-15, 2005, vol.5744, pp. 388-399.
8. J. Y. Bouguet, Camera Calibration Toolbox for MATLAB
9. [Online]. Available: http://www. vision. caltech. edu/bouguetj/calib-doc/
10. H. I. Bozma and J. S. Duncan, "A game-theoretic approach to integration of modules, " IEEE Trans. Pattern Anal. Mach. Intell., vol.16, no.11, pp. 1074-1086, Nov. 1994.
11. A. Cao, P. Dumpuri, and M. I. Miga, "Tracking cortical surface deformations based on vessel structure using a laser range scanner, " in Int. Symp. Biomed. Imag. (ISBI), Washington, DC, Apr. 6-9, 2006, pp. 522-525.
12. A. Chakraborty and J. S. Duncan, "Game-theoretic integration for image segmentation, " IEEE Trans. Pattern Anal. Mach. Intell., vol.21, no.1, pp. 12-30, Jan. 1999.
13. Q. Chen, Q. S. Sun, P. A. Heng, and D. S. Xia, "Parametric active contours for object tracking based on matching degree image of object contour points, " Pattern Recognit. Lett., vol.29, no.2, pp. 126-141, Jan. 2008.
14. O. Clatz, H. Delingette, I. F. Talos, A. J. Golby, R. Kikinis, F. A. Jolesz, N. Ayache, and S. K. Warfield, "Robust nonrigid registration to capture brain shift from intraoperative MRI, " IEEE Trans. Med. Imag., vol.24, no.11, pp. 1417-1427, Nov. 2005.
15. A. C. F. Colchester, J. Zhao, K. S. Holton-Tainter, C. J. Henri, N. Mait-land, P. T. E. Roberts, C. G. Harris, and R. J. Evans, "Development and preliminary evaluation of VISLAN, a surgical planning and guidance system using intra-operative video imaging, " Med. Image Anal., vol.1, no.1, pp. 73-90, Mar. 1996.
16. D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-based object tracking, " IEEE Trans. Pattern Anal. Mach. Intell., vol.25, no.5, pp. 564-577, May 2003.
17. C. Darolti, A. Mertins, and U. G. Hofmann, "A fast level-set method for accurate tracking of articulated objects with an edge-based binary speed term, " in Adv. Concepts Intelligent Vis. Syst. (ACIVS), Delft, Netherlands, Aug. 28-31, 2007, vol.4678, pp. 828-839.
18. C. DeLorenzo, X. Papademetris, K. P. Vives, D. D. Spencer, and J. S. Duncan, "Combined feature/intensity-based brain shift compensation using stereo guidance, " in Int. Symp. Biomed. Imag. (ISBI), Washington, DC, Apr. 6-8, 2006, pp. 335-338.
19. C. DeLorenzo, X. Papademetris, K. P. Vives, D. D. Spencer, and J. S. Duncan, "A comprehensive system for intraoperative 3-D brain deformation recovery, " in Med. Image Computing Computer-Assisted In-tervent. (MICCAI), Brisbane, Australia, Nov. 1, 2007, vol.4792, pp. 553-561.
20. C. DeLorenzo, X. Papademetris, K. P. Vives, D. D. Spencer, and J. S. Duncan, "A realistic brain phantom for 3-D deformation recovery, " in Int. Symp. Biomed. Imag. (ISBI), Washington, DC, Apr. 12-15, 2007.
21. C. DeLorenzo, X. Papademetris, K. Wu, K. P. Vives, D. D. Spencer, and J. S. Duncan, "Nonrigid 3-D brain registration using intensity/feature information, " in Med. Image Computing Computer-Assisted Inter-vent. (MICCAI), Copenhagen, Denmark, Oct. 1-6, 2006, vol.4190, pp. 932-939.
22. V. Duay, T. K. Sinha, P. F. D'Haese, M. I. Miga, and B. M. Dawant, "Non-rigid registration of serial intra-operative images for automatic brain shift estimation, " in Proc. Workshop Biomed. Image Registrat. (WBIR), Philadelphia, PA, Jun. 23-24, 2003, vol.2717, pp. 61-70.
23. P. Dumpuri, R. C. Thompson, B. M. Dawant, A. Cao, and M. I. Miga, "An atlas-based method to compensate for brain shift: Preliminary results, " Med. Image Anal., vol.11, no.2, pp. 128-145, Apr. 2007.
24. P. Dumpuri, R. C. Thompson, T. K. Sinha, and M. I. Miga, "Automated brain shift correction using a pre-computed deformation atlas, " in Proc. SPIE Med. Imag. 2006: Visualizat., Image-Guided Procedures, Display, San Diego, CA, Feb. 12-14, 2006, vol.6141, pp. 430-437.
25. M. Ferrant, A. Nabavi, B. Macq, P. M. Black, F. A. Jolesz, R. Kikinis, and S. K. Warfield, "Serial registration of intraoperative MR images of the brain, " Med. Image Anal., vol.6, no.4, pp. 337-359, Dec. 2002.
26. D. G. Gobbi, R. M. Comeau, and T. M. Peters, "Ultrasound/MRI overlay with image warping for neurosurgery, " in Med. Image Computing Computer-Assisted Intervent. (MICCAI), Pittsburgh, PA, Oct. 11-14, 2000, vol.1935, pp. 106-114.
27. G. L. Goualher, D. L. Collins, C. Barillot, and A. C. Evans, "Automatic identification of cortical sulci using a 3-D probabilistic atlas, " in Med. Image Comput. Computer-Assisted Intervent. (MICCAI), Cambridge, MA, Oct. 11-13, 1998, vol.1496, pp. 509-518.
28. W. E. L. Grimson, G. J. Ettinger, S. J. White, T. Lozano-Pérez, W. M. Wells, and R. Kikinis, "An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization, " IEEE Trans. Med. Imag., vol.15, no.2, pp. 129-140, Apr. 1996.
29. P. Hastreiter, C. Rezk-Salama, G. Soza, M. Bauer, G. Greiner, R. Fahlbusch, O. Ganslandt, and C. Nimsky, "Strategies for brain shift evaluation, " Med. Image Anal., vol.8, no.4, pp. 447-464, Dec. 2004.
30. J. Heikkilä and O. Silvén, "A four-step camera calibration procedure with implicit image correction, " in Comput. Vis. Pattern Recognit. (CVPR), San Juan, Puerto Rico, Jun. 17-19, 1997, pp. 1106-1112.
31. M. Jacob and M. Unser, "Design of steerable filters for feature detection using canny-like criteria, " IEEE Trans. Pattern Anal. Mach. Intell., vol.26, no.8, pp. 1007-1019, Aug. 2004.
32. F. A. Jolesz, "Future perspectives for intraoperative MRI, " Neurosurg. Clinics North Amer., vol.16, no.1, pp. 201-213, Jan. 2005.
33. C. A. Kemper, I. F. Talos, A. Golby, P. M. Black, R. Kikinis, W. E. L. Grimson, and S. K. Warfield, "An anisotropic material model for image guided neurosurgery, " in Med. Image Computing Computer-Assisted Intervent. (MICCAI), Saint-Malo, France, Sep. 26-29, 2004, vol.3217, pp. 267-275.
34. J. S. Kim and K. S. Hong, "A new graph cut-based multiple active contour algorithm without initial contours and seed points, " Mach. Vis. Applicat., vol.19, no.3, pp. 181-193, Feb. 2008.
35. M. M. J. Letteboer, P. W. A. Willems, M. A. Viergever, and W. J. Niessen, "Brain shift estimation in image-guided neurosurgery using 3-D ultrasound, " IEEE Trans. Biomed. Eng., vol.52, no.2, pp. 268-276, Feb. 2005.
36. M. G. Linguraru, M. G. Ballester, and N. Ayache, "A multiscale feature detector for morphological analysis of the brain, " in Medical Image Computing and Computer-Assisted Intervention (MICCAI), Montréal, Canada, Nov. 15-18, 2003, vol.2879, pp. 738-745.
37. K. E. Lunn, K. D. Paulsen, F. Liu, F. E. Kennedy, A. Hartov, and D. W. Roberts, "Data-guided brain deformation modeling: Evaluation of a 3-D adjoint inversion method in porcine studies, " IEEE Trans. Biomed. Eng., vol.53, no.10, pp. 1893-1900, Oct. 2006.
38. K. E. Lunn, K. D. Paulsen, D. R. Lynch, D. W. Roberts, F. E. Kennedy, and A. Hartov, "Assimilating intraoperative data with brain shift modeling using the adjoint equations, " Med. Image Anal., vol.9, no.3, pp. 281-293, Jun. 2005.
39. M. Machacek, M. Sauter, and T. Rösgen, "Two-step calibration of a stereo camera system for measurements in large volumes, " Measurements Sci. Technol., vol.14, pp. 1631-1639, 2003.
40. E. Mendelson, Introducing Game Theory and Its Applications. Boca Raton, FL: Chapman & Hall/CRC, 2004.
41. M. I. Miga, T. K. Sinha, D. M. Cash, R. L. Galloway, and R. J. Weil, "Cortical surface registration for image-guided neurosurgery using laser-range scanning, " IEEE Trans. Med. Imag., vol.22, no.8, pp. 973-985, Aug. 2003.
42. S. Nakajima, H. Atsumi, R. Kikinis, T. M. Moriarty, D. C. Metcalf, F. A. Jolesz, and P. M. Black, "Use of cortical surface vessel registration for image-guided neurosurgery, " Neurosurgery, vol.40, pp. 1201-1210, Jun. 1997.
43. C. Nimsky, O. Ganslandt, B. v. Keller, and R. Fahlbusch, "Intraoper-ative high-field MRI: Anatomical and functional imaging, " Acta Neu-rochir, vol.98 Suppl, pp. 87-95, 2006.
44. X. Papademetris, C. DeLorenzo, S. Flossmann, M. Neff, K. P. Vives, D. D. Spencer, L. H. Staib, and J. S. Duncan, "From medical image computing to computer-aided intervention: Development of a research interface for image-guided navigation, " Int. J. Med. Robotics Comput. Assist. Surg., vol.5, pp. 147-157, 2009.
45. X. Papademetris, M. Jackowski, N. Rajeevan, R. T. Constable, and L. H. Staib, BioImage Suite: An integrated medical image analysis suite Section of Bioimag. Sci., Dep. Diagnostic Radiol., Yale School Med.
46. [Online]. Available: http://www. bioimagesuite. org
47. P. Paul, O. Fleig, and P. Jannin, "Augmented virtuality based on stereoscopic reconstruction in multimodal image-guided neuro-surgery: Methods and performance evaluation, " IEEE Trans. Med. Imag., vol.24, no.11, pp. 1500-1511, Nov. 2005.
48. I. Reinertsen, M. Descoteaux, S. Drouin, K. Siddiqi, and D. L. Collins, "Vessel driven correction of brain shift, " in Med. Image Computing Computer-Assisted Intervent. (MICCAI), Saint-Malo, France, Sep. 26-29, 2004, vol.3217, pp. 208-216.
49. D. Rivière, J. F. Mangin, D. Papadopoulos-Orfanos, J. M. Martinez, V. Frouin, and J. Régis, "Automatic recognition of cortical sulci of the human brain using a congregation of neural networks, " Med. Image Anal., vol.6, no.2, pp. 77-92, Jun. 2002.
50. D. W. Roberts, A. Hartov, F. E. Kennedy, M. I. Miga, and K. D. Paulsen, "Intraoperative brain shift and deformation: A quantitative analysis of cortical displacement in 28 cases, " Neurosurgery, vol.43, no.4, pp. 749-758, Oct. 1998.
51. T. K. Sinha, B. D. Dawant, V. Duay, D. M. Cash, R. J. Weil, R. C. Thompson, K. D. Weaver, and M. I. Miga, "A method to track cortical surface deformations using a laser range scanner, " IEEE Trans. Med. Imag., vol.24, no.6, pp. 767-781, Jun. 2005.
52. T. K. Sinha, V. Duay, B. M. Dawant, and M. I. Miga, "Cortical shift tracking using a laser range scanner and deformable registration methods, " in Med. Image Comput. Computer-Assisted Intervent. (MICCAI), Montréal, Canada, Nov. 15-18, 2003, vol.2879, pp. 166-174.
53. T. K. Sinha, M. I. Miga, D. M. Cash, and R. J. Weil, "Intraoperative cortical surface characterization using laser range scanning: Preliminary results, " Neurosurgery, vol.59(ONS Suppl 4, pp. ONS368-ONS377, Oct. 2006. ́
54. O. Skrinjar and J. S. Duncan, "Stereo-guided volumetric deformation recovery, " in In. Symp. Biomed. Imag. (ISBI), Washington, DC, Jul. 2002, pp. 863-866.
55. O. Skrinjar, A. Nabavi, and J. S. Duncan, "A stereo-guided biomechan-ical model for volumetric deformation analysis, " in Math. Methods Biomed. Image Anal. (MMBIA), Kauai, HI, Dec. 9-10, 2001, pp. 95-102.
56. O. Skrinjar, A. Nabavi, and J. S. Duncan, "Model-driven brain shift compensation, " Med. Image Anal., vol.6, no.4, pp. 361-373, Dec. 2002.
57. G. Soza, R. Grosso, C. Nimsky, G. Greiner, and P. Hastreiter, "Estimating mechanical brain tissue properties with simulation and registration, " in Med. Image Computing Computer-Assisted Intervent. (MICCAI), Saint-Malo, France, Sep. 26-29, 2004, vol.3217, pp. 276-283.
58. H. Sun, H. Farid, K. Rick, A. Hartov, D. W. Roberts, and K. D. Paulsen, "Estimating cortical surface motion using stereopsis for brain deformation models, " in Medical Image Computing Computer-Assisted Inter-vent. (MICCAI), Montréal, Canada, Nov. 15-18, 2003, vol.2878, pp. 794-801.
59. H. Sun, K. E. Lunn, H. Farid, Z. Wu, D. W. Roberts, A. Hartov, and K. D. Paulsen, "Stereopsis-guided brain shift compensation, " IEEE Trans. Med. Imag., vol.24, no.8, pp. 1039-1052, Aug. 2005.
60. H. Sun, D. W. Roberts, H. Farid, Z. Wu, A. Hartov, and K. D. Paulsen, "Cortical surface tracking using a stereoscopic operating microscope, " Neurosurgery, vol.56, pp. ONS86-ONS97, Jan. 2005.
61. H. Sun, D. W. Roberts, A. Hartov, K. Rick, and K. D. Paulsen, "Using cortical vessels for patient registration during image-guided neurosurgery-A phantom study, " in Proc. SPIE Med. Imag. 2003: Visualizat., Image-Guided Procedures, Display, Feb. 16-18, 2003, vol.5029, pp. 183-191.
62. X. Tao, C. Davatzikos, and J. L. Prince, "Using the fast marching method to extract curves with given global properties, " in Med. Image Computing Computer-Assisted Intervent. (MICCAI), Palm Springs, CA, Oct. 26-29, 2005, vol.3750, pp. 870-877.
63. E. Trucco and A. Verri, Introductory Techniques for 3-D Computer Vision. Upper Saddle River, NJ: Prentice-Hall, 1998.
64. Z. Tu, S. Zheng, and A. Yuille, "Shape matching and registration by data-driven EM, " Comput. Vis. Image Understand., vol.109, no.3, pp. 290-304, Mar. 2008.
65. Z. Tu, S. Zheng, A. L. Yuille, A. L. Reiss, R. A. Dutton, A. D. Lee, A. M. Galaburda, I. Dinov, P. M. Thompson, and A. W. Toga, "Automated extraction of the cortical sulci based on a supervised learning approach, " IEEE Trans. Med. Imag., vol.26, no.4, pp. 541-552, Apr. 2007.
66. S. K. Warfield, F. Talos, A. Tei, A. Bharatha, A. Nabavi, M. Ferrant, P. M. Black, F. A. Jolesz, and R. Kikinis, "Real-time registration of volumetric brain MRI by biomechanical simulation of deformation during image guided neurosurgery, " Comput. Visualizat. Sci., vol.5, no.1, pp. 3-11, Jul. 2002.
67. A. Wittek, R. Kikinis, S. K. Warfield, and K. Miller, "Brain shift computation using a fully nonlinear biomechanical model, " in Med. Image Computing Computer-Assisted Intervent. (MICCAI), Palm Springs, CA, Oct. 26-29, 2005, vol.3750, pp. 583-590.
68. Y. Zhou, P. M. Thompson, and A. W. Toga, "Extracting and representing the cortical sulci, " IEEE Computer Graphics Appl., vol.19, no.3, pp. 49-55, May/Jun. 1999.