Cortical surface shift estimation using stereovision and optical flow motion tracking via projection image registration

Medical Image Analysis

Volumn 18, Issue 7, 2014, Pages 1169-1183

  Ji, Songbai ^a,b   Fan, Xiaoyao ^a   Roberts, David W ^b,c   Hartov, Alex ^a   Paulsen, Keith D ^a,b  

^a DARTMOUTH COLLEGE   (United States)

^b DARTMOUTH MEDICAL SCHOOL   (United States)

^c DARTMOUTH HITCHCOCK MEDICAL CENTER   (United States)

Author keywords

Brain shift; Displacement mapping; Motion tracking; Optical flow; Stereovision

Indexed keywords

BRAIN MAPPING; IMAGING TECHNIQUES; MAPPING; OPTICAL FLOWS; PROBES; STEREO IMAGE PROCESSING; STEREO VISION; SURFACE MEASUREMENT; TRANSPLANTATION (SURGICAL);

BRAIN SHIFTS; DISPLACEMENT COMPONENTS; DISPLACEMENT MAPPING; INDEPENDENT MEASUREMENT; LOCAL COORDINATE SYSTEM; MOTION TRACKING; SURFACE NORMAL DIRECTIONS; TWO-DIMENSIONAL (2D) PROJECTION;

BRAIN;

ACCURACY; ARTICLE; AUTOMATION; CONTROLLED STUDY; CORTICAL BONE; CORTICAL SURFACE SHIFT ESTIMATION; DIGITAL IMAGING; GRAVITY; IMAGE ANALYSIS; IMAGE RECONSTRUCTION; IMAGE REGISTRATION; IMAGING PHANTOM; IMAGING SYSTEM; MOTION; MOTION ANALYSIS SYSTEM; MOVEMENT (PHYSIOLOGY); OPTIC FLOW; PRIORITY JOURNAL; SKULL SURGERY; STEREOVISION CAMERA; SURFACE PROPERTY; THREE DIMENSIONAL IMAGING; ADOLESCENT; ADULT; AGED; BRAIN DISEASES; COMPUTER ASSISTED SURGERY; DEVICES; FEMALE; HUMAN; IMAGE ENHANCEMENT; MALE; MIDDLE AGED; NEURONAVIGATION; NEUROSURGERY; PATHOLOGY; PROCEDURES; STEREOTACTIC PROCEDURE;

ADOLESCENT; ADULT; AGED; BRAIN DISEASES; FEMALE; HUMANS; IMAGE ENHANCEMENT; MALE; MIDDLE AGED; NEURONAVIGATION; NEUROSURGICAL PROCEDURES; PHANTOMS, IMAGING; STEREOTAXIC TECHNIQUES; SURGERY, COMPUTER-ASSISTED;

EID: 84904884125     PISSN: 13618415     EISSN: 13618423     Source Type: Journal    
DOI: 10.1016/j.media.2014.07.001     Document Type: Article

References (36)

1. Besl P.J., McKay N.D. A method for registration of 3-d shapes. IEEE Trans. Pattern Anal. Mach. Intell. 1992, 14(2):239-256.
2. Black M.J., Anandan P. The robust estimation of multiple motions: parametric and piecewise-smooth flow fields. Comput. Vis. Image Underst. 1996, 63(1):75-104.
3. Bonsanto M.M., Staubert A., Wirtz C.R., Tronnier V., Kunze S. Initial experience with an ultrasound-integrated single-rack neuronavigation system. Acta Neurochir. 2001, 143(11):1127-1132.
4. Brox T, Bruhn A, Papenberg N, Weickert J. High accuracy optical flow estimation based on a theory for warping. In: European Conference on Computer Vision (ECCV); 2004.
5. Bucholz R.D., Smith K.R., Laycock K.A., McDurmont L.L. Three-dimensional localization: from image-guided surgery to information-guided therapy. Methods (Duluth) 2001, 25(2):186-200.
6. Comeau R.M., Sadikot A.F., Fenster A., Peters T.M. Intraoperative ultrasound for guidance and tissue shift correction in image-guided neurosurgery. Med. Phys. 2000, 27:787-800.
7. DeLorenzo C., Papademetris X., Wu K., Vives K.P., Spencer D., Duncan J.S. Nonrigid 3D brain registration using intensity/feature information. Lecture Notes in Computer Science 2006, vol. 4190. Springer-Verlag, Berlin, Germany, pp. 932-939.
8. DeLorenzo C., Papademetris X., Staib L.H., Vives K.P., Spencer D.D., Duncan J.S. Image-guided intraoperative cortical deformation recovery using game theory: application to neocortical epilepsy surgery. IEEE Trans. Med. Imaging 2010, 29(2):322-338.
9. Ding, S., Miga, M.I., Noble, J.H., Cao, A., Dumpuri, P., Thompson, R.C., Dawant, B.M., 2009. Semi-automatic registration of pre- and postbrain tumor resection laser range data: method and validation. In: IEEE Transactions on Biomedical Engineering, vol. 56(3).
10. Ding S., Miga M.I., Pheiffer T.S., Simpson A.L., Thompson R.C., Dawant B.M. Tracking of vessels in intra-operative microscope video sequences for cortical displacement estimation. IEEE Trans. Biomed. Eng. 2011, 58(7):1985-1993.
11. Dumpuri P., Thompson R.C., Dawant B.M., Cao A., Miga M.I. An atlas-based method to compensate for brain shift: preliminary results. Med. Image Anal. 2007, 11:128-145.
12. Edwards P.J., King A.P., Maurer C.R., de Cunha D.A., Hawkes D.J., Hill D.L., Gaston R.P., Fenlon M.R., Jusczyzck A., Strong A.J., Chandler C.L., Gleeson M.J. Design and evaluation of a system for microscope-assisted guided interventions (MAGI). IEEE Trans. Med. Imaging 2000, 19(11):1082-1093. 10.1109/42.896784.
13. Fan, X., Ji, S., Hartov, A., Roberts, D.W., Paulsen, K.D., 2012. Registering stereovision surface with preoperative magnetic resonance images for brain shift compensation. In: Holmes III, David R., Wong, Kenneth, H. (Eds.), Medical Imaging 2012: Visualization, Image-Guided Procedures, and Modeling, Proceedings of SPIE, vol. 8316. SPIE 2012.
14. Ferrant M., Nabavi A., Macq B., Black P.M., Joles F.A., Kinkinis R., Warfield S.K. Serial registration of intraoperative MR images of the brain. Med. Image Anal. 2002, 6:337-359.
15. Figl M., Ede C., Hummel J., Wanschitz F., Ewers R., Bergmann H., Birkfellner W. A fully automated calibration method for an optical see-through head-mounted operating microscope with variable zoom and focus. IEEE Trans. Med. Imaging 2005, 24(11):1492-1499. 10.1109/TMI.2005.856746.
16. Hall W.A., Liu H., Martin A.J., Pozza C.H., Maxwell R.E., Truwit C.L. Safety, efficacy, and functionality of high-field strength interventional magnetic resonance imaging for neurosurgery. Neurosurgery 2000, 46:632-642.
17. Hartkens T., Hill D.L.G., Castellano-Smith A.D., Hawkes D.J., Maurer C.R., Martin M.J., Hall W.A., Liu H., Truwit C.L. Measurement and analysis of brain deformation during neurosurgery. IEEE Trans. Med. Imaging 2003, 22(1):82-92.
18. Hill D.L.G., Maurer C.R., Maciunas R.J., Barwise J.A., Fitzpatrick J.M., Wang M.Y. Measurement of intraoperative brain surface deformation under a craniotomy. Neurosurgery 1998, 43(3):514-526.
19. Horn B.K.P., Schunck B.G. Determining optical flow. Artif. Intell. 1981, 17(1-3):185-203.
20. Ji, S., Fan, X., Fontaine, K., Hartov, A., Roberts, D.W., Paulsen, K.D., 2010. An integrated model-based neurosurgical guidance system. In: Wong, Kenneth H., Miga, Michael I., Medical Imaging 2010: Visualization, Image-Guided Procedures, and Modeling, Proceedings of SPIE, vol. 7625 (SPIE, Bellingham, WA 2010) 762536.
21. Ji, S., Fan, X., Roberts, D.W., Paulsen, K.D., 2011. Cortical surface strain estimation using stereovision. In: Fichtinger, G., Martel, A., Peters, T. (Eds.), MICCAI 2011, Part I, LNCS 6891, pp. 412-419.
22. Ji, S., Fan, X., Roberts, D.W., Paulsen, K.D., 2014. Efficient stereo image geometrical reconstruction at arbitrary camera settings from a single calibration. In: Barillot, C., Golland, P., Hornegger, J., Howe R. (Eds.) MICCAI.
23. Kumar, Ankur N., Pheiffer, Thomas S., Simpson, Amber L., Thompson, Reid C., Miga, Michael I., Dawant, Benoit M., 2013. Phantom-based comparison of the accuracy of point clouds extracted from stereo cameras and laser range scanner. In: Proc. SPIE 8671, Medical Imaging 2013: Image-Guided Procedures, Robotic Interventions, and Modeling, 867125 (March 14, 2013); doi:10.1117/12.2008036.
24. Liu, C., 2009. Beyond Pixels: Exploring New Representations and Applications for Motion Analysis. Doctoral Thesis. Massachusetts Institute of Technology.
25. Lucas, B.D., Kanade, T., 1981. An iterative image registration technique with an application to stereo vision. IJCAI, pp. 674-679.
26. Maurer C.R., Fitzpatrick J.M., Wang M.Y., Galloway R.L., Maciunas R.J., Allen G.S. Registration of head volume images using implantable fiducial markers. IEEE Trans. Med. Imaging 1997, 16(4):447-462.
27. Meer, P., 2004. Robust techniques for computer vision. Emerging Topics in Computer Vision, pp. 107-190.
28. Miga M.I., Sinha T.K., Cash D.M., Galloway R.L., Weil R.J. Cortical surface registration for image-guided neurosurgery using laser range scanning. IEEE Trans. Med. Imaging 2003, 22(8):973-985.
29. Nabavi A., Black P.M., Gering D.T., Westin C.F., Mehta V., Pergolizzi R.S., Ferrant M., Warfield S.K., Hata N., Schwartz R.B., Wells W.M.III., Kikinis R., Jolesz F.A. Serial intraoperative magnetic resonance imaging of brain shift. Neurosurgery 2001, 48(4):787-798.
30. Paul P., Fleig O.J., Jannin P. Augmented virtuality based on stereoscopic reconstruction inmultimodal image-guided neurosurgery: methods and performance evaluation. IEEE Trans. Med. Imaging 2005, 24(11):1500-1511.
31. Paul P., Morandi X., Jannin P. A surface registration method for quantification of intraoperative brain deformations in image-guided neurosurgery. IEEE Trans. Inf. Technol. Biomed. 2009, 13(6):976-983.
32. Roberts D.W., Hartov A., Kennedy F.E., Miga M.I., Paulsen K.D. Intraoperative brain shift and deformation: a quantitative analysis of cortical displacement in 28 cases. Neurosurgery 1998, 43(4):749-760.
33. Sinha T.K., Dawant B.M., Duay V., Cash D.M., Weil R.J., Thompson R.C., Weaver K.D., Miga M.I. A method to track cortical surface deformations using a laser range scanner. IEEE Trans. Med. Imaging 2005, 24(6):767-781.
34. Sun H., Lunn K.E., Farid H., Wu Z., Roberts D.W., Hartov A., Paulsen K.D. Stereopsis-guided brain shift compensation. IEEE Trans. Med. Imaging 2005, 24(8):1039-1052.
35. Willson R. Modeling and Calibration of Automated Zoom Lenses, CMU-RI-TR-94-03 1994, Carnegie Mellon University, Robotics Institute.
36. Wirtz C.R., Bonsanto M.M., Knauth M., Tronnier V.M., Albert F.K., Staubert A., Kunze S. Intraoperative magnetic resonance imaging to update interactive navigation in neurosurgery: method and preliminary experience. Comput. Aid. Surg. 1997, 2:172-179.