Intraoperative laparoscope augmentation for port placement and resection planning in minimally invasive liver resection

IEEE Transactions on Medical Imaging

Volumn 27, Issue 3, 2008, Pages 355-369

  Feuerstein, Marco ^a   Mussack, Thomas ^b   Heining, Sandro M ^b   Navab, Nassir ^c  

^a NAGOYA UNIVERSITY   (Japan)

^b LUDWIG MAXIMILIANS UNIVERSITY   (Germany)

^c TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Augmented reality visualization; Image guided surgery; Laparoscopic surgery; Port placement

Indexed keywords

COMPUTER SIMULATION; COMPUTERIZED TOMOGRAPHY; DATA STRUCTURES; DISEASES; LIVER; MEDICAL IMAGING; SURGERY;

AUGMENTED REALITY VISUALIZATION; IMAGE GUIDED SURGERY; INVASIVE LAPAROSCOPIC RESECTION; LAPAROSCOPE AUGMENTATION; LAPAROSCOPIC SURGERY; PORT PLACEMENT;

TUMORS;

ANIMAL; ARTICLE; COMPUTER ASSISTED SURGERY; COMPUTER ASSISTED TOMOGRAPHY; COMPUTER INTERFACE; EQUIPMENT; EQUIPMENT DESIGN; EVALUATION; HUMAN; INSTRUMENTATION; LAPAROSCOPE; LIVER RESECTION; METHODOLOGY; MINIMALLY INVASIVE SURGERY; PREOPERATIVE CARE; SWINE;

ANIMALS; EQUIPMENT DESIGN; EQUIPMENT FAILURE ANALYSIS; HEPATECTOMY; HUMANS; LAPAROSCOPES; PREOPERATIVE CARE; SURGERY, COMPUTER-ASSISTED; SURGICAL PROCEDURES, MINIMALLY INVASIVE; SWINE; TOMOGRAPHY, X-RAY COMPUTED; USER-COMPUTER INTERFACE;

EID: 40149097958     PISSN: 02780062     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMI.2007.907327     Document Type: Article

References (55)

1. M. B. Thomas and A. X. Zhu, "Hepatocellular carcinoma: The need for progress," J. Clin. Oncol., vol. 23, no. 13, pp. 2892-2899, 2005.
2. T. Mala and B. Edwin, "Role and limitations of laparoscopic liver resection of colorectal metastases," Digestive Diseases, vol. 23, pp. 142-150, 2005.
3. A. M. Chiu, D. Dey, M. Drangova, W. D. Boyd, and T. M. Peters, "3-d image guidance for minimally invasive robotic coronary artery bypass," in Heart Surgery Forum, 2000, vol. 3, no. 3, pp. 224-231.
4. J. Traub, M. Feuerstein, M. Bauer, E. U. Schirmbeck, H. Najafi, R. Bauernschmitt, and G. Klinker, "Augmented reality for port placement and navigation in robotically assisted minimally invasive cardiovascular surgery," in Comput. Assist. Radiol. Surg., Jun. 2004, pp. 735-740.
5. L. Adhami and È. Coste-Manière, "Optimal planning for minimally invasive surgical robots," IEEE Trans. Robot. Automat., vol. 19, no. 5, pp. 854-863, Oct. 2003.
6. J. Cannon, J. Stoll, S. Selha, P. Dupont, R. Howe, and D. Torchiana, "Port placement planning in robot-assisted coronary artery bypass," IEEE Trans. Robot. Automat., vol. 19, no. 5, pp. 912-917, Oct. 2003.
7. J. Marmurek, C. Wedlake, U. Pardasani, R. Eagleson, and T. Peters, "Image-guided laser projection for port placement in minimally invasive surgery," in Medicine Meets Virtual Reality 14: Accelerating Change in Healthcare: Next Medical Toolkit, ser. Studies in Health Technology and Informatics. Amsterdam, The Netherlands: IOS Press, 2005, vol. 119, pp. 367-372.
8. L. Adhami and È. Coste-Manière, "A versatile system, for computer integrated mini-invasive robotic surgery," in Proc. Int. Conf. Med. Image Computing Comput. Assist. Intervention (MICCAI), Tokyo, Japan, 2002, pp. 272-281.
9. V. Falk, F. Mourgues, L. Adhami, S. Jacobs, H. Thiele, S. Nitzsche, F. W. Mohr, and È. Coste-Manière, "Cardio navigation: Planning, simulation, and augmented reality in robotic assisted endoscopic bypass grafting," Ann. Thoracic Surg., vol. 79, pp. 2040-2047, Jun. 2005.
10. S.D.Selha, P.E.Dupont, R.D.Howe, and D. F. Torchiana, "Dexterity optimization by port placement in robot-assisted minimally invasive surgery," in Telemanipulator and Telepresence Technologies VIII, ser. Proceeding of SPIE. Bellingham, WA:, Feb. 2002, vol. 4570, pp. 97-104.
11. È. Coste-Manière, L. Adhami, F. Mourgues, and O. Bantiche, "Optimal planning of robotically assisted heart surgery: First results on the transfer precision, in the operating room," Int. J. Robot. Res., vol. 23, pp. 539-548, Apr.-May 2004.
12. M. Feuerstein, S. M. Wildhirt, R. Bauernschmitt, and N. Navab, "Automatic patient registration for port placement in minimally invasive endoscopic surgery," Proceedings of the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) ser. Lecture Notes Comput. Sci., J. S. Duncan and G. Gerig, Eds., vol. 3750 New York, Springer-Verlag, 2005, pp. 287-294.
13. B. Olbrich, J. Traub, S. Wiesner, A. Wiechert, H. Feußner, and N. Navab, "Respiratory motion analysis: Towards gated augmentation of the liver," in Comput.Assist. Radiol. Surgery, Berlin, Germany, Jun. 2005, pp. 248-253.
14. A. Herline, J. Stefansic, J. Debelak, S. Hartmann, C. Pinson, R. Galloway, and W. Chapman, "Image-guided surgery: Preliminary feasibility studies of frameless stereotactic liver surgery," Arch. Surg., vol. 134, no. 6, pp. 644-650, Jun. 1999.
15. J. M. Balter, L. A. Dawson, S. Kazanjian, C. McGinn, K. K. Brock, T. Lawrence, and R. T. Haken, "Determination of ventilatory liver movement via radiographic evaluation of diaphragm position," Int. J. Radiation Oncol Biol., Phys., vol. 51, no. 1, pp. 267-270, Sep. 2001.
16. M. Clifford, F. Banovac, E. Levy, and K. Cleary, "Assessment of hepatic motion secondary to respiration for computer assisted interventions," Comput. Aid Surg., vol. 7, no. 5, pp. 291-299, 2002.
17. J. W. Wong, M. B. Sharpe, D. A. Jaffray, V. R. Kini, J. M. Robertson, J. S. Stromberg, and A. A. Martinez, "The use of active breathing control (abc) to reduce margin for breathing motion," Int. J. Radiation Oncol. Biol. Phys., vol. 44, no. 4, pp. 911-919, Jul. 1999.
18. S. Nicolau, X. Pennec, L. Soler, and N. Ayache, "A complete augmented reality guidance system for liver punctures: First clinical evaluation," in Proceedings of the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), ser. Lecture Notes Comput. Sci., J. Duncan and G. Gerig, Eds. New York: Springer-Verlag, 2005, vol. 3749, pp. 539-547.
19. S. Nicolau, L. Goffin, and L. Soler, "A low cost and accurate guidance system for laparoscopic surgery: Validation on an abdominal phantom," in ACM Symp. Virtual Reality Software Technol., Nov. 2005, pp. 124-133.
20. F. Mourgues, T. Vieville, V. Falk, and È. Coste-Manière, "Interactive guidance by image overlay in robot assisted coronary artery bypass," in Pwceedings of the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), ser. Lecture Notes Comput. Sci., R. E. Ellis and T. M. Peters, Eds. New York: Springer-Verlag, 2003, pp. 173-181.
21. G. Fichtinger, A. Deguet, K. Masamune, E. Balogh, G. S. Fischer, H. Mathieu, R. H. Taylor, S. J. Zinreich, and L. M. Fayad, "Image overlay guidance for needle insertion in CT scanner," IEEE Trans. Biomed. Eng., vol. 52, no. 8, pp. 1415-1424, Aug. 2005.
22. J. Ellsmere, J. Stall, D. W. Rattner, D. Brooks, R. Kane, W. M. Wells, III, R. Kikinis, and K. Vosburgh, "A navigation system, for augmenting laparoscopic ultrasound," in Proceedings of the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), ser. Lecture Notes Comput. Sci., R. E. Ellis and T. M. Peters, Eds. New York: Springer-Verlag, 2003, pp. 184-191.
23. J. Ellsmere, J. Stall, W. Wells, R. Kikinis, K. Vosburgh, R. Kane, D. Brooks, and D. Rattner, "A new visualization technique for laparoscopic ultrasonography," Surgery, vol. 136, no. 1, pp. 84-92, Jul. 2004.
24. J. Leven, D. Burschka, R. Kumar, G. Zhang, S. Blumenkranz, X. D. Dai, M. Awad, G. D. Hager, M. Marohn, M. Choti, C. Hasser, and R. H. Taylor, "Davinci canvas: A telerobotic surgical system with integrated, robot-assisted, laparoscopic ultrasound capability," in Proceedings of the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), ser. Lecture Notes Comput. Sci. New York: Springer- Verlag, 2005, vol. 3749, pp. 811-818.
25. J. H. Siewerdsen, D. J. Moseley, S. Burch, S. K. Bisland, A. Bogaards, B. C. Wilson, and D. A. Jaffray, "Volume CT with a flat-panel detector on a mobile, isocentric c-arm: Pre-clinical investigation in guidance of minimally invasive surgery," Med. Phys., vol. 32, no. 1, pp. 241-254, Jan. 2005.
26. Z. Yaniv and K. Cleary, Image-guided procedures: A review Computer Aided Interventions and Medical Robotics, Imaging Science and Information Systems Center, Department of Radiology, Georgetown University Medical Center, Washington, DC, Tech. Rep., Apr. 2006.
27. M. Feuerstein, T. Mussack, S. M. Heining, and N. Navab, "Registrationfree laparoscope augmentation for intra-operative liver resection planning," in Medical Imaging 2007: Visualization and ImageGuided Procedures, ser. Proc. SPIE, K. R. Cleary and M. I. Miga, Eds. Bellingham, WA: SPIE, 2007.
28. S. Kriminski, M. Mitschke, S. Sorensen, N. M. Wink, P. E. Chow, S. Tenn, and T. D. Solberg, "Respiratory correlated cone-beam, computed tomography on an isocentric c-arm," Phys. Med. Biol., vol. 50, no. 22, pp. 5263-5280, Nov. 2005.
29. N. Navab, M. Feuerstein, and C. Bichlmeier, "Laparoscopic virtual mirror-New interaction paradigm for monitor based augmented reality," virtual Reality, pp. 43-50, Mar. 2007.
30. M. Tuceryan, D. S. Greer, R. T. Whitaker, D. E. Breen, C. Crampton, E. Rose, and K. H. Ahlers, "Calibration requirements and procedures for a monitor-based augmented reality system," IEEE Trans. Visual. Comput. Graphics, vol. 1, no. 3, pp. 255-273, Sep. 1995.
31. J. D. Stefansic, A. J. Herline, Y. Shyr, W. C. Chapman, J. M. Fitzpatrick, and R. L. Galloway, "Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery," IEEE Trans. Med Imag., vol. 19, no. 10, pp. 1012-1023, Oct. 2000.
32. R. Shahidi, M. R. Bax, C. R. Maurer, Jr., J. A. Johnson, E. P. Wilkinson, B. Wang, J. B. West, M. J. Citardi, K. H. Manwaring, and R. Khadem, "Implementation, calibration and accuracy testing of an image-enhanced endoscopy system," IEEE Trans. Med. Imag., vol. 21, no. 12, pp. 1524-1535, Dec. 2002.
33. F. Vogt, S. Krüger, H. Niemann, and C. Schick, "A system for real-time endoscopic image enhancement," in Proceedings of the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), ser. Lecture Notes Comput. Sci., R. E. Ellis and T. M. Peters, Eds. New York: Springer-Verlag, 2003, pp. 356-363.
34. J. Heikkilä and O. Silvén, "A four-step camera calibration procedure with implicit image correction," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), Jun. 1997, pp. 1106-1112.
35. Z. Zhang, "A flexible new technique for camera calibration," IEEE Trans. Pattern Anal Mach. Intell., vol. 22, no. 11, pp. 1330-1334, Nov. 2000.
36. R. Tsai and R. Lenz, "Real time versatile robotics hand/eye calibration using 3-D machine vision," in Proc. IEEE Int. Conf. Robot. Automat., 1988, vol. 1, pp. 554-561.
37. K. Daniilidis, "Hand-eye calibration using dual quaternions," Int. J. Robot. Res., vol. 18, pp. 286-298, 1999.
38. M. Mitschke and N. Navab, "Recovering projection geometry: How a cheap camera can outperform, an expensive stereo system," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. (CVPR), 2000, vol. 1, pp. 193-200.
39. T. Yamaguchi, M. Nakamoto, Y. Sato, K. Konishi, M. Hashizume, N. Sugano, H. Yoshikawa, and S. Tamura, "Development of a camera model and calibration procedure for oblique-viewing endoscopes," Comput. Aided Surg., vol. 9, no. 5, pp. 203-214, 2004.
40. N. Navab, A. R. Bani-Hashemi, M. M. Mitschke, D. W. Holdsworth, R. Fahrig, A. J. Fox, and R. Graumann, "Dynamic geometrical calibration for 3-D cerebral angiography," in Medical Imaging 1996: Physics of Medical Imaging, ser. Proc. SPIE. New York: Springer-Verlag, 1996, vol. 2708, pp. 361-370.
41. 3D," Electromedica, vol. 70, no. 1, pp. 31-36, 2002.
42. T. Sielhorst, M. Feuerstein, J. Traub, O. Kutter, and N. Navab, "Campar: A software framework guaranteeing quality for medical augmented reality," Int. J.Comput. Assisted Radiol. Surg., vol. 1, pp. 29-30, Jun. 2006.
43. M. Y. Wang, C. R. Maurer, Jr., J. M. Fitzpatrick, and R. J. Maciunas, "An automatic technique for finding and localizing externally attached markers in CT and MR volume images of the head," IEEE Trans. Biomed. Eng., vol. 43, no. 6, pp. 627-637, Jun. 1996.
44. S. Nicolau, A. Garcia, X. Pennec, L. Soler, and N. Ayache, "Augmented reality guided radio-frequency tumor ablation," Comput. Animation Virtual World vol. 16, no. 1, pp. 1-10, 2005.
45. R. Hartley and A. Zisserman, Multiple View Geometry in ComputerVision, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 2003.
46. E. Trueco and A. Verri, Introductory Techniques for 3-D Computer Vision. Upper Saddle River, NJ: Prentice Hall, 1998.
47. P. Sturm., S. Ramalingam, and S. K. Lodha, "On calibration, sttucturefrom- motion and multi-view geometry for panoramic camera models," presented at the Panoramic Photogrammetry Workshop Berlin, Germany, 2005.
48. S. Gold and A. Rangarajan, "A graduated assignment algorithm for graph matching," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 4, pp. 377-388, Apr. 1996.
49. M. W. Walker, L. Shao, and R. A. Volz, "Estimating 3-d location parameters using dual number quaternions," CVGIP: Image Underst., vol. 54, no. 3, pp. 358-367, 1991.
50. S. Nicolau, X. Pennec, L. Soler, and N. Ayache, "An accuracy certified augmented reality system, for therapy guidance," in Proceedings of the 8th European Conference on Computer Vision (ECCV 04), ser. Lecture Notes Comput. Sci. New York: Springer-Verlag, 2004, vol. 3023, pp. 79-91.
51. E. Euler, S. Heining, C. Riquarts, and W. Mutschier, "C-arm-based threedimensional navigation: A preliminary feasibility study," Comput. Aid. Surg., vol. 8, no. 1, pp. 35-41, 2003.
52. 3D mobile c-arm," Electromedica, vol. 71, no. 1, pp. 7-16, 2003.
53. J. West and C. Maurer, "Designing optically tracked instruments for image-guided surgery," IEEE Trans. Med. Imag., vol. 23, no. 5, pp. 533-545, May 2004.
54. G. S. Fischer and R. H. Taylor, "Electromagnetic tracker measurement error simulation and tool design," in Proc. Int'l Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), ser. Lecture Notes Comput. Sci., J. S. Duncan and G. Gerig, Eds. New York: Springer-Verlag, 2005, vol. 3750, pp. 73-80.
55. M. Bauer, M. Schlegel, D. Pustka, N. Navab, and G. Klinker, "Predicting and estimating the accuracy of vision-based optical tracking systems," in Proc. IEEE ACM Int. Symp. Mixed Augmented Reality (ISMAR), Santa Barbara, CA, Oct. 2006, pp. 43-51.