Augmented reality and haptic interfaces for robot-assisted surgery

International Journal of Medical Robotics and Computer Assisted Surgery

Volumn 8, Issue 1, 2012, Pages 45-56

  Yamamoto, Tomonori ^a,c   Abolhassani, Niki ^b   Jung, Sung ^b   Okamura, Allison M ^a,d   Judkins, Timothy N ^b  

^a Johns Hopkins University   (United States)

^b INTELLIGENT AUTOMATION INC   (United States)

^c SynTouch LLC   (United States)

^d STANFORD UNIVERSITY   (United States)

Author keywords

Augmented reality; Haptics; Robot assisted minimally invasive surgery; Robotics; Stereo vision; Teleoperation

Indexed keywords

AUGMENTED REALITY; BIOMECHANICS; COMPUTER PROGRAMMING; HAPTIC INTERFACES; ROBOTIC SURGERY; STEREO IMAGE PROCESSING; STEREO VISION; SURGICAL EQUIPMENT; THREE DIMENSIONAL COMPUTER GRAPHICS; TISSUE; VIRTUAL REALITY; VISUAL COMMUNICATION; VISUAL SERVOING;

BACKGROUND CURRENT; HAPTIC FEEDBACKS; HAPTICS; HAPTICS INTERFACES; MINIMALLY-INVASIVE SURGERY; PLUG-INS; REALITY INTERFACE; ROBOT-ASSISTED MINIMALLY INVASIVE SURGERY; ROBOT-ASSISTED SURGERY; TELEOPERATED ROBOTS;

REMOTE CONTROL;

ARTICLE; COMPUTER PROGRAM; IMAGE PROCESSING; MINIMALLY INVASIVE SURGERY; PALPATION; ROBOT ASSISTED MINIMALLY INVASIVE SURGERY; ROBOTICS; SURFACE PROPERTY; TACTILE FEEDBACK; TASK PERFORMANCE; VISUAL FEEDBACK;

EID: 84858003738     PISSN: 14785951     EISSN: 1478596X     Source Type: Journal    
DOI: 10.1002/rcs.421     Document Type: Article

References (29)

1. Kitagawa M, Dokko D, Okamura AM, et al. Effect of sensory substitution on suture manipulation forces for robotic surgical systems. J Thorac Cardiovasc Surg 2005; 129(1): 151-158.
2. Wagner CR, Stylopoulos N, Jackson PG, et al. The benefit of force feedback in surgery: examination of blunt dissection [Internet]. Presence: Teleoperat Virtual Environ 2007; 16(3): 252-262.
3. Gwilliam J, Mahvash M, Vagvolgyi B, et al. Effects of haptic and graphical force feedback for teleoperated palpation. In IEEE International Conference on Robotics and Automation, 2009; 677-682.
4. Okamura AM. Haptic feedback in robot-assisted minimally invasive surgery. Curr Opin Urol 2009; 19(1): 102-107.
5. Tewari AK, Patel ND, Leung RA, et al. Visual cues as a surrogate for tactile feedback during robotic-assisted laparoscopic prostatectomy: posterolateral margin rates in 1340 consecutive patients. Br J Urol Int 2010; 106(4): 528-536.
6. Vagvolgyi B, DiMaio S, Deguet A, et al. The Surgical Assistant Workstation: a software framework for telesurgical robotics research. In MICCAI Workshop on Systems and Archive for Computer Assisted Interventions, 2008.
7. King HH, Hannaford B, Kwok K, et al. Global interoperability in telerobotics and telemedicine. In IEEE International Conference on Robotics and Automation, 2010; 1733-1738.
8. King HH, Hannaford B, Kammerly J, et al. Establishing multimodal telepresence sessions using the Session Initiation Protocol (SIP) and advanced haptic codecs. In 2010 IEEE Haptics Symposium, 2010; 321-325.
9. Krouskop TA, Wheeler TM, Kallel F, et al. Elastic moduli of breast and prostate tissues under compression. Ultrason Imaging 1998; 20(4): 260-274.
10. Miller AP, Peine WJ, Son JS, et al. Tactile imaging system for localizing lung nodules during video-assisted thoracoscopic surgery. In IEEE International Conference on Robotics and Automation, 2007; 2996-3001.
11. Trejos AL, Jayender J, Perri MT, et al. Robot-assisted tactile sensing for minimally invasive tumor localization. Int J Robotics Res 2009; 28(9): 1118-1133.
12. Liu H, Noonan DP, Challacombe BJ, Althoefer K, et al. Rolling mechanical imaging for tissue abnormality localization during minimally invasive surgery. IEEE Trans Biomed Eng 2010; 57(2): 404-414.
13. Sarvazyan A. Mechanical imaging: a new technology for medical diagnostics. Int J Med Informat 1998; 49(2): 195-216.
14. Egorov V, Kearney T, Pollak SB, et al. Differentiation of benign and malignant breast lesions by mechanical imaging. Breast Cancer Res Treatm 2009; 118(1): 67-80.
15. Weiss R, Egorov V, Ayrapetyan S, et al. Prostate mechanical imaging: a new method for prostate assessment. Urology 2008; 71(3): 425-429.
16. Yamamoto T, Vagvolgyi B, Balaji K, et al. Tissue property estimation and graphical display for teleoperated robot-assisted surgery. In IEEE International Conference on Robotics and Automation, 2009; 4239-4245.
17. Rosenberg LB. Virtual fixtures: Perceptual tools for telerobotic manipulation. In Proceedings of IEEE Virtual Reality Annual International Symposium, 1993; 76-82.
18. Bettini A, Marayong P, Lang S, et al. Vision assisted control for manipulation using virtual fixtures. IEEE Trans Robotics 2004; 20(6): 953-966.
19. Dewan M, Marayong P, Okamura AM, et al. Vision-based assistance for ophthalmic microsurgery. In Proceedings of the 7th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2004. 3217-II: 49-57.
20. Li M, Ishii M, Taylor RH. Spatial motion constraints using virtual fixtures generated by anatomy. IEEE Trans Robotics 2007; 23(1): 4-19.
21. Kragic D, Marayong P, Li M, et al. Human machine collaborative systems for microsurgical applications. Int J Robotics Res 2005; 24(9): 731-742.
22. Park S, Howe R, Torchiana D. Virtual fixtures for robotic cardiac surgery. In Medical Image Computing and Computer-Assisted Intervention - MICCAI 2001, Niessen WJ, Viergever MA (eds). Springer: Berlin: Heidelberg, 2001; 1419-1420.
23. Abbott JJ, Okamura AM. Stable forbidden-region virtual fixtures for bilateral telemanipulation. ASME J Dynam Syst Measure Control 2006; 128: 53-64.
24. Williams SB, Chen M-H, Dâ Amico AV, et al. Radical retropubic prostatectomy and robotic-assisted laparoscopic prostatectomy: likelihood of positive surgical margin(s). Urology 2010; 76(5): 1097-1101.
25. Triclops Stereo Vision SDK Manual [homepage on the Internet]. Point Grey Research Inc.; c2010 [updated 13 August 2010; cited 1 September 2010];
26. Wang J, Oliveira MM. Filling holes on locally smooth surfaces reconstructed from point clouds. Image Vision Comput 2007; 25: 103-113.
27. Diolaiti N, Melchiorri C, Stramigioli S. Contact impedance estimation for robotic systems. IEEE Trans Robotics 2005; 21(5): 925-935.
28. Diolaiti N, Niemeyer G, Barbagli F, et al. Stability of haptic rendering: discretization, quantization, time delay, and Coulomb effects. IEEE Trans Robotics 2006; 22(2): 256-268.
29. Vagvolgyi B, Su L, Taylor R, et al. Video to CT registration for image overlay on solid organs. In Augmented Reality in Medical Imaging and Augmented Reality in Computer-Aided Surgery (AMI-ARCS) Workshop, 2008; 78-86.