Appearance learning for 3D tracking of robotic surgical tools

International Journal of Robotics Research

Volumn 33, Issue 2, 2014, Pages 342-356

  Reiter, Austin ^a   Allen, Peter K ^a   Zhao, Tao ^b  

^a Columbia University ^*  (United States)

^b INTUITIVE SURGICAL INC   (United States)

Author keywords

Fusion; Learning features; Surgical robotics; Tool tracking

Indexed keywords

AGRICULTURAL ROBOTS; EDUCATIONAL ROBOTS; FUSION REACTIONS; ROBOTICS; ROBOTS; SURGERY; SURGICAL EQUIPMENT;

APPEARANCE LEARNING; LEARNING FEATURES; MULTIPLE TOOLS; ROBOT KINEMATICS; SURGICAL ROBOTICS; SURGICAL TOOLS; TOOL TRACKING; VISUAL OBSERVATIONS;

ROBOTIC SURGERY;

EID: 84940285650     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364913507796     Document Type: Article

References (38)

1. Allan M, Ourselin S, Thompson S, et al. (2013) Toward detection and localization of instruments in minimally invasive surgery. IEEE Transactions on Biomedical Engineering 60(4): 1050-1058.
2. Bosch A, Zisserman A and Munoz X (2007) Representing shape with a spatial pyramid kernel. In: ACM International conference on image and video retrieval.
3. Burschka D, Corso JJ, Dewan M, et al. (2004) Navigating inner space: 3-D assistance for minimally invasive surgery. In: IEEE/RSJ International conference on intelligent robots and systems.
4. Cortes C and Vapnik VN (1995) Support-vector networks. Machine Learning 20: 273-297.
5. Dalal N and Triggs B (2005) Histograms of oriented gradients for human detection. In: IEEE conference on computer vision and pattern recognition.
6. Doignon C, Graebling P and deMathelinM(2005) Real-time segmentation of surgical instruments inside the abdominal cavity using a joint hue saturation color feature. Real-Time Imaging 11(5-6): 429-442.
7. Doignon C, Nageotte F and de Mathelin M (2004) Detection of grey regions in color images: Application to the segmentation of a surgical instrument in robotized laparoscopy. In: IEEE/RSJ International conference on intelligent robots and systems.
8. Doignon C, Nageotte F and de Mathelin M (2006) Segmentation and guidance of multiple rigid objects for intra-operative endoscopic vision. In: European conference on computer vision, pp. 314-327.
9. Duda RO, Hart PE and Stork DG (2001) Pattern Classification. 2nd edn. New York: Wiley.
10. Groeger M, Arbter K and Hirzinger G (2008) Motion tracking for minimally invasive robotic surgery. In: Bozovic V (ed.) Medical Robotics. Vienna, Austria: I-Tech Education and Publishing, pp. 117-148.
11. Hartley R and Zisserman A (2003) Multiple View Geometry in Computer Vision. 2nd edn. New York, NY: Cambridge University Press.
12. Intuitive Surgical, Inc. (1995) Homepage at: http://www. intuitivesurgical. com/.
13. Krupa A, Gangloff J, Doignon C, et al. (2003) Autonomous 3-D positioning of surgical instruments in robotized laparoscopic surgery using visual servoing. IEEE Transactions on Robotics and Automation, Special Issue on Medical Robotics 19(5): 842-853.
14. Lee C, Wang YF, Uecker D, et al. (1994) Image analysis for automated tracking in robot-assisted endoscopic surgery. In: Proceedings of the 12th International conference on pattern recognition.
15. Lepetit V and Fua P (2006) Keypoint recognition using randomized trees. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(9): 1465-1479.
16. Leven J, Burschka D, Kumar R, et al. (2005) DaVinci canvas: A telerobotic surgical system with integrated, robot-assisted, laparoscopic ultrasound capability. In: International conference on medical image computing and computer assisted intervention, pp. 811-818.
17. Lowe D (2004) Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2): 91-110.
18. Lucas B and Kanade T (1981) An iterative image registration technique with an application to stereo vision. In: International joint conference on artificial intelligence, pp. 674-679.
19. Mack MJ (2001) Minimally invasive and robotic surgery. The Journal of the American Medical Association 285: 568-572.
20. Malpani A, Vagvolgyi B and Kumar R (2011) Kinematics based safety operation mechanism for robotic surgery extending the JHU SAW framework. The MIDAS Journal-Systems and Architectures for Computer Assisted Interventions
21. Pennec X, Fillard P and Ayache N (2006) A Riemannian framework for tensor computing. International Journal of Computer Vision 66(1): 41-66.
22. Pezzementi Z, Voros S and Hager G (2009) Articulated object tracking by rendering consistent appearance parts. In: IEEE International conference on robotics and automation.
23. Reiter A, Allen PK and Zhao T (2012a) Feature classification for tracking articulated surgical tools. In: International conference on medical image computing and computer assisted intervention, pp. 592-600.
24. Reiter A, Allen PK and Zhao T (2012b) Learning features on robotic surgical tools. In: Workshop on medical computer vision, IEEE conference on computer vision and pattern recognition.
25. Reiter A, Allen PK and Zhao T (2012c) Marker-less articulated surgical tool detection. In: Computer assisted radiology and surgery.
26. Reiter A and Allen PK (2010) An online approach to in-vivo tracking using synergistic features. In: IEEE/RSJ International conference on Intelligent robots and systems.
27. Tuzel O, Porikli F and Meer P (2006) Region covariance: A fast descriptor for detection and classification. In: European conference on computer vision.
28. Tuzel O, Porikli F and Meer P (2007) Human detection via classification on Riemannian manifolds. In: IEEE conference on computer vision and pattern recognition.
29. Viola PA and Jones MJ (2004) Robust real-time face detection. International Journal of Computer Vision 57(2): 137-154.
30. Voros S, Long J and Cinquin P (2007) Automatic detection of instruments in laparoscopic images: A first step towards highlevel command of robotic endoscopic holders. The International Journal of Robotics Research 26(11-12): 1173-1190.
31. Wei GQ, Arbter K and Hirzinger G (1997a) Automatic tracking of laparoscopic instruments by color coding. In: Proceedings of the first joint conference on computer vision, virtual reality and robotics in medicine and medical robotics and computerassisted surgery, pp. 357-366.
32. Wei GQ, Arbter K and Hirzinger G (1997b) Real-time visual servoing for laparoscopic surgery. IEEE Engineering in Medicine and Biology Magazine 16(1): 40-45.
33. Wolf R, Duchateau J, Cinquin P, et al. (2011) 3D tracking of laparoscopic instruments using statistical and geometric modeling. In: International conference on medical image computing and computer assisted intervention, pp. 203-210.
34. Zhang X and Payandeh S (2002) Application of visual tracking for robot-assisted laparoscopic surgery. Journal of Robotic Systems 19(7): 315-328.
35. Zhang Z (2000) A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(11): 1330-1334.
36. Zhao T, Zhao W and Nowlin W (2009a) Configuration marker design and detection for instrument tracking. US Patent US 2010/0168763 A1.
37. Zhao T, Zhao W, Halabe D, et al. (2009b) Fiducial marker design and detection for locating surgical instrument in images. US Patent US 2010/0168562 A1.
38. Zhao T, Zhao W, Hoffman BD, et al. (2009c) Efficient vision and kinematic data fusion for robotic surgical instruments and other applications. US Patent US 2010/0331855 A1.