Cutaneous feedback of fingertip deformation and vibration for palpation in robotic surgery

IEEE Transactions on Biomedical Engineering

Volumn 63, Issue 2, 2016, Pages 278-287

  Pacchierotti, Claudio ^a,b,c   Prattichizzo, Domenico ^a   Kuchenbecker, Katherine J ^d  

^a UNIVERSITY OF SIENA   (Italy)

^b ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^c UNIVERSITY OF PENNSYLVANIA   (United States)

^d UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Force feedback; Haptic interfaces; Medical robotics; Surgery; Tactile sensors

Indexed keywords

DEFORMATION; ELECTRIC GROUNDING; HAPTIC INTERFACES; ROBOTICS; ROBOTS; SURGERY; SURGICAL EQUIPMENT; TABLE LOOKUP;

CLOSED LOOP CONTROLLERS; FINGERTIP DEFORMATION; FORCE FEEDBACK; MEDICAL ROBOTICS; MODEL-FREE ALGORITHMS; SURGICAL INSTRUMENT; TACTILE SENSORS; TASK COMPLETION TIME;

ROBOTIC SURGERY;

ALGORITHM; ARTICLE; FINGERTIP DEFORMATION; OPERATING TABLE; PALPATION; PHYSICAL PARAMETERS; PRESSURE; ROBOT ASSISTED SURGERY; SENSATION; SENSOR; SURGEON; SURGICAL EQUIPMENT; TACTILE FEEDBACK; VIBRATION; DEVICES; EQUIPMENT DESIGN; FEEDBACK SYSTEM; FEMALE; FINGER; HUMAN; MALE; PHYSIOLOGY; PROCEDURES; ROBOTIC SURGICAL PROCEDURE; SIGNAL PROCESSING; TOUCH;

EQUIPMENT DESIGN; FEEDBACK; FEMALE; FINGERS; HUMANS; MALE; ROBOTIC SURGICAL PROCEDURES; SIGNAL PROCESSING, COMPUTER-ASSISTED; TOUCH; VIBRATION;

EID: 84959370802     PISSN: 00189294     EISSN: 15582531     Source Type: Journal    
DOI: 10.1109/TBME.2015.2455932     Document Type: Article

References (46)

1. T. B. Sheridan, "Telerobotics," Automatica, vol. 25, no. 4, pp. 487-507, 1989.
2. T. B. Sheridan, Telerobotics, Automation, and Human Supervisory Control. Cambridge, MA, USA: MIT Press, 1992.
3. N. Diolaiti et al., "Stability of haptic rendering: Discretization, quantization, time delay, and Coulomb effects," IEEE Trans. Robot., vol. 22, no. 2, pp. 256-268, Apr. 2006.
4. D. Prattichizzo et al., "Cutaneous force feedback as a sensory subtraction technique in haptics," IEEE Trans. Haptics, vol. 5, no. 4, pp. 289-300, Jan. 2012.
5. A. M. Okamura, "Methods for haptic feedback in teleoperated robot-assisted surgery," Ind. Robot: Int. J., vol. 31, no. 6, pp. 499-508, 2004.
6. A. M. Okamura, "Haptic feedback in robot-assisted minimally invasive surgery," Current Opinion Urology, vol. 19, no. 1, pp. 102-107, 2009.
7. E. Westebring-Van Der Putten et al., "Haptics in minimally invasive surgery-a review," Minimally Invasive Therapy Allied Technol., vol. 17, no. 1, pp. 3-16, 2008.
8. O. Van der Meijden and M. Schijven, "The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: A current review," Surgical Endoscopy, vol. 23, no. 6, pp. 1180-1190, 2009.
9. A. Wedmid et al., "Future perspectives in robotic surgery," BJU Int., vol. 108, no. 6b, pp. 1028-1036, 2011.
10. S. E. Salcudean et al., "Performance measurement in scaled teleoperation for microsurgery," in Proc. 1st Joint Conf. Comput. Vis., Virtual Reality Robot. Med. Medial Robot. Comput.-Assisted Surg., 1997, pp. 789-798.
11. A. Kazi, "Operator performance in surgical telemanipulation," Presence: Teleoperators Virtual Environ., vol. 10, no. 5, pp. 495-510, 2001.
12. L. Moody et al., "Objective surgical performance evaluation based on haptic feedback," Stud. Health Technol. Inf., vol. 85, pp. 304-310, 2002.
13. C. W. Kennedy et al., "A novel approach to robotic cardiac surgery using haptics and vision," Cardiovascular Eng., vol. 2, no. 1, pp. 15-22, 2002.
14. A. Pillarisetti et al., "Evaluating the effect of force feedback in cell injection," IEEE Trans. Autom. Sci. Eng., vol. 4, no. 3, pp. 322-331, Jul. 2007.
15. B. Hannaford et al., "Performance evaluation of a six-axis generalized force-reflecting teleoperator," IEEE Trans. Syst., Man, Cybern., vol. 21, no. 3, pp. 620-633, May/Jun. 1991.
16. M. J. Massimino and T. B. Sheridan, "Teleoperator performance with varying force and visual feedback," Human Factors: J. Human Factors Ergonom. Soc., vol. 36, no. 1, pp. 145-157, 1994.
17. C. R. Wagner et al., "The role of force feedback in surgery: Analysis of blunt dissection," in Proc. 10th Symp. Haptic Interfaces Virtual Environ. Teleoperator Syst., 2002, pp. 68-74.
18. D. Prattichizzo et al., "Using a fingertip tactile device to substitute kines-thetic feedback in haptic interaction," in Proc. Haptics: Generating Perceiving Tangible Sensations Conf., 2010, pp. 125-130.
19. C. Pacchierotti et al., "Two finger grasping simulation with cutaneous and kinesthetic force feedback," in Proc. Haptics: Perception, Devices, Mobility, Commun., 2012, pp. 373-382.
20. L. Meli et al., "Sensory subtraction in robot-assisted surgery: Fingertip skin deformation feedback to ensure safety and improve transparency in bimanual haptic interaction," IEEE Trans. Biomed. Eng., vol. 61, no. 4, pp. 1318-1327, Apr. 2014.
21. R. E. Schoonmaker and C. G. L. Cao, "Vibrotactile force feedback system for minimally invasive surgical procedures," in Proc. IEEE Int. Conf. Syst., Man Cybern., 2006, pp. 2464-2469.
22. W. B. Griffin et al., "Feedback strategies for telemanipulation with shared control of object handling forces," Presence: Teleoperators Virtual Environ., vol. 14, no. 6, pp. 720-731, 2005.
23. M. Kitagawa et al., "Effect of sensory substitution on suture-manipulation forces for robotic surgical systems," J. Thoracic Cardiovascular Surg., vol. 129, no. 1, pp. 151-158, 2005.
24. I. Birznieks et al., "Encoding of direction of fingertip forces by human tactile afferents," J. Neurosci., vol. 21, no. 20, pp. 8222-8237, 2001.
25. K. O. Johnson, "The roles and functions of cutaneous mechanoreceptors," Current Opinion Neurobiol., vol. 11, no. 4, pp. 455-461, 2001.
26. W. McMahan et al., "Tool contact acceleration feedback for telerobotic surgery," IEEE Trans. Haptics, vol. 4, no. 3, pp. 210-220, May/Jun. 2011.
27. C.-H. King et al., "Tactile feedback induces reduced grasping force in robot-assisted surgery," IEEE Trans. Haptics, vol. 2, no. 2, pp. 103-110, Apr.-Jun. 2009.
28. C.-H. King et al., "A multielement tactile feedback system for robot-assisted minimally invasive surgery," IEEE Trans. Haptics, vol. 2, no. 1, pp. 0052-0056, Jan.-Mar. 2009.
29. M. Li et al., "Haptics for multi-fingered palpation," in Proc. IEEE Int. Conf. Syst., Man, Cybern., 2013, pp. 4184-4189.
30. A. Stanley and A. Okamura, "Controllable surface haptics via particle jamming and pneumatics," IEEE Trans. Haptics, vol. 8, no. 2, pp. 20-30, Jan.-Mar. 2015.
31. M. Li et al., "Multi-fingered haptic palpation utilizing granular jamming stiffness feedback actuators," Smart Mater. Struct., vol. 23, no. 9, p. 095007, 2014.
32. D. A. Kontarinis and R. D. Howe, "Tactile display of vibratory information in teleoperation and virtual environments," Presence: Teleoperators Virtual Environ., vol. 4, no. 4, pp. 387-402, 1995.
33. J. K. Koehn and K. J. Kuchenbecker, "Surgeons and non-surgeons prefer haptic feedback of instrument vibrations during robotic surgery," Surgical Endoscopy, pp. 1-14, 2014.
34. C. Pacchierotti, D. Prattichizzo, and K. J. Kuchenbecker, "A data-driven approach to remote tactile interaction: From a BioTac sensor to any fingertip cutaneous device," in Proc. Eurohaptics, 2014, pp. 418-424.
35. C. Pacchierotti et al., "Displaying sensed tactile cues with a fingertip haptic device," IEEE Trans. Haptics, art. no. 7124519, to be published, 2015.
36. N. Wettels and G. E. Loeb, "Haptic feature extraction from a biomimetic tactile sensor: Force, contact location and curvature," in Proc. IEEE Int. Conf. Robot. Biomimetics, 2011, pp. 2471-2478.
37. M. S. Arian et al., "Using the BioTac as a tumor localization tool," in Proc. IEEE Haptics Symp., Feb. 2014, pp. 443-448.
38. W. R. Provancher et al., "Contact location display for haptic perception of curvature and object motion," Int. J. Robot. Res., vol. 24, no. 9, pp. 691-702, Sep. 2005.
39. L. Wauben et al., "Application of ergonomic guidelines during minimally invasive surgery: A questionnaire survey of 284 surgeons," Surgical En-doscopy Other Interventional Tech., vol. 20, no. 8, pp. 1268-1274, 2006.
40. E. H.Lawson et al., "Postural ergonomics during robotic and laparoscopic gastric bypass surgery: A pilot project," J. Robotic Surgery, vol. 1, no. 1, pp. 61-67, 2007.
41. D. Prattichizzo et al., "Towards wearability in fingertip haptics: A 3-dof wearable device for cutaneous force feedback," IEEE Trans. Haptics, vol. 6, no. 4, pp. 506-516, Oct.-Dec. 2013.
42. C. Pacchierotti et al., "Improving transparency in teleoperation by means of cutaneous tactile force feedback," ACM Trans. Appl. Perception, vol. 11, no. 1, pp. 4:1-4:16, 2014.
43. D. M. Mount and S. Arya. (2010). ANN: A library for approximate nearest neighbor searching [Online]. Available: http://www.cs.umd.edu/mount/ANN/
44. A. V. Oppenheim et al., Discrete-Time Signal Processing. Englewood Cliffs, NJ, USA: Prentice-hall, 1989.
45. T. Yamamoto et al., "Tissue property estimation and graphical display for teleoperated robot-assisted surgery," in Proc. IEEE Int. Conf. Robot. Autom., 2009, pp. 4239-4245.
46. S. J. Lederman and R. L. Klatzky, "Hand movements: A window into haptic object recognition," Cognitive Psychology, vol. 19, no. 3, pp. 342-368, 1987.