Cutaneous haptic feedback to ensure the stability of robotic teleoperation systems

International Journal of Robotics Research

Volumn 34, Issue 14, 2015, Pages 1773-1787

  Pacchierotti, C ^a   Meli, L ^a,b   Chinello, F ^a,b   Malvezzi, M ^b   Prattichizzo, D ^a,b  

^a ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^b UNIVERSITY OF SIENA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

AGRICULTURAL ROBOTS; HAPTIC INTERFACES; REMOTE CONTROL; ROBOTICS;

COMMUNICATION DELAYS; CONTROL LOOP; CUTANEOUS FEEDBACKS; FORCE FEEDBACK; HAPTIC FEEDBACKS; HUMAN OPERATOR; ROBOTIC TELEOPERATION; TELEOPERATED;

FEEDBACK;

EID: 84948685615     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364915603135     Document Type: Article

References (52)

1. Birznieks I, Jenmalm P, Goodwin AW, et al. (2001) Encoding of direction of fingertip forces by human tactile afferents. Journal of Neuroscience 21 (20): 8222-8237.
2. Edin BB, Johansson N, (1995) Skin strain patterns provide kinaesthetic information to the human central nervous system. Journal of Physiology 487 (1): 243-251.
3. Franken M, Stramigioli S, Misra S, et al. (2011) Bilateral telemanipulation with time delays: A two-layer approach combining passivity and transparency. IEEE Transactions on Robotics 27 (4): 741-756.
4. Frisoli A, Solazzi M, Salsedo F, et al. (2008) A fingertip haptic display for improving curvature discrimination. Presence: Teleoperators and Virtual Environments 17 (6): 550-561.
5. Hannaford B, (1987) Task-level testing of the JPL-OMV smart end effector. In: Workshop on space telerobotics, volume 2, Pasadena, CA, USA, 1 July, pp. 371-380.
6. Hayward V, Astley OR, Cruz-Hernandez M, et al. (2004) Haptic interfaces and devices. Sensor Review 24 (1): 16-29.
7. Hirche S, Ferre M, Barrio J, et al. (2007) Bilateral control architectures for telerobotics. In: Ferre M, Buss M, Aracil R, et al. (eds) Advances in Telerobotics. Berlin/Heidelberg: Springer-Verlag, pp. 163-176.
8. Hokayem P, Spong M, (2006) Bilateral teleoperation: An historical survey. Automatica 42 (12): 2035-2057.
9. Johnson KO, (2001) The roles and functions of cutaneous mechanoreceptors. Current Opinion in Neurobiology 11 (4): 455-461.
10. Kim J, Ryu J, (2010) Robustly stable haptic interaction control using an energy-bounding algorithm. International Journal of Robotics Research 29 (6): 666-679.
11. King CH, Culjat MO, Franco ML, et al. (2009a) A multielement tactile feedback system for robot-assisted minimally invasive surgery. IEEE Transactions on Haptics 2 (1): 52-56.
12. King CH, Culjat MO, Franco ML, et al. (2009b) Tactile feedback induces reduced grasping force in robot-assisted surgery. IEEE Transactions on Haptics 2 (2): 103-110.
13. Kitagawa M, Dokko D, Okamura AM, et al. (2005) Effect of sensory substitution on suture-manipulation forces for robotic surgical systems. Journal of Thoracic and Cardiovascular Surgery 129 (1): 151-158.
14. Koehn JK, Kuchenbecker KJ, (2014) Surgeons and non-surgeons prefer haptic feedback of instrument vibrations during robotic surgery. Surgical Endoscopy. Epub ahead of print 25. DOI: 10.1007/s00464-014-4030-8.
15. Kontarinis DA, Howe RD, (1995) Tactile display of vibratory information in teleoperation and virtual environments. Presence: Teleoperators and Virtual Environments 4 (4): 387-402.
16. Kurita Y, Yonezawa S, Ikeda A, et al. (2011) Weight and friction display device by controlling the slip condition of a fingertip. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), San Francisco, USA, 25-30 September, pp. 2127-2132.
17. Lawrence DA, (1993) Stability and transparency in bilateral teleoperation. IEEE Transactions on Robotics and Automation 9 (5): 624-637.
18. Lee D, Huang K, (2010) Passive-set-position-modulation framework for interactive robotic systems. IEEE Transactions on Robotics 26 (2): 354-369.
19. Li M, Luo S, Seneviratne L, et al. (2013) Haptics for multi-fingered palpation. In: 2013 IEEE international conference on systems, man, and cybernetics, Manchester, UK, 13-16 October, pp. 4184-4189.
20. Massimino MJ, (1995) Improved force perception through sensory substitution. Control Engineering Practice 3 (2): 215-222.
21. Massimino MJ, Sheridan TB, (1993) Sensory substitution for force feedback in teleoperation. Presence: Teleoperators and Virtual Environments 2 (4): 344-352.
22. Massimino MJ, Sheridan TB, (1994) Teleoperator performance with varying force and visual feedback. Human Factors: The Journal of the Human Factors and Ergonomics Society 36 (1): 145-157.
23. McMahan W, Gewirtz J, Standish D, et al. (2011) Tool contact acceleration feedback for telerobotic surgery. IEEE Transactions on Haptics 4 (3): 210-220.
24. Meli L, Pacchierotti C, Prattichizzo D, (2014) Sensory subtraction in robot-assisted surgery: Fingertip skin deformation feedback to ensure safety and improve transparency in bimanual haptic interaction. IEEE Transactions on Biomedical Engineering 61 (4): 1318-1327.
25. Moody L, Baber C, Arvanitis TN, (2002) Objective surgical performance evaluation based on haptic feedback. Studies in Health Technology and Informatics 85: 304-310.
26. Niemeyer G, Slotine JJE, (2004) Telemanipulation with time delays. International Journal of Robotics Research 23 (9): 873-890.
27. Pacchierotti C, Chinello F, Malvezzi M, et al. (2012a) Two finger grasping simulation with cutaneous and kinesthetic force feedback. In: 8th international conference, eurohaptics 2012 (eds Isokoski P, Springare J,), Tampere, Finland, 13-15 June, pp. 373-382. Berlin/Heidelberg: Springer-Verlag.
28. Pacchierotti C, Chinello F, Prattichizzo D, (2012b) Cutaneous device for teleoperated needle insertion. In: 4th IEEE RAS & EMBS international conference on biomedical robotics and biomechatronics, Rome, Italy, 24-28 June, pp. 32-37. IEEE.
29. Pacchierotti C, Prattichizzo D, Kuchenbecker KJ, (2015) Cutaneous feedback of fingertip deformation and vibration for palpation in robotic surgery. IEEE Transactions on Biomedical Engineering. In press.
30. Pacchierotti C, Tirmizi A, Prattichizzo D, (2014) Improving transparency in teleoperation by means of cutaneous tactile force feedback. ACM Transactions on Applied Perception 11 (1): 4.
31. Park KH, Kim BH, Hirai S, (2003) Development of a soft-fingertip and its modeling based on force distribution. In: 2003 IEEE International Conference on Robotics and Automation (ICRA), volume 3, Taipei, Taiwan, 14-19 September, pp. 3169-3174. IEEE.
32. Prattichizzo D, Chinello F, Pacchierotti C, et al. (2013) Towards wearability in fingertip haptics: A 3-DoF wearable device for cutaneous force feedback. IEEE Transactions on Haptics 6 (4): 506-516.
33. Prattichizzo D, Pacchierotti C, Cenci S, et al. (2010) Using a fingertip tactile device to substitute kinesthetic feedback in haptic interaction. In: 7th international conference, eurohaptics 2010 (eds Kappers AML, Van Erp JB, Bergmann WM, Tiest WM, et al.), Amsterdam, Netherlands, 8-10 July, pp. 125-130. Berlin/Heidelberg: Springer-Verlag.
34. Prattichizzo D, Pacchierotti C, Rosati G, (2012) Cutaneous force feedback as a sensory subtraction technique in haptics. IEEE Transactions on Haptics 5 (4): 289-300.
35. Prattichizzo D, Trinkle J, (2008) Grasping. In: Siciliano V, Oussama K, (eds) Handbook of Robotics, pp. 671-700. Berlin/Heidelberg: Springer.
36. Provancher WR, Sylvester ND, (2009) Fingerpad skin stretch increases the perception of virtual friction. IEEE Transactions on Haptics 2 (4): 212-223.
37. Quek ZF, Schorr S, Nisky I, et al. (2015) Sensory substitution and augmentation using 3-degree-of-freedom skin deformation feedback. IEEE Transactions on Haptics 8 (2): 209-221.
38. Quek ZF, Schorr SB, Nisky I, et al. (2013) Sensory augmentation of stiffness using fingerpad skin stretch. In: 5th IEEE world haptics conference, Daejeon, South Korea, 14-18 April, pp. 467-472. IEEE.
39. Ryu J, Kwon D, Hannaford B, (2004) Stable teleoperation with time-domain passivity control. IEEE Transactions on Robotics and Automation 20 (2): 365-373.
40. Salcudean S, (1998) Control for teleoperation and haptic interfaces. In: Siciliano B, Valavanis K, (eds) Control Problems in Robotics and Automation, pp. 51-66. Berlin/Heidelberg: Springer.
41. Salisbury K, Tarr C, (1997) Haptic rendering of surfaces defined by implicit functions. Proceedings of the ASME Dynamic Systems and Control Division 61: 61-67.
42. Schoonmaker RE, Cao CGL, (2006) Vibrotactile force feedback system for minimally invasive surgical procedures. In: 2006 IEEE international conference on systems, man and cybernetics, volume 3, Tainan, Taiwan, 8-11 October, pp. 2464-2469. IEEE.
43. Sheridan TB, (1989) Telerobotics. Automatica 25 (4): 487-507.
44. Sheridan TB, (1992) Telerobotics, Automation, and Human Supervisory Control. Cambridge, MA: MIT Press.
45. Sheridan TB, (1995) Teleoperation, telerobotics and telepresence: A progress report. Control Engineering Practice 3 (2): 205-214.
46. Solazzi M, Provancher WR, Frisoli A, et al. (2011) Design of a SMA actuated 2-dof tactile device for displaying tangential skin displacement. In: 2011 IEEE world haptics conference, Istanbul, Turkey, 21-24 June, pp. 31-36. IEEE.
47. van Der Putten EPW, Van den Dobbelsteen JJ, Goossens RH, et al. (2010) The effect of augmented feedback on grasp force in laparoscopic grasp control. IEEE Transactions on Haptics 3 (4): 280-291.
48. van der Schaft A, (2000) L2-gain and Passivity Techniques in Nonlinear Control. Berlin/Heidelberg: Springer.
49. Wagner CR, Stylopoulos N, Howe RD, (2002) The role of force feedback in surgery: Analysis of blunt dissection. In: 10th symposium on haptic interfaces for virtual environment and teleoperator systems, Orlando, FL, USA, 24-25 March, pp. 68-74. IEEE.
50. Webster RJ III, Murphy TE, Verner LN, et al. (2005) A novel two-dimensional tactile slip display: Design, kinematics and perceptual experiments. ACM Transactions on Applied Perception 2: 150-165.
51. Wiertlewski M, Hayward V, (2012) Mechanical behavior of the fingertip in the range of frequencies and displacements relevant to touch. Journal of Biomechanics 45 (11): 1869-1874.
52. Zilles CB, Salisbury JK, (1995) A constraint-based god-object method for haptic display. In: 1995 international conference on human robot interaction and cooperative robots, volume 3, Pittsburgh, USA, 5-9 August, pp. 146-151. IEEE.