Tactor-Induced Skin Stretch as a Sensory Substitution Method in Teleoperated Palpation

IEEE Transactions on Human-Machine Systems

Volumn 45, Issue 6, 2015, Pages 714-726

  Schorr, Samuel B ^a   Quek, Zhan Fan ^a   Nisky, Ilana ^b   Provancher, William R ^c   Okamura, Allison M ^a  

^a Stanford University   (United States)

^b BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^c University of Utah   (United States)

Author keywords

Cutaneous feedback; haptic devices; sensory substitution; skin stretch; stiffness perception

Indexed keywords

ARTIFICIAL TISSUES; FORCE FEEDBACK; INTERACTION FORCES; MAGNITUDE INFORMATION; NATURALLY OCCURRING; SENSORY SUBSTITUTION; TASK COMPLETION TIME; VIBRATION FEEDBACK;

EID: 84959571440     PISSN: 21682291     EISSN: None     Source Type: Journal    
DOI: 10.1109/THMS.2015.2463090     Document Type: Article

References (47)

1. S. J. Lederman and R. L. Klatzky, "Sensing and displaying spatially distributed fingertip forces in haptic interfaces for teleoperator and virtual environment systems," Presence: Teleoperator Virtual Environ., vol. 8, no. 1, pp. 86-103, 1999.
2. C.R. Wagner, R. D. Howe, and N. Stylopoulos, "The role of force feedback in surgery: Analysis of blunt dissection," in Proc. 10th Symp. Haptic Interfaces Virtual Environ. Teleoperator Syst., 2002, pp. 68-74.
3. G. Tholey, J. P. Desai, and A. E. Castellanos, "Force feedback plays a significant role in minimally invasive surgery," Ann. Surg., vol. 241, no. 1, pp. 102-109, 2005.
4. C. Wagner, N. Stylopoulos, P. G. Jackson, and R. Howe, "The benefit of force feedback in surgery: Examination of blunt dissection," Presence: Teleoperators Virtual Environ., vol. 16, no. 3, pp. 252-2620, 2007.
5. J. C. Gwilliam, M. Mahvash, B. Vagvolgyi, A. Vacharat, D. D. Yuh, and A. M. Okamura, "Effects of haptic and graphical force feedback on teleoperated palpation," in Proc. IEEE Int. Conf. Robot. Autom., 2009, pp. 677-682.
6. M. Kitagawa, D. Dokko, A. M. Okamura, and D. D. Yuh, "Effect of sensory substitution on suture-manipulation forces for robotic surgical systems," J. Thoracic Cardiovascular Surg., vol. 129, no. 1, pp. 151-158, 2005.
7. C. E. Reiley, T. Akinbiyi, D. Burschka, D. C. Chang, A. M. Okamura, and D. D. Yuh, "Effects of visual force feedback on robot-assisted surgical task performance," J. Thoracic Cardiovascular Surg., vol. 135, no. 1, pp. 196-202, 2008.
8. M. J. Massimino, "Improved force perception through sensory substitution," Control Eng. Practice, vol. 3, pp. 215-222, 1995.
9. T. Debus and T. Jang, "Multi-channel vibrotactile display for teleoperated assembly," Int. J. Control, Autom., Syst., vol 2, pp. 390-397, 2004.
10. M. A. Srinivasan and R. H. LaMotte, "Tactual discrimination of softness," J. Neurophysiol., vol. 73, no. 1, pp. 88-101, 1995.
11. W. M. B. Tiest and A. M. L. Kappers, "Cues for haptic perception of compliance," IEEE Trans. Haptics, vol. 2, no. 4, pp. 189-199, Oct.-Dec. 2009.
12. S. B. Schorr, Z. F. Quek, R. Y. Romano, I. Nisky, W. R. Provancher, and A. M. Okamura, "Sensory substitution via cutaneous skin stretch feedback," in Proc. IEEE Int. Conf. Robot. Autom., May 2013, pp. 2341-2346.
13. G. Tholey, J. P. Desai, and A. E. Castellanos, "Evaluation of a laparoscopic grasper with force feedback," Surgical Endoscopy, vol. 18, no. 5, pp. 863-867, 2004.
14. P. Puangmali, K. Althoefer, L. D. Seneviratne, D. Murphy, and P. Dasgupta, "State-of-the-art in force and tactile sensing for minimally invasive surgery," IEEE Sensors J., vol. 8, no. 4, pp. 371-381, Apr. 2008.
15. D. Lawrence, "Stability and transparency in bilateral teleoperation," IEEE Trans. Robot. Autom., vol. 9, no. 5, pp. 624-637, Oct. 1993.
16. N. Cutler, M. Balicki, M. Finkelstein, J. Wang, P. Gehlbach, J. McGready, I. Iordachita, R. Taylor, and J. T. Handa, "Auditory force feedback substitution improves surgical precision during simulated ophthalmic surgery," Investigative Ophthalmol. Visual Sci., vol. 54, no. 2, pp. 1316-1324, 2013.
17. P. Galambos, "Vibrotactile feedback for haptics and telemanipulation: Survey, concept and experiment," Acta Polytechnica Hungarica, vol. 9, pp. 41-65, 2012.
18. Y. Muramatsu, M. Niitsuma, and T. Thomessen, "Perception of tactile sensation using vibrotactile glove interface," in Proc. IEEE Int. Conf. Cognitive Infocommun., 2012, pp. 621-626.
19. R. Schoonmaker and C. Cao, "Vibrotactile force feedback system for minimally invasive surgical procedures," in Proc. IEEE Int. Conf. Syst., Man Cybern., 2006, vol. 3, pp. 2464-2469.
20. W. McMahan, J. Gewirtz, D. Standish, P. Martin, J. Kunkel, M. Lilavois, A. Wedmid, D. I. Lee, and K. J. Kuchenbecker, "Tool contact acceleration feedback for telerobotic surgery," IEEE Trans. Haptics, vol. 4, no. 3, pp. 210-220, May/Jun. 2011.
21. L. Jones and N. B. Sarter, "Tactile displays: Guidance for their design and application," Human Factors: J. Human Factors Ergonomics Soc., vol. 50, no. 1, pp. 90-111, 2008.
22. K. Kim and J. Colgate, "Haptic feedback enhances grip force control of sEMG-controlled prosthetic hands in targeted reinnervation amputees," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 20, no. 6, pp. 798-805, Nov. 2012.
23. K. Minamizawa, D. Prattichizzo, and S. Tachi, "Simplified design of haptic display by extending one-point kinesthetic feedback to multipoint tactile feedback," in Proc. IEEE Haptics Symp., 2010, pp. 257-260.
24. D. Prattichizzo, C. Pacchierotti, and G. Rosati, "Cutaneous force feedback as a sensory subtraction technique in haptics," IEEE Trans. Haptics, vol. 5, no. 4, pp. 289-300, Fourth Quarter 2012.
25. L. Meli, C. Pacchierotti, and D. Prattichizzo, "Sensory subtraction in robotassisted surgery: Fingertip skin deformation feedback to ensure safety and improve transparency in bimanual haptic interaction," vol. 61, no. 4, pp. 1318-1327, Apr. 2014.
26. L. Ben Porquis, D. Maemori, N. Nagaya, M. Konyo, and S. Tadokoro, "Presenting virtual stiffness by modulating the perceived force profile with suction pressure," in Proc. IEEE Haptics Symp., Feb. 2014, pp. 289-294.
27. J. Biggs and M. Srinivasan, "Tangential versus normal displacements of skin: relative effectiveness for producing tactile sensations," in Proc. 10th Symp. Haptic Interfaces Virtual Environ. Teleoperator Syst., 2002, pp. 121-128.
28. K. Bark, J. Wheeler, P. Shull, J. Savall, and M. Cutkosky, "Rotational skin stretch feedback: A wearable haptic display for motion," IEEE Trans. Haptics, vol. 3, no. 3, pp. 166-176, Jul.-Sep. 2010.
29. J. Wheeler, K. Bark, J. Savall, and M. Cutkosky, "Investigation of rotational skin stretch for proprioceptive feedback with application to myoelectric systems," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 18, no. 1, pp. 58-66, Feb. 2010.
30. Z. F. Quek, S. B. Schorr, I. Nisky, A. M. Okamura, and W. R. Provancher, "Sensory augmentation of stiffness using fingerpad skin stretch," in Proc. IEEE World Haptics Conf., 2013, pp. 467-472.
31. W. R. Provancher and N. D. Sylvester, "Fingerpad skin stretch increases the perception of virtual friction," IEEE Trans. Haptics, vol. 2, no. 4, pp. 212-223, Oct.-Dec. 2009.
32. B. Gleeson, S. Horschel, and W. Provancher, "Perception of direction for applied tangential skin displacement: Effects of speed, displacement, and repetition," IEEE Trans. Haptics, vol. 3, no. 3, pp. 177-188, Jul.-Sep. 2010.
33. A. L. Guinan, N. C. Hornbaker, M. N. Montandon, A. J. Doxon, and W. R. Provancher, "Back-to-back skin stretch feedback for communicating five degree-of-freedom direction cues," in Proc. IEEE World Haptics Conf., 2013, pp. 13-18.
34. Z. F. Quek, S. B. Schorr, I. Nisky, A. M. Okamura, and W. R. Provancher, "Sensory substitution using 3-degree-of-freedom tangential and normal skin deformation feedback," in Proc. IEEE Haptics Symp., 2014, pp. 27-33.
35. M. O'Malley and M. Goldfarb, "The effect of virtual surface stiffness on the haptic perception of detail," IEEE/ASME Trans. Mechatronics, vol. 9, no. 2, pp. 448-454, Jun. 2004.
36. J. D. Brown, J. Rosen, L. Chang, M. N. Sinanan, and B. Hannaford, "Quantifying surgeon grasping mechanics in laparoscopy using the blue dragon system," Stud. Health Technol. Informat., vol. 98, pp. 34-36, 2004.
37. J. Marescaux, J. Leroy, M. Gagner, F. Rubino, D. Mutter, M. Vix, S. E. Butner, and M.K. Smith, "Transcontinental robot-assisted remote telesurgery: Feasibility and potential applications," Ann. Surg., vol. 235, no. 4, pp. 487-492, 2002.
38. C. E. Stepp and Y. Matsuoka, "Vibrotactile sensory substitution for object manipulation: Amplitude versus pulse train frequency modulation," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 20, no. 1, pp. 31-37, Jan. 2012.
39. J. Bell, S. Bolanowski, and M. H. Holmes, "The structure and function of pacinian corpuscles: A review," Prog. Neurobiol., vol. 42, no. 1, pp. 79-128, 1994.
40. N. Landin, J. Romano, W. McMahan, and K. Kuchenbecker, "Dimensional reduction of high-frequency accelerations for haptic rendering," in Proc. Euro Haptics, Jul. 2010, pp. 79-86.
41. N. E. Hochreiter, M. J. Jewell, L. Barber, and P. Brown, "Effect of vibration on tactile sensitivity," J. Am. Phys. Therapy Assoc., vol. 63, no. 6, pp. 934-937, 1983.
42. Z. Quek, S. Schorr, I. Nisky, W. Provancher, and A. M. Okamura, "Sensory substitution using 3-degree-of-freedom tangential and normal skin deformation feedback," in Proc. Haptic Symp., 2014, pp. 27-33.
43. J. T. Dennerlein, P. A. Millman, and R. D. Howe, "Vibrotactile feedback for industrial telemanipulators," in Proc. ASME Dynam. Syst. Control Division, vol. 61, 1997, pp. 189-195.
44. A. M. Okamura, "Haptic feedback in robot-assisted minimally invasive surgery," Current Opinion Urology, vol. 19, no. 1, pp. 102-107, 2009.
45. Q. Wang and V. Hayward, "In vivo biomechanics of the fingerpad skin under local tangential traction," J. Biomechanics, vol. 6, pp. 27-32, 1983.
46. D. Loesch and N. Martin, "Finger ridge patterns and tactile sensitivity," Ann. Human Biol., vol. 40, pp. 851-860, 2007.
47. R. Johansson and A. Vallbo, "Tactile sensory coding in the glabrous skin of the human hand," Trends Neurosci., vol. 11, no. 2, pp. 113-124, 1984.