Vibrotactile feedback for haptics and telemanipulation: Survey, concept and experiment

Acta Polytechnica Hungarica

Volumn 9, Issue 1, 2012, Pages 41-65

  Galambos, Péter ^a  

^a INSTITUTE OF EXPERIMENTAL MEDICINE   (Hungary)

Author keywords

Cognitive infocommunications; Force feedback; Telemanipulation; Vibrotactile feedback

Indexed keywords

EID: 84859652369     PISSN: 17858860     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (64)

1. O. Ogorodnikova, "Creating an active awareness system for humans in robotic workcell," Acta Polytechnica Hungarica, vol. 5, no. 2, pp. 113-126, 2008.
2. O. Ogorodnikova, "How safe the Human-Robot coexistence is? theoretical presentation," Acta Polytechnica Hungarica, vol. 6, no. 4, pp. 51-74, 2009.
3. P. Galambos and P. Baranyi, "Virca as virtual intelligent space for rtmiddleware," in Advanced Intelligent Mechatronics (AIM), 2011 IEEE/ASME International Conference on, july 2011, pp. 140-145.
4. P. Baranyi and A. Csapo, "Cognitive infocommunications: CogInfoCom," in 2010 11th International Symposium on Computational Intelligence and Informatics (CINTI), Budapest, Hungary, Nov. 2010, pp. 141-146.
5. P. Bach-y-Rita, "Sensory plasticity. applications to a vision substitution system." Acta Neurol Scand, vol. 43, no. 4, pp. 417-426, 1967.
6. P. Bach-y-Rita, "Various neurophysiological findings of sensory substitution," Acta Neurol Latinoam, vol. 14, no. 1, pp. 125-131, 1968.
7. P. Bach-y-Rita, C. C. Collins, F. A. Saunders, B. White, and L. Scadden, "Vision substitution by tactile image projection," Nature, vol. 221, no. 5184, pp. 963-964, 1969.
8. P. Bach-y-Rita, Brain mechanisms in sensory substitution. New York: Academic Press, 1972.
9. P. Bach-y-Rita, "Theoretical aspects of sensory substitution and of neurotransmission related reorganization in spinal cord injury," Spinal Cord: The Official Journal of the International Medical Society of Paraplegia, vol. 37, no. 7, pp. 465-474, Jul. 1999.
10. P. Bach-y-Rita and M. E. Tyler, "Tongue man-machine interface." Stud Health Technol Inform, vol. 70, pp. 17-19, 2000.
11. Y. Danilov, M. Tyler, K. Skinner, and P. Bach-y-Rita, "Efficacy of electrotactile vestibular substitution in patients with bilateral vestibular and central balance loss," in 2006 International Conference of the IEEE Engineering in Medicine and Biology Society, 2006, pp. 6605-6609.
12. Y. P. Danilov, M. E. Tyler, K. L. Skinner, R. A. Hogle, and P. Bach-y-Rita, "Efficacy of electrotactile vestibular substitution in patients with peripheral and central vestibular loss." J Vestib Res, vol. 17, no. 2-3, pp. 119-130, 2007.
13. T. Sheridan, "Musings on telepresence and virtual presence," Presence: Teleoperators and Virtual Environments, vol. 1, no. 1, pp. 120-126, 1992.
14. M. Endsley and D. Garland, Situation Awareness: Analysis and Measurement. Routledge, 2000.
15. T. Sheridan, "Human factors considerations for remote manipulation," in Advanced Guidance and Control Aspects in Robotics, 1994.
16. M. Slater and S. Wilbur, "A framework for immersive virtual environments (five): Speculations on the role of presence in virtual environments," Presence, vol. 6, no. 6, pp. 603-615, 1997.
17. S. Ellis, "Nature and origins of virtual environments: a bibliographical essay," Computing Systems in Engineering, vol. 2, no. 4, pp. 321-347, 1991.
18. R. Adams and B. Hannaford, "Stable haptic interaction with virtual environments," IEEE Transactions on Robotics and Automation, vol. 15, no. 3, pp. 465-474, 1999.
19. M. Massimino, "Sensory substitution for force feedback in space teleoperation," Ph.D. dissertation, MIT, Dept. of Mechanical Engineering, 1992.
20. K. Kaczmarek, J. Webster, P. Bach-y-Rita, and W. Tompkins, "Electrotactile and vibrotactile displays for sensory substitution systems," IEEE Transactions on Biomedical Engineering, vol. 38, no. 1, pp. 1-16, 1991.
21. H. Tan and A. Pentland, "Tactual displays for sensory substitution and wearable computers," in ACM SIGGRAPH 2005 Courses, ser. SIGGRAPH'05, 2005.
22. M. Kitagawa, D. Dokko, A. Okamura, and D. Yuh, "Effect of sensory substitution on suture-manipulation forces for robotic surgical systems," Journal of Thoracic and Cardiovascular Surgery, vol. 129, no. 1, pp. 151-158, 2005.
23. A. M. Okamura, L. N. Verner, T. Yamamoto, J. C. Gwilliam, and P. G. Griffiths, Force Feedback and Sensory Substitution for Robot-Assisted Surgery. Springer, 2011, pp. 419-448.
24. F. Biocca, J. Kim, and Y. Choi, "Visual touch in virtual environments: An exploratory study of presence, multimodal interfaces and cross-modal sensory illusions," Presence: Teleoperators and Virtual Environments, vol. 10, no. 3, pp. 247-265, 2001.
25. F. Biocca, Y. Inoue, H. Polinsky, A. Lee, and A. Tang, "Visual cues and virtual touch: Role of visual stimuli and intersensory integration in cross-modal haptic illusions and the sense of presence," in In Proceedings of Presence, F. Gouveia, Ed., 2002.
26. R. Welch and D. Warren, "Immediate perceptual response to intersensory discrepancy," Psychological Bulletin, vol. 88, no. 3, pp. 638-667, 1980.
27. L. Verner and A. Okamura, "Sensor/actuator asymmetries in telemanipulators: Impliations of partial force feedback," in In Proc. 14th Symposium on Haptic Interfaces for Virtual Environments and Teleoperator Systems, 2006, pp. 309-314.
28. B. Stein, M. Wallace, and A. Meredith, "Neural mechanisms mediating attention and orientation to multisensory cues," in The Cognitive Neurosciences, M. Gazzaniga, Ed. MIT Press, Cambridge, 1995, pp. 683-702.
29. L. Williams, "Bisensory force feedback in telerobotics," Ph.D. dissertation, University of Houston, 2001.
30. J. Rochlis, "Human factors and telerobotics: Tools and approaches for designing remote robotics workstation displays," Ph.D. dissertation, Massachusetts Institute of Technology, 2002.
31. R. Welch and D. Warren, "Intersensory interactions," in Handbook of Perception and Human Performance, L. Boff and J. Thomas, Eds. John Wiley, 1986, vol. 1, pp. 25-36.
32. F. Pavani, C. Spence, and J. Driver, "Visual capture of touch: Out-of-the-body experiences with rubber gloves," Psychological Science, vol. 11, no. 5, pp. 353-359, 2000.
33. D. Hecht and M. Reiner, "Sensory dominance in combinations of audio, visual and haptic stimuli," Experimental Brain Research, vol. 193, pp. 307-314, 2009.
34. S. Munir and W. J. Book, "Internet-based teleoperation using wave variables with prediction," IEEE/ASME Transactions on Mechatronics, vol. 7, no. 2, pp. 124-133, 2002.
35. I. G. Polushin, P. X. Liu, and C. Lung, "A Force-Reflection algorithm for improved transparency in bilateral teleoperation with communication delay," Mechatronics, IEEE/ASME Transactions on, vol. 12, no. 3, pp. 361-374, Jun. 2007.
36. N. Ando, P. Korondi, and H. Hashimoto, "Development of micromanipulator and haptic interface for networked micromanipulation," Mechatronics, IEEE/ASME Transactions on, vol. 6, no. 4, pp. 417-427, Dec. 2001.
37. D. A. Lawrence, "Stability and transparency in bilateral teleoperation," IEEE Transactions on Robotics and Automation, vol. 9, no. 5, pp. 624-637, 1993.
38. P. F. Hokayem and M. W. Spong, "Bilateral teleoperation: An historical survey," Automatica, vol. 42, no. 12, pp. 2035-2057, Dec. 2006.
39. T. Sheridan, "Space teleoperation through time delay: Review and prognosis," IEEE Transactions on Robotics and Automation, vol. 9, no. 5, pp. 592-606, 1993.
40. W. Ferrell, "Delayed force feedback," Human Factors: The Journal of the Human Factors and Ergonomic Society, vol. 8, no. 5, pp. 449-455, 1966.
41. H. Das and H. Zak, "Operator performance with alternative manual control modes in teleoperation," Presence, vol. 1, no. 2, pp. 201-217, 1992.
42. H. Kazerooni and T. Snyder, "Case study on haptic devices: Human-induced instability in powered hand controllers," Journal of Guidance, Control and Dynamics, vol. 18, no. 1, pp. 108-113, 1995.
43. F. Buzan and T. Sheridan, "A model-based predictive operator-aid for telemanipulators with time delay," in In proc. of the IEEE International Conference on Systems, Man and Cybernetics, 1989, pp. 14-17.
44. M. Massimino, "Improved force perception through sensory substitution," Control Engineering Practice, vol. 3, no. 2, pp. 215-222, 1995.
45. M. Tavakoli, A. Aziminejad, R. Patel, and M. Moallem, "High-fidelity bilateral teleoperation systems and the effect of multimodal haptics," IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 37, no. 6, pp. 1512-1528, 2007.
46. R. Anderson and M. Spong, "Hybrid impedance control of robotic manipulators," IEEE Journal of Robotics and Automation, vol. 4, pp. 549-556, 1988.
47. G. Niemeyer and J.-J. E. Slotine, "Stable adaptive teleoperation," IEEE Journal of Oceanic Engineering, vol. 16, no. 1, 1991.
48. K. Salisbury, F. Conti, and F. Barbagli, "Haptic rendering: introductory concepts," Computer Graphics and Applications, IEEE, vol. 24, no. 2, pp. 24-32, march-april 2004.
49. N. Magnenat-Thalmann and U. Bonanni, "Haptics in virtual reality and multi-media," Multimedia, IEEE, vol. 13, no. 3, pp. 6-11, july-sept. 2006.
50. T. Coles, D. Meglan, and N. John, "The role of haptics in medical training simulators: A survey of the state of the art," Haptics, IEEE Transactions on, vol. 4, no. 1, pp. 51-66, jan.-feb. 2011.
51. J. Kammerl, R. Chaudhari, and E. Steinbach, "Combining contact models with perceptual data reduction for efficient haptic data communication in networked ves," Instrumentation and Measurement, IEEE Transactions on, vol. 60, no. 1, pp. 57-68, jan. 2011.
52. R. Adams and B. Hannaford, "Control law design for haptic interfaces to virtual reality," Control Systems Technology, IEEE Transactions on, vol. 10, no. 1, pp. 3-13, jan 2002.
53. A. Bejczy, R. Dotson, J. Brown, and J. Lewis, "Manual control of manipulator forces and torques using graphic display," in IEEE International Conference of Cybernetics and Society, 1982, pp. 691-698.
54. P. Bach-y-Rita, J. Webster, W. Tompkins, and T. Crabb, "Sensory substitution for space gloves and for space robots," in In Proceedings of the Workshop for Space Telerobotics, vol. 2, 1987, pp. 51-57.
55. W. Kim and A. Bejczy, "Graphics displays for operator aid in telemanipulation," in IEEE International Conference on Systems, Man and Cybernetics, 1991, pp. 1059-1067.
56. M. Massimino and T. Sheridan, "Sensory substitution of force feedback for the human-machine interface in space teleoperation," in 43rd Congress of the International Astronautical Federation, 1992.
57. T. Debus, T. Becker, P. Dupont, T.-J. Jang, and R. Howe, "Multichannel vibrotactile display for sensory substitution during teleoperation," in SPIE International Symposium on Intelligent Systems and Advanced Manufacturing, 2001.
58. T. Debus, T.-J. Jang, P. Dupont, and R. Howe, "Multichannel vibrotactile display for teleoperated assembly," in IEEE International Conference on Robotics and Automation, 2002, pp. 592-597.
59. C. Reiley, T. Akinbiyi, D. Burschka, D. Chang, A. Okamura, and D. Yuh, "Effects of visual force feedback on robot-assisted surgical task performance," The Journal of Thoracic and Cardiovascular Surgery, vol. 135, no. 1, pp. 196-202, 2008.
60. T. Yoshikawa, Y. Yokokohji, T. Matsumoto, and X.-Z. Zheng, "Display of feel for the manipulation of dynamic virtual objects," Journal of Dynamic Systems, Measurement, and Control, vol. 117, no. 4, pp. 554-558, 1995.
61. P. Galambos, M. Boleraczki, A. Juhász, A. Tóth, J. Püspöki, and G. Arz, "Development of the prototype of a master-slave servoelectrical gripper with forcefeedback for telemanipulation tasks," in Proceedings of the Fifth Conference on Mechanical Engineering, K. L. Penninger A, Ed. BME OMIKK, May 2006.
62. P. Galambos, A. Róka, P. Baranyi, and P. Korondi, "Contrast vision-based grasp force feedback in telemanipulation," in Advanced Intelligent Mechatronics, 2010 IEEE/ASME International Conference on, Montreal, Canada, Jun. 2010.
63. M. Slater, B. Spanlang, M. V. Sanchez-Vives, and O. Blanke, "First person experience of body transfer in virtual reality," PLoS ONE, vol. 5, 05 2010.
64. A. Csapo and P. Baranyi, "An interaction-based model for auditory substitution of tactile percepts," in 2010 IEEE 14th International Conference on Intelligent Engineering Systems, Las Palmas, Spain, 2010, pp. 271-276.