Tactile sensory substitution: Models for enaction in HCI

Interacting with Computers

Volumn 21, Issue 1-2, 2009, Pages 38-53

  Visell, Yon ^a  

^a MCGILL UNIVERSITY   (Canada)

Author keywords

Enaction; Enactive interfaces; Sensory substitution; Tactile display

Indexed keywords

HUMAN COMPUTER INTERACTION; SURVEYS;

DESIGN AND IMPLEMENTATIONS; ENACTION; ENACTIVE INTERFACES; HUMAN SENSORY; RESEARCH DOMAINS; SCIENCE AND ENGINEERING; SENSORY SUBSTITUTION; TACTILE DISPLAY;

SENSORY PERCEPTION;

EID: 59649106069     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intcom.2008.08.004     Document Type: Article

References (103)

1. Adams R.J., and Hannaford B. Stable haptic interaction with virtual environments. IEEE Transactions on Robotics and Automation 15 3 (1999) 465-474
2. Akinbiyi, T., Reiley, C.E., Saha, S., Burschka, D., Hasser, C.J., Kontarinis, D.A., Yuh, D., Okamura, A.M., 2006. Dynamic augmented reality for sensory substitution in robot-assisted surgical systems. In: Proceedings of the 28th IEEE EMBS Annual International Conference.
3. Amedi, A., Bermpohl, F., Stern, W., Camrpodon, J.A., Bermpohl, F., Merabet, L., Meijer, P., Pascual-Leone, A., 2007. Extracting shape and location information conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex and dorsal visual stream respectively in blind and sighted individuals. In: IMRF 2007, the 8th Annual Meeting of the International Multisensory Research Forum.
4. Auvray, M., 2004. Immersion et perception spatiale: L'exemple des dispositifs de substitution sensorielle, Ph.D. thesis, Ecole des Hautes Etudes en Sciences Sociales.
5. Auvray M., Hanneton S., Lenay C., and O'Regan K. There is something out there: distal attribution in sensory substitution, twenty years later. Journal of Integrative Neuroscience 4 4 (2005) 505-521
6. Bach-y-Rita P. Theoretical and practical considerations in the restoration of function after stroke. Topics in Stroke Rehabilitation 8 3 (2001) 1-15
7. Bach-y-Rita P. Seeing with the brain. International Journal of Human-Computer Interaction 15 2 (2003) 285-295
8. Bach-y-Rita P. Tactile sensory substitution studies, the coevolution of human potential and converging technologies. Annals of the New York Academy of Sciences 1013 (2004) 83-91
9. Bach-y-Rita P., Collins C.C., Sauders F., White B., and Scadden L. Vision substitution by tactile image projection. Nature 221 (1969) 963-964
10. Bach-y-Rita P., Kaczmarek K.A., Tyler M.E., and Garcia-Lara M. Form perception with a 49-point electrotactile stimulus array on the tongue: a technical note. Journal of Rehabilitation Research and Development 35 (1998) 427-430
11. Bach-y-Rita P., and Kercel S.W. Sensory substitution and the human-machine interface. Trends in Cognitive Sciences 7 12 (2003) 541-546
12. Bavelier D., and Nevile H.J. Cross-modal plasticity: where and how?. Nature Reviews in Neuroscience 3 (2002) 443-452
13. Benali-Khoudja, M., Hafez, M., Alexandre, J.-M., Kheddar, A., 2004. Tactile interfaces: a state of the art survey. In: 35th International Symposium on Robotics, Paris.
14. Bliss J.C., Katcher M.H., Rogers C.H., and Shepard R.P. Optical-to-tactile image conversion for the blind. IEEE Transactions on Man-Machine Systems 11 1 (1970) 58-65
15. Browse R.A., and McDonald M.L. Using tactile information in telerobotics. IEEE Transactions on Systems, Man, and Cybernetics 22 5 (1992) 1205-1210
16. Capp M., and Picton P. The optophone: an electronic blind aid. Engineering Science and Education Journal 9 3 (2000) 137-143
17. Cholewiak R.W., and Collins A.A. The generation of vibrotactile patterns on a linear array: influences of body site, time, and presentation mode. Perception and Psychophysics 62 6 (2000) 1220-1235
18. Chouvardas, V.G., Miliou, A.N., Hatalis, M.K., 2005. Tactile displays: a short overview and recent developments. In: Proceedings of the 5th International Conference on Technology and Automation (ICTA'05).
19. Clark A. Cognitive complexity and the sensorimotor frontier. Aristotelian Society Supplementary 80 1 (2006) 43-65
20. Clifford C.W. Perceptual adaptation: motion parallels orientation. Trends in Cognitive Sciences 6 3 (2002) 136-143
21. Cohn, M.B., Lam, M., Fearing, R.S., 1992. Tactile feedback for teleoperation. In: Telemanipulator Technology SPIE Proceedings 1833.
22. Collins C.C. Tactile television: mechanical and electrical image projection. IEEE Transactions on Man-Machine Systems 11 (1970) 65-71
23. Craig J.C., and Johnson K.O. The two-point threshold: not a measure of tactile spatial resolution. Current Directions in Psychological Science 9 1 (2000) 29-32
24. Debus, T., Becker, T., DUpont, P., Jang, T.-J., Howe, R., 2001. Multichannel vibrotactile display for sensory substitution during teleoperation. In: Proceedings of the SPIE International Symposium on Intelligent Systems and Advanced Manufacturing.
25. Debus, T., Jang, T.-J., Dupont, P., Howe, R., 2002. Multi-channel vibrotactile display for teleoperated assembly. In: Proceedings IEEE International Conference on Robotics and Automation.
26. Debus T., Jang T.-J., Dupont P., and Howe R. Multi-channel vibrotactile display for teleoperated assembly. Int. J. of Control, Automation, and Systems 2 3 (2004) 390-397
27. Degenaar M., and Lokhorst G.-J. Molyneuxś problem. In: Zalta E.N. (Ed). The Stanford Encyclopedia of Philosophy (2005), Stanford University, Fall
28. Epstein W., Highes B., Schneider S., and Bach-y-Rita P. Is there anything out there? a study of distal attribution in response to vibrotactile stimulation. Perception 15 3 (1986) 275-284
29. Foulke E. Reading braille. In: Schiff W., and Foulke E. (Eds). Tactual Perception: A Sourcebook (1982), Cambridge University Press 168-208
30. Fujimoto, I., Yamada, Y., Maeno, T., Morizono, T., Umetani, Y., 2004. Study on a "tactile mirror" for displaying static friction sensation with tactile perception feedback. In: Proceedings of the IEEE International Conference on Robotics and Automation.
31. Gallace A., Tan H.Z., and Spence C. The body surface as a communication system: the state of the art after 50 years. Presence 16 6 (2007) 655-676
32. Gibson J.J. Observations on active touch. Psychological Reviews 69 (1962) 477-491
33. Goldstone R.L. Perceptual learning. Annual Review of Psychology 49 (1998) 585-612
34. Hafez M. Tactile interfaces: technologies, applications, and challenges. Visual Computing 23 (2007) 267-272
35. Hamilton R.H., and Pacual-Leone A. Cortical plasticity associated with braille learning. Trends in Cognitive Sciences 2 5 (1998) 168-174
36. Hart S.G., and Staveland L.E. Development of nasa-tlx. In: Hancock P.A., and Meshkati N. (Eds). Human Mental Workload (1988), North Holland Press 239-250
37. Hasser C.J. Tactile Feedback For A Force Reflecting Haptic Display (1993), University of Dayton Master's thesis
38. Hayashi, K., Ninjouji, T., 2004. Two-point discrimination threshold as a function of frequency and polarity at fingertip by electrical stimulation. In: Proceedings of the 26th Annual International Conference of the IEEE EMBS.
39. Hayward V., Astley O.R., Cruz-Hernandez M., Grant D., and Robles-De-La-Torre G. Haptic interfaces and devices. Sensor Review 24 1 (2004) 16-29
40. Hein, A., Brell, M., 2007. Contact - a vibrotactile display for computer aided surgery. In: Proceedings of the Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).
41. Hurley S., and Nöe A. Neural plasticity and consciousness. Biology & Philosophy 18 (2003) 131-168
42. Iwamoto, T., Maeda, T., Shinoda, H., 2001. Focused ultrasound for tactile feeling display. In: Proceedings of ICAT, Tokyo, Japan.
43. Jeka J.J., and Lackner J. Fingertip contact influences human postural control. Experimental Brain Research 100 (1994)
44. Jones L.A., and Sarter N.B. Tactile displays: guidance for their design and application. Human Factors 50 1 (2008) 90-111
45. Kaczmarek K., Webster J.G., Bach-y-Rita P., and Tompkins W.J. Electrotactile and vibrotactile displays for sensory substitution systems. IEEE Transactions on Biomedical Engineering 38 1 (1991) 1-16
46. Kadkade P.P., Benda B.J., Schmidt P.B., and Wall III C. Vibrotactile display coding for a balance prosthesis. IEEE Transactions on Neural Systems and Rehabilitation Engineering 11 4 (2003) 392-399
47. Kajimoto, H., Kawakami, N., Tachi, S. 2003. In: Psychophysical evaluation of receptor selectivity in electrotactile display, Proceeding of 13th International Symposium on Measurement and Control in Robotics (ISMCR), vol. 13, pp. 83-86.
48. Kajimoto H., Inami M., Kawakami N., and Tachi S. Smarttouch: electric skin to touch the untouchable. IEEE Computer Graphics and Applications 24 1 (2004) 36-43
49. Kandel E.R., Schwartz J.H., and Jessell T.M. Principles of Neural Science. 4th ed. (2000), McGraw-Hill
50. Kitagawa M., Dokko D., Okamura A.M., and Yuh D.D. Effect of sensory substitution on suture-manipulation forces for robotic surgery systems. Journal of Thoracic and Cardiovascular Surgery 129 1 (2005) 151-158
51. Kolb B., and Whishaw I.Q. Brain plasticity and behavior. Annual Review of Psychology 49 1 (1998) 43-64
52. Kontarinis D.A., and Howe R.D. Tactile display of vibratory information in teleoperation and virtual environments. Presence 4 4 (1995) 387-402
53. Kreuger L.E. David Katz's der aufbau der tastwelt (the world of touch): a synopsis. Perception and Psychophysics 7 6 (1970) 337-341
54. Kreuger L.E. Tactual perception in historical perspective: David Katz's world of touch. In: Schiff W., and Foulke E. (Eds). Tactual Perception (1982), Cambridge University Press
55. LaMotte R.H., and Whitehouse J. Tactile detection of a dot on a smooth surface: peripheral neural events. Journal of Neurophysiology 56 5 (1986) 1109-1128
56. Lenay, C., Canu, S., Villion, P., 1997. Technology and perception: the contribution of sensory substitution systems. In: 2nd International Conference on Cognitive Technology (CT'97), p. 44.
57. Lenay C., Gapenne O., and Hanneton S. Sensory substitution: limits and perspectives. In: Hatwell Y., Streri A., and Gentaz E. (Eds). Touching for Knowing: Cognitive Psychology of Haptic Manual Perception (2003), John Benjamins
58. Lenay, C., Gapenne, O., Stewart, J., 2001. Constitution of spatiality in relation to the lived body: a study based on prosthetic perception. In: Symposium on Emergence and Development of Embodied Cognition (EDEC2001), Beijing, China.
59. Lévesque, V., 2005. Blindness, technology, and haptics, Tech. Rep. TR-CIM-05.08, McGill University Centre for Intelligent Machines.
60. Lieberman J., and Breazeal C. Tikl: Development of a wearable vibrotactile feedback suit for improved human motor learning. IEEE Transactions on Robotics 23 5 (2007) 919-926
61. Loomis J.M. Distal attribution and presence. Presence 1 1 (1992) 113-119
62. Massimino M.J. Using bisensory feedback displays for space teleoperation. Acta Astronautica 24 (1991) 391-397
63. Massimino M.J. Improved force perception through sensory substitution. Control Engineering Practice 3 2 (1995) 215-222
64. Merleau-Ponty M. Phenomenology of Perception. 2002nd ed (1945), Routledge, New York
65. Minsky M., Ming O.-Y., Steele O., Brooks Jr. F.P., and Behensky M. Feeling and seeing: issues in force display. ACM SIGGRAPH Computer Graphics 24 2 (1990) 235-241
66. Morgan M.J. Molyneux's Question (1977), Cambridge University Press
67. Noë A. Action in Perception (2005), MIT Press
68. O'Regan J.K., and Noë A. A sensorimotor account of vision and visual consciousness. Behavioral and Brain Sciences 24 (2001) 939-1031
69. Paré M., Behets C., and Cornu O. Paucity of presumptive ruffini corpuscles in the index finger pad of humans. Journal of Comparative Neurology 456 (2003) 260-268
70. Paré M., Smith A.M., and Rice F.L. Distribution and terminal arborizations of cutaneous mechanoreceptors in the glabrous finger pads of the monkey. Journal of Comparative Neurology 445 (2002) 347-359
71. Pascual-Leone A., Amedi A., Fregni F., and Merabet L.B. The plastic human brain cortex. Annual Review of Neuroscience 28 (2005) 377-401
72. Pascual-Leone, A., Hamilton, R.H., 2001. The metamodal organization of the brain. In: Casanova, C., Ptito M. (Eds.), Progress in Brain Research.
73. Pascual-Leone A., and Torres F. Plasticity of the sensorimotor cortex representation of the reading finger in braille readers. Brain 116 1 (1993) 39-52
74. Philipona, D., O'Regan, J.K., 2005. Perception of the structure of the physical world using unknown multimodal sensors and effectors. In: Proceedings of NIPS.
75. Philipona D., O'Regan K., and Nadal J.-P. Is there something out there? inferring space from sensorimotor dependencies. Neural Computation 15 9 (2003) 2029-2049
76. Poiriera C., Voldera A.G.D., and Scheiberb C. What neuroimaging tells us about sensory substitution. Neuroscience & Biobehavioral Reviews 31 7 (2007) 1064-1070
77. Ptito M., Moesgaard S.M., Gjedde A., and Kupers R. Cross-modal plasticity revealed by electrotactile stimulation of the tongue in the congenitally blind. Brain 128 3 (2005) 606-614
78. Rath M., and Rocchesso D. Continuous sonic feedback from a rolling ball. IEEE MultiMedia 12 2 (2005) 60-69
79. Reed C.M., and Delhorne L.A. Current results of a field study of adult users of tactile aids. Seminars in Hearing 16 (1995) 305-315
80. Roll J.P., and Gilhodes J.C. Proprioceptive sensory codes mediating movement trajectory perception: human hand vibration-induced drawing illusions. Canadian Journal of Physiology and Pharmacology 73 2 (1995) 295-304
81. Sampaio E., Maris S., and yRita P.B. Brain plasticity: 'visual' acuity of blind persons via the tongue. Brain Research 908 (2001) 204-207
82. Siegle, J.H., Warren, W.H., 2007. Distance perception in visual-to-tactile sensory substitution. In: Three Dimensional Sensory and Motor Space, Sant Feliu de Guixols, Spain.
83. Spirkovska, L., 2005. Summary of tactile user interfaces techniques and systems, Tech. Rep. NASA/TM-2005-213451, National Aeronautics and Space Administration, Ames Research Center, Moffett Field, California.
84. Starkiewicz, W., Kuliszewski, T., 1963. The 80-channel elektroftalm. In: Proceedings of the lnternational Congress Technology Blindness, Am. Found. Blindness, New York, NY, USA.
85. Tan H.Z., Durlach N.I., Reed C.M., and Rabinowitz W.M. Information transmission with a multifinger tactual display. Perception and Psychophysics 61 6 (1999) 993-1008
86. Tan H.Z., and Pentland A. Tactual displays for wearable computing. Personal Technologies 1 (1997) 225-230
87. Théoret H., Merabet L., and Pascual-Leone A. Behavioral and neuroplastic changes in the blind: evidence for functionally relevant cross-modal interactions. Journal of Physiology - Paris 98 1-3 (2004) 221-233
88. Torebjork H.E., Schady W., and Ochoa J. Sensory correlates of somatic afferent fiber activation. Human Neurobiology 3 1 (1984) 15-20
89. Triggs T.J., Levison W.H., and Sanneman R. Some experience with flight-related electrocutaneous and vibrotactile displays. In: Geldard F.A. (Ed). Conference Cutaneous Communication System Devices (1973), Psychonomic Society 57-64
90. van Erp J.B.F. Vibrotactile in-vehicle navigation system, transportation research part F. Human Factors 7 (2004) 247-256
91. van Erp J.B.F. Presenting directions with a vibrotactile torso display. Ergonomics 48 3 (2005) 302-313
92. van Erp, J.B.F., 2005. Vibrotactile spatial acuity on the torso: effects of location and timing parameters. In: Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.
93. van Erp J.B.F. Touch down: The effect of artificial touch cues on orientation in microgravity. Neuroscience Letters 404 (2006) 78-82
94. van Erp, J.B.F., van Veen, H.A.H.C., 2003. A multi-purpose tactile vest for astronauts in the international space station. In: Proceedings of Eurohaptics.
95. van Erp J.B.F., van Veen H.A.H.C., Jansen C., and Dobbins T. Waypoint navigation with a vibrotactile waist belt. ACM Transactions on Applied Perception 2 2 (2005) 106-117
96. van Erp J.B.F., and Verschoor M.H. Cross-modal visual and vibrotactile tracking. Applied Ergonomics 35 (2004) 105-112
97. Vuillerme, N., Chenu, O., Pinsault, N., Moreau-Gaudry, A., Fleury, A., Demongeot, J., Payan, Y., 2007a. Pressure sensor-based tongue-placed electrotactile biofeedback for balance improvement. In: Proceedings of the 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.
98. Vuillerme, N., Chenu, O., Pinsault, N., Moreau-Gaudry, A., Fleury, A., Demongeot, J., Payan, Y. 2007b. Pressure sensor-based tongue-placed electrotactile biofeedback for balance improvement - Biomedical application to prevent pressure sores formation and falls. In: Proc. of the Engineering in Medicine and Biology Society.
99. Vuillerme N., Chenua O., Demongeota J., and Payana Y. Improving human ankle joint position sense using an artificial tongue-placed tactile biofeedback. Neuroscience Letters 405 1-2 (2006) 19-23
100. Wall S.A., and Brewster S. Sensory substitution using tactile pin arrays: human factors, technology, and applications. Signal Processing 86 (2006) 3674-3695
101. Weiskrantz L. Blindsight: A Case Study and Implications (1998), Oxford University Press
102. White B.W. Perceptual findings with the vision-substitution system. IEEE Transactions on Man-Machine Systems 11 (1970) 54-59
103. Yao H.-Y., and Hayward V. An experiment on length perception with a virtual rolling stone. Proceedings of Eurohaptics (2006) 325-330