Visual touch in virtual environments: An exploratory study of presence, multimodal interfaces, and cross-modal sensory illusions

Presence: Teleoperators and Virtual Environments

Volumn 10, Issue 3, 2001, Pages 247-265

  Biocca, Frank ^b   Jin, Kim ^a   Choi, Yung ^a  

^a MICHIGAN STATE UNIVERSITY   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0041028832     PISSN: 10547460     EISSN: None     Source Type: Journal    
DOI: 10.1162/105474601300343595     Document Type: Article

References (58)

1. Anderson, R. A., Snyder, L. H., Bradley, D. C., & Xing, J. (1997). Multimodal representation of space in the posterior parietal cortex and its use in planning movement. Annual Review in Neuroscience, 20, 303-330.
2. Barfield, W., Hendrix, C., Bjorneseth, O., Kaczmarek, K. A., & Lotens, W. (1995). Comparison of human sensory capabilities with technical specifications of virtual environment equipment. Presence: Teleoperators and Virtual Environments, 4(4), 329-357.
3. Barfield, W., Zeltzer, B., Sheridan, T., & Slater, M. (1995). Presence and performance within virtual environments. In W. Barfield & T. A. Furness (Eds.), Virtual environments and advanced interface design (pp. 473-513). New York: Oxford University Press.
4. Baron-Cohen, S., Wyke, M., & Binnie, C. (1996). Is there a normal phase of synaesthesia in development? Psyche, 2(27).
5. Begault, D. R. (1994). 3D sound for virtual reality and multimedia. New York: AP Professional.
6. Biocca, F. (1992). Will simulator sickness slow down the diffusion of virtual environment technology? Presence: Teleoperators and Virtual Environments, 1(3), 258-264.
7. _. (2000). Human-bandwidth and the design of Internet2 interfaces: Human factors and psychosocial challenges, In Internet2 Sociotechnical Summit (pp. 67-81). Ann Arbor, MI: University Corporation for Advanced Internet Development, Internet2.
8. Biocca, F., Kim, J., & Brady, R. (2000). The effect of aural narrative frames on feelings of presence in virtual environments. East Lansing, MI: Media Interface and Network Design Lab, Department of Telecommunication, Michigan State University.
9. Biocca, F., Polinsky, H., Inoue, H., & Lee, A. (2001). Intersensory integration and presence: Evidence from crossmodal interactions and perceptual illusions. East Lansing, MI: Media Interface and Network Design Lab, Department of Telecommunication, Michigan State University.
10. Biocca, F., & Rolland, J. (1998). Virtual eyes can rearrange your body: Adaptation to visual displacement in seethrough, head-mounted displays. Presence: Teleoperators and Virtual Environments, 7(3), 262-277.
11. Bryant, D. J. (1992). A spatial representation system in humans. Psycholoquy, 3(16) [on-line serial], (http:// psycholoquy.92.3.16.space.l.bryant).
12. Cacioppo, J. T., & Petty, R. E. (1982). The need for cognition. Journal of Personality and Social Psychology, 42(1), 116-131.
13. Cacioppo, J. T., Petty, R. E., & Kao, C. F. (1984). The efficient assessment of need for cognition. Journal of Personality Assessment, 48(3), 306-307.
14. Cross, D. V., & Rotkin, L. (1975). The relation between size and apparent heaviness. Perception and psychophysics, 18, 79-87.
15. Cytowic, R. E. (1989). Synesthesia: The union of the senses. Berlin: Springer Verlag.
16. _. (1995). Synesthesia: Phenomenology and neuropsychology, A review of current knowledge. Psyche, 2(10), 1-15.
17. Durlach, N., & Mavor, A. (1994). Virtual reality: Scientific and technological challenges. Washington: National Research Council.
18. Ellis, R. R., & Lederman, S. J. (1993). The role of haptic versus visual volume cues in the size-weight illusion. Perception and psychophysics, 55(3), 315-324.
19. Foreman, N., & Gillet, R. (Eds.). (1997). A handbook of spatial research paradigms and methodologies: Volume 1: Spatial Cognition in the Child and Adult. East Sussex: Psychology Press.
20. _. (1998). A handbook of spatial research paradigms and methodologies: Volume 2: Clinical and Comparative Approaches. East Sussex: Psychology Press.
21. Fraisse, P. (1963). The psychology of time. New York: Harper & Row.
22. _. (1984). Perception and estimation of time. Annual review of psychology, 35, 1-36.
23. Graziano, M. S. A. (1999). Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position. Proceedings of the National Academic of Sciences, USA, 96, 411-418.
24. Held, R. M., & Durlach, N. I. (1992). Telepresence. Presence: Teleoperators and Virtual Environments, 1(1), 109-112.
25. Hollier, M. P., Rimell, A. N., Hands, D. S., & Voelcker, R. M. (1999). Multi-modal perception. BT technological journal, 77(1), 35-46.
26. Howard, I. P., & Templeton, W. B. (1966). Human spatial orientation. London: Wiley.
27. Hunter, J. E., & Gerbing, D. W. (1982). Unidimensional measurement, second order factor analysis, and causal models. In B. M. Staw & L. L. Cummings (Eds.), Research in organizational behavior, Vol. 4, pp. 267-320. Greenwich, CT.
28. Kennedy, R. S., Hettinger, L. J., & Lilienthal, M. G. (1987). Simulator sickness. In G. Crampton (Ed.), Motion and space sickness (pp. 317-341). Boca Raton, FL: CRC Press.
29. Kim, J., & Mueller, C. W. (1978). Factor analysis: Statistical methods and practical issues. Beverly Hills: Sage.
30. Kolasinski, E. M. (May, 1995). Simulator sickness in virtual environments. Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences, Department of the Army.
31. Lang, P. J., Greenwald, M., Bradley, M. M., & Hamm, A. (1993). Looking at pictures: Evaluative, facial, visceral, and behavioral responses. Psychophysiology, 30, 261-273.
32. Lang, P. J., & Greenwald, M. K. (1985). The international affective picture system slides and technical report. Gainesville, FL: University of Florida Center for Research in Psychophysiology.
33. Lecuyer, A., Coquillart, S., & Kheddar, A. (2000). Pseudohaptic feedback: Can isometric input devices simulate force feedback? In S. K. Feiner & D. Thalmann (Eds.), Virtual reality 2000 conference (pp. 83-90). Los Alamitos, CA: IEEE Computer Society.
34. Lombard, M., & Ditton, T. (1997). At the heart of it all: The concept of presence. Journal of Computer-Mediated Communication, 3(2) [on-line serial]. http://www.ascusc.org/ jcmc/
35. _. (1999). Presence measures. Unpublished manuscript, Temple University. Available: http://nimbus.temple.edu/ ~ mlombard/index.html.
36. Long, J. S. (1983). Confirmatory factor analysis. Beverly Hills: Sage.
37. Marks, L. E. (1978). The unity of the senses. New York: Academic Press.
38. Masin, C. M., & Crestoni, L. (1988). Experimental demonstration of the sensory basis of the size-weight illusion. Perception and psychophysics, 44, 309-371.
39. Neuman, W. R., Crigler, A. C., & Bove, V. M. (1991). Television sound and viewer perceptions. Paper presented at the Proceedings of the Joint IEEE/Audio Engineering Society, Detroit, Michigan, February 1991, pp. 101-104.
40. Paillard, J. (Ed.). (1991). Brain and space. Cambridge, MA: Oxford Science Publications.
41. Pavani, F., Spence, C., & Driver, J. (2000). Visual capture of touch: Out-of-the-body experiences with rubber gloves. Psychological Science, 11(5), 353-359.
42. Ramachandran, V. S., & Rogers-Ramachandran, D. (1996). Synaesthesia in phantom limbs induced with mirrors. Proceedings of the Royal Society of London B, 263, 377-386.
43. Ramachandran, V. S., Rogers-Ramachandran, D., & Cobb, S. (1995). Touching the phantom limb. Nature, 377, 489-490.
44. Reeves, B., Detember, B., & Steuer, J. S. (1993). New television: The effects of big pictures and big sound on viewer responses to the screen. Paper presented at the International Communication Association, Chicago, IL.
45. Reeves, B., & Nass, C. (1996). The media equation: How peopie treat computers, television, and new media like real people and places. Cambridge: Cambridge University Press.
46. Stanney, K. (1998). Aftereffects and sense of presence in virtual environments: Formulation of a research and development agenda. International Journal of Human-Computer Interaction, 10(2), 135-187.
47. Stein, B., Wallace, M., & Meredith, A. (1995). Neural mechanisms mediating attention and orientation to multisensory cues. In M. Gazzaniga (Ed.), The cognitive neurosciences (pp. 683-702). Cambridge: M.I.T. Press.
48. Stein, B. E. (1984). Multimodal representation in the superior colliculus and optic tectum. Journal of Neurophysiology, 41, 55-64.
49. Stein, E., & Meredith, A. (1993). The merging of the senses. London: MIT Press.
50. Steuer, J. (1995). Defining virtual reality: Dimensions determining telepresence. In F. Biocca & M. Levy (Eds.), Communication in the age of virtual reality (pp. 33-56). Hillsdale, NJ: Lawrence Erlbaum.
51. Tang, A., Maslowski, E., & Biocca, F. (2000). Hands-on Virtual Cadaver Demonstration (ML-TR-2000-01). East Lansing, MI: Media Interface and Network Design Lab, Department of Telecommunication, Michigan State University.
52. Watkins, C. (1997). Synaesthesia: Is it the key to consciousness? Unpublished doctoral dissertation, University of Exeter.
53. Welch, R. (1978). Perceptual modification: Adapting to altered sensory environments. New York: Academic Press.
54. _. (1998). Adapting to telesystems. Unpublished manuscript, NASA-Ames Research Center, Moffett Field, CA.
55. _. (1999). Meaning, attention, and the unity assumption in the intersensory bias of spatial and temporal perceptions. In G. Aschersleben, T. Bachmann, & J. Müsseler (Eds.), Cognitive contributions to the perception of spatial and temporal events, (pp. 371-387). Amsterdam: Elsevier.
56. Welch, R B., & Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychological Bulletin, 88(3), 638-667.
57. _. (1986). Intersensory interactions. In Boff, K. K., Kaufman, L., & Thomas, J. P. (Eds.), Handbook of perception and human performance (Vol. 1, pp. 25.1-25.36. New York: John Wiley.
58. Witmer, B. G., & Singer, M. J. (1994). Measuring immersion in virtual environments (Tech. Report 1014). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences.