The role of mismatches in the sensory feedback provided to indicate selection within a virtual environment

Multimedia Tools and Applications

Volumn 55, Issue 3, 2011, Pages 353-378

  Viciana Abad, Raquel ^a   Reyes Lecuona, Arcadio ^b   Poyade, Matthieu ^b   Escolano, José ^a  

^a UNIVERSITY OF JAÉN   (Spain)

^b UNIVERSITY OF MÁLAGA   (Spain)

Author keywords

Co location; Delay; Feedback; Mismatches; Performance; Presence; Selection

Indexed keywords

COLOCATIONS; DELAY; MISMATCHES; PERFORMANCE; PRESENCE; SELECTION;

ALIGNMENT; DESIGN; FEEDBACK; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; SENSORY FEEDBACK; SENSORY PERCEPTION;

VIRTUAL REALITY;

EID: 80053575081     PISSN: 13807501     EISSN: 15737721     Source Type: Journal    
DOI: 10.1007/s11042-010-0551-x     Document Type: Article

References (50)

1. Allison RS, Harris LR, Jenkin M, Jasiobedzka U, Zacher JE (2001) Tolerance of temporal delay in virtual environments. In Proc. of IEEE Virtual Reality, pp 247-254. doi: http://doi.ieeecomputersociety.org/10.1109/VR.2001. 913793 (Pubitemid 32334755)
2. C Ardito MF Costabile A Angeli F Pittarello 2007 Navigation help in 3D worlds: some empirical evidences on use of sound Multimed Tools Appl 33 201 216 10.1007/s11042-006-0060-0 10.1007/s11042-006-0060-0 (Pubitemid 46492296)
3. Arsenault R, Ware C (2000) Eye-hand co-ordination with force feedback. In Proc. of the SIGCHI conf. on Human factors in computing systems, pp 408-414
4. JN Bailenson N Yee 2008 Virtual interpersonal touch: haptic interaction and copresence in collaborative virtual environments Multimed Tools Appl 37 5 14 10.1007/s11042-007-0171-2 10.1007/s11042-007-0171-2 (Pubitemid 351239541)
5. Begault DR (2000) 3-D sound for virtual reality and multimedia. Facsimile reprint of 1994 edition, Preface to the NASA Technical Memorandum version, Ames Research Center, Moffett Field, CA, USA
6. Boring EG (1929) A history of experimental psychology. Appleton Century Crofts, New York
7. Boukerche A, Shirmohammadi S, Hossain A (2006) Moderating simulation lag in haptic virtual environments. In Proc. of the 39th Annual Symposium on Simulation, pp 269-277, IEEE Computer Society, Washington, USA. doi: 10.1109/ANSS.2006.31 (Pubitemid 44592123)
8. Burke JL, Prewett MS, Gray AA, Yang L, Stilson, FRB, Coovert MD, Elliot LR, Redden E (2006) Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis. In Proc. Multimodal interfaces, pp 108-117. ACM, NY, USA (Pubitemid 47113436)
9. Burns E, Razzaque S, Whitton M, McCallus M, Panter A, Brooks FP (2005) The hand is slower than the eye: a quantitative exploration of visual dominance over proprioception. In Proc. of IEEE Virtual Reality, pp 3-10 (Pubitemid 41731703)
10. Buttazzo G, Lipari G, Abeni L, Caccamo M (2005) Soft real-time systems: predictability vs. efficiency (Series in Computer Science). Springer, Berlin
11. M Congedo A Lécuyer E Gentaz 2006 The influence of spatial delocation on perceptual integration of vision and touch Presence-Teleoper Virtual Env 15 353 357 10.1162/pres.15.3.353 (Pubitemid 43953318)
12. De Boeck J, Raymaekers C, Coninx K (2005) Are existing metaphors in virtual environments suitable for haptic interaction. In Proc. of Virtual Reality, pp 261-268. Laval, France
13. PJ Durlach J Fowlkes CJ Metevier 2005 Effect of variations in sensory feedback on performance in a virtual reaching task Presence-Teleoper Virtual Env. 14 450 462 10.1162/105474605774785299 (Pubitemid 41365737)
14. Ehmann S, Lin MC (2001) Accurate and fast proximity queries between polyhedral using convex surface decomposition. In Proc. of Eurographics, 20, pp 500-510
15. W Fujisaki S Shimojo M Kashino S Nishida 2004 Recalibration of audiovisual simultaneity Nat Neurosci 7 773 778 10.1038/nn1268 (Pubitemid 38859063)
16. CS Harris 1965 Perceptual adaptation to inverted, reversed, and displaced vision Psychol Rev 72 419 444 10.1037/h0022616
17. IJ Hirsh CE Sherrick 1961 Perceived order in different sense modalities J Exp Psychol 62 423 432 10.1037/h0045283
18. WA Ijsselsteijn YAW deKort A Haans 2006 Is this my hand I see before me? The rubber hand illusion in reality, virtual reality, and mixed reality Presence-Teleoper Virtual Env 15 455 464 10.1162/pres.15.4.455 10.1162/pres.15.4.455 (Pubitemid 44387187)
19. Jay C, Hubbold R (2005) Delayed visual and haptic feedback in a reciprocal tapping task. In Proc. of World Haptics, pp 655-656. doi: http://doi.ieeecomputersociety.org/10.1109/WHC.2005.29
20. Jay C, Hubbold R (2006) Quantifying the effects of latency on sensory feedback in distributed virtual environments. In Proc. of Virtual Images Seminar, pp 9-16. Paris, France
21. M Keetels J Vroomen 2007 No effect of auditory-visual spatial disparity on temporal recalibration Exp Brain Res 182 559 565 10.1007/s00221-007-1012-2 10.1007/s00221-007-1012-2 (Pubitemid 47403853)
22. Larsson P, Västfjäll D, Kleiner, M (2001) Ecological acoustics and the multi-modal perception of rooms: real and unreal experiences of auditory-visual virtual environments. In Proc. of the Conf. on Auditory Display, pp 245-249, Espoo, Finland
23. Lécuyer A, Burkhardt JM, Coquillart S, Coiffet P (2001) "Boundary of illusion": an experiment of sensory integration with a pseudo-haptic system. In Proc. of IEEE Virtual Reality, pp 115-122 (Pubitemid 32334739)
24. Lee I, Choi S (2007) Discrimination of virtual environments under visual and haptic rendering delays, frontiers in the convergence of bioscience and information technologies, pp 554-562. doi: http://doi.ieeecomputersociety.org/ 10.1109/FBIT.2007.124
25. Levitin DJ, MacLean K, Mathews M, Chu L, Jensen E (2000) The perception of cross-modal simultaneity. In AIP Conf. Proc. 517, pp 323, doi: 10.1063/1.1291270
26. JM Loomis 1992 Distal attribution and presence Presence-Teleoper Virtual Env 1 113 119
27. MacKenzie IS, Ware C (1993) Lag as a determinant of human performance in interactive systems. In Proc. of the INTERACT '93 and CHI '93, pp 488-493, NY, USA. doi: http://doi.acm.org/10.1145/169059.169431
28. S Morein-Zamir S Soto-Faraco A Kingstone 2003 Auditory capture of vision: examining temporal ventriloquism Cogn Brain Res 17 154 163 10.1016/S0926- 6410(03)00089-2 10.1016/S0926-6410(03)00089-2 (Pubitemid 36577550)
29. KG Munhall P Gribble L Sacco M Ward 1996 Temporal constraints on the McGurk effect Percept Psychophys 58 351 362 10.3758/BF03206811 (Pubitemid 126423050)
30. J Navarra S Soto-Faraco C Spence 2007 Adaptation to audiotactile asynchrony Neurosci Lett 413 72 76 10.1016/j.neulet.2006.11.027 10.1016/j.neulet.2006.11.027 (Pubitemid 46149187)
31. Pellegrini RS (2001) Quality assessment of auditory virtual environments. In Proceedings of ICAD, Espoo, Finland
32. M Radeau P Bertelson 1977 Adaptation to auditory-visual discordance and ventriloquism in semirealistic situations Percept Psychophys 22 137 146 10.3758/BF03198746 (Pubitemid 8175762)
33. Y Rossetti K Koga T Mano 1993 Prismatic displacement of vision induces transient changes in the timing of eye-hand coordination Percept Psychophys 54 355 364 10.3758/BF03205270
34. L Rothrock K Barron T Simpson M Frecker C Ligetti R Barton 2006 Applying the proximity compatibility and the control-display compatibility principles to engineering design interfaces Hum Factors Ergon Manuf 16 61 81 10.1002/hfm.v16:1 10.1002/hfm.20039
35. S Ryu H Kim J Park Y Kwon C Jeong 2007 Collaborative object-oriented visualization environment Multimed Tools Appl 3 209 234 10.1007/s11042-006-0066- 7 10.1007/s11042-006-0066-7 (Pubitemid 46181693)
36. TW Simpson K Barron L Rothrock M Frecker RR Barton C Ligetti 2007 Impact of response delay and training on user performance with text-based and graphical user interfaces for engineering design Res Eng Des 18 49 65 10.1007/s00163-007-0033-y 10.1007/s00163-007-0033-y (Pubitemid 350112196)
37. M Slater M Usoh A Steed 1994 Depth of presence in virtual environments Presence-Teleoper Virtual Env 3 113 119
38. B Sousa Santos P Dias A Pimentel J Baggerman C Ferreira S Silva J Madeira 2009 Head-mounted display versus desktop for 3D navigation in virtual reality: a user study Multimed Tools Appl 4 161 181 10.1007/s11042-008-0223-2 10.1007/s11042-008-0223-2
39. C Spence DI Shore RM Klein 2001 Multisensory prior entry J Exp Psychol Gen 130 799 832 10.1037/0096-3445.130.4.799 (Pubitemid 33594796)
40. D Swapp V Pawar C Loscos 2006 Interaction with co-located haptic feedback in virtual reality Virtual Real 10 24 30 10.1007/s10055-006-0027-5 10.1007/s10055-006-0027-5 (Pubitemid 43750701)
41. AJ Szameitat J Rummel DP Szameitat A Sterr 2009 Behavioral and emotional consequences of brief delays in human-computer interaction Int J Hum Comput Stud 67 561 570 10.1016/j.ijhcs.2009.02.004 10.1016/j.ijhcs.2009.02.004
42. Theile G (1993) Trends and activities in the development of multichannel sound systems. In Proc. of AES International Conf., pp 180-187
43. A Vatakis C Spence 2006 Audiovisual synchrony perception for music, speech, and object actions Brain Res 1111 134 142 10.1016/j.brainres.2006.05.078 10.1016/j.brainres.2006.05.078 (Pubitemid 44331172)
44. Viciana-Abad R, Reyes-Lecuona A (2008) Effects of Co-location and crossmodal interaction between haptic, auditory and visual cues in presence. Haptics: Perception, Devices and Scenarios, LNCS 5024: 832-837, Berlin: Springer. doi: 10.1007/978-3-540-69057-3
45. J Vroomen M Keetels B de Gelder P Bertelson 2004 Recalibration of temporal order perception by exposure to audio-visual asynchrony Cogn Brain Res 2 32 35 10.1016/j.cogbrainres.2004.07.003 10.1016/j.cogbrainres.2004.07.003 (Pubitemid 39550749)
46. Watson B, Walker N, Ribarsky B, Spaulding V (1999) Managing temporal detail in virtual environments: relating system responsiveness to feedback. In Proc. of CHI '99, pp 280-281, NY, USA. doi: http://doi.acm.org/10.1145/632716. 632888
47. Watson B, Walker N, Woytiuk P, Ribarsky W (2003) Maintaining usability during 3D placement despite delay. In Proc. of IEEE Virtual Reality Conf., pp 133-140. doi: http://doi.ieeecomputersociety.org/10.1109/VR.2003.1191131
48. BG Witmer CJ Jerome MJ Singer 2005 The factor structure of the presence questionnaire Presence-Teleoper Virtual Env 14 298 331 10.1162/ 105474605323384654 10.1162/105474605323384654 (Pubitemid 41016936)
49. Woszczyk W (1993) Quality assessment of multichannel sound recordings. In Proc. of AES Int. Conf., pp 197-218
50. Yang U, Jounghyun KG (2004) Increasing the effective egocentric field of view with proprioceptive and tactile feedback. In Proc. of IEEE Virtual Reality, pp 27-34