Using virtual reality to assess user experience

Human Factors

Volumn 54, Issue 6, 2012, Pages 964-982

  Rebelo, Francisco ^a   Noriega, Paulo ^a   Duarte, Emília ^b   Soares, Marcelo ^c  

^a UNIVERSITY OF LISBON   (Portugal)

^b UNIDCOM IADE   (Portugal)

^c FEDERAL UNIVERSITY OF PERNAMBUCO   (Brazil)

Author keywords

context of use; technological interfaces; user experience; virtual environments; virtual reality

Indexed keywords

CONTEXT OF USE; ECOLOGICAL VALIDITY; EXPERIMENTAL CONDITIONS; FIRST MOMENTS; POTENTIAL APPLICATIONS; USER EXPERIENCE; USER RESEARCH;

RESEARCH;

VIRTUAL REALITY;

ARTICLE; BIOENGINEERING; COMPUTER INTERFACE; HUMAN;

HUMAN ENGINEERING; HUMANS; USER-COMPUTER INTERFACE;

MLCS; MLOWN;

EID: 84870916636     PISSN: 00187208     EISSN: 15478181     Source Type: Journal    
DOI: 10.1177/0018720812465006     Document Type: Conference Paper

References (121)

1. Antonya C., Talaba D.. Design evaluation and modification of mechanical systems in virtual environments. Virtual Reality. 2007 ; 11: 275-285
2. Arhippainen L., Tähti M.. Empirical evaluation of user experience in two adaptive mobile application prototypes. Proceedings of the 2nd International Conference on Mobile and Ubiquitous Multimedia, MUM 2003 ; 2003 ; 2003. 27.
3. Arns L. L., Cerney M. M. Proceedings of the Virtual Reality 2005. Bonn: IEE ; 2005: 267-268.
4. Baños R. M., Etchemendy E., Castilla D., García-Palacios A., Quero S., Botella C.. Positive mood induction procedures for virtual environments designed for elderly people. Interacting with Computers. 2011 ; 24: 131-138
5. Bell G., Blythe M., Sengers P.. Making by making strange: Defamiliarization and the design of domestic technologies. ACM Transactions on Computer-Human Interaction. 2005 ; 12: 149-173
6. Biocca F.. Will simulator sickness slow down the diffusion of virtual environment technology?. Presence: Teleoperators and Virtual Environments. 1992 ; 1: 334-343
7. Bruno F., Muzzupappa M.. Product interface design: A participatory approach based on virtual reality. International Journal of Human-Computer Studies. 2010 ; 68: 254-269
8. Burdea G., Coiffet P. Virtual reality technology. 2003 ). Virtual reality technology (2nd ed.). New Brunswick, NJ: Wiley/IEEE Press. New Brunswick, NJ: Wiley/IEEE Press ; 2003:
9. Cobb S. V. G.. Measurement of postural stability before and after immersion in a virtual environment. Applied Ergonomics. 1999 ; 30: 47-57
10. Cobb S. V. G., Nichols S., Ramsey A., Wilson J. R.. Virtual reality-induced symptoms and effects (VRISE). Presence: Teleoperators and Virtual Environments. 1999 ; 8: 169-186
11. Cobb S. V. G., Nichols S. C., Wilson J. R.. Health and safety implications of virtual reality: In search of an experimental methodology. Proceedings of FIVE'95 Conference, Framework for Immersive Virtual Environments ; 1995 ; 1995. 227.
12. Dahlman J., Sjörs A., Lindström J., Ledin T., Falkmer T.. Performance and autonomic responses during motion sickness. Human Factors. 2009 ; 51: 55-66
13. deNoyelles A., Seo K. K.-J.. Inspiring equal contribution and opportunity in a 3D multi-user virtual environment: Bringing together men gamers and women non-gamers in Second Life. Computers & Education. 2012 ; 58: 21-29
14. Dinka D., Lundberg J.. Identity and role: A qualitative case study of cooperative scenario building. International Journal of Human-Computer Studies. 2007 ; 64: 1049-1060
15. DiZio P., Lackner J. R. Advances in human factors/ergonomics: Vol. 21b. Design of computing systems: Social and ergonomic considerations. Smith M. Salvendy G. Koubek R., ed. Amsterdam, Netherlands: Elsevier ; 1997: 893-896.
16. Dobie T., May J., McBride D., Dobie T.. The effects of age and sex on susceptibility to motion sickness. Aviation, Space, and Environmental Medicine. 2001 ; 72: 13-20
17. Draper M. H., Viirre E. S., Furness T. A., Gawron V. J.. Effects of image scale and system time delay on simulator sickness within head-coupled virtual environments. Human Factors. 2001 ; 43: 129-146
18. Duh H. B.-L., Parker D. E., Abi-Rached H., Furness T. A. Proceedings of IEEE Virtual Reality 2002. New York, NY: IEEE ; 2002: 164-171.
19. Duh H. B.-L., Parker D. E., Furness T. A. Proceedings of ACM CHI 2001. New York, NY: Association for Computing Machinery ; 2001: 85-89.
20. Dunn M. J., Searle R.. Effect of manipulated prestige-car ownership on both sex attractiveness ratings. British Journal of Psychology. 2010 ; 101: 69-80
21. Ekman P. The nature of emotion: Fundamental questions. Ekman P. Davidson R. J., ed. New York, NY: Oxford University Press ; 1994: 15-19.
22. Ekman P., Friesen W. V., Hager J. C. Facial Action Coding System: The manual. Salt Lake City, UT: Network Information Research Corp ; 2002:
23. Ekman P., Levenson R. W., Friesen W. V.. Autonomic nervous system activity distinguishes among emotions. Science. 1983 ; 221: 1208-1210
24. Fetterman D. M. Ethnography: Step by step. 1998 ). Ethnography: Step by step (2nd ed.). Thousand Oaks, CA: Sage. Thousand Oaks, CA: Sage ; 1998:
25. Forlizzi J., Battarbee K.. Understanding experience in interactive systems. DIS '04. Proceedings of the 5th Conference on Designing Interactive Systems: Processes, practices, methods, and techniques ; 2004 ; 2004. 261.
26. Gianaros P. J., Muth E. R., Mordkoff J. T., Levine M. E., Stern R. M.. A questionnaire for the assessment of the multiple dimensions of motion sickness. Aviation, Space, and Environmental Medicine. 2001 ; 72: 115-119
27. Golding J. F.. Predicting individual differences in motion sickness susceptibility by questionnaire. Personality and Individual Differences. 2004 ; 41: 237-248
28. Golding J. F.. Motion sickness susceptibility. Autonomic Neuroscience: Basic and Clinical. 2006 ; 129: 67-76
29. Gorini A., Capideville C. S., De Leo G., Mantovani F., Riva G.. The role of immersion and narrative in mediated presence: The virtual hospital experience. Cyberpsychology, Behavior, and Social Networking. 2011 ; 14: 99-105
30. Gorini A., Mosso J. L., Mosso S., Pineda E., Ruíz N. L., Ramíez M.,... Riva G.. Emotional response to virtual reality exposure across different cultures: The role of the attribution Process. CyberPsychology & Behavior. 2009 ; 12: 699-705
31. Gross J. J. Handbook of emotion regulation. New York, NY: Guilford Press ; 2007:
32. Gutiérrez M. A., Vexo F., Thalmann D. Stepping into virtual reality. Lausanne, Switzerland: Springer ; 2008:
33. Hassenzahl M. Funology: From usability to enjoyment. Blythe M. A. Overbeeke K. Monk A. F. Wright P. C., ed. Dordrecht, Netherlands: Kluwer Academic ; 2004: 31-42.
34. Helander M. G., Khalid H. M. Handbook of human factors and ergonomics. 2006 ). Affective and pleasurable design. In SalvendyG. (Ed.), Handbook of human factors and ergonomics (3rd ed., pp. 543-572). Hoboken, NJ: Wiley. Salvendy G., ed. Hoboken, NJ: Wiley ; 2006: 543-572.
35. Heldal I.. Supporting participation in planning new roads by using virtual reality systems. Virtual Reality. 2007 ; 11: 145-159
36. Hettinger L. Handbook of virtual environments: Design, implementation, and applications. Stanney K. M., ed. Mahwah, NJ: Lawrence Erlbaum ; 2002: 471-491.
37. Hill K. J., Howarth P. A.. Habituation to the side effects of immersion in a virtual environment. Displays. 2000 ; 21: 25-30
38. Howarth P. A., Finch M.. The nauseogenicity of two methods of navigating within a virtual environment. Applied Ergonomics. 1999 ; 30: 39-45
39. Howarth P. A., Hodder S. G.. Characteristics of habituation to motion in a virtual environment. Displays. 2007 ; 29: 117-123
40. Hughes J., O'Brien J., Rodden T., Rouncefield M., Viller S.. Patterns of home life: Informing design for domestic environments. Journal of Personal Technologies. 2000 ; 4: 25-38
41. Ergonomics of human system interaction: Part 210. Human-centered design for interactive systems (formerly known as 13407). Geneva, Switzerland: Author ; 2010:
42. Izard C. E. The Maximally Discriminative Facial Movement Coding System (MAX). Newark: University of Delaware, Instructional Recourses Center ; 1979:
43. Jarmon L., Traphagan T., Mayrath M., Trivedi A.. Virtual world teaching, experiential learning, and assessment: An interdisciplinary communication course in Second Life. Computers & Education. 2009 ; 53: 169-182
44. Jeka J. J., Lackner J. R.. The role of haptic cues from rough and slippery surfaces on human postural control. Experimental Brain Research. 1995 ; 103: 267-276
45. Jennings S., Reid L. D., Craig G., Kruk R. V.. Time delays in visually coupled systems during flight test and simulation. Journal of Aircraft. 2004 ; 41: 1327-1335
46. Johnstone T., Scherer K. R. Handbook of emotions. 2001 ). Vocal communication of emotion. In LewisM.Haviland-JonesJ. M. (Eds.), Handbook of emotions (2nd ed., pp. 220-235). New York, NY: Guilford Press. Lewis M. Haviland-Jones J. M., ed. New York, NY: Guilford Press ; 2001: 220-235.
47. Jordan P. W. Designing pleasurable products: An introduction to new human factors. London, UK: Taylor & Francis ; 2000:
48. Kahneman D. Attention and effort. Englewood Cliffs, NJ: Prentice Hall ; 1973:
49. Kaiser S., Wehrle T. Appraisal processes in emotion. Scherer K. Schorr A. Johnstone T., ed. Oxford, UK: Oxford University Press ; 2001: 285-300.
50. Kennedy R. S., Drexler J., Kennedy R. C.. Research in visually induced motion sickness. Applied Ergonomics. 2010 ; 41: 494-503
51. Kennedy R. S., Fowlkes J. E.. Simulator sickness is polygenic and polysymptomatic: Implications for research. International Journal of Aviation Psychology. 1992 ; 2: 23-38
52. Kennedy R. S., Hettinger L. J., Lilienthal M. G. Motion and space sickness. Crampton G. H., ed. Boca Raton, FL: CRC Press ; 1990: 317-341.
53. Kennedy R. S., Lane N. E., Berbaum K. S., Lilienthal M. G.. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. International Journal of Aviation and Space Psychology. 1993 ; 3: 203-220
54. Kennedy R. S., Lanham D. S., Drexler J. M., Lilienthal M. G. Advances in industrial safety VII. Bittner A. C. Champney P. C., ed. London, UK: Taylor & Francis ; 1995: 263-270.
55. Kennedy R. S., Stanney K. M.. Postural instability induced by virtual reality exposure: Development of a certification protocol. International Journal of Human-Computer Interaction. 1996 ; 8: 25-47
56. Kennedy R. S., Stanney K. M., Dunlap W. P.. Duration and exposure to virtual environments: Sickness curves during and across sessions. Presence: Teleoperators and Virtual Environments. 2000 ; 9: 463-472
57. Kennedy R. S., Stanney K. M., Dunlap W. P., Jones M. B. Virtual environment adaptation assessment test battery (Final report, Contract No. NAS9-19453). Houston, TX: NASA Johnson Space Center ; 1996:
58. Keshavarz B., Hecht H.. Validating an efficient method to quantify motion sickness. Human Factors. 2011 ; 53: 415-426
59. Khalid H. M.. Embracing diversity in user needs for affective design. Applied Ergonomics. 2006 ; 37: 409-418
60. Kolasinski E. M. Simulator sickness in virtual environments. Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences ; 1995:
61. Kraft C. User experience innovation: User centered design that works. Berkeley, CA: Apress ; 2012:
62. Kurosu M., Kashimura K.. Apparent usability vs. inherent usability: Experimental analysis on the determinants of the apparent usability. Proceeding of CHI '95 Conference on Human Factors in Computing Systems ; 1995 ; 1995. 292.
63. Larsen R. J., Prizmic-Larsen Z. Handbook of multimethod measurement in psychology. Eid M. Diener E., ed. Washington, DC: American Psychological Association ; 2006: 337-351.
64. Laurans G., Desmet P. M. A.. Using self-confrontation to study user experience: A new approach to the dynamic measurement of emotions while interacting with products. Proceedings from the 5th Conference on Design and Emotion [CD-ROM] ; 2006 ; 2006..
65. Laurans G., Desmet P. M. A.. Speaking in tongues: Assessing user experience in a global economy. Proceedings from the 6th Conference on Design and Emotion [CD-ROM] ; 2008 ; 2008..
66. Law E., Roto V., Hassenzahl M., Vermeeren A., Kort J.. Understanding, scoping and defining user experience: A survey approach. Proceedings of the 27th International Conference on Human Factors in Computing Systems, CHI'09 ; 2009 ; 2009. 719.
67. Levenson R. W.. Autonomic nervous system differences among emotions. Psychological Science. 1992 ; 3: 23-27
68. Liu L., Watson B., Miyazaki M.. VR for the elderly: Quantitative and qualitative differences in performance with a driving simulator. CyberPsychology & Behavior. 1999 ; 2: 567-576
69. Lo W. T., So R. H.-Y.. Cybersickness in the presence of scene rotational movements along different axes. Applied Ergonomics. 2001 ; 32: 1-14
70. Luck R.. Learning to talk to users in participatory design situations. Design Studies. 2007 ; 28: 217-242
71. McCarthy J., Wright P. Technology as experience. Cambridge, MA: MIT Press ; 2004:
72. McCauley M. E., Sharkey T. J.. Cybersickness: Perception of self-motion in virtual environments. Presence: Teleoperators and Virtual Environments. 1992 ; 1: 311-318
73. Mobach M. P.. Do virtual worlds create better real worlds?. Virtual Reality. 2008 ; 12: 163-170
74. Moss J. D., Austin J., Salley J., Coats J., Williams K., Muth E. R.. The effects of display delay on simulator sickness. Displays. 2011 ; 32: 159-168
75. Moss J. D., Muth E. R.. Characteristics of head-mounted displays and their effects on simulator sickness. Human Factors. 2011 ; 53: 308-319
76. Mourant R. R., Thattacherry T. R.. Simulator sickness in a virtual environments driving simulator. Proceedings of the IEA 2000/HFES 2000 Congress ; 2000 ; 2000. 534.
77. Muth E. R.. The challenge of uncoupled motion: Duration of cognitive and physiological aftereffects. Human Factors. 2009 ; 51: 752-761
78. Nacke L. E., Grimshaw M. N., Lindley C. A.. More than a feeling: Measurement of sonic user experience and psychophysiology in a first-person shooter game. Interacting With Computers. 2010 ; 22: 336-343
79. Nagamachi M.. Kansei engineering as a powerful consumer-oriented technology for product development. Applied Ergonomics. 2002 ; 33: 289-294
80. Nevalaa N., Tamminen-Peter L.. Ergonomics and usability of an electrically adjustable shower trolley. International Journal of Industrial Ergonomics. 2004 ; 34: 131-138
81. Norman D. A. Emotional design: Why we love (or hate) everyday things. New York, NY: Basic Books ; 2004:
82. Obrist M., Bernhaupt R., Tscheligi M.. Interactive television for the home: An ethnographic study on users' requirements and experiences. International Journal of Human-Computer Interaction. 2008 ; 24: 174-196
83. Olsson E., Jansson A.. Participatory design with train drivers: A process analysis. Interacting With Computers. 2005 ; 17: 147-166
84. Pacheco C., Duarte E., Rebelo F., Teles J. Advances in cognitive ergonomics. Advances in human factors and ergonomics series. Kaber D. B. Boy G., ed. Miami, FL: CRC Press ; 2010: 784-792.
85. Pausch R., Crea T., Conway M.. A literature survey for virtual environments: Military flight simulator visual systems and simulator sickness. Presence: Teleoperators and Virtual Environments. 1992 ; 1: 344-363
86. Peck B., Miller C.. I think I can, I think I can, I think I can... I know I can. Multi-User Virtual Environments (MUVEs) as a means of developing competence and confidence in undergraduate nursing students. An Australian perspective. Procedia-Social and Behavioral Sciences. 2010 ; 2: 4571-4575
87. Picard R. W.. Toward computers that recognize and respond to user emotion. IBM Systems Journal. 2000 ; 39: 705-719
88. Rebelo F., Duarte E., Noriega P., Soares M. M. Human factors and ergonomics in consumer product design. Karwowski W. Soares M. M. Stanton N. A., ed. Boca Raton, FL: CRC Press ; 2011: 381-402.
89. Rebelo F., Filgueiras E., Soares M. M. Human factors and ergonomics in consumer product design. Karwowski W. Soares M. M. Stanton N. A., ed. Boca Raton, FL: CRC Press ; 2011: 275-292.
90. Regan E. C.. Some evidence of adaptation to immersion in virtual reality. Displays. 1995 ; 16: 135-139
91. Regan E. C., Price K. R.. The frequency of occurrence and severity of side-effects of immersion virtual reality. Aviation, Space, and Environmental Medicine. 1994 ; 65: 527-530
92. Riccio G. E., Stoffregen T. A.. An ecological theory of motion sickness and postural instability. Ecological Psychology. 1991 ; 3: 195-240
93. Rolnick A., Lubow R. E.. Why is the driver rarely motion sick? The role of controllability in motion sickness. Ergonomics. 1991 ; 34: 867-879
94. Rudmann D. S., Strybel T. Z.. Auditory spatial facilitation of visual search performance: Effect of cue precision and distractor density. Human Factors. 1999 ; 41: 146-160
95. Scherer K. R.. What are emotions? And how can they be measured?. Social Science Information. 2005 ; 44: 695-729
96. Seay A. F., Krum D. M., Hodges L., Ribarsky W. Proceedings of IEEE Virtual Reality 2001. New York, NY: IEEE ; 2001: 299-300.
97. Seva R. R., Gosiaco K. G. T., Santos M. C. E. D., Pangilinan D. M. L.. Product design enhancement using apparent usability and affective quality. Applied Ergonomics. 2011 ; 42: 511-517
98. Sharples S., Cobb S., Moody A., Wilson J. R.. Virtual reality induced symptoms and effects (VRISE): Comparison of head mounted display (HMD), desktop and projection display systems. Displays. 2008 ; 29: 58-69
99. Siriaraya C. S.. Characteristics and usage patterns of older people in a 3D online multi-user virtual environment. Computers in Human Behavior.:
100. Slovic P., Finucane M., Peters E., MacGregor D. Heuristics and biases: The psychology of intuitive judgment. Gilovich T. Griffin D. Kahneman D., ed. London, UK: Cambridge University Press ; 2002: 397-420.
101. Smart L. J., Stoffregen T. A., Bardy B. G.. Visually induced motion sickness predicted by postural instability. Human Factors. 2002 ; 44: 451-465
102. So R. H. Y., Lo W. T., Ho A. T. K.. Effects of navigation speed on motion sickness caused by an immersive virtual environment. Human Factors. 2001 ; 43: 452-461
103. Sonderegger A., Sauer J.. The influence of laboratory set-up in usability tests: Effects on user performance, subjective ratings and physiological measures. Ergonomics. 2009 ; 52: 1350-1361
104. Stanney K. M., Hale K. S., Nahmens I., Kennedy R. S.. What to expect from immersive virtual environment exposure: Influences of gender, body mass index, and past experience. Human Factors. 2003 ; 45: 504-520
105. Stanney K. M., Hash P. A. K.. Locus of user-initiated control in virtual environments: Influences on cybersickness. Presence: Teleoperators and Virtual Environments. 1998 ; 7: 447-459
106. Stanney K. M., Mollaghasemi M., Reeves L., Breaux R., Graeber D. A.. Usability engineering of virtual environments (VEs): Identifying multiple criteria that drive effective VE system design. International Journal of Human-Computer Studies. 2003 ; 58: 447-481
107. Stanney K. M., Salvendy G., Deisigner J., DiZio P., Ellis S., Ellison E.,... Witmer B.. Aftereffects and sense of presence in virtual environments: Formulation of a research and development agenda. Report sponsored by the Life Sciences Division at NASA headquarters. International Journal of Human-Computer Interaction. 1998 ; 10: 135-187
108. Stoffregen T. A., Smart L. J.. Postural instability precedes motion sickness. Brain Research Bulletin. 1998 ; 47: 437-448
109. Strick M., Holland R. W., van Knippenberg A.. Seductive eyes: Attractiveness and direct gaze increase desire for associated objects. Cognition. 2008 ; 106: 1487-1496
110. Toet A., van der Hoeven M., Kahrimanović M., Delleman N. J.. Effects of field of view on human locomotion. Proceedings of the SPIE. 2008 ; 6955: 69550H - 69550H-11
111. Toet A., van der Spek E. D., Houtkamp J. M.. Cybersickness influences the affective appraisal of a virtual environment. Open Virtual Reality Journal. 2010 ; 2: 26-31
112. Tolmie R., Pycock J., Diggins T., MacLean A., Karsenty A.. Unremarkable computing. Proceedings of the Human Factors in Computing Systems Conference (CHI'02) ; 2002 ; 2002. 399.
113. Tractinsky N.. Aesthetics and apparent usability: Empirically assessing cultural and methodological issues. Proceeding of CHI '97 Conference on Human Factors in Computing Systems ; 1997 ; 1997. 115.
114. Tsekleves E., Whitham R., Kondo K., Hill A.. Investigating media use and the television user experience in the home. Entertainment Computing. 2011 ; 2: 151-161
115. Villani D., Repetto C., Cipresso P., Riva G.. May I experience more presence in doing the same thing in virtual reality than in reality? An answer from a simulated job interview. Interacting With Computers.:
116. Villard S. J., Flanagan M. B., Albanese G. M., Stoffregen T. A.. Postural instability and motion sickness in a virtual moving room. Human Factors. 2008 ; 50: 332-345
117. Virtual reality (VR). (n.d.). In Encyclopædia Britannica. Retrieved from http://www.britannica.com/EBchecked/topic/630181/virtual-reality-VR
118. Wertheim A. H., Ooms J., De Regt G. P., Wientjes C. J. E. Soesterberg, Netherlands: TNO Human Factors Research Institute ; 1992:
119. Witmer B. G., Singer M. J.. Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments. 1998 ; 7: 225-240
120. Yoon S.-Y., Laffey J., Oh H.. Understanding usability and user experience of web-based 3D graphics technology. International Journal of Human-Computer Interaction. 2008 ; 24: 288-306
121. Young S. D., Adelstein B. D., Ellis S. R.. Demand characteristics in assessing motion sickness in a virtual environment: Or does taking a motion sickness questionnaire make you sick?. IEEE Transactions on Visualization and Computer Graphics. 2007 ; 13: 422-428