A survey of usability evaluation in virtual environments: Classification and comparison of methods

Presence: Teleoperators and Virtual Environments

Volumn 11, Issue 4, 2002, Pages 404-424

  Bowman, Doug A ^a   Gabbard, Joseph L ^b   Hix, Deborah ^b  

^a State University   (United States)

^b VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

USABILITY EVALUATION;

GRAPHICAL USER INTERFACES; HUMAN COMPUTER INTERACTION; SYSTEMS ANALYSIS; USABILITY ENGINEERING;

VIRTUAL REALITY;

EID: 0036703951     PISSN: 10547460     EISSN: None     Source Type: Journal    
DOI: 10.1162/105474602760204309     Document Type: Review

References (44)

1. Bowman, D. (2002). Principles for the design of performance-oriented interaction techniques. In K. Stanney (Ed.), Hand-book of virtual environments: Design, implementation, and applications. Mahwah NJ: Lawrence Erlbaum Associates. 277-300.
2. Bowman, D., & Hodges, L. (1999). Formalizing the design, evaluation, and application of interaction techniques for immersive virtual environments. The Journal of Visual Languages and Computing, 10(1), 37-53.
3. Bowman, D., & Hodges, L. (1997). An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. Proceedings of the ACM Symposium on Interactive 3D Graphics, 35-38.
4. Bowman, D., Johnson, D., & Hodges, L. (1999). Testbed evaluation of VE interaction techniques. Proceedings of the ACM Symposium on Virtual Reality Software and Technology (pp. 26-33).
5. Card, S., Mackinlay, J., & Robertson, G. (1990). The design space of input devices. Proceedings of CHI: Human Factors in Computing Systems (pp. 117-124).
6. Cruz-Neira, C., Sandin, D., DeFanti, T., Kenyon, R., & Hart, J. (1992). The CAVE: Audio visual experience automatic virtual environment. Communications of the ACM, 35(6), 65-72.
7. Conkar, T, Noyes, J.M., & Kimble, C. (1999) CLIMATE: A framework for developing holistic requirements analysis in virtual environments. Interacting with Computers, 11(4), 387-403.
8. Darken, R.P., & Sibert, J.L. (1996). Wayfinding strategies and behaviors in large virtual worlds. Proceedings of CHI: Human Factors in Computing Systems (pp. 142-149).
9. Gabbard, J.L., Swan, E.J., Hix, D., Lanzagortac, M., Livingston, M., Brown, D., & Julier, S. (2002, in press). Usability engineering: Domain analysis activities for augmented reality systems. Proceedings of SPIE 2002 - Photonics West 2002, Electronic Imaging Conference.
10. Gabbard, J.L., Hix, D, & Swan, E.J. (1999). User centered design and evaluation of virtual environments. IEEE Computer Graphics and Applications, 19(6), 51-59.
11. Gabbard J.L. (1997). A taxonomy of usability characteristics for virtual environments. Unpublished master's thesis, Department of Computer Science, Virginia Tech.
12. Hackos, J.T., & Redish, J.C. (1998). User and task analysis for interface design. New York: Wiley.
13. Hix, D., & Gabbard, J.L. (2002). Usability engineering of virtual environments. In K. Stanney (Ed.), Handbook of virtual environments: Design, implementation and applications (pp. 681-699). Mahwah, NJ: Lawrence Erlbaum Associates.
14. Hix, D., & Hartson, H.R. (1993). Developing user interfaces: Ensuring usability through product & process. New York: John Wiley and Sons.
15. Hix, D., Swan, E.J., Gabbard, J.L., McGee, M., Durbin, J., & King, T. (1999). User-centered design and evaluation of a real-time battlefield visualization virtual environment. Proceedings of IEEE Virtual Reality (pp. 96-103).
16. Johnson, C. (1999). Evaluating the contribution of desktop VR for safety-critical applications. Proceedings of SAFECOMP (pp. 67-78).
17. Kalawsky, R. (1993). The science of virtual reality and virtual environments. Reading, MA: Addison-Wesley.
18. Kaur, K. (1998). Designing virtual environments for usability. Unpublished doctoral dissertation, Centre for HCI Design, City University, London.
19. Kaur, K., Maiden, N., & Sutcliffe, A. (1999). Interacting with virtual environments: An evaluation of a model of interaction. Interacting with Computers, 11(4), 403-426.
20. Kennedy, R.S., Lane, N.E., Berbaum, K.S., & Lilienthal, M.G. (1993). Simulator sickness questionnaire (SSQ): A new method for quantifying simulator sickness. International Journal of Aviation Psychology, 3(3), 203-220.
21. Kennedy, R.S., Stanney, K., & Dunlap, W. (2000). Duration and exposure to virtual environments: Sickness curves during and across sessions. Presence: Teleoperators and Virtual Environments, 9(5), 463-472.
22. Mills, S., & Noyes, J. (1999). Virtual reality: An overview of user-related design issues. Interacting with Computers, 11(4), 375-386.
23. Nielsen, J. (1993). Usability engineering. Boston: Academic Press.
24. Nielsen, J. (1999). Users first: Cheap usability tests. Available at: http://www.zdnet.com/devhead/stories/articles/ 0,4413,2224316,00.html.
25. Nielsen, J., & Mack, R.L. (1994). Executive summary. In J. Nielsen & R.L. Mack (Eds.), Usability Inspection Methods. (pp. 1-23). New York: John Wiley & Sons.
26. Normand, V., & Tromp, J. (1996). Collaborative virtual environments: The COVEN project. Proceedings of Framework for Immersive Virtual Environments.
27. Polson, P., Lewis, C., Rieman, J., & Wharton, C. (1992). Cognitive walkthroughs: A method for theory-based evaluation of user interfaces. International Journal of Man-Machine Studies, 36, 741-773.
28. Poupyrev, I., Weghorst, S., Billinghurst, M., & Ichikawa, T. (1997). A framework and testbed for studying manipulation techniques for immersive VR. Proceedings of the ACM Symposium on Virtual Reality Software and Technology (pp. 21-28).
29. Schneiderman, B. (1992). Developing the User Interface. Reading, MA: Addison-Wesley.
30. Scriven, M. (1967). The methodology of evaluation. In R.E. Stake (Ed.), Perspectives of curriculum evaluation. American Educational Research Association monograph Chicago: Rand McNally.
31. Siochi, A.C., & Hix, D. (1991). A study of computer-supported user interface evaluation using maximal repeating pattern analysis. Proceedings of CHI: Human Factors in Computing Systems (pp. 301-305).
32. Slater, M. (1999). Measuring presence: A response to the Witmer and Singer Presence Questionnaire. Presence: Teleoperators and Virtual Environments, 8(5), 560-565.
33. Slater, M., Usoh, M., & Steed, A. (1995). Taking steps: The influence of a walking metaphor on presence in virtual reality. ACM Transactions on Computer Human Interaction, 2(3) 201-219.
34. Snow, M.P., & Williges, R.C. (1998). Empirical models based on free-modulus magnitude estimation of perceived presence in virtual environments. Human Factors, 40(3), 386-402.
35. Stanney, K.M., & Reeves, L. (2000). COVE evaluation report. Final report, contract no. N61339-99-C-0098, Orlando, FL: Naval Air Warfare Center, Training Systems Division, 7/00.
36. Stanney, K.M., Mollaghasemi, M., & Reeves, L. (2000). Development of MAUVE: the multi-criteria assessment of usability for virtual environments system. Final report, contract no. N61339-99-C-0098, Orlando, FL: Naval Air Warfare Center, Training Systems Division, 8/00.
37. Steed, A., & Tromp, J. (1998). Experiences with the evaluation of CVE applications. Proceedings of Collaborative Virtual Environments.
38. Stiles, R., McCarthy, L., Munro, A., Pizzini, Q., Johnson, L., & Rickel, J. (1996). Virtual environments for shipboard training. Proceedings of the Intelligent Ships Symposium.
39. Tromp, J., Hand, C., Kaur, K., Istance, H., & Steed, A. (1998). Proceedings the First International Workshop on Usability Evaluation for Virtual Environments: Methods, Results and Future Directions.
40. Usoh, M., Catena, E., Arman, S., & Slater, M. (2000). Using presence questionnaires in reality. Presence: Teleoperators and Virtual Environments, 9(5), 497-503.
41. Viirre, E. (1994, August). A survey of medical issues and virtual reality technology. Virtual Reality World, 16-20.
42. Volbracht, S., & Paelke, V. (2000). Proceedings of the Workshop on Guiding Users through Interactive Experiences: Usability Centered Design and Evaluation of Virtual 3D Environments. Paderborn, Germany.
43. Williges, R.C. (1984). Evaluating human-computer software interfaces. Proceedings of International Conference on Occupational Ergonomics (pp. 81-87).
44. Witmer, B.G., & Singer, M.J. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments, 7(3), 225-240.