An empirical study to investigate the efficacy of collaborative immersive virtual reality systems for designing information architecture of software systems

Applied Ergonomics

Volumn 80, Issue , 2019, Pages 175-186

  Narasimha, Shraddhaa ^a   Dixon, Emma ^a   Bertrand, Jeffrey W ^a   Chalil Madathil, Kapil ^b  

^a Department of Industrial Engineering ^*  (United States)

^b CLEMSON UNIVERSITY   (United States)

Author keywords

Card sorting; Computer supported collaborative work; Immersive systems; Information architecture design; Virtual reality

Indexed keywords

COMPUTER SUPPORTED COOPERATIVE WORK; INFORMATION MANAGEMENT; INFORMATION RETRIEVAL; SORTING;

CARD-SORTING; COLLABORATIVE INFORMATION; COLLABORATIVE WORK; CONVENTIONAL APPROACH; DEPENDENT VARIABLES; IMMERSIVE SYSTEM; IMMERSIVE VIRTUAL REALITY; INFORMATION ARCHITECTURES;

VIRTUAL REALITY;

ADULT; ARTICLE; CLINICAL ARTICLE; CONTROLLED STUDY; DEPENDENT VARIABLE; DRUG EFFICACY; EMPIRICISM; EXPERIMENTAL DESIGN; FEASIBILITY STUDY; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; SOFTWARE; VIDEORECORDING; VIRTUAL REALITY; WORKLOAD; COMPUTER INTERFACE; COOPERATION; EMPIRICAL RESEARCH; GROUP PROCESS; QUALITATIVE RESEARCH; SOFTWARE DESIGN; TASK PERFORMANCE;

ADULT; COOPERATIVE BEHAVIOR; EMPIRICAL RESEARCH; FEASIBILITY STUDIES; FEMALE; GROUP PROCESSES; HUMANS; MALE; QUALITATIVE RESEARCH; SOFTWARE; SOFTWARE DESIGN; TASK PERFORMANCE AND ANALYSIS; USER-COMPUTER INTERFACE; VIRTUAL REALITY;

EID: 85067351977     PISSN: 00036870     EISSN: 18729126     Source Type: Journal    
DOI: 10.1016/j.apergo.2019.05.009     Document Type: Article

References (68)

1. Adobe Fuse CC (Beta), March 27 http://www.adobe.com/products/fuse.html, 2014. (Accessed 17 August 2017)
2. Agnisarman, S., Chalil Madathil, K., Smith, K., Ashok, A., Welch, B., McElligott, J.T., Lessons learned from the usability assessment of home-based telemedicine systems. Appl. Ergon. 58 (2017), 424–434.
3. Alaraj, A., Lemole, M.G., Finkle, J.H., Yudkowsky, R., Wallace, A., Luciano, C., Charbel, F.T., Virtual reality training in neurosurgery: review of current status and future applications. Surg. Neurol. Int., 2, 2011, 52.
4. Amazon.com: online shopping for electronics, apparel, computers. July 5 https://www.amazon.com/, 1994. (Accessed 17 August 2017)
5. Azuma, R.T., A survey of augmented reality. Presence Teleoperators Virtual Environ. 6:4 (1997), 355–385.
6. Benford, S., Dourish, P., Rodden, T., Introduction to the special issue on human-computer interaction and collaborative virtual environments. ACM Trans. Comput. Hum. Interact. 7:4 (2000), 439–441.
7. Berg, L.P., Vance, J.M., An industry case study: investigating early design decision making in virtual reality. J. Comput. Inf. Sci. Eng., 17(1), 2017, 011001.
8. Bertrand, J., Brickler, D., Babu, S., Madathil, K., Zelaya, M., Wang, T., et al. The role of dimensional symmetry on bimanual psychomotor skills education in immersive virtual environments. Virtual Reality (VR), 2015 IEEE, 2015, March, IEEE, 3–10.
9. Bhargava, A., Bertrand, J.W., Gramopadhye, A.K., Madathil, K.C., Babu, S.V., Evaluating multiple levels of an interaction fidelity continuum on performance and learning in near-field training simulations. IEEE Trans. Vis. Comput. Graph. 24:4 (2018), 1418–1427.
10. Borghoff, U.M., Schlichter, J.H., Computer-supported cooperative work. Computer-Supported Cooperative Work, 2000, Springer, Berlin, Heidelberg, 87–141.
11. Burdea, G.C., Coiffet, P., Virtual Reality Technology. 2003, John Wiley & Sons.
12. Chalil Madathil, K., Greenstein, J.S., Synchronous remote usability testing: a new approach facilitated by virtual worlds. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2011, May, ACM, 2225–2234.
13. Chalil Madathil, K., Greenstein, J.S., An investigation of the efficacy of collaborative virtual reality systems for moderated remote usability testing. Appl. Ergon. 65 (2017), 501–514.
14. Chalil Madathil, K., Koikkara, R., Obeid, J., Greenstein, J.S., Sanderson, I.C., Fryar, K., Gramopadhye, A.K., An investigation of the efficacy of electronic consenting interfaces of research permissions management system in a hospital setting. Int. J. Med. Inform. 82:9 (2013), 854–863.
15. Choi, S., Jung, K., Noh, S.D., Virtual reality applications in manufacturing industries: past research, present findings, and future directions. Concurr. Eng.: Research and Applications 23:1 (2015), 40–63.
16. Christian, W., Galambos, P., Csapó, Á.B., Zentay, P., Baranyi, P.Z., Future internet-based collaboration in factory planning. Acta Polytechnica Hungarica 11:7 (2014), 157–177.
17. Churchill, E.F., Snowdon, D., Collaborative virtual environments: an introductory review of issues and systems. Virtual Real. 3:1 (1998), 3–15.
18. Clark, H.H., Using Language. 1996, Cambridge University Press.
19. Cohen, J., Cohen, P., West, S.G., Aiken, L.S., Others, Applied Multiple Regression/correlation Analysis for the Behavioral Sciences. third ed., 2003, erlbaum, Mahwah, NJ Retrieved from https://epdf.tips/applied-multiple-regression-correlation-analysis-for-the-behavioral-sciences.html.
20. Cruz-Neira, C., Sandin, D.J., DeFanti, T.A., Surround-screen projection-based virtual reality: the design and implementation of the CAVE. Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, 1993, ACM, New York, NY, USA, 135–142.
21. Deb, S., Carruth, D.W., Sween, R., Strawderman, L., Garrison, T.M., Efficacy of virtual reality in pedestrian safety research. Appl. Ergon. 65 (2017), 449–460.
22. De Lucia, A., Francese, R., Passero, I., Tortora, G., Development and evaluation of a virtual campus on Second Life: the case of SecondDMI. Comput. Educ. 52:1 (2009/1), 220–233.
23. Dillon, A., Information architecture in JASIST: just where did we come from?. J. Am. Soc. Inf. Sci. Technol. 53:10 (2002), 821–823 Retrieved from http://arizona.openrepository.com/arizona/handle/10150/105433.
24. Eppinger, S., Ulrich, K., Product Design and Development. 2011, McGraw-Hill Education.
25. Firat Ozkan, N., Greenstein, J.S., Effects of 2D online and 3D virtual world meeting spaces on the performance of a concept selection task by engineering design teams. Proceedings of the Human Factors and Ergonomics Society.. Annual Meeting Human Factors and Ergonomics Society. Meeting, vol. 55, 2011, 1676–1680 1.
26. Fleury, C., Férey, N., Vézien, J.M., Bourdot, P., Remote collaboration across heterogeneous large interactive spaces. 2015 IEEE Second VR International Workshop on Collaborative Virtual Environments (3DCVE), 2015, 9–10.
27. Gopinath, A.K., Tucker, C.S., Investigating the impact of interactive immersive virtual reality environments in enhancing task performance in online engineering design activities. ASME 2015 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, 2015, American Society of Mechanical Engineers pp. V003T04A004–V003T04A004.
28. Greif, I., Overview. Computer-Supported Cooperative Work: A Book of Readings. 1988, Morgan Kaufmann Publishers, San Mateo, Calif, 5–12.
29. Gross, T., Stary, C., Totter, A., User-centered awareness in computer-supported cooperative work-systems: structured embedding of findings from social sciences. Int. J. Hum. Comput. Interact. 18:3 (2005), 323–360.
30. Hart, S.G., Staveland, L.E., Development of NASA-TLX (task Load index): results of empirical and theoretical research. Hancock, Peter A., Meshkati, Najmedin, (eds.) Advances in Psychology, vol. 52, 1988, 139–183 North-Holland.
31. Home of the Blender Project - Free and Open 3D Creation Software, 1998 https://www.blender.org/. (Accessed 17 August 2017)
32. Howarth, P.A., Finch, M., The nauseogenicity of two methods of navigating within a virtual environment. Appl. Ergon. 30:1 (1999), 39–45.
33. Jaspers, M.W.M., A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. Int. J. Med. Inform. 78:5 (2009), 340–353.
34. Juárez-Ramírez, R., User-centered design and adaptive systems: toward improving usability and accessibility. Univers. Access Inf. Soc. 16:2 (2017), 361–363.
35. Kallmann, M., Analytical inverse kinematics with body posture control. Comput. Animat. Virtual Worlds 19:2 (2008), 79–91.
36. Karreman, J., Arendsen, R., van der Geest, T., Navigating on web sites: exploring the life events approach. 2010 IEEE International Professional Comunication Conference, 2010 https://doi.org/10.1109/ipcc.2010.5530028.
37. Lee, J., Quy, P., Kim, J.I., Kang, L.W., Seo, A., Kim, H., A collaborative virtual reality environment for molecular biology. 2009 International Symposium on Ubiquitous Virtual Reality, 2009, 68–71.
38. Lewis, J.R., IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum. Comput. Interact. 7:1 (1995), 57–78.
39. Liu, A., Tendick, F., Cleary, K., Kaufmann, C., A survey of surgical simulation: applications, technology, and education. Presence Teleoperators Virtual Environ. 12:6 (2003), 599–614.
40. Maguire, M., Methods to support human-centred design. Int. J. Hum. Comput. Stud. 55:4 (2001), 587–634.
41. Malone, T.W., Crowston, K., The interdisciplinary study of coordination. ACM Comput. Surv. 26:1 (1994), 87–119.
42. Mikropoulos, T.A., Natsis, A., Educational virtual environments: a ten-year review of empirical research (1999–2009). Comput. Educ. 56:3 (2011), 769–780.
43. Mills, K.L., Computer-supported cooperative work (CSCW). Encyclopedia of Library and Information Science, 2003, 678–684.
44. Narasimha, S., Agnisarman, S., Chalil Madathil, K., Gramopadhye, A., McElligott, J.T., Designing home-based telemedicine systems for the geriatric population: an empirical study. Telemed. J. e Health: The Official Journal of the American Telemedicine Association 24:2 (2018), 94–110.
45. Narasimha, S., Scharett, E., Madathil, K.C., Bertrand, J., WeRSort: preliminary results from a new method of remote collaboration facilitated by fully immersive virtual reality, No. 1. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 62, 2018, SAGE Publications, Los Angeles, CA, 2084–2088 Sage CA.
46. Neale, D.C., Carroll, J.M., Rosson, M.B., Evaluating computer-supported cooperative work. Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work - CSCW ’04, 2004 https://doi.org/10.1145/1031607.1031626.
47. Nguyen, H., Pontonnier, C., Hilt, S., Duval, T., Dumont, G., VR-based operating modes and metaphors for collaborative ergonomic design of industrial workstations. J. Multimodal User Interfac. 11:1 (2017), 97–111.
48. Nichols, S., Physical ergonomics of virtual environment use. Appl. Ergon. 30:1 (1999), 79–90.
49. Nichols, S., Patel, H., Health and safety implications of virtual reality: a review of empirical evidence. Appl. Ergon. 33:3 (2002), 251–271.
50. Olson, G.M., Olson, J.S., Distance matters. Hum. Comput. Interact. 15:2 (2000), 139–178.
51. Pagliari, C., Design and evaluation in eHealth: challenges and implications for an interdisciplinary field. J. Med. Internet Res., 9(2), 2007, e15.
52. Palmer, T.D., Fields, N.A., Computer supported cooperative work. Computer 27:5 (1994), 15–17.
53. Pantelidis, V.S., Reasons to use virtual reality in education. VR in the Schools. 1, 1995, 9 1.
54. Rosenfeld, L., Morville, P., Information Architecture for the World Wide Web. 2002, O'Reilly Media, Inc.
55. Rubin, J., Chisnell, D., Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests. 2011, John Wiley & Sons.
56. Seymour, N.E., Gallagher, A.G., Roman, S.A., O'Brien, M.K., Bansal, V.K., Andersen, D.K., Satava, R.M., Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann. Surg. 236:4 (2002), 458–463 discussion 463–464.
57. Sinha, R., Persona development for information-rich domains. CHI ’03 Extended Abstracts on Human Factors in Computing Systems, 2003, ACM, New York, NY, USA, 830–831.
58. Slater, M., Sanchez-Vives, M.V., Enhancing our lives with immersive virtual reality. Frontiers in Robotics and AI. 3, 2016, 74.
59. Spencer, D., Card Sorting: Designing Useable Categories. 2009, Rosenfeld Media.
60. Sun, H.-M., Li, S.-P., Zhu, Y.-Q., Hsiao, B., The effect of user's perceived presence and promotion focus on usability for interacting in virtual environments. Appl. Ergon. 50 (2015), 126–132.
61. Sutherland, I.E., The ultimate display. Multimedia: from wagner to virtual reality. Retrieved from https://books.google.com/books?hl=en&lr=&id=adtKCdwzwqIC&oi=fnd&pg=PA232&dq=Sutherland+1965&ots=frLnflJv79&sig=LWTE8_U121ya-BZpdjI2T9FIB1M, 1965.
62. VIVE, April 5 https://www.vive.com/us/, 2016. (Accessed 17 August 2017)
63. Vora, J., Nair, S., Gramopadhye, A.K., Duchowski, A.T., Melloy, B.J., Kanki, B., Using virtual reality technology for aircraft visual inspection training: presence and comparison studies. Appl. Ergon. 33:6 (2002), 559–570.
64. Wentzel, J., Müller, F., Beerlage-de Jong, N., van Gemert-Pijnen, J., Card sorting to evaluate the robustness of the information architecture of a protocol website. Int. J. Med. Inform. 86 (2016), 71–81.
65. Wilson, J.R., Virtual environments applications and applied ergonomics. Appl. Ergon. 30:1 (1999), 3–9.
66. Witmer, B.G., Singer, M.J., Measuring presence in virtual environments: a presence questionnaire. Presence Teleoperators Virtual Environ. 7:3 (1998), 225–240.
67. Zimmerman, D.E., Akerelrea, C., A group card sorting methodology for developing informational Web sites. Proceedings. IEEE International Professional Communication Conference, 2002, 437–445.
68. Zyda, M., From visual simulation to virtual reality to games. Computer 38:9 (2005), 25–32.