The impact of self-efficacy and perceived system efficacy on effectiveness of virtual training systems

Behaviour and Information Technology

Volumn 33, Issue 1, 2014, Pages 16-35

  Jia, Dawei ^a   Bhatti, Asim ^a   Nahavandi, Saeid ^a  

^a DEAKIN UNIVERSITY   (Australia)

Author keywords

human virtual environment interaction; learning outcomes; memory; perceptions; performance; training evaluation

Indexed keywords

CONTROLLED EXPERIMENT; HUMAN-VIRTUAL ENVIRONMENT INTERACTION; LEARNING OUTCOME; PERFORMANCE; PERFORMANCE MEASURE; TRAINING EVALUATION; TRAINING SYSTEMS; VIRTUAL TRAINING SYSTEMS;

DATA STORAGE EQUIPMENT; REGRESSION ANALYSIS; SENSORY PERCEPTION;

VIRTUAL REALITY;

EID: 84893102752     PISSN: 0144929X     EISSN: 13623001     Source Type: Journal    
DOI: 10.1080/0144929X.2012.681067     Document Type: Article

References (96)

1. Abdi, H., 2003. Partial least squares (PLS) regression. In Lewis-Beck, M., Bryman, A., Futing, T. (Ed.), Encyclopedia of social sciences research methods, (pp. 1-7). Thousand Oaks, CA: SAGE.
2. Bandura, A., 1997. Self-efficacy: The exercise of control, New York: W.H. Freeman.
3. Bhatti, A., 2008. Haptically enabled interactive virtual reality prototype for general assembly. In: M., Jamshidi., eds. Proceedings of the World Automation Congress '08. Piscataway, NJ: IEEE, 1-6
4. Boulanger, P., 2006. Hapto-audio-visual environments for collaborative training of ophthalmic surgery over optical network. Paper presented at the IEEE international workshop on haptic audio visual environments and their applications (HAVE), November 4-5, Ottawa, Canada, 21-26
5. Bowman, D. A., Gabbard, J. L., Hix, D., 2002. A survey of usability evaluation in virtual environments: classification and comparison of methods. Presence: Teleoprators & Virtual Environments, 11 (4), 404-424.
6. Bowman, D. A., 2004. 3D user interfaces: theory and practice, Boston: Addison-Wesley/Pearson Education.
7. Brough, J. E., 2007. Towards the development of a virtual environment-based training system for mechanical assembly operations. Virtual Reality, 11, 189-206.
8. Burnett, G., 2011. Designing touchpad user-interfaces for vehicles: which tasks are most suitable?. Behaviour & Information Technology, 30 (3), 403-414.
9. Compeau, D. R., Higgins, C. A., 1995a. Application of social cognitive theory to training for computer skills. Information Systems Research, 6 (1), 118-143.
10. Compeaus, D. R., Higgins, C. A., 1995b. Computer self-efficacy: development of a measure and initial test. MIS Quarterly, 19 (2), 189-211.
11. Corbalan, G., Kester, L., van Merrienboer, J. J. G., 2009. Dynamic task selection: effects of feedback and learner control on efficiency and motivation. Learning and Instruction, 19, 455-465.
12. Chai, L., 2003. To have or have not: an examination of feedback, learner control and knowledge type in online learning, Proceedings of the 36th Hawaii international conference on system sciences (HICSS'03), January 6-9, Hawaii, USA, 6a
13. Charness, N., 2005. Light pen use and practice minimize age and hand performance differences in pointing tasks. Human Factors, 46, 373-384.
14. Crellin, J. M., Horn, T., Preece, J., 1990. Evaluating evaluation: an empirical examination of novel and conventional usability evaluation methods. Human computer interaction: interact 90, (pp. 329-336). Cambridge UK
15. Davis, F. D., 1993. User acceptance of information technology: system characteristics, user perceptions and behavioural impacts. International Journal of Man-Machine Studies, 38, 475-487.
16. David, P., Fitzgerald, D., 1961. Meaningful learning and retention: intrapersonal cognitive variables. Review of Educational Research, 31 (5), 500-510.
17. DeVellis, R. F., 2003. Scale development: theory and applications, Thousand Oaks: Sage Publications.
18. Faulkner, X., 2000. Usability engineering, Basingstoke: Macmillan.
19. Furr, R. M., Bacharach, R., 2008. Psychometrics: an introduction, Thousand Oaks: Sage Publications.
20. Gist, M. E., 1987. Self-efficacy: implications for organizational behaviour and human resource management. Academy of Management Review, 12 (3), 472-485.
21. Gist, M. E., 1997. Training design and pedagogy: implications for skill acquisition, maintenance, and generalization. In Quinones, M. A., Ehrenstein, A. (Ed.), Training for a rapidly changing workplace: applications of psychological research, (pp. 201-222). Washington, DC: American Psychological Association.
22. Gefen, D., Straub, D., Boudreau, M.-C., 2000. Structural equation modeling and regression: guidelines for research practice. Communications of the Association for Information Systems, 4 (7), 1-77.
23. Hasan, B., 2008. The impact of multilevel computer self-efficacy on effectiveness of computer training. In Clarke, S. (Ed.), End user computing challenges and technologies: emerging tools and applications, (pp. 33-47). Hershey, PA: Information Science Reference.
24. Hill, T., Smith, N. D., Mann, M. F., 1987. Role of self-efficacy expectations in predicting the decision to use advanced technologies: The case of computers. Journal of Applied Psychology, 72 (2), 307-313.
25. Hix, D., 2002. Usability engineering of virtual environments. In Stanney, K. M. (Ed.), Handbook of virtual environments: design, implementation and applications, (pp. 681-699). Mahwah: Lawrence Erlbaum Associates.
26. Igbaria, M., Iivari, J., 1995. The effects of self-efficacy on computer usage. OMEGA International Journal of Management Science, 23 (6), 587-605.
27. Jawahar, I. M., Elango, B., 2001. The effects of attitudes, goal setting and self-efficacy on end user performance. Journal of End User Computing, 13 (2), 40-45.
28. Jia, D., Bhatti, A., Nahavandi, S., 2009b. Design and evaluation of a haptically enable virtual environment for object assembly training. The haptic audio-visual environments and games (HAVE09), 7-8 November, (pp. 75-80). Piscataway, NJ: IEEE Computer Society.
29. Jia, D., 2009a. User-centred evaluation of a virtual environment training system: utility of user perception measures. In Shumaker, R. (Ed.), Virtual and mixed reality, (pp. 196-205). Verlag Berline Heidelberg: Springer. LNCS 5622.
30. Johnson, R. D., 2005. An empirical investigation of sources of application-specific computer-self-efficacy and mediators of the efficacy-performance relationship. International Journal of Human-Computer Studies, 62, 737-758.
31. Johnson, R. D., Marakas, G. M., 2000. The role of behavioural modeling in computer skills acquisition: toward refinement of the model. Information Systems Research, 11 (4), 402-417.
32. Kelkar, K., 2005. The added usefulness of process measures over performance measures in interface design. International Journal of Human-Computer Interaction, 18, 1-18.
33. Kennedy, R. S., 1993. Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. International Journal of Aviation Psychology, 3 (3), 203-220.
34. Kirkpatrick, D. L., 1959. Techniques for evaluating training programs. Journal of the American Society of Training Directors, 13 (11-12), 3-26.
35. Kirkpatrick, D. L., 1987. Evaluation of training. In Craig, R. L. (Ed.), Training and development handbook: a guide to human resource development, (pp. 301-319). New York: McGraw-Hill.
36. Kostaras, N., Xenos, M., 2011. A study on how usability flaws in GUI design increase mouse movements and consequently may affect users' health. Behaviour & Information Technology, 30 (3), 425-436.
37. Kraiger, K., Ford, J. K., Salas, E., 1993. Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology, 78 (2), 311-328.
38. Lin, J. J.W., 2002. Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. In: The IEEE virtual reality 2002, 24-28 March, Orlando, Florida, USA, (pp. 164-171). New York, NY: IEEE Computer Society.
39. Lin, J.-W.J., 2004. Enhancement of user-experiences in immersive virtual environments that employ wide-field displays,: Thesis (PhD). University of Washington.
40. Lin, J.-W.J., 2007. User experience modeling and enhancement for virtual environment that employ wide-field displays. In Duffy, V. G. (Ed.), Digital human modeling, (pp. 423-433). Berlin/Heidelberg: Springer.
41. Lindgaard, G., 1994. Usability testing and system evaluation, London: Chapman & Hall.
42. Liu, L., Watson, B., Miyazaki, M., 1999. VR for the elderly: quantitative and qualitative differences in performance with a driving simulator. Cyberpsychology & Behavior, 2 (6), 567-576.
43. Liu, R. X., 2003. Principal component regression analysis with SPSS. Compute Methods Programs Biomed, 71 (2), 141-147.
44. Mantovani, F., 2001. VR learning: potential and challenges for the use of 3D environments in education and training., In: R. Giuseppe and G. Carlo., eds. Towards cyber psychology: mind, cognitions and society in the internet age, Amsterdam: IOS Press, 207-226.
45. Marakas, G. M., Yi, M. Y., Johnson, R. D., 1998. The multilevel and multifaceted character of computer self-efficacy: toward clarification of the construct and an integrative framework for research. Information Systems Research, 9 (2), 126-163.
46. Marcolin, B. L., 2000. Assessing user competence: conceptualization and measurement. Information Systems Research, 11 (1), 37-60.
47. Mead, S. E., Fisk, A. D., 1998. Measuring skill acquisition and retention with an ATM simulator: The need for age-specific training. Human Factors, 40, 516-523.
48. Moreno, R., Mayer, R. E., 2007. Interactive multimodal learning environments. Educational Psychology Review, 19, 309-326.
49. Moroney, W. F., 1992. A comparison of two scoring procedures with the NASA TASK LOAD INDEX in a simulated flight task, IEEE national aerospace and electronics conference (NAECON), May 18-22. New York, NY: IEEE Computer Society, 734-740
50. Nash, E. B., 2000. A review of presence and performance in virtual environments. International Journal of Human-Computer Interaction, 12 (1), 1-41.
51. Nichols, S., Haldane, C., Wilson, J. R., 2000. Measurement of presence and its consequences in virtual environments. International Journal of Human-Computer Studies, 52, 471-491.
52. Nielsen, J., 1993. Usability engineering, San Francisco: Morgan Kaufmann Publishers, Inc.
53. North, M., 2001. Virtual reality and transfer of learning. In Michael, J. S., Richard, J. K., Gavriel, S., Don, H. (Ed.), Usability evaluation and interface design: cognitive engineering, intelligent agents and virtual reality, (pp. 634-638). Vol. 1. London: Lawrence Erlbaum Associates. 1
54. Ostroff, C., 1991. Training effectiveness measures and scoring schemes: a comparison. Personal Psychology, 44 (2), 353-374.
55. Paas, F., 2003. Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38 (1), 63-71.
56. Pallant, J., 2000. Development and validation of a scale to measure perceived control of internal states. Journal of Personality Assessment, 75, 308-337.
57. Popovici, D. M., Marhan, A. M., 2008. Virtual reality-based environments for learning and training. In Talaba, D., Amditis, A. (Ed.), Product engineering: tools and methods based on virtual reality, (pp. 123-142). Dordrecht Netherlands: Springer.
58. Preece, J., 1994. Human-computer interaction, Wokingham: Addison-Wesley.
59. Randall, D. Tobias., 1995. An introduction to partial least squares regression, April 2-5. SUGI proceedings, Orlando: Florida, 1-8
60. Ricciardi, S., 2009. Dependability issues in visual-haptic interfaces. Journal of Visual Languages & Computing, 21 (1), 33-40.
61. Riley, J. M., Kaber, D. B., Draper, J. V., 2004. Situation awareness and attention allocation measures for quantifying telepresence experiences in teleoperation. Human Factors and Ergonomics in Manufacturing, 14, 51-67.
62. Ryu, H., Monk, A., 2009. Interaction unit analysis: a new interaction design framework. Human-Computer Interaction, 24 (4), 367-407.
63. Rubio, S., 2004. Evaluation of subjective mental workload: a comparison of SWAT, NASA-TLX, and workload profile methods. Applied Psychology: An International Review, 53 (1), 61-86.
64. Saddik, A. E., Rahaman, A. S.M.M., Hossain, M. A., 2008. Suitability of searching and representing multimedia learning resources in a 3-D virtual gaming environment. IEEE Transactions on Instrumentation and Measurement, 57 (9), 1830-1839.
65. Salzman, M. C., 1999. A model for understanding how virtual reality aids complex conceptual learning. Presence: Teleoperators and Virtual Environments, 8, 293-316. Special issue on education
66. Samur, E., 2007. Generic and systematic evaluation of haptic interfaces based on test beds, Proceedings of the IEEE/RSJ international conference on intelligent robots and systems, October-November 29-2. San Diego, CA, Los Alamitos, CA. 2113-2119
67. Seth, A., Su, H.-J., Vance, J. M., 2008. Development of a dual-handed haptic assembly system: SHARP. Journal of Computing and Information Science in Engineering, 8 (4), 44-502.
68. Seufert, T., Schutze, M., Brunken, R., 2009. Memory characteristics and modality in multimedia learning: an aptitude-treatment-interaction study. Learning and Instruction, 19 (1), 28-42.
69. Slater, M., 1996. Immersion, presence and performance in virtual environments: an experiment using tri-dimensional chess [online],: University College London. Available from: www.cs.ucl.ac.uk/staff/m.slater/Papers/Chess/ index.html [Accessed 22 May 2012]
70. Stanney, K. M., 2002. Handbook of virtual environments: design, implementation, and applications, Mahwah, London: Lawrence Erlbaum Associates.
71. Stanney, K. M., 2003. Usability engineering of virtual environments (VEs): identifying multiple criteria that drive effective VE system design. International Journal of Human-Computer Studies, 58, 447-481.
72. Sue-Chan, C., Ong, M., 2002. Goal assignment and performance: assessing the mediating roles of goal commitment and self-efficacy and the moderating role of power distance. Organizational Behavior and Human Decision Processes, 89, 1140-1161.
73. Sutcliffe, A., 2003. Multimedia and virtual reality: designing multisensory user interfaces, Hillsdale, NJ: Lawrence Erlbaum.
74. Sutcliffe, A., Gault, B., Shin, J. E., 2005. Presence, memory and interaction in virtual environments. International Journal of Human-Computer Studies, 62 (3), 307-327.
75. Sutcliffe, A. G., Kaur, K. D., 2000. Evaluating the usability of virtual reality user interfaces. Behavior and Information Technology, 19 (6), 415-426.
76. Sutter, C., Musseler, J., Bardos, L., 2011. Effects of sensorimotor transformations with graphical input devices. Behaviour & Information Technology, 30 (3), 415-424.
77. Tabachnick, B. G., Fidell, L. S., 2007. Using multivariate statistics, Boston: Pearson Education.
78. Tavakoli, M., Patel, R. V., Moallem, M., 2006. A haptic interface for computer-integrated endoscopic surgery and training. Virtual Reality, 9, 160-176.
79. Tesfazgi, S. H., 2003. Survey on behavioral observation methods in virtual environments,: (Research Assignment), Delft University of Technology.
80. Theng, Y. L., 2007. Mixed reality systems for learning: a pilot study understanding user perceptions and acceptance, The 12th international conference on human-computer interaction, July 22-27. Beijing China, New York: Springer-Verlag, 728-737
81. Thompson, R., 2008. Intentions to use information technologies: an integrative model. In Clarke, S. (Ed.), End user computing challenges and technologies: emerging tools and applications, (pp. 79-101). New York: Information Science Reference.
82. Usoh, M., 2000. Using presence questionnaires in reality. Presence: Teleoperators & Virtual Environments, 9 (5), 497-503.
83. Venkatesh, V., 2000. Determinants of perceived ease of use: integrating control, intrinsic motivation and emotion into the technology acceptance model. Information Systems Research, 114, 342-365.
84. Venkatesh, V., Davis, F. D., 1996. A model of the antecedents of perceived ease of use: development and test. Decision Sciences, 27 (3), 451-481.
85. Vince, J., 1995. Virtual reality systems, New Jersey: Pearson Education.
86. Wang, A. Y., Newlin, M. H., 2002. Predictors of web-student performance: The role of self-efficacy and reasons for taking an on-line class. Computers in Human Behavior, 18, 151-163.
87. Whalen, T., Noel, S., Stewart, J., 2003. Measuring the human side of virtual reality, The VECIMS'03, 2003 IEEE international symposium on virtual environments, human-computer interfaces and measurement systems, July 27-29. Lugano: Switzerland, 8-12
88. Whelan, R. R., 2007. Neuroimaging of cognitive load in instructional multimedia. Educational Research Review, 1 (1), 1-12.
89. Willingham, D. B., 1998. A neuropsychological theory of motor skill learning. Psychological Review, 105 (3), 558-584.
90. Windell, D., 2006. A comparison of two mental workload instruments in multimedia instruction, The human factors and ergonomics society 50th annual meeting, October 16-20. Santa Monica, San Francisco: Human Factors and Ergonomics Society, 1764-1768
91. Winn, W., 2002. Learning in artificial environments: embodiment, embeddedness and dynamic adaptation. Technology, Instruction, Cognition & Learning, 1, 87-114.
92. Witmer, B. G., Singer, M. J., 1998. Measuring presence in virtual environments: a presence questionnaire. Presence, 7 (3), 225-240.
93. Yang, X.-D., Bischof, W. F., Boulanger, P., 2008. Validating the performance of haptic motor skill training, Symposium on haptic interfaces for virtual environments and teleoperator systems, Reno, Nevada, USA, Madrid: Spain, 129-135
94. Yi, M. U., Im, K. S., 2004. Predicting computer task performance: personal goal and self-efficacy. Journal of Organizational and End User Computing, 16 (2), 28-37.
95. Yi, M. Y., Davis, F. D., 2001. Improving computer training effectiveness for decision technologies: behavior modelling and retention enhancement. Decision Sciences, 32 (3), 521-544.
96. Yoo, Y. H., Bruns, W., 2005. Motor skill learning with force-feedback in mixed reality, July 3-8, Proceedings of the 9th international federation of automatic control (IFAC) world congress, analysis, design, evaluation of human-machine systems, Atlanta