The effects of technical difficulties on learning and attrition during online training

Journal of Experimental Psychology: Applied

Volumn 16, Issue 3, 2010, Pages 281-292

  Sitzmann, Traci ^a   Ely, Katherine ^b   Bell, Bradford S ^c   Bauer, Kristina N ^d  

^a UNIVERSITY OF COLORADO   (United States)

^b Fors Marsh Group   (United States)

^c Department of Obstetrics Gynecology   (United States)

^d OLD DOMINION UNIVERSITY   (United States)

Author keywords

Attrition; Interruptions; Motivation; Online training; Technical difficulties

Indexed keywords

ADULT; AGED; ANALYSIS OF VARIANCE; ARTICLE; FEMALE; HEALTH CARE QUALITY; HUMAN; INTERNET; LEARNING; MALE; MIDDLE AGED; MOTIVATION; TEACHING;

ADULT; AGED; ANALYSIS OF VARIANCE; COMPUTER-ASSISTED INSTRUCTION; FEMALE; HUMANS; INTERNET; LEARNING; MALE; MIDDLE AGED; MOTIVATION; PROGRAM EVALUATION; TEACHING;

EID: 77957289116     PISSN: 1076898X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0019968     Document Type: Article

References (94)

1. Baldwin-Evans K. Employees and e-learning: What do the end-users think?. Industrial and Commercial Training 2004, 36:269-274.
2. Barker, B. S. (2002). A comparison research model for adult distributed training. Unpublished doctoral dissertation, University of Nebraska, Lincoln.
3. Baron R.S. Distraction- conflict theory: Progress and problems. Advances in Experimental Social Psychology 1986, 19:1-40.
4. Barrington B.L., Hendricks B. Differentiating characteristics of high school graduates, dropouts, and nongraduates. Journal of Educational Research 1989, 82:309-319.
5. Bean J.P. Dropouts and turnover: The synthesis and test of a causal model of student attrition. Research in Higher Education 1980, 12:155-187.
6. Bell B.S., Kozlowski S.W.J. Active learning: Effects of core training design elements on self-regulatory processes, learning, and adaptability. Journal of Applied Psychology 2008, 93:296-316.
7. Berge Z.L., Huang Y.-P. A model for sustainable student retention: A holistic perspective on the student dropout problem with special attention to e-learning. DEOSNEWS 2004, 13(5). Retrieved from http://www.Ed.psu.edu/acsde/deos/deosnews/deosnews13_5.pdf.
8. Bliese P.D., Ployhart R.E. Growth modeling using random-coefficient models: Model building, testing, and illustrations. Organizational Research Methods 2002, 5:362-387.
9. Boyles, L. W. (2000). Exploration of a retention model for community college student. Unpublished doctoral dissertation, The University of North Carolina at Greensboro.
10. Bryk A.S., Raudenbush S.W. Hierarchical linear models: Applications and data analysis methods 1992, Sage, Newbury Park, CA.
11. Cavanaugh M.A., Milkovich G.T., Tang J. The effective use of multimedia distance learning technology: The role of technology self-efficacy, attitudes, reliability, use and distance in a global multimedia distance learning classroom (Working Paper No. 00-01) 2000, Center for Advanced Human Resource Studies, Ithaca, NY.
12. Cellier J.-M., Eyrolle H. Interference between switched tasks. Ergonomics 1992, 35:25-36.
13. Clarke T., Ayres P., Sweller J. The impact of sequencing and prior knowledge on learning mathematics through spreadsheet applications. Educational Technology Research and Development 2005, 53:15-24.
14. Cohen S. Environmental load and the allocation of attention. Advances in environmental psychology: Vol. 1. The urban environment 1978, 1-29. Erlbaum, Hillsdale, NJ. A. Baum, J.E. Singer, S. Valins (Eds.).
15. Cohen S. After effects of stress on human performance and social behavior: A review of research and theory. Psychological Bulletin 1980, 88:82-108.
16. Collis B. Anticipating the impact of multimedia in education: Lessons from the literature. Computers in Adult Education and Training 1995, 2(2):136-149.
17. Colquitt J.A., LePine J.A., Noe R.A. Toward an integrative theory of training motivation: A meta-analytic path analysis of 20 years of research. Journal of Applied Psychology 2000, 85:678-707.
18. Colquitt J.A., Simmering M.J. Conscientiousness, goal orientation, and motivation to learn during the learning process: A longitudinal study. Journal of Applied Psychology 1998, 83:654-665.
19. Cook T.D., Campbell D.T. Quasi-experimentation: Design and analysis for field settings 1979, Rand McNally, Chicago, IL.
20. Corragio, L. (1990). Deleterious effects of intermittent interruptions on the task performance of knowledge workers: A laboratory investigation. Unpublished doctoral dissertation, University of Arizona, Tucson.
21. DeRouin R.E., Fritzsche B.A., Salas E. Optimizing e-learning: Research-based guidelines for learner-controlled training. Human Resource Management 2004, 43:147-162.
22. Escaler, M. V., Valdez, V. B., & Hofileña, C. (2003). The electronic classroom as a communications medium: Foundations and strategies of online instruction. Paper presented at the Second National Conference Integrating eLearning into Education and Industry, Manila, Philippines.
23. Fordis M., King J.E., Ballantyne C.M., Jones P.H., Schneider K.H., Spann S.J., Greisinger A.J. Comparison of the instructional efficacy of internet-based CME with live interactive CME workshops: A randomized controlled trial. The Journal of the American Medical Association 2005, 294:1043-1051.
24. Frankola K. Why online learners drop out. Workforce 2001, 80:53-58.
25. Frese M., Zapf D. Action as the core of work psychology: A German approach. Handbook of industrial and organizational psychology 1994, 4:271-340. Consulting Psychologists Press, Palo Alto, CA. 2nd ed. M. Dunnette, L. Hough, H.C. Triandis (Eds.).
26. Gillie T., Broadbent D.E. What make interruptions disruptive? A study of length, similarity, and complexity. Psychological Research 1989, 50:243-250.
27. Hacker W. Action control. On the task dependent structure of action-controlling mental representations. Cognitive and motivational aspects of action 1982, 137-149. Deutscher Verlag der Wissenschaften, Berlin, Germany. W. Hacker, W. Volpert, M. Cranach (Eds.).
28. Hedeker D., Gibbons R.D. Application of random effects pattern-mixture models for missing data in longitudinal studies. Psychological Methods 1997, 2:64-78.
29. Homans G. Social behaviour: Its elementary forms 1961, Routledge and Kegan Paul, London, England.
30. Jett Q.R., George J.M. Work interrupted: A closer look at the role of interruptions in organizational life. Academy of Management Review 2003, 28:494-507.
31. Johnson S.D., Aragon S.R., Shaik N., Palma-Rivas N. Comparative analysis of learner satisfaction and learning outcomes in online and face-to-face learning environments. Journal of Interactive Learning Research 2000, 11:29-49.
32. Kanfer R., Ackerman P.L. Motivation and cognitive abilities: An integrative/aptitude-treatment interaction approach to skill acquisition. Journal of Applied Psychology 1989, 74:657-690.
33. Kirmeyer S.L. Coping with competing demands: Interruption and the Type A pattern. Journal of Applied Psychology 1988, 73:621-629.
34. Lan W., Tallent-Runnels M.K., Fryer W., Thomas J., Cooper S., Wang K. An examination of the relationship between technology problems and teaching evaluation of online instruction. Internet and Higher Education 2003, 6:365-375.
35. Langan-Fox J., Armstrong K., Balvin N., Anglim J. Process in skill acquisition: Motivation, interruptions, memory, affective states, and metacognition. Australian Psychologist 2002, 37:104-117.
36. Leibowitz Z.B., Farren C., Kaye B.L. Designing career development systems 1986, Jossey-Bass, San Francisco, CA.
37. Levy Y. Comparing dropouts and persistence in e-learning courses. Computers and Education 2007, 48:185-204.
38. Lewis A. Dear scoop jackson. New York Times 1971, March 15, 37.
39. Marler J.H., Liang X., Dulebohn J.H. Training and effective employee information technology use. Journal of Management 2006, 32:721-743.
40. Mathieu J.E., Tannenbaum S.I., Salas E. Influences of individual and situational characteristics on measures of training effectiveness. Academy of Management Journal 1992, 35:828-847.
41. Miller G.A. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review 1956, 63:81-97.
42. Mischel W. The interaction of person and situation. Personality at the crossroads: Current issues in interactional psychology 1977, 333-352. Erlbaum, Hillsdale, NJ. D. Magnusson, N.S. Endler (Eds.).
43. Mobley W.H., Hand H.H., Baker R.L., Meglino B.M. Conceptual and empirical analysis of military recruit training attrition. Journal of Applied Psychology 1979, 64:10-18.
44. Monk, C. A., Boehm-Davis, D. A., & Trafton, J. G. (2002). The attentional costs of interrupting task performance at various stages. In Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting (pp. 1824-1828). Santa Monica, CA: Human Factors and Ergonomics Society.
45. Monk C.A., Boehm-Davis D.A., Trafton J.G. Recovering from interruptions: Implications for driver distraction research. Human Factors 2004, 46:650-663.
46. Muilenburg L.Y., Berge Z.L. Student barriers to online learning: A factor analytic study. Distance Education 2005, 26:29-48.
47. Munzer E. Managing the e in e-learning 2002, Retrieved from http://www.learningcircuits.org/2002/nov2002/elearn.html.
48. Noe R.A. Trainees' attributes and attitudes: Neglected influences on training effectiveness. Academy of Management Review 1986, 11:736-749.
49. Noe R.A., Schmitt N. The influence of trainee attitudes on training effectiveness: Test of a model. Personnel Psychology 1986, 39:497-523.
50. Noe R.A., Wilk S.L. Investigation of the factors that influence employees' participation in development activities. Journal of Applied Psychology 1993, 78:291-302.
51. North R.F.J., Strain D.M., Abbott L. Training teachers in computer-based management information systems. Journal of Computer Assisted Learning 2000, 16:27-40.
52. Oldham G.R., Kulik C.T., Stepina L.P. Physical environments and employee reactions: Effects of stimulus-screening skills and job complexity. Academy of Management Journal 1991, 34:929-938.
53. O'Neil C.K., Poirier T.I. Online doctor of pharmacy program for pharmacy practitioners: Development and evaluation of six pilot courses. American Journal of Pharmaceutical Education 2000, 64:272-276.
54. Paas F., Renkl A., Sweller J. Cognitive load theory and instructional design: Recent developments. Educational Psychologist 2003, 38:1-4.
55. Paradise A. State of the industry report 2008 2008, American Society for Training & Development, Alexandria, VA.
56. Pintrich P.R., Cross D.R., Kozma R.B., McKeachie W.J. Instructional psychology. Annual Review of Psychology 1986, 37:611-651.
57. Ployhart R.E., Holtz B.C., Bliese P.D. Longitudinal data analysis: Applications of random coefficient modeling to leadership research. Leadership Quarterly 2002, 13:455-486.
58. Randel J.M., Main R.E., Seymour G.E., Morris B.A. Relation of study factors to performance in Navy technical schools. Military Psychology 1992, 4:75-86.
59. Raudenbush S.W., Bryk A.S., Cheong Y.F., Congdon R.T. HLM 6: Hierarchical linear and nonlinear modeling 2004, Scientific Software International, Lincolnwood, IL.
60. Rogelberg S.G., Leach D.J., Warr P.B., Burnfield J.L. " Not another meeting!" Are meeting time demands related to employee well-being?. Journal of Applied Psychology 2006, 91:83-96.
61. Rossett A., Schafer L. What to do about e-dropouts. Training and Development 2003, 57(6):40-46.
62. Rubin D.B. Inference and missing data. Biometrika 1976, 63:581-592.
63. Rumberger R.W. Dropping out of middle school: A multilevel analysis of students and schools. American Educational Research Journal 1995, 32:583-625.
64. Schmidt A.M., Ford J.K. Learning within a learner control training environment: The interactive effects of goal orientation and metacognitive instruction on learning outcomes. Personnel Psychology 2003, 56:405-429.
65. Scott J. Rational choice theory. Understanding contemporary society: Theories of the present 2000, Sage, Newbury Park, CA, Retrieved from http://privatewww.essex.ac.uk/~scottj/socscot7.htm. G. Browning, A. Halcli, F. Webster (Eds.).
66. Sitzmann T., Bell B.S., Kraiger K., Kanar A. A multi-level analysis of the effect of prompting self-regulation in technology-delivered instruction. Personnel Psychology 2009, 62:697-734.
67. Sitzmann T., Ely K. Sometimes you need a reminder: The effects of prompting self-regulation on regulatory processes, learning, and attrition. Journal of Applied Psychology 2010, 95:132-144.
68. Sitzmann T., Ely K., Wisher R. Designing Web-based training courses to maximize learning and student satisfaction. Computer supported collaborative learning: Best practices and principles for instructors 2008, 1-19. Idea Group Inc, Hershey, PA. K.L. Orvis, A.R. Lassiter (Eds.).
69. Sitzmann T., Kraiger K., Stewart D., Wisher R. The comparative effectiveness of Web-based and classroom instruction: A meta-analysis. Personnel Psychology 2006, 59:623-664.
70. Smith E., Ford J.K., Kozlowski S.W.J. Building adaptive expertise: Implications for training design. Training for a rapidly changing workplace: Applications of psychological research 1997, 89-118. American Psychological Association, Washington, DC. M.A. Quinones, A. Ehrenstein (Eds.).
71. Spady W.G. Dropouts from higher education: An interdisciplinary review and synthesis. Interchange 1970, 1:64-85.
72. Speier C., Valacich J.S., Vessey I. The influence of task interruption on individual decision making: An information overload perspective. Decision Sciences 1999, 30:337-360.
73. Speier C., Vessey I., Valacich J.S. The effects of interruptions, task complexity, and information presentation on computer-supported decision-making performance. Decision Sciences 2003, 34:771-797.
74. Sturman M.C., Trevor C.O. The implications of linking the dynamic performance and turnover literatures. Journal of Applied Psychology 2001, 86:684-696.
75. Sweller J. Cognitive load during problem solving: Effects on learning. Cognitive Science 1988, 12:257-285.
76. Sweller J. Instructional design in technical areas 1999, ACER Press, Camberwell, Australia.
77. Sweller J., van Merrienboer J.J.G., Paas F.G.W.C. Cognitive architecture and instructional design. Educational Psychology Review 1998, 10:251-296.
78. Tai L. Corporate e-learning: An inside view of IBM's solutions 2007, Oxford University Press, New York, NY.
79. Tallent-Runnels M.K., Lan W.Y., Fryer W., Thomas J.A., Cooper S., Wang K. The relationship between problems with technology and graduate students' evaluations of online teaching. Internet and Higher Education 2005, 8:167-174.
80. Tannenbaum S.I., Mathieu J.E., Salas E., Cannon-Bowers J.A. Meeting trainees' expectations: The influence of training fulfillment on the development of commitment, self-efficacy, and motivation. Journal of Applied Psychology 1991, 76:759-769.
81. Tinto V. Dropout from higher education: A theoretical synthesis of recent research. Review of Educational Research 1975, 45:89-125.
82. Vancouver J.B., Kendall L.N. When self-efficacy negatively relates to motivation and performance in a learning context. Journal of Applied Psychology 2006, 91:1146-1153.
83. Vroom V.H. Work and motivation 1964, Wiley, New York, NY.
84. Wang G., Foucar-Szocki D., Griffen O., O'Connor C., Sceiford E. Departure, abandonment, and dropout of e-learning: Dilemma and solutions (Final research report to the E-learning Consortium, the Masie Center) 2003, James Madison University, Harrisonburg, VA.
85. Warr P., Downing J. Learning strategies, learning anxiety and knowledge acquisition. British Journal of Psychology 2000, 91:311-333.
86. Webster J., Hackley P. Teaching effectiveness in technology-mediated distance learning. Academy of Management Journal 1997, 40:1282-1309.
87. Welsh E.T., Wanberg C.R., Brown K.G., Simmering M.J. E-learning: Emerging uses, empirical results and future directions. International Journal of Training and Development 2003, 7:245-258.
88. Wentling T.L., Park J., Peiper C. Learning gains associated with annotation and communication software designed for large undergraduate classes. Journal of Computer Assisted Learning 2007, 23:36-46.
89. Wisher R. ADL advocate: Making the vision of learning anytime, anywhere, a reality. Military Training Technology 2006, 11(4):20-23.
90. Yeo G.B., Neal A. A multilevel analysis of effort, practice, and performance: Effects of ability, conscientiousness, and goal orientation. Journal of Applied Psychology 2004, 89:231-247.
91. Yeo G.B., Neal A. Subjective cognitive effort: A model of states, traits, and time. Journal of Applied Psychology 2008, 93:617-631.
92. Zazanis M.M., Zaccaro S.J., Kilcullen R.N. Identifying motivation and interpersonal performance using peer evaluations. Military Psychology 2001, 13:73-88.
93. Zijlstra F.R.H., Roe R.A., Leonora A.B., Krediet I. Temporal factors in mental work: Effects of interrupted activities. Journal of Occupational and Organizational Psychology 1999, 72:163-185.
94. Zohar D. When things go wrong: The effect of daily work hassles on effort, exertion, and negative mood. Journal of Occupational and Organizational Psychology 1999, 72:265-283.