Optimizing learning in surgical simulations: Guidelines from the science of learning and human performance

Surgical Clinics of North America

Volumn 90, Issue 3, 2010, Pages 583-603

  Cannon Bowers, Janis A ^a   Bowers, Clint ^a   Procci, Katelyn ^a  

^a UNIVERSITY OF CENTRAL FLORIDA   (United States)

Author keywords

Cognition; Feedback; Optimization; Simulation; Training

Indexed keywords

ACADEMIC ADVISEMENT; ADAPTIVE BEHAVIOR; CLINICAL COMPETENCE; CLINICAL PRACTICE; COMPUTER SYSTEM; EDUCATIONAL MODEL; EXPERIENTIAL LEARNING; GOAL ATTAINMENT; HUMAN; INDIVIDUALIZATION; LEARNING ENVIRONMENT; LEARNING STYLE; MOTIVATION; PERFORMANCE MEASUREMENT SYSTEM; PRACTICE GUIDELINE; PRIORITY JOURNAL; PROCESS DEVELOPMENT; PROCESS MODEL; PROCESS OPTIMIZATION; QUALITY CONTROL; REVIEW; SURGICAL TRAINING; TASK PERFORMANCE; VALIDATION PROCESS;

COMPETENCY-BASED EDUCATION; COMPUTER-ASSISTED INSTRUCTION; GENERAL SURGERY; HUMANS; KNOWLEDGE OF RESULTS (PSYCHOLOGY); MOTIVATION; MOTOR SKILLS; PRACTICE GUIDELINES AS TOPIC; PROBLEM-BASED LEARNING;

EID: 77953083754     PISSN: 00396109     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.suc.2010.02.006     Document Type: Review

References (90)

1. Issenberg S.B., McGaghie W.C., Petrusa E.R., et al. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teacher 2005, 27(1):10-28.
2. Russell J.D. Book review: principles of instructional design, 5th edition. Perform Improv 2007, 44(2):44-46.
3. Reiser R.A., Gagne R.M. Characteristics of media selection models. Rev Educ Res 1982, 52(4):499-512.
4. Hewson M., Little M. Giving feedback in medical education: verification of recommended techniques. J Gen Intern Med 1998, 13(2):111-116.
5. Bangert-Drowns R.L., Kulik C.C., Kulik J.A., et al. The instructional effect of feedback in test-like events. Rev Educ Res 1991, 61(2):213-238.
6. Earley P.C., Northcraft G.B., Lee C., et al. Impact of process and outcome feedback on the relation of goal setting to task performance. Acad Manage J 1990, 33(1):87-105.
7. Balzer W.K., Doherty M.E., O'Connor R. Effects of cognitive feedback on performance. Psychol Bull 1989, 106(3):410-433.
8. Korsgaard M.A., Diddams M. The effect of process feedback and task complexity on personal goals, information searching, and performance improvement. J Appl Soc Psychol 1996, 26(21):1889-1911.
9. Anderson J.R., Corbett A.T., Koedinger K.R., et al. Cognitive tutors: lessons learned. J Learn Sci 1995, 4(2):167-207.
10. Gibson F.P. Feedback delays: how can decision makers learn not to buy a new car every time the garage is empty?. Organ Behav Hum Decis Process 2000, 83(1):141-166.
11. Schmidt R.A., Bjork R.A. New conceptualizations of practice: common principles in three paradigms suggest new concepts for training. Psychol Sci 1992, 3(4):207-217.
12. Kulik J.A., Kulik C.C. Timing of feedback and verbal learning. Rev Educ Res 1988, 58(1):79-97.
13. Schooler L.J., Anderson J.R. The role of process in the rational analysis of memory. Cognit Psychol 1997, 32(3):219-250.
14. Scroth M. The effects of delay of feedback on a delayed concept formation transfer task. Contemp Educ Psychol 1992, 17(1):78-82.
15. Xeroulis G., Park J., Moulton C., et al. Teaching suturing and knot-tying skills to medical students: a randomized controlled study comparing computer-based video instruction and (concurrent and summary) expert feedback. Surgery 2007, 141(4):442-449.
16. Walsh C., Ling S., Wang C., et al. Concurrent versus terminal feedback: it may be better to wait. Acad Med 2009, 84(10):S54-S57.
17. McLaughlin A, Rogers W. Fisk A. Feedback support for training: accounting for learner and task. In: Proceedings of the Human Factors and Ergonomics Society 52nd Annual Meeting, September 22-6, 2008. New York (NY): Human Factors and Ergonomics Society; 2008. p. 2624-8.
18. Schmidt R.A., Young D.E., Swinnen S., et al. Summary knowledge of results for skill acquisition: support for the guidance hypothesis. J Exp Psychol Learn Mem Cogn 1989, 15(2):352-359.
19. Wickens C. Multiple resources and performance prediction. Ergonomics: psychological mechanisms and models in ergonomics 2005, Taylor & Francis, New York, p. 83-105. N. Moray (Ed.).
20. van Merriënboer J., Clark R., de Croock M. Blueprints for complex learning: the 4c/id-model. Educ Tech Res Dev 2002, 50(2):39-64.
21. Lim J, Reiser RA. Effects of part-task and whole-task instructional approaches and levels of learner expertise on learner acquisition and transfer of a complex cognitive skill. International Conference on Learning Sciences. In: Proceedings of the 7th International Conference on Learning Sciences, June 27 to July 1, 2006. Bloomington (IN): International Society of the Learning Sciences; 2006. p. 425-31.
22. Naylor J.C., Briggs G.E. Effect of rehearsal of temporal and spatial aspects on the long-term retention of a procedural skill. J Appl Psychol 1963, 47(2):120-126.
23. Mattoon J. Learner control and part/whole-task practice methods in instructional simulation 1992, Amstriong Air Force Base Technical Report, San Antonio (TX).
24. van Merriënboer J.J., Sweller J. Cognitive load theory and complex learning: recent developments and future directions. Educ Psychol Rev 2005, 17(2):147-177.
25. Paas F.G., Van Merriënboer J.J. Instructional control of cognitive load in the training of complex cognitive tasks. Educ Psychol Rev 1994, 6(4):351-371.
26. Son L.K. Spacing one's study: evidence for a metacognitive control strategy. J Exp Psychol Learn Mem Cogn 2004, 30(3):601-609.
27. Cepeda N.J., Coburn N., Rohrer D., et al. Optimizing distributed practice: theoretical analysis and practical implications. Exp Psychol 2009, 56(4):236-246.
28. Pashler H., Rohrer D., Cepeda N.J., et al. Enhancing learning and retarding forgetting: choices and consequences. Psychon Bull Rev 2007, 14(2):187-193.
29. Cepeda N.J., Pashler H., Vul E., et al. Distributed practice in verbal recall tasks: a review and quantitative synthesis. Psychol Bull 2006, 132(3):354-380.
30. Glenberg A.M., Lehmann T.S. Spacing repetitions over 1 week. Mem Cognit 1980, 8(6):528-538.
31. Bahrick H.P., Bahrick L.E., Bahrick A.S., et al. Maintenance of foreign language vocabulary and the spacing effect. Psychol Sci 1993, 4(5):316-321.
32. Salas E., Rhodenizer L., Bowers C.A. The design and delivery of crew resource management training: exploiting available resources. Hum Factors 2000, 42(3):490-511. Publisher:US: Human Factors & Ergonomics Society.
33. Cannon-Bowers J., Bowers C. Synthetic learning environments: on developing a science of simulation, games, and virtual worlds for training. Learning, training, and development in organizations 2010, 229-261. Routledge, New York (NY). S.W. Kozlowski, E. Salas (Eds.).
34. Cannon-Bowers J.A. Recent advances in scenario-based training for medical education. Curr Opin Anaesthesiol 2008, 21(6):784-789.
35. Oser R.L., Cannon-Bowers J.A., Salas E., et al. Enhancing human performance in technology-rich environments: guidelines for scenario-based training. Human/Technology Interaction in Complex Systems 1999, 9:175-202.
36. Dwyer D.J., Fowlkes J.E., Oser R.L., et al. Team performance measurement in distributed environments: the TARGETs methodology. Team performance assessment and measurement: theory, methods, and applications 1997, 137-153. Lawrence Erlbaum, Mahwah (NJ). M.T. Brannick (Ed.).
37. Fowlkes J., Dwyer D.J., Oser R.L., et al. Event-based approach to training (EBAT). Int J Aviat Psychol 1998, 8(3):209-221.
38. Kozlowski S.W., Gully S.M., Brown K.G., et al. Effects of training goals and goal orientation traits on multidimensional training outcomes and performance adaptability. Organ Behav Hum Decis Process 2001, 85(1):1-31.
39. Mayer R.E., Moreno R. Nine ways to reduce cognitive load in multimedia learning. Educ Psychol 2003, 38(1):43-52.
40. Sweller J. Cognitive load theory, learning difficulty, and instructional design. Learn Instruct 1994, 4(4):295-312.
41. Lee H., Plass J.L., Homer B.D. Optimizing cognitive load for learning from computer-based science simulations. J Educ Psychol 2006, 98(4):902-913.
42. Cannon-Bowers J.A., Rhodenizer L., Salas E., et al. A framework for understanding pre-practice conditions and their impact on learning. Person Psychol 1998, 51(2):291-320.
43. Phye G.D. Schemata training and transfer of an intellectual skill. J Educ Psychol 1989, 81(3):347-352.
44. Ausubel D. Educational psychology: a cognitive view 1968, Holt, Rinehart and Winston, New York.
45. Preiss R.W., Gayle B.M. A meta-analysis of the educational benefits of employing advanced organizers. Classroom communication and instructional processes: advances through meta-analysis 2006, 329-344. Lawerence Erlbaum, Mahwah (NJ). B.M. Gayle, R.W. Preiss, N. Burrell (Eds.).
46. Paivio A., Clark J.M. The role of topic and vehicle imagery in metaphor comprehension. Communication and Cognition 1986, 19(3-4):367-387.
47. Quealy J., Langan-Fox J. Attributes of delivery media in computer-assisted instruction. Ergonomics 1998, 41(3):257-279.
48. Anderson J.R., Schunn C.D. Implications of the ACT-R learning theory: no magic bullets. Advances in instructional psychology: educational design and cognitive science, 5 2000, 1-34. Lawrence Erlbaum, Mahwah (NJ). R. Glaser (Ed.).
49. Sweller J., van Merrienboer J.J., Paas F.G. Cognitive architecture and instructional design. Educ Psychol Rev 1998, 10(3):251-296.
50. Sweller J. Discussion of 'emerging topics in cognitive load research: using learner and information characteristics in the design of powerful learning environments'. Appl Cogn Psychol 2006, 20(3):353-357.
51. Kalyuga S., Chandler P., Tuovinen J., et al. When problem solving is superior to studying worked examples. J Educ Psychol 2001, 93(3):579-588.
52. di Vesta F.J., Peverly S.T. The effects of encoding variability, processing activity, and rule-examples sequence on the transfer of conceptual rules. J Educ Psychol 1984, 76(1):108-119.
53. Clark R.E., Voogel A. Transfer of training principles for instructional design. Educ Comm Tech J 1985, 33(2):113-123.
54. Bransford J.D., Brown A.L., Cocking R.R. How people learn: brain, mind, experience, and school 1999, US: National Academy Press, Washington, DC.
55. Puntambekar S., Hübscher R. Tools for scaffolding students in a complex learning environment: what have we gained and what have we missed?. Educ Psychol 2005, 40(1):1-12.
56. Hannafin M., Land S., Oliver K. Open learning environments: foundation, methods, and models. Instructional-design theories and models: a new paradigm of instructional theory, II 1999, 115-140. Lawrence Erlbaum, Mahwah (NJ). C.M. Reigeluth (Ed.).
57. Singer M.J., Howey A.M. Enhancing virtual environments to support training. The PSI handbook of virtual environments for training and education: developments for the military and beyond, vols. 1-3 2008, 407-421. Praeger, Westport (CT). D. Schmarrow, J. Cohn, D.M. Nicholson (Eds.).
58. Cuevas H.M., Fiore S.M., Oser R.L. Scaffolding cognitive and metacognitive processes in low verbal ability learners: use of diagrams in computer-based training environments. Instructional Science 2002, 30(6):433-464.
59. Azevedo R., Cromley J.G., Winters F.I., et al. Adaptive human scaffolding facilitates adolescents' self-regulated learning with hypermedia. Instructional Science 2005, 33(5-6):381-412.
60. Locke E., Latham G. Building a practically useful theory of goal setting and task motivation: a 35-year odyssey. Am Psychol 2002, 57(9):705-717.
61. Kanfer R., Ackerman P. Dynamics of skill acquisition: building a bridge between intelligence and motivation. Advances in the psychology of human intelligence 1989, vol. 5:83-134. Lawrence Erlbaum Associates, Inc, Mahwah (NJ), [e-book]. R.J. Sternberg (Ed.).
62. Dweck C.S. Motivational processes affecting learning. American Psychologist 1986, 41(10):1040-1048. Special issue: psychological science and education.
63. Middleton M.J., Midgley C. Avoiding the demonstration of lack of ability: an underexplored aspect of goal theory. J Educ Psychol 1997, 89(4):710-718.
64. Rawsthorne L.J., Elliott A.J. Achievement goals and intrinsic motivation: a meta-analytic review. Pers Soc Psychol Rev 1999, 3(4):326-344.
65. Colquitt J.A., Simmering M.J. Conscientiousness, goal orientation, and motivation to learn during the learning process: a longitudinal study. J Appl Psychol 1998, 83(4):654-665.
66. Janssen O., Prins J. Goal orientations and the seeking of different types of feedback information. J Occup Organ Psychol 2007, 80(2):235-249.
67. Teunissen P.W., Stapel D.A., Scheele F., et al. The influence of context on residents' evaluations: effects of priming on clinical judgment and affect. Adv Health Sci Educ Theory Pract 2009, 14(1):23-41.
68. Martocchio J.J. Effects of conceptions of ability on anxiety, self-efficacy, and learning in training. J Appl Psychol 1994, 79(6):819-825.
69. Winters D., Latham G.P. The effect of learning versus outcome goals on a simple versus a complex task. Group Organ Manag 1996, 21(2):236-250.
70. Gist M.E., Stevens C.K. Effects of practice conditions and supplemental training method on cognitive learning and interpersonal skill generalization. Organ Behav Hum Decis Process 1998, 75(2):142-169.
71. Latham G., Locke E. New developments in and directions for goal-setting research. Eur Psychol 2007, 12(4):290-300.
72. Bell B.S., Kozlowski S.W. Active learning: effects of core training design elements on self-regulatory processes, learning, and adaptability. J Appl Psychol 2008, 93(2):296-316.
73. Gott S.P., Lesgold A.M. Competence in the workplace: How cognitive performance models and situated instruction can accelerate skill acquisition. Advances in instructional psychology: educational design and cognitive science, vol. 5 2000, 239-328. Lawrence Erlbaum, Mahwah (NJ). R. Glaser (Ed.).
74. Noe R.A. Trainees' attributes and attitudes: neglected influences on training effectiveness. Acad Manage Rev 1986, 11(4):736-749.
75. Tannenbaum S.I., Yukl G. Training and development in work organizations. Annu Rev Psychol 1992, 43:399-441.
76. Burke L.A., Hutchins H.M. A study of best practices in training transfer and proposed model of transfer. Hum Resource Dev Q 2008, 19(2):107-128.
77. Facteau J.D., Dobbins G.H., Russell J.E., et al. The influence of general perceptions of the training environment on pretraining motivation and perceived training transfer. J Manag 1995, 21(1):1-25.
78. Colquitt J.A., LePine J.A., Noe R.A. Toward an integrative theory of training motivation: a meta-analytic path analysis of 20 years of research. J Appl Psychol 2000, 85(5):678-707.
79. Tharenou P. The relationship of training motivation to participation in training and development. J Occup Organ Psychol 2001, 74(5):599-621.
80. Clark C.S., Dobbins G.H., Ladd R.T. Exploratory field study of training motivation: influence of involvement, credibility, and transfer climate. Group Organ Manag 1993, 18(3):292-307.
81. Baumgartel H.J., Reynolds J.I., Pathan R.Z. How personality and organisational climate variables moderate the effectiveness of management development programmes: a review and some recent research findings. Management and Labour Studies 1984, 9(1):1-16.
82. Lim D.H., Morris M.L. Influence of trainee characteristics, instructional satisfaction, and organizational climate on perceived learning and training transfer. Hum Resource Dev Q 2006, 17(1):85-115.
83. Yedidia M.J., Lipkin M., Schwartz M.D., et al. Doctors as workers: work-hour regulations and interns' perceptions of responsibility, quality of care, and training. J Gen Intern Med 1993, 8(8):429-435.
84. Tannenbaum S.I., Mathieu J.E., Salas E., et al. Meeting trainees' expectations: the influence of training fulfillment on the development of commitment, self-efficacy, and motivation. J Appl Psychol 1991, 76(6):759-769.
85. Hoiberg A., Booth R.F., Berry N.H. Non-cognitive variables related to performance in Navy 'A' schools. Psychol Rep 1977, 41(2):647-655.
86. Cannon-Bowers J.A., Salas E., Tannenbaum S.I., et al. Toward theoretically based principles of training effectiveness: a model and initial empirical investigation. Mil Psychol 1995, 7(3):141-164.
87. Hicks W.D., Klimoski R.J. Entry into training programs and its effects on training outcomes: a field experiment. Acad Manage J 1987, 30(3):542-552.
88. Magjuka R.J., Baldwin T.T. Team-based employee involvement programs: effects of design and administration. Personnel Psychology 1991, 44(4):793-812.
89. Tai W. Effects of training framing, general self-efficacy and training motivation on trainees' training effectiveness. Person Rev 2006, 35(1):51-65.
90. Bandura A. Self-efficacy: the foundation of agency. Control of human behavior, mental processes, and consciousness: essays in honor of the 60th birthday of August Flammer 2000, 17-33. Lawrence Erlbaum, Mahwah (NJ). W.J. Perrig, A. Grobb (Eds.).