Towards effective evaluation and reform in medical education: A cognitive and learning sciences perspective

Advances in Health Sciences Education

Volumn 14, Issue 5, 2009, Pages 791-812

  Patel, Vimla L ^a,b   Yoskowitz, Nicole A ^c   Arocha, Jose F ^d  

^a UNIVERSITY OF ARIZONA COLLEGE OF MEDICINE   (United States)

^b Arizona State University   (United States)

^c Och Spine at New York Presbyterian Hospitals   (United States)

^d UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Assessment; Clinical competence; Cognitive science; Evaluation; Learning science; Medical education

Indexed keywords

ARTICLE; CLINICAL COMPETENCE; COGNITION; CURRICULUM; EDUCATION; EDUCATIONAL MODEL; HUMAN; LEARNING; MEDICAL EDUCATION; METHODOLOGY; MOTIVATION; PHYSIOLOGY; TEACHING;

CLINICAL COMPETENCE; COGNITION; CURRICULUM; EDUCATION, MEDICAL; EDUCATIONAL MEASUREMENT; GOALS; HUMANS; LEARNING; MODELS, EDUCATIONAL; TEACHING;

EID: 70449085444     PISSN: 13824996     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10459-007-9091-1     Document Type: Article

References (102)

1. AAMC (2004). Educating doctors to provide high quality medical care: A vision for medical education in the United States. Report of the Ad Hoc Committee of Deans. Washington, DC.
2. AAMC (2005a). Recommendations for clinical skills curricula for undergraduate medical education. Retrieved April 16, 2007, from https://services.aamc.org/Publications/index.cfm?fuseaction=Product.displayForm&prd_id=141&prv_id=165.
3. AAMC (2005b). Cultural competence education for medical students. Retrieved April 12, 2007, from http://www.aamc.org/meded/tacct/start.htm.
4. AAMC (2006). Implementing the vision: Group on educational affairs responds to the IIME Dean's Committee report. Washington, DC.
5. ACGME (1999). ACGME outcome project. General competencies. Retrieved May 3, 2007, from http://www.acgme.org/outcome/comp/compFull.asp.
6. Anderson, J. R. (1983). The architecture of cognition. Cambridge, MA: Harvard University Press.
7. Anderson, J. R. (1993). Rules of the mind. Hillsdale, NJ: Lawrence Erlbaum Associates.
8. Anderson, J. R. (1996). ACT: A simple theory of complex cognition. American Psychologist, 51, 355-365.
9. Anderson, L., & Krathwohl, D. (Eds.) (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives. New York: Longman.
10. Anderson, J., Reder, L., & Simon, H. (1996). Situated learning and education. Educational Researcher, 25(4), 5-11.
11. Anderson, J. R., & Schunn, C. D. (2000). Implications of the ACT-R learning theory: No magic bullets. In R. Glaser (Ed.), Advances in instructional psychology: Educational design and cognitive science (Vol. 5, pp. 1-34). Mahwah, NJ: Lawrence Erlbaum Associates.
12. Baker, E. L. (2007). Moving to the next generation system design: Integrating cognition, assessment, and learning. CSE Report 706. National Center for Research on Evaluation, Standards, and Student Testing, University of California, Los Angeles.
13. Baker, D. P., Gustafson, S., Beaubien, J. M., Salas, E., & Barach, P. (2005). Medical team training programs in health care. In Advances in patient safety: From research to implementation (Vol. 4). Rockville, MD: Agency for Healthcare Research and Quality. http://www.ahrq.gov/qual/advances/.
14. Bereiter, C., & Scardamalia, M. (1996). Rethinking learning. In D. R. Olson & N. Torrance (Eds.), The handbook of education and human development: New models of learning, teaching and schooling (pp. 485-513). Cambridge, MA: Basil Blackwell.
15. Betancourt, J. R. (2003). Cross-cultural medical education: Conceptual approaches and frameworks for evaluation. Academic Medicine, 78, 560-569.
16. Blaskiewicz, R. J., Park, R. S., Chibnall, J. T., & Powell, J. K. (2004). The influence of testing context and clinical rotation order on students' OSCE performance. Academic Medicine, 79, 597-601.
17. Bloom, B. S. (1956). The taxonomy of educational objectives. London: Longman.
18. Bond, W. F., Lammers, R. L., Spillane, L. L., Smith-Coggins, R., Fernandez, R., Reznek, M. A., et al. (2007). The use of simulation in emergency medicine: A research agenda. Academic Emergency Medicine, 14, 353-363.
19. Bransford, J., Brown, A., & Cocking, R. (2000). How people learn: Brain, mind, experience, and school (Expanded ed.). Washington, DC: Commission on Behavioral and Social Sciences and Education/National Academy Press.
20. Bransford, J. D., & Schwartz, D. L. (1999). Rethinking transfer: A simple proposal with multiple implications. Review of Research in Education, 24, 61-100.
21. Chatterji, M. (2005). Evidence on "what works": An argument for extended-term mixed-method (ETMM) evaluation designs. Educational Researcher, 34, 14-24.
22. Clark, R. C., & Mayer, R. E. (2007). E-learning and the science of instruction (2nd ed.). San Francisco: Jossey-Bass.
23. Cooper, H., Carlisle, C., Gibbs, T., & Watkins, C. (2001). Developing an evidence base for interdisciplinary learning: A systematic review. Journal of Advanced Nursing, 35, 228-237.
24. Detterman, D. K., & Sternberg, R. J. (1993). Transfer on trial: Intelligence, cognition, and instruction. Norwood, NJ: Ablex.
25. Devitt, J. H., Kurrek, M. M., Cohen, M. M., Fish, K., Fish, P., Noel, A., et al. (1998). Testing internal consistency and construct validity during evaluation of performance in a patient simulator. Anesthesia & Analgesia, 86, 1160-1164.
26. Doll, R. C. (1996). Curriculum improvement (Rev. ed.). Boston, MA: Allyn and Bacon.
27. Dutta, S., Gaba, D., & Krummel, T. M. (2006). To simulate or not to simulate: What is the question? Annals of Surgery, 243, 301-303.
28. Epstein, R. M. (2007). Assessment in medical education. New England Journal of Medicine, 356(4), 387-396.
29. Ericsson, K. A. (2004). Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Academic Medicine, 79(10 Suppl), S70-S81.
30. Ericsson, K. A., Charness, N., Feltovich, P. J., & Hoffman, R. R. (2006). The Cambridge handbook of expertise and expert performance. New York: Cambridge University Press.
31. Eva, K. W., Cunnington, J. P. W., Reiter, H. I., Keane, D. R., & Norman, G. R. (2004). How can I know what I don't know? Poor self assessment in a well-defined domain. Advances in Health Sciences Education, 9, 211-224.
32. Eva, K. W., Neville, A. J., & Norman, G. R. (1998). Exploring the etiology of content specificity: Factors influencing analogic transfer and problem solving. Academic Medicine, 73(10 Suppl), S1-S5.
33. Feltovich, P. J., Spiro, R. J., & Coulson, R. L. (1993). Learning, teaching, and testing for complex conceptual understanding. In N. Frederiksen, R. J. Mislevy, & I. I. Bejar (Eds.), Test theory for a new generation of tests (pp. 181-217). Hillsdale, NJ: Lawrence Erlbaum Associates.
34. Fried, G. M., Feldman, L. S., Vassiliou, M. C., Fraser, S. A., Stanbridge, D., Ghitulescu, G., et al. (2004). Proving the value of simulation in laparoscopic surgery. Annals of Surgery, 240, 518-528.
35. Friedrich, M. (2002). Risk-free medical training with patient simulators. Journal of the American Medical Association, 288, 2808-2812.
36. Gaba, D. M. (2004). The future vision of simulation in health care. Quality and Safety in Health Care, 13, i2-i10.
37. Gallagher, A. G., & Cates, C. U. (2004). Approval of virtual reality training for carotid stenting: What this means for procedural-based medicine. Journal of the American Medical Association, 292, 3024-3026.
38. Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., et al. (2005). Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: A systematic review. Journal of the American Medical Association, 293, 1223-1238.
39. Gelman, R., & Greeno, J. G. (1989). On the nature of competence: Principles of understanding in a domain. In L. B. Resnick (Ed.), Knowing, learning and instructing: Essays in honor of Robert Glaser (pp. 125-186). Hillsdale, NJ: Lawrence Erlbaum Associates.
40. Gentner, D., Loewenstein, J., & Thompson, L. (2003). Learning and transfer: A general role for analogical encoding. Journal of Educational Psychology, 95, 393-408.
41. Gick, M. L., & Holyoak, K. J. (1983). Schema induction and analogical transfer. Cognitive Psychology, 15, 1-38.
42. Gordon, J. A., Brown, D. F. M., & Armstrong, E. G. (2006). Can a simulated critical care encounter accelerate basic science learning among preclinical medical students? A pilot study. Simulation in Healthcare, 1, 13-17.
43. Gordon, J., Shaffer, D., Raemer, D., Pawlowski, J., Hurford, W., & Cooper, J. (2006). A randomized controlled trial of simulation-based teaching versus traditional instruction in medicine: A pilot study among clinical medical students. Advances in Health Sciences Education, 11, 33-39.
44. Greeno, J. G. (1998). The situativity of knowing, learning, and research. American Psychologist, 53(1), 5-26.
45. Greeno, J. G. (2006). Learning in activity. In R. K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (pp. 79-96). New York: Cambridge University Press.
46. Gregg, J., & Saha, S. (2006). Losing culture on the way to competence: The use and misuse of culture in medical education. Academic Medicine, 81, 542-547.
47. Griffith, C. H., Wilson, J. F., Haist, S. A., & Ramsbottom-Lucier, M. (1997). Relationships of how well attending physicians teach to their students' performances and residency choices. Academic Medicine, 72, S118-S120.
48. Griffith, C. H., Wilson, J. F., Haist, S., & Ramsbottom-Lucier, M. (1998). Do students who work with better housestaff in their medicine clerkships learn more. Academic Medicine, 73, S57-S59.
49. Guest, C., Regehr, G., & Tiberius, R. (2001). The life long challenge of expertise. Medical Education, 35, 78-81.
50. Hamdy, H., Prasad, K., Anderson, M. B., Scherpbier, A., Williams, R., Zwierstra, R., et al. (2006). BEME systematic review: Predictive values of measurements obtained in medical schools and future performance in medical practice. Medical Teacher, 28, 103-116.
51. Hamstra, S. J., Dubrowski, A., & Backstein, D. (2006). Teaching technical skills to surgical residents: A survey of empirical research. Clinical Orthopaedics and Related Research, 449, 108-115.
52. Hawkes, S., & Santhya, K. G. (2002). Diverse realities: Sexually transmitted infections and HIV in India. Sexually Transmitted Infections, 78, 31-39.
53. Hobgood, C., Sawning, S., Bowen, J., & Savage, K. (2006). Teaching culturally appropriate care: A review of educational models and methods. Academic Emergency Medicine, 13, 1288-1295.
54. Holyoak, K. J. (2005). Analogy. In K. J. Holyoak & R. G. Morrison (Eds.), The Cambridge handbook of thinking and reasoning (pp. 117-142). New York: Cambridge University Press.
55. Howley, L. D. (2004). Performance assessment in medical education: Where we've been and where we're going. Evaluation in the Health Professions, 27, 285-303.
56. Issenberg, S., McGaghie, W., & Petrusa, E. (2005). Features and uses of high fidelity medical simulations that lead to effective learning: A BEME systematic review. Medical Teacher, 27, 10-28.
57. Jolly, B. C., Jones, A., Dacre, J. E., Elzubier, M., Kopelman, P., & Hitman, G. (1996). Relationships between students' clinical experiences in introductory clinical courses and their performance on an objective structured clinical examination (OSCE). Academic Medicine, 71, 909-916.
58. Junger, J., Schafer, S., Roth, C., Schellberg, D., Friedman Ben-David, M., & Nikendei, C. (2005). Effects of basic clinical skills training on objective structured clinical examination performance. Medical Education, 39, 1015-1020.
59. Kapur, P., & Steadman, R. (1998). Patient simulator competency testing: Ready for takeoff? Anesthesia and Analgesia, 86, 1157-1158.
60. Kaufman, D. (2003). Applying educational theory in practice. British Medical Journal, 326, 213-216.
61. Krathwohl, D. R. (2002). A revision of bloom's taxonomy: An overview. Theory into practice, 41, 212-218.
62. Lave, J. (1988). Cognition in practice: Mind, mathematics, and culture in everyday life. Cambridge: Cambridge University Press.
63. Lave, J., & Wenger, E. (1991). Situated cognition: Legitimate peripheral participation. Cambridge: Cambridge University Press.
64. Magee, M. (2006). State of the field review: Simulation in education. A final report. Calgary, AB: Alberta Online Learning Consortium.
65. Mayer, R. E., Heiser, J., & Lonn, S. (2001). Cognitive constraints on multimedia learning: When presenting more material results in less understanding. Journal of Educational Psychology, 93, 187-198.
66. Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43-52.
67. McLaughlin, S. A., Bond, W., Promes, S., & Spillane, L. (2006). The status of human simulation training in emergency medicine residency programs. Simulation in Healthcare, 1, 18-21.
68. McLaughlin, S. A., Doezema, D., & Sklar, D. P. (2002). Human simulation in emergency medicine training: A model curriculum. Academic Emergency Medicine, 9, 1310-1318.
69. Metheny, W. P., Espey, E. L., Bienstock, J., Cox, S. M., Erickson, S. S., Goepfert, A. R., et al. (2005). To the point: Medical education reviews evaluation in context: Assessing learners, teachers, and training programs. American Journal of Obstetrics and Gynecology, 192, 34-37.
70. Morgan, P., & Cleave-Hogg, D. (2002). A worldwide survey of the use of simulation in anesthesia. Canadian Journal of Anaesthesia, 49, 659-662.
71. Norcini, J. J., Lipner, R. S., & Kimball, H. R. (2002). Certifying examination performance and patient outcomes following acute myocardial infarction. Medical Education, 36, 853-859.
72. Norcini, J. J., & Mckinley, D. W. (2007). Assessment methods in medical education. Teaching and Teacher Education, 23, 239-250.
73. Norman, G. R. (2005a). Editorial - Inverting the pyramid. Advances in Health Sciences Education, 10, 85-88.
74. Norman, G. R. (2005b). Editorial - Beyond PBL. Advances in Health Sciences Education, 9, 257-260.
75. Norman, G., & Feightner, J. (1981). A comparison of behavior on simulated patients and patient management problems. Medical Education, 15, 26-32.
76. Patel, V. L., Arocha, J. F., Diermeier, M., How, J., & Mottur-Pilson, C. (2001). Cognitive psychological studies of representation and use of clinical practice guidelines. International Journal of Medical Informatics, 63(3), 147-167.
77. Patel, V. L., & Dauphinee, W. D. (1984). Return to basic sciences after clinical experience in undergraduate medical training. Medical Education, 18(4), 244-248.
78. Patel, V. L., Evans, D. A., & Groen, G. J. (1989). Biomedical knowledge and clinical reasoning. In D. A. Evans & V. L. Patel (Eds.), Cognitive science in medicine: Biomedical modeling (pp. 53-112). Cambridge, MA: The MIT Press.
79. Patel, V. L., Glaser, R., & Arocha, J. F. (2000a). Cognition and expertise: Acquisition of medical competence. Clinical and Investigative Medicine, 23(4), 256-260.
80. Patel, V. L., Groen, G. J., & Norman, G. R. (1993). Reasoning and instruction in medical curricula. Cognition and Instruction, 10(4), 335-378.
81. Patel, V. L., Kaufman, D. R., & Arocha, J. F. (2000b). Conceptual change in the biomedical, health sciences domain. In R. Glaser (Ed.), Advances in instructional psychology: Educational design and cognitive science (Vol. 5, pp. 329-392). Mahwah, NJ: Lawrence Erlbaum Associates.
82. Patel, V. L., Kaufman, D. R., & Magder, S. A. (1991). Causal reasoning about complex physiological concepts in cardiovascular physiology by medical students. International Journal of Science Education, 13, 171-185.
83. Pellegrini, C. A. (2006). Surgical education in the United States: Navigating the white waters. Annals of Surgery, 244, 335-342.
84. Posner, G. J., & Rudnitsky, A. D. (1982). Course design (2nd ed.). New York: Longman.
85. Salomon, G., & Perkins, D. N. (1989). Rocky roads to transfer: Rethinking mechanism of a neglected phenomenon. Educational Psychologist, 24, 113-142.
86. Schmidt, H. G., Norman, G. R., & Boshuizen, H. P. A. (1990). A cognitive perspective on medical expertise: Theory and implications. Academic Medicine, 65, 611-621.
87. Seymour, N. E., Gallagher, A. G., Roman, S. A., O'Brien, M. K., Bansal, V. K., Andersen, D. K., et al. (2002). Virtual reality training improves operating room performance: Results of a randomized, double-blinded study. Annals of Surgery, 236, 458-464.
88. Shapiro, M. J., Morey, J. C., Small, S. D., Langford, V., Kaylor, C. J., Jagminas, L., et al. (2004). Simulation based teamwork training for emergency department staff: Does it improve clinical team performance when added to an existing didactic teamwork curriculum? Quality and Safety in Health Care, 13, 417-421.
89. Shumway, J., & Harden, R. (2003). AMEE Guide No. 25: The assessment of learning outcomes for the competent and reflective physician. Medical Teacher, 25, 569-584.
90. Snell, L., Tallett, S., Haist, S., Hays, R., Norcini, J., Prince, K., et al. (2000). A review of the evaluation of clinical teaching: New perspectives and challenges. Medical Education, 34, 862-870.
91. Spiro, R. J., Feltovich, P. J., Jacobson, M., & Coulson, R. L. (1991). Cognitive flexibility, constructivism, and hypertext: Advanced knowledge acquisition in ill-structured domains. Educational Technology, 31(5), 24-33.
92. Steadman, R. H., Coates, W. C., Huang, Y. M., Matevosian, R., Larmon, B. R., McCullough, L., et al. (2006). Simulation-based training is superior to problem-based learning for the acquisition of critical assessment and management skills. Critical Care Medicine, 34, 151-157.
93. Suchman, L. A. (1985). Plans and situated action: The problem of human-machine communication. Cambridge: Cambridge University Press.
94. Sutherland, L. M., Middleton, P. F., Anthony, A., Hamdorf, J., Cregan, P., Scott, D., et al. (2006). Surgical simulation: A systematic review. Annals of Surgery, 243, 291-300.
95. Sweller, J., van Merrienboer, J. J., & Paas, F. G. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10(3), 251-296.
96. Tang, T. S., Fantone, J. C., Bozynski, M. E. A., & Adams, B. S. (2002). Implementation and evaluation of an undergraduate sociocultural medicine program. Academic Medicine, 77, 578-585.
97. Tervalon, M. (2003). Components of culture in health for medical students' education. Academic Medicine, 78, 570-576.
98. van der Vleuten, C. P. M. (1996). The assessment of professional competence: Developments, research and practical implications. Advances in Health Science Education, 1, 41-67.
99. Veloski, J., Boex, J. R., Grasberger, M. J., Evans, A., & Wolfson, D. B. (2006). Systematic review of the literature on assessment, feedback and physicians' clinical performance: BEME Guide No. 7. Medical Teacher, 28, 117-128.
100. Wallin, C., Meurling, L., Hedman, L., Hedegård, J., & Felländer-Tsai, L. (2007). Target-focused medical emergency team training using a human patient simulator: Effects on behaviour and attitude. Medical Education, 41, 173-180.
101. Wang, E. E., & Vozenilek, J. A. (2005). Addressing the systems-based practice core competency: A simulation-based curriculum. Academic Emergency Medicine, 12, 1191-1194.
102. Weinberger, S., & Whitcomb, M. (2003). The clinical education of medical students: Report on millennium conferences I & II. Retrieved April 12, 2007, from http://www.aamc.org/meded/clinicalskills/.