Cognitive and learning sciences in biomedical and health instructional design: A review with lessons for biomedical informatics education

Journal of Biomedical Informatics

Volumn 42, Issue 1, 2009, Pages 176-197

  Patel, Vimla L ^a,b   Yoskowitz, Nicole A ^c   Arocha, Jose F ^d   Shortliffe, Edward H ^a,b  

^a UNIVERSITY OF ARIZONA COLLEGE OF MEDICINE   (United States)

^b Arizona State University   (United States)

^c Columbia University ^*  (United States)

^d UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Biomedical curricula; Cognition; Competency evaluation; Expertise; Health professions; Informatics education; Instructional design; Knowledge organization; Learning sciences; Reasoning; Technology based learning

Indexed keywords

BIOMEDICAL CURRICULA; COGNITION; COMPETENCY EVALUATION; EXPERTISE; HEALTH PROFESSIONS; INFORMATICS EDUCATION; INSTRUCTIONAL DESIGN; KNOWLEDGE ORGANIZATION; LEARNING SCIENCES; REASONING; TECHNOLOGY-BASED LEARNING;

BIOINFORMATICS; CURRICULA; DESIGN; HEALTH; HEALTH CARE; MEDICAL EDUCATION; PROGRAMMING THEORY; TECHNOLOGY;

EDUCATION;

COGNITION; DECISION MAKING; HEALTH CARE PERSONNEL; LEARNING; MEDICAL EDUCATION; MEDICAL INFORMATION; MEDICAL RESEARCH; MEMORY; PRIORITY JOURNAL; PROBLEM SOLVING; REVIEW;

CLINICAL COMPETENCE; COGNITION; COGNITIVE SCIENCE; COMPUTATIONAL BIOLOGY; CURRICULUM; DATA COLLECTION; EDUCATION, MEDICAL; EDUCATION, PROFESSIONAL; HUMANS; LEARNING; MEDICAL INFORMATICS; MODELS, EDUCATIONAL; PROBLEM-BASED LEARNING; TEACHING;

EID: 60049094847     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2008.12.002     Document Type: Review

References (185)

1. Patel V.L., Glaser R., and Arocha J.F. Cognition and expertise: acquisition of medical competence. Clin Invest Med 23 (2000) 256-260
2. Patel V.L., Kaufman D.R., and Magder S.A. The acquisition of medical expertise in complex dynamic environments. In: Ericsson A. (Ed). The road to excellence: the acquisition of expert performance in the arts and sciences, sports, and games (1996), Lawrence Erlbaum Associates, Mahwah, N.J. 369
3. Patel V.L., Cytryn K.N., Shortliffe E.H., and Safran C. The collaborative health care team: the role of individual and group expertise. Teach Learn Med 12 (2000) 117-132
4. Patel V.L., and Kaufman D.R. Medical informatics and the science of cognition. J Am Med Inform Assoc 5 (1998) 493-502
5. Patel V.L., and Kaufman D.R. Science and practice: a case for medical informatics as a local science of design. J Am Med Inform Assoc 5 (1998) 489-492
6. Elstein A.S., Shulman L.S., and Sprafka S. A Medical problem solving: an analysis of clinical reasoning (1978), Harvard University Press, Cambridge, MA
7. Sittig D.F., Wright A., Osheroff J.A., Middleton B., Teich J.M., Ash J.S., et al. Grand challenges in clinical decision support. J Biomed Inform 41 (2008) 387-392
8. Sittig D.F. Grand challenges in medical informatics?. J Am Med Inform Assoc 1 (1994) 412-413
9. Erikson E. Childhood and society (1950), W. W. Norton, New York
10. Piaget J. The psychology of the child (1972), Basic Books, New York
11. Gagne R. The conditions of learning. 4th ed. (1985), Holt, Rinehart & Winston, New York
12. Bandura A. Social foundations of thoughts and actions: a social cognitive theory (1986), Prentice-Hall, Englewood Cliffs, NJ
13. Bransford J., Brown A., and Cocking R. How people learn: brain, mind, experience, and school. Expanded edition ed. (2000), Commission on Behavioral and Social Sciences and Education/National Academy Press, Washington, DC
14. Thorndike E.L. The contribution of psychology to education. J Educ Psychol 1 (1910) 5-12
15. Thorndike E. Educational psychology: the psychology of learning (1913), Teachers College Press, New York
16. Ericsson K.A., Krampe R.T., and Tesch-Römer C. The role of deliberate practice in the acquisition of expert performance. Psychol Rev 100 (1993) 363-406
17. Anderson J.R. Rules of the mind (1993), Lawrence Erlbaum Associates, Hillsdale, NJ
18. Anderson J.R. ACT: a simple theory of complex cognition. Am Psychol 51 (1996) 355-365
19. Sweller J. Cognitive load during problem solving: effects on learning. Cogn Sci 12 (1988) 257-285
20. Sweller J., and Chandler P. Evidence for cognitive load theory. Cogn Instr 8 (1991) 351-362
21. Sweller J. Cognitive load theory, learning difficulty, and instructional design. Learn Instru 4 (1994) 295-312
22. Spiro R.J., Feltovich P.J., Jacobson M., and Coulson R.L. Cognitive flexibility, constructivism, and hypertext: advanced knowledge acquisition in ill-structured domains. Educ Technol 31 (1991) 24-33
23. Spiro RJ, Coulson RL, Feltovich PJ, Anderson DK. Cognitive flexibility theory: advanced knowledge acquisition in ill-structured domains: Ruddell, Robert B (Ed.); Ruddell, Martha Rapp (Ed.); Singer, Harry (Ed.); 1994.
24. Greeno J.G. Learning in activity. In: Sawyer R.K. (Ed). The Cambridge handbook of the learning sciences (2006), Cambridge University Press, New York 79-96
25. Anderson J.R., and Schunn C.D. Implications of the ACT-R learning theory: no magic bullets. In: Glaser R. (Ed). Advances in instructional psychology: educational design and cognitive science (2000), Lawrence Erlbaum Associates, Mahwah, NJ 1-34
26. Anderson J.R., Douglass S., and Qin Y. How should a theory of learning and cognition inform instruction?. In: Healy A. (Ed). Experimental cognitive psychology and it's applications (2004), American Psychological Association, Washington, DC
27. Anderson J.R., Bothell D., Byrne M.D., Douglass S., Lebiere C., and Qin Y. An integrated theory of the mind. Psychol Rev 111 (2004) 1036-1060
28. Koedinger K.R., and Anderson J.R. Illustrating principled design: the early evolution of a cognitive tutor for algebra symbolization. Interact Learn Environ 5 (1998) 161-180
29. Sweller J., van Merrienboer J.J., and Paas F.G. Cognitive architecture and instructional design. Educ Psychol Rev 10 (1998) 251-296
30. Miller G.A. The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychol Rev 63 (1956) 81-97
31. Hasher L., and Zacks R.T. Working memory, comprehension, and aging: a review and a new view. In: Bower G.H. (Ed). The psychology of learning and motivation (1988), Academic Press, New York 193-225
32. Suchman L.A. Plans and situated action: the problem of human-machine communication (1985), Cambridge University Press, Cambridge
33. Lave J. Cognition in practice: mind, mathematics, and culture in everyday life (1988), Cambridge University Press, Cambridge
34. Lave J., and Wenger E. Situated cognition: legitimate peripheral participation (1991), Cambridge University Press, Cambridge
35. Anderson J., Reder L., and Simon H. Situated learning and education. Educ Res 25 (1996) 5-11
36. Greeno J.G. The situativity of knowing, learning, and research. Am Psychol 53 (1998) 5-26
37. Feltovich P.J., Spiro R.J., and Coulson R.L. Learning, teaching, and testing for complex conceptual understanding. In: Frederiksen N., Mislevy R.J., and Bejar I.I. (Eds). Test theory for a new generation of tests (1993), Lawrence Erlbaum Associates, Hillsdale, NJ 181-217
38. Pople H. Heuristic methods for imposing structure on ill-structured problems: the structuring of medical diagnosis. In: Szolovits P. (Ed). Artificial intelligence in medicine (1982), Westview Press, Boulder, CO 119-190
39. Coulson R.L., Feltovich P.J., and Spiro R.J. Cognitive flexibility in medicine: an application to the recognition and understanding of hypertension. Adv Health Sci Educ 2 (1997) 141-161
40. Vygotsky L.S. Mind in society (1978), Harvard University Press, Cambridge
41. Anderson J.R., Greeno J.G., Reder L.M., and Simon H.A. Perspectives on learning, thinking, and activity. Educ Res 29 (2000) 11-13
42. Patel V.L., Kaufman D.R., and Arocha J.F. Steering through the murky waters of a scientific conflict: situated and symbolic models of clinical cognition. Artif Intell Med 7 (1995) 413-438
43. Greeno J.G. A perspective on thinking. Am Psychol 44 (1989) 134-141
44. Rasmussen J., Pejtersen A.M., and Goodstein L.P. Cognitive systems engineering (1994), John Wiley and Sons, New York
45. Winograd T., and Flores F. Understanding computers and cognition: a new foundation for design (1986), Ablex Publishing Corporation, Norwood, NJ
46. Norman D.A. Cognition in the head and in the world: an introduction to the special issue on situated action. Cogn Sci 17 (1993) 1-6
47. Patel V.L., and Kaufman D.R. Cognitive science and biomedical informatics. In: Shortliffe E.H., and Cimino J.J. (Eds). Biomedical informatics: computer applications in health care and biomedicine. 3rd ed. (2006), Springer-Verlag, New York 133-185
48. Perkins D.N. Person-plus: a distributed view of thinking and learning. In: Salomon G. (Ed). Distributed cognition: psychological and educational considerations (1993), Cambridge University Press, Cambridge, MA 88-110
49. Schmidt H.G., Norman G.R., and Boshuizen H.P.A. A cognitive perspective on medical expertise: theory and implications. Acad Med 65 (1990) 611-621
50. Patel V.L., Groen G.J., and Norman G.R. Reasoning and instruction in medical curricula. Cogn Instr 10 (1993) 335-378
51. De Corte E. Learning theory and instructional science. In: Reimann P., and Spada H. (Eds). Learning in human and machines: towards an interdisciplinary learning science (1996), Elsevier Science, Tarrytown, NY 97-108
52. Glaser R. Learning, cognition, and education: then and now. In: Pick Jr. H.L., Broek P.v.d., and Knill D.C. (Eds). Cognition: conceptual and methodological issues (1992), America Psychological Association, Washington, DC
53. Nichols P.D. A framework for developing cognitively diagnostic assessments. Rev Educ Res 64 (1994) 575-603
54. Resnick L.B. Toward a cognitive theory of instruction. In: Paris S., Olson G., and Stevenson H. (Eds). Learning and motivation in the classroom (1983), Lawrence Erlbaum, Hillsdale, NJ
55. Baum K.D., and Axtell S. Trends in North American medical education. Keio J Med 54 (2005) 22-28
56. Gelman R., and Greeno J.G. On the nature of competence: principles of understanding in a domain. In: Resnick L.B. (Ed). Knowing, learning and instructing: essays in honor of Robert Glaser (1989), Lawrence Erlbaum Associates, Hillsdale, NJ 125-186
57. Ericsson K.A. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med 79 (2004) S70-S81
58. Epstein R.M. Assessment in medical education. N Engl J Med 356 (2007) 387-396
59. AAMC. Implementing the vision: group on educational affairs responds to the IIME Dean's Committee report. Washington, DC; 2006.
60. Batalden P., Leach D., Swing S., Dreyfus H., and Dreyfus S. General competencies and accreditation in graduate medical education. Health Aff (2002) 103-111
61. Bloom B.S., Engelhart M.D., Furst E.J., Hill W.H., and Krathwohl D.R. Taxonomy of educational objectives: the classification of educational goals. Handbook 1: cognitive domain (1956), David McKay, New York
62. Anderson L, Krathwohl D. A taxonomy for learning, teaching, and assessing: a revision of Bloom's taxonomy of educational objectives. New York: Longman; 2001.
63. Krathwohl D.R. A revision of bloom's taxonomy: an overview. Theory Pract 41 (2002) 212-218
64. Patel V.L., Arocha J.F., and Kaufman D.R. A primer on aspects of cognition for medical informatics. J Am Med Inform Assoc 8 (2001) 324-343
65. Patel V.L., Kaufman D.R., and Arocha J.F. Emerging paradigms of cognition in medical decision-making. J Biomed Inform 35 (2002) 52-75
66. Patel V.L., Arocha J.F., and Zhang J. Thinking and reasoning in medicine. In: Holyoak K. (Ed). Thinking and reasoning (2005), Cambridge University Press, MA 727-750
67. Patel V.L., and Groen G.J. Cognitive frameworks for clinical reasoning: application for training and practice. In: Evans D.A., and Patel V.L. (Eds). Advanced models of cognition for medical training and practice, NATO ASI series F: computer and systems sciences (1992), Springer-Verlag, Heidelberg, Germany 193-212
68. deGroot A.D. Thought and choice in chess (1965), Mouton, The Hague, The Netherlands
69. Chase W.G., and Simon H.A. Perception in chess. Cogn Psychol 4 (1973) 55-81
70. Simon D.P., and Simon H.A. Individual differences in solving physics problems. In: Siegler R.S. (Ed). Children's thinking: what develops? (1978), Lawrence Erlbaum, Hillsdale, NJ 325-348
71. Chi M.T.H., Feltovich P.J., and Glaser R. Categorization and representation of physics problems by experts and novices. Cogn Sci 5 (1981) 121-152
72. Patel V., and Ramoni M. Cognitive models of directional inference in expert medical reasoning. In: Feltovich P., Ford K.M., and Hoffman R.R. (Eds). Expertise in context: human and machine (1997), MIT Press, Cambridge, MA 67-99
73. Ledley R.S., and Lusted L.B. Reasoning foundations of medical diagnosis. Science 130 (1959) 9-21
74. Rimoldi H.J.A. The test of diagnostic skills. J Med Educ 36 (1961) 73-79
75. Chi M.T.H. Two approaches to the study of experts' characteristics. In: Ericsson K.A., Charness N., Feltovich P., and Hoffman R. (Eds). The Cambridge handbook of expertise and expert performance (2006), Cambridge University Press, New York 21-30
76. Chi M.T.H. Laboratory methods for assessing experts' and novices' knowledge. In: Ericsson K.A., Charness N., Feltovich P., and Hoffman R. (Eds). The Cambridge handbook of expertise and expert performance (2006), Cambridge University Press, New York 167-184
77. Patel V.L., and Groen G.J. The general and specific nature of medical expertise: a critical look. In: Ericsson A., and Smith J. (Eds). Toward a general theory of expertise: prospects and limits (1991), Cambridge University Press, New York 93-125
78. Patel V., Arocha J., and Kaufman D. Diagnostic reasoning and medical expertise. Psychol Learn Motiv: Adv Res Theory 31 (1994) 187-252
79. Newell A., and Simon H. Human problem solving (1972), Prentice-Hall, Englewood Cliffs, NJ
80. Newell A., Shaw J.C., and Simon H.A. Elements of a theory of human problem solving. Psychol Rev 65 (1958) 151-166
81. Gorry G.A. Modeling the diagnostic process. J Med Educ 45 (1970) 293-302
82. Pauker S.G., Gorry G.A., Kassirer J.P., and Schwartz W.B. Towards the simulation of clinical cognition: taking a present illness by computer. Am J Med 60 (1976) 981-996
83. Miller R.A., Pople H.E., and Myers J.D. Internist-1, an experimental computer-based diagnostic consultant for general internal medicine. N Engl J Med 307 (1982) 468-476
84. Shortliffe E.H. Computer-based medical consultations, MYCIN (1976), Elsevier, New York
85. Clancey W., and Letsinger R. NEOMYCIN: reconfiguring a rule-based expert system for application to teaching. In: Clancey W., and Shortliffe E. (Eds). Readings in medical artificial intelligence: the first decade (1984), Addison-Wesley, Reading, MA 361-381
86. Clancey W.J. Acquiring, representing and evaluating a competence model of diagnostic strategy. In: Chi M., Glaser R., and Farr M. (Eds). The nature of expertise (1988), Lawrence Erlbaum, Hillsdale, NJ 343-418
87. Feltovich P.J., Johnson P.E., Moller J.H., and Swanson D.B. LCS: the role and development of medical knowledge in diagnostic expertise. In: Clancey W.J., and Shortliffe E.H. (Eds). Readings in medical artificial intelligence (1984), Addison-Wesley, Reading, MA 275-319
88. Patel V.L., and Groen G.J. Knowledge-based solution strategies in medical reasoning. Cogn Sci 10 (1986) 91-116
89. Gaba D. Dynamic decision-making in anesthesiology: cognitive models and training approaches. In: Evans D.A., and Patel V.L. (Eds). Advanced models of cognition for medical training and practice (1992), Springer-Verlag GmbH, Heidelberg, Germany 123-148
90. Leprohon J., and Patel V.L. Decision-making strategies for telephone triage in emergency medical services. Med Decis Making 15 (1995) 240-253
91. Patel V.L., Arocha J.F., and Kushniruk A.W. Patients' and physicians' understanding of health and biomedical concepts: relationship to the design of EMR systems. J Biomed Inform 35 (2002) 8-16
92. Salas E., and Klein G.A. Linking expertise and naturalistic decision making (2001), Lawrence Erlbaum Associates, Mahwah, NJ
93. Frensch P.A., and Funke J. Complex problem solving: the European perspective (1995), Lawrence Erlbaum, Hillsdale, NJ
94. Vicente K.J., and Rasmussen J. The ecology of human-machine systems. II: Mediating "direct perception" in complex work domains. Ecol Psychol 2 (1990) 207-250
95. Hoffman R.R., and Deffenbacher K.A. A brief history of applied cognitive psychology. Appl Cogn Psychol 6 (1992) 1-48
96. Patel V.L., and Groen G.J. Developmental accounts of the transition from medical student to doctor: some problems and suggestions. Med Educ 25 (1991) 527-535
97. Robertson R.J., and Glines L.A. The phantom plateau returns. Percept Motor Skills 61 (1985) 55-64
98. Ericsson K.A., and Simon H.A. Protocol analysis: verbal reports as data (1993), MIT Press, Cambridge, MA
99. Vicente K.J. Memory recall in a process control system: a measure of expertise and display effectiveness. Mem Cogn 20 (1992) 356-373
100. Morrow D.G., Menard W.E., Stine-Morrow E.A.L., Teller T., and Bryant D. The influence of expertise and task factors on age differences in pilot communication. Psychol Aging 16 (2001) 31-46
101. Arocha J., Patel V., and Patel Y. Hypothesis generation and the coordination of theory and evidence in novice diagnostic reasoning. Med Decis Making 13 (1993) 198-211
102. Patel V.L., Groen G.J., and Arocha J.F. Medical expertise as a function of task difficulty. Mem Cogn 18 (1990) 394-406
103. Olson J.R., and Biolsi K.J. Techniques for representing expert knowledge. In: Ericsson K.A., and Smith J. (Eds). Toward a general theory of expertise: prospects and limits (1991), Cambridge, New York, NY 240-285
104. vanDijk T., and Kintsch W. Strategies of discourse comprehension (1983), Academic Press, New York
105. Frederiksen C.H. Representing logical and semantic structure of knowledge acquired from discourse. Cogn Psychol 7 (1975) 371-458
106. Arocha J.F., Wang D., and Patel V.L. Identifying reasoning strategies in medical decision making: a methodological guide. J Biomed Inform 38 (2005) 154-171
107. Patel V.L., Arocha J.F., and Groen G.J. Medical expertise as a function of task difficulty. Mem Cogn 18 (1990) 394-406
108. Finlay K., Norman G.R., Keane D.R., and Stolberg H. A web-based test of residents' skills in diagnostic radiology. Can Assoc Radiol J 57 (2006) 106-116
109. Leblanc V.R., Brooks L.R., and Norman G.R. Believing is seeing: the influence of a diagnostic hypothesis on the interpretation of clinical features. Acad Med 77 (2002) S67-S69
110. Norman G.R., Coblentz C.L., Brooks L.R., and Babcook C.J. Expertise in visual diagnosis: a review of the literature. Acad Med Rime Suppl 67 (1992) 78-83
111. Lesgold A., Rubinson H., Feltovich P., Glaser R., Klopfer D., and Wang Y. Expertise in a complex skill: diagnosing x-ray pictures. In: Chi M.T.H., Glaser R., and Farr M.J. (Eds). The nature of expertise (1988), Lawrence Erlbaum, Hillsdale, NJ 311-342
112. Brooks L.R., LeBlanc V.R., and Norman G.R. On the difficulty of noticing obvious features in patient appearance. Psychol Sci 11 (2000) 112-117
113. Norman G.R., Rosenthal D., Brooks L.R., Allen S.W., and Muzzin L.J. The development of expertise in dermatology. Arch Dermatol 125 (1989) 1063-1068
114. Boshuizen H.P.A., and Schmidt H.G. On the role of biomedical knowledge in clinical reasoning by experts, intermediates and novices. Cogn Sci 16 (1992) 153-184
115. Woods N.N., Brooks L.R., and Norman G.R. The value of basic science in clinical diagnosis: Creating coherence among signs and symptoms. Med Educ 39 (2005) 107-112
116. Patel V.L., Evans D.A., and Groen G.J. Biomedical knowledge and clinical reasoning. In: Evans D.A., and Patel V.L. (Eds). Cognitive science in medicine: biomedical modeling (1989), The MIT Press, Cambridge, MA 53-112
117. Patel V.L., Kaufman D.R., and Magder S.A. Causal reasoning about complex physiological concepts in cardiovascular physiology by medical students. Int J Sci Educ 13 (1991) 171-185
118. Kaufman D.R., Patel V.L., and Magder S.A. The explanatory role of spontaneous generated analogies in reasoning about physiological concepts. Int J Sci Educ 18 (1996) 369-386
119. Kaufman D.R., and Patel V.L. Progressions of mental models in understanding circulation physiology. In: Singh I., and Parasaruman R. (Eds). Human cognition: a multidisciplinary perspective (1999), Sage, London, UK 300-346
120. Crawford V.M., and Brophy S. Adaptive expertise: methods, findings, and emerging issues (2006), SRI International, Menlo Park, CA
121. Hatano G., and Inagaki K. Two courses of expertise. In: Stevenson H., Azuma H., and Hakuta K. (Eds). Child development and education in Japan (1986), W. H. Freeman and Company, New York 262-272
122. Schwartz D.L., Bransford J.D., and Sears D. Efficiency and Innovation in transfer. In: Mestre J. (Ed). Transfer of learning: research and perspectives (2005), Information Age Publishing, Greenwich, CT
123. Crawford VM, Schlager M, Toyama Y, Riel M, Vahey P. Characterizing adaptive expertise in science teaching: report on a laboratory study of teacher reasoning. In: Annual Conference of the American Educational Research Association. Montreal, Canada; 2005.
124. Walker J.M.T., Cordray D.S., King P.H., and Fries R.C. Novice and expert definitions of biodesign: developmental differences with implications for educators. Int J Eng Educ 21 (2005) 467-479
125. Atman C.J., and Turns J. Studying engineering design learning: four verbal protocol studies. In: Eastman C., McCracken M., and Newstetter W. (Eds). Design knowing and learning: cognition in design education (2001), Elsevier, Georgia Institute of Technology 37-60
126. Barnett S.M., and Koslowski B. Adaptive expertise: effects of type of experience and the level of theoretical understanding it generates. Thinking and Reasoning 8 (2002) 237-267
127. Cooke M., Irby D.M., Sullivan W., and Ludmerer K.M. American medical education 100 years after the Flexner Report. N Engl J Med 355 (2006) 1339-1344
128. AAMC. Educating doctors to provide high quality medical care: a vision for medical education in the United States. Report of the Ad Hoc Committee of Deans. Washington, DC; 2004.
129. Flexner A. Medical education in the United States and Canada: a report to the Carnegie Foundation for the Advancement of Teaching (1910), Carnegie Foundation for the Advancement of Teaching, New York
130. Feinstein A.R. An analysis of diagnostic reasoning. I. The domains and disorders of clinical macrobiology. Yale J Biol Med 46 (1973) 212-232
131. Clough R.W., Shea S.L., and Hamilton W.R. Weaving basic science and social sciences into a case-based, clinically oriented medical curriculum: one school's approach. Acad Med 79 (2004) 1073-1083
132. Patel V.L., Evans D.A., and Groen G.J. On reconciling basic science and clinical reasoning. Teach Learn Med: Int J 1 (1989) 116-121
133. Norman G.R., and Schmidt H.G. Effectiveness of problem-based learning curricula: theory, practice and paper darts. Med Educ 34 (2000) 721-728
134. Albanese M., and Mitchell S. Problem-based learning: a review of literature on its outcomes and implementation issues. Acad Med 68 (1993) 52-81
135. Albanese M. Problem-based learning: why curricula are likely to show little effect on knowledge and clinical skills. Med Educ 34 (2000) 729-738
136. Colliver J. Effectiveness of problem-based learning curricula: research and theory. Acad Med 75 (2000) 259-266
137. Jolly B. Problem-based learning. Med Educ 40 (2006) 494-495
138. Svinicki M.D. Moving beyond "it worked": the ongoing evolution of research on problem-based learning in medical education. Educ Psychol Rev 19 (2007) 49-61
139. Koh G.C., Khoo H.E., Wong M.L., and Koh D. The effects of problem-based learning during medical school on physician competency: a systematic review. CMAJ 178 (2008) 34-41
140. Capon N., and Kuhn D. What's so good about problem-based learning?. Cogn Instr 22 (2004) 61-79
141. Norman G. Beyond PBL. Adv Health Sci Educ 9 (2004) 257-260
142. Patel VL, Kaufman DR. Medical education isn't just about solving problems. In: The chronicle of higher education; 2007. p. B12.
143. Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century. Washington, DC: National Academy Press; 2001.
144. Kohn L.T., Corrigan J.M., and Donaldson M.S. Institute of Medicine (U.S.). Committee on Quality of Health Care in America. To err is human: building a safer health system (2000), National Academy Press, Washington, DC
145. Aspden P. Institute of Medicine (U.S.). Committee on Data Standards for Patient Safety. In: Corrigan J.M., Wolcott J., and Erickson S.M. (Eds). Patient safety: achieving a new standard for care (2004), National Academies Press, Washington, DC
146. Santos-Gomez L., Kalishman S., Rezler A., Skipper B., and Mennin S.P. Residency performance of graduates from a problem-based and a conventional curriculum. Med Educ 24 (1990) 366-375
147. Shin J., Haynes R., and Johnston M. Effect of problem-based, self-directed undergraduate education on life-long learning. CMAJ 148 (1993) 969-976
148. Tolnai S. Continuing medical education and career choice among graduates of problem-based and traditional curricula. Med Educ 25 (1991) 414-420
149. Patel V.L., Groen G.J., and Scott H.S. Biomedical knowledge in explanations of clinical problems by medical students. Med Educ 22 (1988) 398-406
150. Patel V.L., Evans D.A., and Kaufman D.R. Reasoning strategies and the use of biomedical knowledge by medical students. Med Educ 24 (1990) 129-136
151. Patel V.L., Arocha J.F., and Leccisi M.S. Impact of undergraduate medical training on housestaff problem-solving performance: implications for problem-based curricula. J Dent Educ 65 (2001) 1199-1218
152. Patel V., Groen G., and Norman G. Reasoning and instruction in medical curricula. Cogn Instr 10 (1993) 335-378
153. Chandler P., and Sweller J. Cognitive Load Theory and the format of instruction. Cogn Instr 8 (1991) 293-332
154. Norman G., and Schmidt H. The psychological basis of problem-based learning: a review of the evidence. Acad Med 67 (1992) 557-565
155. Kaufman DR, Yoskowitz NA, Patel VL. Clinical reasoning and biomedical knowledge: implications for teaching. In: Higgs J, Jones M, Loftus S, Christensen N, editors. Clinical reasoning in the health professions. 3rd ed. New York: Butterworth-Heinemann-Elsevier, 2008. p. 137-49.
156. Mayer R.E. Multimedia learning (2001), Cambridge University Press, New York
157. Clark R.C., and Mayer R.E. E-learning and the science of instruction (2003), Jossey-Bass/Pfeiffer, San Francisco, CA
158. Mayer R.E. The Cambridge handbook of multimedia learning (2005), Cambridge University Press, New York
159. O'Neil Jr. H.F., and Perez R.S. Technology applications in education: a learning view (2003), Lawrence Erlbaum Associates, Mahwah, NJ
160. O'Neil H.F., and Perez R.S. Web-based learning: theory, research, and practice (2006), Lawrence Erlbaum Associates, Mahwah, NJ
161. Jonassen DH. Handbook of research on educational communications and technology. Mahwah, NJ: Lawrence Erlbaum Associates; 2004.
162. Mayer R.E., and Moreno R. Nine ways to reduce cognitive load in multimedia learning. Educ Psychol 38 (2003) 43-52
163. Eisemon T.O., Patel V.L., and Ole-Sena S. Uses of formal and informal knowledge in the comprehension of instructions for oral rehydration therapy in Kenya. Soc Sci Med 25 (1987) 1225-1234
164. Mayer R.E. Cognitive theory and the design of multimedia instruction: an example of the two-way street between cognition and instruction. New Direct Teach Learn 89 (2002) 55-71
165. Ruiz J.G., Mintzer M.J., and Leipzig R.M. The impact of E-learning in medical education. Acad Med 81 (2006) 207-212
166. Sherry A.C., Fulford C.P., and Zhang S. Assessing distance learners' satisfaction with instruction: a quantitative and a qualitative measure. Am J Dist Educ 12 (1998) 5-28
167. E-learning-a review of literature. Available at http://learning.ncsa.uiuc.edu/papers/elearnlit.pdf.
168. Kirkley S.E., and Kirkley J.R. Creating next generation blended learning environments using mixed reality, video games and simulations. TechTrends 49 (2005) 42-89
169. Bajura M., Fuchs H., and Ohbuchi R. Merging virtual objects with the real world: seeing ultrasound imagery within the patient. Comput Graph 26 (1992) 203-210
170. Kahol K, Smith M. Surgeons on Wii. In: Paper presented at the Medicine Meets Virtual Reality Conference. Long Beach, CA; 2008.
171. Dev P., Youngblood P., Heinrichs W.L., and Kusumoto L. Virtual worlds and team training. Anesthesiol Clin 25 (2007) 321-336
172. Kahol K, Smith M. Neuro-cognitively designed dynamic simulations for laparoscopic surgical skills. In: Paper presented at MODSIM. Virginia Beach; 2007.
173. Fletcher J.D. Effectiveness and cost of interactive videodisc instruction in defense training and education (IDA Paper P-2372) (1990), Institute for Defense Analyses, Alexandria, VA
174. Fletcher JD. Evidence for learning from technology-assisted instruction. In: O'Neil Jr HF, Perez R, editors. Technology applications in education: a learning view. Mahwah, NJ: Lawrence Erlbaum Associates; 2003, p. 79-99.
175. Kulik J. Meta-analytic studies of findings on computer-based instruction. In: Baker E.L., and H.F. O'Neil J. (Eds). Technology assessment in education and training (1994), Lawrence Erlbaum Associates, Hillsdale, NJ 9-33
176. Sitzmann T., Kraiger K., Stewart D., and Wisher R. The comparative effectiveness of web-based and classroom instruction: a meta-analysis. Pers Psychol 59 (2006) 623-664
177. Schilling K., Wiecha J., Polineni D., and Khalil S. An interactive web-based curriculum on evidence-based medicine: design and effectiveness. Fam Med 38 (2006) 126-132
178. Clark R.E. Media will never influence learning. Educ Technol Res Develop 42 (1994) 21-29
179. Kirschner P.A., Sweller J., and Clark R.E. Why minimal guidance during instruction does not work: an analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educ Psychol 41 (2006) 75-86
180. Clark R.E. Reconsidering research on learning from media. Rev Educ Res 53 (1983) 445-459
181. Clark R.E. Media and method. Educ Technol Res Develop 42 (1994) 7-10
182. McNulty J., Espiritu B., and Halsey M. Medical student use of computers is correlated with personality. JAIMSE 12 (2002) 9-13
183. McNulty J.A., Espiritu B., Halsey M., and Mendez M. Personality preference influences medical student use of specific computer-aided instruction (CAI). BMC Med Educ (2006) 6
184. Klein H.J., Noe R.A., and Wang C. Motivation to learn and course outcomes: the impact of delivery mode, learning goal orientation, and perceived barriers and enablers. Pers Psychol 59 (2006) 665-702
185. Patel V.L., Kushniuruk A.W., Yang S., and Yale J.F. Impact of a computerized patient record system on medical data collection, organization and reasoning. J Am Med Inform Assoc 7 (2000) 569-585