Making the case for mastery learning assessments: Key issues in validation and justification

Academic Medicine

Volumn 90, Issue 11, 2015, Pages 1445-1450

  Lineberry, Matthew ^a   Soo Park, Yoon ^b   Cook, David A ^c   Yudkowsky, Rachel ^a  

^a UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^b UNIVERSITY OF ILLINOIS   (United States)

^c MAYO CLINIC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLINICAL COMPETENCE; CURRICULUM; EDUCATION; EDUCATIONAL MODEL; HUMAN; LEARNING; MEDICAL EDUCATION; PROCEDURES; TRENDS;

CLINICAL COMPETENCE; CURRICULUM; EDUCATION, MEDICAL; EDUCATIONAL MEASUREMENT; HUMANS; LEARNING; MODELS, EDUCATIONAL;

EID: 84945366802     PISSN: 10402446     EISSN: 1938808X     Source Type: Journal    
DOI: 10.1097/ACM.0000000000000860     Document Type: Review

References (34)

1. Bloom BS, Block JH, Airasian PW, Mastery learning. Mastery Learning: Theory and Practice 1971 New York, NY Holt, Rinehart and Winston
2. Guadagnoli M, Morin MP, Dubrowski A, The application of the challenge point framework in medical education. Med Educ 2012 46 447 453
3. Kulik C-LC, Kulik JA, Bangert-Drowns RL, Effectiveness of mastery learning programs: A meta-analysis. Rev Educ Res 1990 60 265 299
4. Cook DA, Brydges R, Zendejas B, Hamstra SJ, Hatala R, Mastery learning for health professionals using technology-enhanced simulation: A systematic review and meta-analysis. Acad Med 2013 88 1178 1186
5. Frank JR, Snell LS, ten Cate O, Competency-based medical education: Theory to practice. Med Teach 2010 32 638 645
6. Kane MT, Validating the interpretations and uses of test scores. J Educ Meas 2013 50 1 73
7. Cizek GJ, Defining and distinguishing validity: Interpretations of score meaning and justifications of test use. Psychol Methods 2012 17 31 43
8. Lineberry M, Kreiter CD, Bordage G, Threats to validity in the use and interpretation of script concordance test scores. Med Educ 2013 47 1175 1183
9. Ricci v, Destefano. 557 U.S (2009) 557
10. Downing SM, Yudkowsky R, Assessment in Health Professions Education 2009 New York, NY Routledge
11. Cook DA, Beckman TJ, Current concepts in validity and reliability for psychometric instruments: Theory and application. Am J Med 2006 119 166.e7 166.16
12. Downing SM, Validity: On meaningful interpretation of assessment data. Med Educ 2003 37 830 837
13. Arthur W, Bennett W, Stanush PL, McNelly TL, Factors that influence skill decay and retention: A quantitative review and analysis. Hum Perf 1998 11 57 101
14. Rohrer D, Pashler H, Recent research on human learning challenges conventional instructional strategies. Educ Res 2010 39 406 412
15. Norman G, Norcini J, Bordage G, Competency-based education: Milestones or millstones? J Grad Med Educ 2014 6 1 6
16. Yudkowsky R, Tumuluru S, Casey P, Herlich N, Ledonne C, A patient safety approach to setting pass/fail standards for basic procedural skills checklists. Simul Healthc 2014 9 277 282
17. Embretson SE, Reise SP, Item Response Theory for Psychologists 2000 Mahwah, NJ L. Erlbaum Associates
18. American Educational Research Association, American Psychological Association, National Council on Measurement in Education Validity. Standards for Educational and Psychological Testing 2014 Washington, DC American Educational Research Association
19. Richland LE, Kornell N, Kao LS, The pretesting effect: Do unsuccessful retrieval attempts enhance learning? J Exp Psychol Appl 2009 15 243 257
20. Crocker L, Algina J, Equating test scores from different tests. Introduction to Classical and Modern Test Theory 1986 Belmont, Calif Wadsworth
21. Stefanidis D, Scerbo MW, Montero PN, Acker CE, Smith WD, Simulator training to automaticity leads to improved skill transfer compared with traditional proficiency-based training: A randomized controlled trial. Ann Surg 2012 255 30 37
22. Williams RG, Klamen DL, Markwell SJ, Cianciolo AT, Colliver JA, Verhulst SJ, Variations in senior medical student diagnostic justification ability. Acad Med 2014 89 790 798
23. Stansfield RB, Kreiter CD, Conditional reliability of admissions interview ratings: Extreme ratings are the most informative. Med Educ 2007 41 32 38
24. Webb NM, Shavelson RJ, Haertel EH, Rao CR, Sinharay S, Reliability coefficients and generalizability theory. Handbook of Statistics. Amsterdam, The Netherlands: Elsevier 2006 26 81 124
25. Livingston SA, Lewis C, Estimating the consistency and accuracy of classifications based on test scores. J Educ Meas 1995 32 179 197
26. Subkoviak MJ, A practitioner's guide to computation and interpretation of reliability indices for mastery tests. J Educ Meas 1988 25 47 55
27. Norcini JJ, Stillman PL, Sutnick A, Scoring and standard-setting with standardized patients. Eval Health Prof 1993 16 322 332
28. Hambleton RK, Slater SC, Reliability of credentialing examinations and the impact of scoring models and standard setting policies. Appl Meas Educ 1997 10 19 38
29. Ziv A, Wolpe PR, Small SD, Glick S, Simulation-based medical education: An ethical imperative. Acad Med 2003 78 783 788
30. Angoff WH, Thorndike RL, Scales, norms, and equivalent scores. Educational Measurement 1971 2nd ed Washington, DC American Council on Education
31. Yudkowsky R, Park YS, Lineberry M, Knox A, Ritter EM, Setting mastery learning standards. Acad Med 2015 90 1495 1500
32. Payne SC, Youngcourt SS, Beaubien JM, A meta-analytic examination of the goal orientation nomological net. J Appl Psychol 2007 92 128 150
33. McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB, Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad Med 2011 86 706 711
34. Barsuk JH, Cohen ER, Potts S, Dissemination of a simulation-based mastery learning intervention reduces central line-associated bloodstream infections. BMJ Qual Saf 2014 23 749 756