Validity and reliability of a novel written examination to assess knowledge and clinical decision making skills of medical students on the surgery clerkship

American Journal of Surgery

Volumn 207, Issue 2, 2014, Pages 236-242

  Reinert, Anna ^a   Berlin, Ana ^a   Swan Sein, Aubrie ^a   Nowygrod, Roman ^a   Fingeret, Abbey ^a  

^a Department of Medicine   (United States)

Author keywords

Assessment; Clinical reasoning; Clinical skills; Medical student; Objective examination; Surgical education

Indexed keywords

ARTICLE; CLINICAL DECISION MAKING; CLINICAL EVALUATION; COMMUNICATION SKILL; CONVERGENT VALIDITY; CORONER; EXAMINATION; HUMAN; KNOWLEDGE; MEDICAL STUDENT; MULTIVARIATE LOGISTIC REGRESSION ANALYSIS; NORMAL HUMAN; PRIORITY JOURNAL; PROFESSIONALISM; PROSPECTIVE STUDY; RELIABILITY; SCORING SYSTEM; SKILL; SURGERY CLERKSHIP CLINICAL SKILL EXAMINATION; SURGICAL TRAINING; VALIDITY;

ASSESSMENT; CLINICAL REASONING; CLINICAL SKILLS; MEDICAL STUDENT; OBJECTIVE EXAMINATION; SURGICAL EDUCATION;

CLINICAL CLERKSHIP; CLINICAL COMPETENCE; DECISION MAKING; EDUCATION, MEDICAL, UNDERGRADUATE; EDUCATIONAL MEASUREMENT; GENERAL SURGERY; HUMANS; PROSPECTIVE STUDIES; REPRODUCIBILITY OF RESULTS; SCHOOLS, MEDICAL; STUDENTS, MEDICAL; UNITED STATES;

EID: 84893636437     PISSN: 00029610     EISSN: 18791883     Source Type: Journal    
DOI: 10.1016/j.amjsurg.2013.08.024     Document Type: Article

References (26)

1. D. Leach The ACGME competencies: substance or form? J Am Coll Surgeons 192 2001 396 398
2. R.M. Epstein Assessment in medical education New Engl J Med 356 2007 387 396
3. C. McGuire Perspectives in assessment J.S. Gonella, M. Hojat, J.B. Erdmann, Assessment Measures in Medical School, Residency, and Practice: The Connections 1993 Springer New York 3 16
4. J.J. Norcini, E.S. Holmboe, and R.E. Hawkins Evaluation challenges in an era of outcomes-based education E.S. Holmboe, R.E. Hawkins, Practical Guide to the Evaluation of Clinical Competence 2008 Mosby Elsevier Philadelphia, PA 1 9
5. C.P.M. Van Der Vleuten The assessment of professional competence: developments, research and practical implications Adv Health Sci Educ 1 1996 41 67
6. G.E. Miller The assessment of clinical skills/competence/performance Acad Med 65 suppl 1990 S63 S67
7. C.P.M. van der Vleuten, and D.L. Newble How can we test clinical reasoning? Lancet 345 1995 1032 1034
8. E.A. Farmer, and G. Page A practical guide to assessing clinical decision-making skills using the key features approach Med Educ 39 2005 1188 1194
9. L.W. Schuwirth, and C.P.M. van der Vleuten Different written assessment methods: what can be said about their strengths and weaknesses? Med Educ 38 2004 974 979
10. G. Pickering Against multiple choice questions Med Teach 1 1979 84 86
11. D.I. Newble, A. Baxter, and R.G. Elmslie A comparison of multiple-choice tests and free-response tests in examinations of clinical competence Med Educ 13 1979 263 268
12. National Board of Medical Examiners 2008 clinical clerkship directors survey results 2008 National Board of Medical Examiners Philadelphia, PA
13. D.S. Lind, A.M. Deladisma, and J.I. Cue et al. Survey of student education in surgery J Am Coll Surg 204 2007 969 974
14. National Board of Medical Examiners Surgery subject examination score interpretation guide 2010 National Board of Medical Examiners Philadelphia, PA
15. R.E. Hawkins, and D.B. Swanson Using written examinations to assess medical knowledge and its application E.S. Holmboe, R.E. Hawkins, Practical Guide to the Evaluation of Clinical Competence 2008 Mosby Elsevier Philadelphia, PA 42 59
16. W.B. Widmann, T. Aranoff, and B.R. Fleischer et al. Why should the first be last? "Seasonal" variations in the National Board of Medical Examiners (NBME) subject examination program for medical students in surgery Curr Surg 60 2003 69 72
17. F.A. Baciewicz Jr., L. Arent, and M. Weaver et al. Influence of clerkship structure and timing on individual student performance Am J Surg 159 1990 265 268
18. D.R. Ripkey, S.M. Case, and D.B. Swanson Predicting performance on the NBME surgery subject test and USMLE Step 2: the effects of surgery clerkship timing and length Acad Med 72 1997 S31 S33
19. National Board of Medical Examiners. 2013-2014 subject examination fees. Available at: http://www.nbme.org/Schools/Subject-Exams/Fees-2013-2014.html. Accessed July 1, 2013.
20. T.M. Haladyna Roles and importance of validity studies in test development S.M. Downing, T.M. Haladyna, Handbook of Test Development 2006 Lawrence Erlbaum Mahwah, NJ 739 753
21. A.H. Niehaus, D.M. DaRosa, and S.J. Markwell et al. Is test security a concern when OSCE stations are repeated across clerkship rotations? Acad Med 71 1996 287 289
22. R.W. Schwartz, M.B. Donnelly, and B. Young et al. Undergraduate surgical education for the twenty-first century Ann Surg 216 1992 639 647
23. A. Elstein Beyond multiple-choice questions and essays. The need for a new way to assess clinical competence Acad Med 68 1993 244 249
24. L.W. Schuwirth, C.P. Van Der Vleuten, and H.H. Donkers A closer look at cueing effects in multiple-choice questions Med Educ 30 1996 44 49
25. S.M. Downing, and T.M. Haladyna Validity threats: overcoming interference with proposed interpretations of assessment data Med Educ 38 2004 327 333
26. J. Crossley, T.M. Haladyna, and B. Jolly Assessing health professionals Med Educ 36 2002 800 804