Internal structure of mini-CEX scores for internal medicine residents: Factor analysis and generalizability

Advances in Health Sciences Education

Volumn 15, Issue 5, 2010, Pages 633-645

  Cook, David A ^a   Beckman, Thomas J ^a   Mandrekar, Jayawant N ^a   Pankratz, V Shane ^a  

^a Mayo Clinic College of Medicine   (United States)

Author keywords

Assessment; Clinical competence; Educational measurement; Factor analysis; Internal consistency; Medical education; Psychometrics; Reproducibility of results

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; CLINICAL COMPETENCE; CONFIDENCE INTERVAL; EDUCATION; EDUCATIONAL STATUS; FACTORIAL ANALYSIS; HUMAN; INTERNAL MEDICINE; MEDICAL EDUCATION; METHODOLOGY; PSYCHOMETRY; REPRODUCIBILITY; RETROSPECTIVE STUDY; STATISTICS; UNITED STATES; VALIDATION STUDY;

ANALYSIS OF VARIANCE; CLINICAL COMPETENCE; CONFIDENCE INTERVALS; EDUCATIONAL MEASUREMENT; EDUCATIONAL STATUS; FACTOR ANALYSIS, STATISTICAL; HUMANS; INTERNAL MEDICINE; INTERNSHIP AND RESIDENCY; PRECEPTORSHIP; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; RETROSPECTIVE STUDIES; STATISTICS AS TOPIC; UNITED STATES;

EID: 78649908982     PISSN: 13824996     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10459-010-9224-9     Document Type: Article

References (34)

1. Brennan, R. L. (2001). Generalizability theory. New York: Springer.
2. Cook, D. A., & Beckman, T. J. (2009). Does scale length matter? A comparison of nine-versus five-point rating scales for the mini-CEX. Advances in Health Sciences Education: Theory and Practice, 14, 655-664.
3. Cook, D. A., Dupras, D. M., Beckman, T. J., Thomas, K. G., & Pankratz, V. S. (2009). Effect of rater training on reliability and accuracy of mini-CEX scores: A randomized, controlled trial. Journal of General Internal Medicine, 24, 74-79.
4. Donato, A. A., Pangaro, L., Smith, C., Rencic, J., Diaz, Y., Mensinger, J., et al. (2008). Evaluation of a novel assessment form for observing medical residents: A randomised, controlled trial. Medical Education, 42, 1234-1242.
5. Durning, S. J., Cation, L. J., Markert, R. J., & Pangaro, L. N. (2002). Assessing the reliability and validity of the mini-clinical evaluation exercise for internal medicine residency training. Academic Medicine, 77, 900-904.
6. Fernando, N., Cleland, J., McKenzie, H., & Cassar, K. (2008). Identifying the factors that determine feedback given to undergraduate medical students following formative mini-CEX assessments. Medical Education, 42, 89-95.
7. Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7, 286-299.
8. Gorsuch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
9. Greenburg, D. L., Durning, S. J., Cohen, D. L., Cruess, D., & Jackson, J. L. (2007). Identifying medical students likely to exhibit poor professionalism and knowledge during internship. Journal of General Internal Medicine, 22, 1711-1717.
10. Haber, R. J., & Avins, A. L. (1994). Do ratings on the American Board of internal medicine resident evaluation form detect differences in clinical competence? Journal of General Internal Medicine, 9, 140-145.
11. Harvill, L. M. (1991). NCME instructional module: Standard error of measurement. Educational Measurement: Issues and Practice, 10(2), 33-41.
12. Hatala, R., Ainslie, M., Kassen, B. O., Mackie, I., & Roberts, J. M. (2006). Assessing the mini-clinical evaluation exercise in comparison to a national specialty examination. Medical Education, 40, 950-956.
13. Herbers, J. E., Jr., Noel, G. L., Cooper, G. S., Harvey, J., Pangaro, L. N., & Weaver, M. J. (1989). How accurate are faculty evaluations of clinical competence? Journal of General Internal Medicine, 4, 202-208.
14. Hill, F., Kendall, K., Galbraith, K., & Crossley, J. (2009). Implementing the undergraduate mini-CEX: A tailored approach at Southampton University. Medical Education, 43, 326-334.
15. Hojat, M., Paskin, D. L., Callahan, C. A., Nasca, T. J., Louis, D. Z., Veloski, J., et al. (2007). Components of postgraduate competence: analyses of thirty years of longitudinal data. Medical Education, 41, 982-989.
16. Holmboe, E., Fiebach, N., Galaty, L., & Huot, S. (2001). Effectiveness of a focused educational intervention on resident evaluations from faculty. Journal of General Internal Medicine, 16, 427-434.
17. Holmboe, E. S., Huot, S., Chung, J., Norcini, J., & Hawkins, R. E. (2003). Construct validity of the miniclinical evaluation exercise (miniCEX). Academic Medicine, 78, 826-830.
18. Kogan, J. R., Bellini, L. M., & Shea, J. A. (2003). Feasibility, reliability, and validity of the mini-clinical evaluation exercise (mCEX) in a medicine core clerkship. Academic Medicine, 78(10 Suppl), S33-S35.
19. Kogan, J. R., Holmboe, E. S., & Hauer, K. E. (2009). Tools for direct observation and assessment of clinical skills of medical trainees: A systematic review. JAMA, 302, 1316-1326.
20. Kroboth, F. J., Hanusa, B. H., & Parker, S. C. (1996). Didactic value of the clinical evaluation exercise. Missed opportunities. Journal of General Internal Medicine, 11, 551-553.
21. Margolis, M. J., Clauser, B. E., Cuddy, M. M., Ciccone, A., Mee, J., Harik, P., et al. (2006). Use of the mini-clinical evaluation exercise to rate examinee performance on a multiple-station clinical skills examination: A validity study. Academic Medicine, 81(10 Suppl), S56-S60.
22. Nasca, T. J., Gonnella, J. S., Hojat, M., Veloski, J., Erdmann, J. B., Robeson, M., et al. (2002). Conceptualization and measurement of clinical competence of residents: A brief rating form and its psychometric properties. Medical Teacher, 24, 299-303.
23. Ney, E. M., Shea, J. A., & Kogan, J. R. (2009). Predictive validity of the mini-clinical evaluation exercise (mCEX): Do medical students' mCEX ratings correlate with future clinical exam performance? Academic Medicine, 84(10 suppl), S21-S24.
24. Norcini, J. J., Blank, L. L., Arnold, G. K., & Kimball, H. R. (1995). The mini-CEX (clinical evaluation exercise): A preliminary investigation. Annals of Internal Medicine, 123, 795-799.
25. Norcini, J. J., Blank, L. L., Duffy, F. D., & Fortna, G. S. (2003). The mini-CEX: A method for assessing clinical skills. Annals of Internal Medicine, 138, 476-481.
26. O'Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instrumentation, & Computers, 32, 396-402.
27. Shavelson, R. L., & Webb, N. M. (1991). Generalizability theory: A primer. Newbury Park: Sage Publications.
28. Sidhu, R. S., Hatala, R., Barron, S., Broudo, M., Pachev, G., & Page, G. (2009). Reliability and acceptance of the mini-clinical evaluation exercise as a performance assessment of practicing physicians. Academic Medicine, 84(10 suppl), S113-S115.
29. Silber, C. G., Nasca, T. J., Paskin, D. L., Eiger, G., Robeson, M., & Veloski, J. J. (2004). Do global rating forms enable program directors to assess the ACGME competencies? Academic Medicine, 79, 549-556.
30. Srinivasan, M., Hauer, K. E., Der-Martirosian, C., Wilkes, M., & Gesundheit, N. (2007). Does feedback matter? Practice-based learning for medical students after a multi-institutional clinical performance examination. Medical Education, 41, 857-865.
31. Thomas, P. A., Gebo, K. A., & Hellmann, D. B. (1999). A pilot study of peer review in residency training. Journal of General Internal Medicine, 14, 551-554.
32. Volkan, K., Simon, S. R., Baker, H., & Todres, I. D. (2004). Psychometric structure of a comprehensive objective structured clinical examination: A factor analytic approach. Advances in Health Sciences Education: Theory and Practice, 9, 83-92.
33. Weller, J. M., Jolly, B., Misur, M. P., Merry, A. F., Jones, A., Crossley, J. G. M., et al. (2009). Mini-clinical evaluation exercise in anaesthesia training. British Journal of Anaesthesia, 102, 633-641.
34. Wilkinson, T. J., & Frampton, C. M. (2003). Assessing performance in final year medical students. Can a postgraduate measure be used in an undergraduate setting? Medical Education, 37, 233-240.