The predictive validity of three versions of the mcat in relation to performance in medical school, residency, and licensing examinations: A longitudinal study of 36 classes of jefferson medical college

Academic Medicine

Volumn 85, Issue 6, 2010, Pages 980-987

  Callahan, Clara A ^a   Hojat, Mohammadreza ^a   Veloski, Jon ^a   Erdmann, James B ^a   Gonnella, Joseph S ^a  

^a THOMAS JEFFERSON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77953167566     PISSN: 10402446     EISSN: None     Source Type: Journal    
DOI: 10.1097/ACM.0b013e3181cece3d     Document Type: Article

References (34)

1. McGaghie W. Assessing readiness for medical education: Evolution of the Medical College Admission Test. JAMA. 2002;288:1085-1090.
2. Basco WT Jr, Way DP, Gilbert GE, Hudson A. Undergraduate institutional MCAT scores as predictors of USLME Step 1 Performance. Acad Med. 2002;77(10 suppl):S13-S16.
3. Colliver JA, Verhulst SJ, Williams RG. Using a standardized-patient examination to establish the predictive validity of the MCAT and undergraduate GPA as admissions criteria. Acad Med. 1989;64:482-484.
4. Friedman CP, Bakewell WE. Incremental validity of the new MCAT. J Med Educ. 1980; 55:399-404.
5. Hall FR, Bailey BA. Correlating students' undergraduate science GPAs, their MCAT scores, and the academic caliber of their undergraduate colleges with their first-year academic performances across five classes at Dartmouth Medical School. Acad Med. 1992; 67:121-123.
6. Hojat M, Erdmann JB, Veloski JJ, et al. A validity study of the writing sample section of the Medical College Admission Test. Acad Med. 2000;75(10 suppl):S25-S27.
7. Huff KL, Koenig JA, Treptau MM, Sireci SG. Validity of MCAT scores for predicting clerkship performance of medical students grouped by sex and ethnicity. Acad Med. 1999;74(10 suppl):S41-S44.
8. Jones RF, Thomae-Forgues M. Validity of the MCAT for predicting performance in the first two years of medical school. J Med Educ. 1984;59:455-464.
9. Julian ER. Validity of the Medical College Admission Test for predicting medical school performance. Acad Med. 2005;80:910-917.
10. Koenig JA, Sireci SG, Wiley A. Evaluating the predictive validity of MCAT scores across diverse applicant groups. Acad Med. 1998;73: 1095-1106.
11. Mitchell K, Haynes R, Koenig J. Assessing the validity of the updated Medical College Admission Test. Acad Med. 1994;69:394-401.
12. Nowacek GA, Pullen E, Short J, Blumner HN. Validity of MCAT scores as predictors of preclinical grades and NBME Part I examination scores. J Med Educ. 1987;62: 989-991.
13. Silver B, Hodgson CS. Evaluating GPAs and MCAT scores as predictors of NBME I and clerkship performances based on students' data from one undergraduate institution. Acad Med. 1997;72:394-396.
14. Swanson DB, Case SM, Koenig JA, Killian CD. Preliminary study of the accuracies of the old and new Medical College Admission Test for predicting performance on USLME Step 1. Acad Med. 1996;71(10 suppl):S25-S27.
15. Vancouver JB, Reinhart MA, Solomon DJ, Haf JJ. Testing for validity and bias in the use of GPA and the MCAT in selection of medical school students. Acad Med. 1990;65:694-697.
16. Veloski JJ, Callahan CA, Xu G, Hojat M, Nash DB. Prediction of students' performances on licensing examinations using age, race, sex, undergraduate GPA, and MCAT scores. Acad Med. 2000;75(10 suppl): S28-S30.
17. Wiley A, Koenig JA. The validity of the MCAT for predicting performance in the first two years of medical school. Acad Med. 1996; 71(10 suppl):S83-S85.
18. Shen H, Comrey AL. Predicting medical students' academic performances by their cognitive abilities and personality characteristics. Acad Med. 1997;72:781-786.
19. Donnon T, Paolucci EO, Violato C. The predictive validity of the MCAT for medical school performance and medical board licensing examinations: A meta-analysis of the published research. Acad Med. 2007;82: 100-106.
20. Gilbert GE, Basco WT Jr, Blue AV, O'Sullivan PS. Predictive validity of the Medical College Admission Test writing sample for the United States Medical Licensing Examination. Adv Health Sci Educ Theory Pract. 2002;7:191-200.
21. Gonnella JS, Erdmann JB, Hojat M. An empirical study of the predictive validity of number grades in medical school using three decades of longitudinal study: Implications for a grading system. Med Educ. 2004;38: 425-434.
22. Hojat M, Gonnella JS, Erdmann JB, Veloski JJ. The fate of medical students with different levels of knowledge: Are the basic medical sciences relevant to physician competence? Adv Health Sci Educ Theory Pract. 1997;1: 179-196.
23. Hojat M, Paskin DL, Callahan CA, et al. Components of postgraduate competence: Analysis of 30 years of longitudinal data. Med Educ. 2007;41:982-989.
24. Hojat M, Veloski JJ, Borenstein BD. Components of clinical competence ratings: An empirical approach. Educ Psychol Meas. 1986;46:761-769.
25. Hojat M, Borenstein BD, Veloski JJ. Cognitive and noncognitive factors in predicting the clinical performance of medical school graduates. J Med Educ. 1988; 63:323-325.
26. Hojat M, Veloski JJ, Zeleznik C. Predictive validity of the MCAT for students with two sets of scores. J Med Educ. 1985;60:911-918.
27. Swanson DB, Case SM, Waechter D, et al. A preliminary study of the validity of scores and pass/fail standards for he USMLE Steps 1 and 2. Acad Med. 1993;68(10 suppl):S19-S21.
28. Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum; 1988.
29. Hojat M, Xu G.Avisitor's guide to effect size: Statistical significance versus practical (clinical) importance of research findings. Adv Health Sci Educ Theory Pract. 2004;9:241-249.
30. Gonnella JS, Hojat M, Erdmann JB, Veloski JJ. Assessment Measures in Medical School, Residency, and Practice: The Connections. New York, NY: Springer; 1993.
31. Sackett PR, Borneman MJ, Connelly BS. High-stakes testing in higher education and employment: Appraising the evidence for validity and fairness. Am Psychol. 2008;63: 215-227.
32. Hemphill JF. Interpreting the magnitudes of correlation coefficients. Am Psychol. 2003;58: 78-79.
33. Willoughby L, Calkins V, Arnold L. Different predictors of examination performance for male and female medical students. J Am Med Womens Assoc. 1979;34:316 -317, 320.
34. Harris S. AAMC launches review of MCAT exam. The Reporter. February 2009. Available at: http://www.aamc.org/newsroom/reporter/ feb09/mcat.htm. Accessed December 30, 2009.