Constructing a More Comprehensive Validity Argument for Medical School Admission Testing: Predicting Long-Term Outcomes

Teaching and Learning in Medicine

Volumn 27, Issue 2, 2015, Pages 197-200

  Kreiter, Clarence D ^a   Otaki, Junji ^b  

^a UNIVERSITY OF IOWA   (United States)

^b HOKKAIDO UNIVERSITY GRADUATE SCHOOL OF MEDICINE   (Japan)

Author keywords

admissions; MCAT; validity

Indexed keywords

CLINICAL COMPETENCE; EDUCATION; FORECASTING; HUMAN; LEARNING; MEDICAL SCHOOL; PREDICTIVE VALUE; UNITED STATES;

CLINICAL COMPETENCE; COLLEGE ADMISSION TEST; FORECASTING; HUMANS; LEARNING; PREDICTIVE VALUE OF TESTS; SCHOOL ADMISSION CRITERIA; SCHOOLS, MEDICAL; UNITED STATES;

EID: 84928521515     PISSN: 10401334     EISSN: None     Source Type: Journal    
DOI: 10.1080/10401334.2015.1025016     Document Type: Article

References (32)

1. Cohen JJ. Our compact with tomorrow's doctors. Academic Medicine 2002;77:475–80.
2. Association of American Medical Colleges. Roadmap to diversity: Integrating Holistic Review Practices into Medical School Admission Processes. Washington, DC: Association of American Medical Colleges, 2010. Available at: http://www.cossa.org/diversity/reports/Integrating_Holistic_Review_Practices.pdf. Accessed February19, 2015.
3. Kreiter CD. A commentary on the use of cut-scores to increase the emphasis on non-cognitive variables in medical education. Advances in Health Sciences Education 2007;12:315–9.
4. Julian ER. Validity of the medical college admission test for predicting medical school performance. Academic Medicine 2005;80:910–7.
5. Basco WT, Gilbert GE, Chessman AW, Blue AV. The ability of a medical school admission process to predict clinical performance and patient's satisfaction. Academic Medicine 2000;75:743–7.
6. Silver B, Hodgson CS. Evaluating GPAs and MCAT scores as predictors of NBME I and clerkship performance based on students’ data from one institution. Academic Medicine 1997;72:394–6.
7. Cunnington JPW, Norman GR. Obstacles in identifying valid performance predictors [Letter]. Academic Medicine 1997;72:931.
8. Kreiter CD, Kreiter Y. A validity generalization perspective on the ability of undergraduate GPA and the Medical College Admission Test to predict important outcomes. Teaching and Learning in Medicine 2007;19:95–100.
9. Norcini JJ, Lipner RS, Kimball HR. Certifying examination performance and patient outcomes following acute myocardial infarction. Medical Education 2002;36:853–9.
10. Ramsey PG, Carline JD, Inui RS, Larson EB, LoGerfo JP, Wenrich MD. Predictive validity of certification by the American Board of Internal Medicine. Annals of Internal Medicine 1989;110:719–26.
11. Tamblyn R, Abrahomowicz M, Brailovsky C, Grand’Maison P, Lescop J, Norcini J, et al. Association between licensing examination scores and resource use and quality of care in primary care practice. Journal of the American Medical Association 1989;280:989–96.
12. Tamblyn R, Abrahomowicz M, Dauphinee WD, Hanley JA, Norcini J, Girard N, et al. Association between licensing examination scores and practice in primary care. Journal of the American Medical Association 2002;288:3019–26.
13. Donnon T, Paolucci EO, Violato C. The predictive validity of the MCAT for medical school performance and medical licensing examinations: A meta-analysis of the published research. Academic Medicine 2007;82:100–6.
14. Ramsey PG, Carline JD, Blank LL, Wenrich MD. Feasibility of hospital-based use of peer ratings to evaluate the performance of practicing physicians. Academic Medicine 1996;71:364–70.
15. Violato C, Lockyer JM, Fidler H. Changes in performance: A 5-year longitudinal study of participants in a multi-source feedback programme. Medical Education 2008;42:1007–13.
16. Dauphine WD. An international review of the recertification and revalidation of physicians: Progress toward achieving best practices. In W. McGaghie (Ed.), International best practices for evaluation in the health professions (pp. 117–32). London: Radcliffe, 2013.
17. Donnon T, Ansari AA, Alawi SA, Violato C. The reliability, validity, and feasibility of multisource feedback physician assessment: A systematic review. Academic Medicine 2014;89:230–6.
18. Brand C. The importance of general intelligence. In S. Modgil & C. Modgil (Eds.), Author Jensen: Consensus and controversy (pp. 251–65). Philadelphia, PA: Falmer, 1987.
19. Gottfredson LS. Why g matters: The complexity of everyday life. Intelligence 1997;24:79–132.
20. Gottfredson LS. Mainstream science on intelligence: An editorial with 52 signatories, history and bibliography. Intelligence 1997;24:13–23.
21. Jensen AR. The g factor: The science of mental ability. Westport, CT: Praeger, 1998.
22. Schmidt FL. Select on intelligence. In E. A. Locke (Ed.), Handbook of principle of organizational behavior (2nd ed., pp. 3–17). Hoboken, NJ: Wiley, 2009.
23. Murphy KR. Validity generalization: A critical review. Mahwah, NJ: Erlbaum, 2003.
24. Schmidt FL, Hunter JE. Employment testing: Old theories and new research finding. American Psychologist 1981;36:1128–37.
25. Schmidt FL, Hunter JE. Development of a general solution to the problem of validity generalization. Journal of Applied Psychology 1977;62:529–40.
26. Schmidt FL. The role of general cognitive ability and job performance: Why there cannot be debate. Human Performance 2002;15:187–210.
27. Schmidt FL, Ones DS, Hunter JE. Personnel selection. Annual Review of Psychology 1992;43:627–70.
28. Kuncel NR, Hezlett SA, Ones DS. Academic performance, career potential, creativity, and job performance: can one construct predict them all? Journal of Personality and Social Psychology 2004;861:148–61.
29. Frey MC, Detterman DK. Scholastic assessment or g? The relationship between the Scholastic Assessment Test and General Cognitive Ability. Psychological Science 2003;15:373–78.
30. Carajal H, Pauls KK. Relationships among graduate record examinations scores, Wechsler Adult Intelligence Scale-Revised IQs and undergraduate grade point average. College Student Journal 1995;29:414–16.
31. Dilchert S, Ones DS, Davis RD, Rostow CD. Cognitive ability predicts objectively measured counterproductive work behavior. Journal of Applied Psychology 2007;92:616–27.
32. Papadakis MA, Teherani A, Banach MA, Knettler TR, Rattner SL, Stern DT, et al. Disciplinary action by medical boards and prior behavior in medical school. New England Journal of Medicine 2005;353:2673–82.